2023-11-24T05:57:36.630 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T05:57:36.631 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551 --name rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} --verbose -- /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/orig.config.yaml 2023-11-24T05:57:36.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T05:57:36.848 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: null first_in_suite: false job_id: '7465551' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mgr-vol-misc sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3305 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: rishabh-mgr-vol-misc suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5qF7p74YaACFye6SUxwuT6WvUyn9torgEIVYQMzkIKIAJUTWTSVfwaDzWjwxnyAKl9aBcgz4B3OilkZeHPWNU= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJweiEB58igV9ycutzsmY/QeiFksdxoOFacgsEqE6Rv1U8yi5jIsbOJE8kzhcIsnnqsblklgn6xyUB98S9h/MMw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes - tasks.cephfs.test_subvolume.TestSubvolume teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_05:41:33 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T05:57:36.848 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa; will attempt to use it 2023-11-24T05:57:36.849 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks 2023-11-24T05:57:36.849 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T05:57:36.854 INFO:teuthology.task.internal:Checking packages... 2023-11-24T05:57:36.908 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T05:57:36.908 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T05:57:36.908 INFO:teuthology.packaging:ref: None 2023-11-24T05:57:36.909 INFO:teuthology.packaging:tag: None 2023-11-24T05:57:36.909 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T05:57:36.909 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T05:57:36.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T05:57:37.137 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.ga13ea5ff 2023-11-24T05:57:37.138 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T05:57:37.148 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T05:57:37.148 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T05:57:37.162 INFO:teuthology.task.internal:Saving configuration 2023-11-24T05:57:37.189 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T05:57:37.200 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T05:57:37.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:51:47.664274', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5qF7p74YaACFye6SUxwuT6WvUyn9torgEIVYQMzkIKIAJUTWTSVfwaDzWjwxnyAKl9aBcgz4B3OilkZeHPWNU='} 2023-11-24T05:57:37.267 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:51:47.662304', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJweiEB58igV9ycutzsmY/QeiFksdxoOFacgsEqE6Rv1U8yi5jIsbOJE8kzhcIsnnqsblklgn6xyUB98S9h/MMw='} 2023-11-24T05:57:37.273 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T05:57:37.281 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T05:57:37.282 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T05:57:37.282 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T05:57:37.394 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f335c1ddb80>, signals=[15]) 2023-11-24T05:57:37.395 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T05:57:37.405 INFO:teuthology.task.internal:Opening connections... 2023-11-24T05:57:37.406 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T05:57:37.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:57:37.507 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T05:57:37.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:57:37.634 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T05:57:37.642 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-11-24T05:57:37.661 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-11-24T05:57:37.661 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T05:57:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-11-24T05:57:37.721 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2023-11-24T05:57:37.721 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T05:57:37.721 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-11-24T05:57:37.721 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T05:57:37.721 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T05:57:37.721 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T05:57:37.721 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-11-24T05:57:37.744 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-11-24T05:57:37.762 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-11-24T05:57:37.763 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-11-24T05:57:37.820 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-11-24T05:57:37.820 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-11-24T05:57:37.820 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-11-24T05:57:37.821 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-11-24T05:57:37.821 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T05:57:37.825 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T05:57:37.826 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-11-24T05:57:37.864 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T05:57:37.877 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T05:57:37.905 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T05:57:37.905 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-11-24T05:57:37.915 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2023-11-24T05:57:37.936 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T05:57:37.948 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T05:57:37.949 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-11-24T05:57:37.968 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2023-11-24T05:57:38.068 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T05:57:38.134 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T05:57:38.161 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T05:57:38.162 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-24T05:57:38.162 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-24T05:57:38.162 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T05:57:38.162 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T05:57:38.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T05:57:38.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-24T05:57:38.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T05:57:38.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-11-24T05:57:38.333 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:57:38.333 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T05:57:38.333 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2023-11-24T05:57:38.353 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-361.el9.x86_64 2023-11-24T05:57:38.353 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:57:38.354 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T05:57:38.354 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum upgrade -y linux-firmware 2023-11-24T05:57:38.419 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:57:38.420 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T05:57:38.420 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-11-24T05:57:38.438 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-361.el9.x86_64 2023-11-24T05:57:38.438 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:57:38.438 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T05:57:38.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum upgrade -y linux-firmware 2023-11-24T05:57:40.522 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-11-24T05:57:40.744 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-11-24T05:57:42.186 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2023-11-24T05:57:42.389 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2023-11-24T05:57:43.946 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 7.9 MB 00:01 2023-11-24T05:57:44.643 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 7.9 MB 00:02 2023-11-24T05:57:47.305 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 18 MB 00:02 2023-11-24T05:57:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 18 MB 00:01 2023-11-24T05:57:51.086 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.8 MB 00:00 2023-11-24T05:57:52.589 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-11-24T05:57:52.671 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.8 MB 00:01 2023-11-24T05:57:53.799 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2023-11-24T05:57:55.062 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-11-24T05:57:57.333 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 20 MB 00:02 2023-11-24T05:57:58.575 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-11-24T05:58:01.009 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-11-24T05:58:01.021 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-11-24T05:58:01.021 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-11-24T05:58:01.021 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-11-24T05:58:01.021 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2023-11-24T05:58:01.021 INFO:teuthology.orchestra.run.smithi188.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T05:58:01.021 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T05:58:01.022 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-11-24T05:58:01.022 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-11-24T05:58:01.022 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 1 Package 2023-11-24T05:58:01.022 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T05:58:01.022 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 328 M 2023-11-24T05:58:01.022 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-11-24T05:58:02.356 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-11-24T05:58:04.859 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-11-24T05:58:04.870 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-11-24T05:58:04.870 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-11-24T05:58:04.870 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-11-24T05:58:04.870 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-11-24T05:58:04.870 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T05:58:04.871 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T05:58:04.871 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-11-24T05:58:04.871 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-11-24T05:58:04.871 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 1 Package 2023-11-24T05:58:04.871 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T05:58:04.871 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 328 M 2023-11-24T05:58:04.871 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-11-24T05:58:05.974 INFO:teuthology.orchestra.run.smithi188.stdout:linux-firmware-20231030-141.el9.noarch.rpm 66 MB/s | 328 MB 00:04 2023-11-24T05:58:05.975 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-11-24T05:58:05.976 INFO:teuthology.orchestra.run.smithi188.stdout:Total 66 MB/s | 328 MB 00:04 2023-11-24T05:58:05.976 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-11-24T05:58:06.078 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-11-24T05:58:06.078 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-11-24T05:58:08.191 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-11-24T05:58:08.191 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-11-24T05:58:09.781 INFO:teuthology.orchestra.run.smithi037.stdout:linux-firmware-20231030-141.el9.noarch.rpm 67 MB/s | 328 MB 00:04 2023-11-24T05:58:09.783 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-11-24T05:58:09.783 INFO:teuthology.orchestra.run.smithi037.stdout:Total 67 MB/s | 328 MB 00:04 2023-11-24T05:58:09.784 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-11-24T05:58:09.864 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-11-24T05:58:09.864 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-11-24T05:58:12.059 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-11-24T05:58:12.059 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-11-24T05:58:13.764 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-11-24T05:58:14.352 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:58:14.461 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:58:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:58:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:58:16.003 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:58:16.004 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T05:58:16.004 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2023-11-24T05:58:16.005 INFO:teuthology.orchestra.run.smithi188.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T05:58:16.005 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T05:58:16.005 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-11-24T05:58:16.309 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T05:58:16.309 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:58:16.464 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T05:58:16.464 DEBUG:teuthology.orchestra.run.smithi188:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T05:58:16.467 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi188.front.sepia.ceph.com to complete... 2023-11-24T05:58:18.109 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-11-24T05:58:18.408 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:58:18.489 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:58:19.491 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:58:19.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T05:58:19.885 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T05:58:19.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T05:58:19.885 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-11-24T05:58:19.885 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T05:58:19.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T05:58:19.886 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-11-24T05:58:20.177 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T05:58:20.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T05:58:20.327 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T05:58:20.328 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T05:58:20.344 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2023-11-24T05:58:34.158 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24 05:58:34 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T05:58:34.159 INFO:teuthology.orchestra.run.smithi188.stderr:FINISHED --2023-11-24 05:58:34-- 2023-11-24T05:58:34.159 INFO:teuthology.orchestra.run.smithi188.stderr:Total wall clock time: 18s 2023-11-24T05:58:34.159 INFO:teuthology.orchestra.run.smithi188.stderr:Downloaded: 1 files, 306M in 17s (17.7 MB/s) 2023-11-24T05:58:34.161 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T05:58:34.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T05:58:36.001 INFO:teuthology.orchestra.run.smithi188.stdout:Verifying... ######################################## 2023-11-24T05:58:36.071 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing... ######################################## 2023-11-24T05:58:36.150 INFO:teuthology.orchestra.run.smithi188.stdout:Updating / installing... 2023-11-24T05:58:39.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24 05:58:39 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T05:58:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2023-11-24 05:58:39-- 2023-11-24T05:58:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 19s 2023-11-24T05:58:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 306M in 18s (16.6 MB/s) 2023-11-24T05:58:39.134 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T05:58:39.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T05:58:41.065 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying... ######################################## 2023-11-24T05:58:41.120 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing... ######################################## 2023-11-24T05:58:41.204 INFO:teuthology.orchestra.run.smithi037.stdout:Updating / installing... 2023-11-24T05:58:43.236 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T05:58:48.590 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T05:58:58.820 INFO:teuthology.orchestra.run.smithi188.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T05:59:03.594 INFO:teuthology.orchestra.run.smithi037.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T05:59:19.968 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T05:59:19.968 DEBUG:teuthology.orchestra.run.smithi188:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T05:59:20.072 INFO:teuthology.orchestra.run.smithi188.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:59:20.073 INFO:teuthology.orchestra.run.smithi188.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T05:59:20.073 INFO:teuthology.orchestra.run.smithi188.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T05:59:20.073 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T05:59:20.073 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T05:59:20.073 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T05:59:20.073 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T05:59:20.073 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T05:59:20.074 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T05:59:20.074 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T05:59:20.074 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T05:59:20.074 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T05:59:20.074 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T05:59:20.074 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T05:59:20.074 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T05:59:20.075 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T05:59:20.076 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T05:59:20.077 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T05:59:20.078 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T05:59:20.078 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T05:59:20.078 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T05:59:20.078 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T05:59:20.078 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T05:59:20.079 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T05:59:20.079 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T05:59:20.079 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T05:59:20.079 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T05:59:20.079 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T05:59:20.079 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T05:59:20.079 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T05:59:20.080 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T05:59:20.080 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T05:59:20.080 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T05:59:20.080 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T05:59:20.080 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T05:59:20.080 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T05:59:20.080 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T05:59:20.081 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T05:59:20.081 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T05:59:20.081 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T05:59:20.081 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T05:59:20.081 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T05:59:20.081 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T05:59:20.081 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T05:59:20.082 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T05:59:20.082 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T05:59:20.082 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T05:59:20.082 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T05:59:20.082 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T05:59:20.082 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T05:59:20.082 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T05:59:20.083 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T05:59:20.083 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T05:59:20.083 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T05:59:20.083 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T05:59:20.083 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T05:59:20.083 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T05:59:20.083 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T05:59:20.084 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T05:59:20.084 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T05:59:20.084 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T05:59:20.084 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T05:59:20.084 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T05:59:20.085 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T05:59:20.086 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T05:59:20.086 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T05:59:20.086 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T05:59:20.087 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T05:59:20.087 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T05:59:20.087 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T05:59:20.087 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T05:59:20.087 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T05:59:20.088 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T05:59:20.088 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T05:59:20.088 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T05:59:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T05:59:20.090 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T05:59:20.091 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T05:59:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T05:59:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T05:59:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T05:59:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T05:59:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T05:59:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T05:59:20.093 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T05:59:20.094 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T05:59:20.095 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T05:59:20.096 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T05:59:20.096 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T05:59:20.096 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T05:59:20.096 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T05:59:20.097 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T05:59:20.098 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T05:59:20.098 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T05:59:20.098 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T05:59:20.098 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T05:59:20.098 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T05:59:20.098 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T05:59:20.098 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T05:59:20.099 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T05:59:20.099 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T05:59:20.099 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T05:59:20.099 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T05:59:20.099 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T05:59:20.100 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T05:59:20.101 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T05:59:20.102 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T05:59:20.103 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T05:59:20.104 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T05:59:20.105 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T05:59:20.106 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T05:59:20.107 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T05:59:20.107 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T05:59:20.107 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T05:59:20.107 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T05:59:20.107 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T05:59:20.107 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T05:59:20.107 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T05:59:20.108 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T05:59:20.109 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T05:59:20.109 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T05:59:20.109 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T05:59:20.109 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T05:59:20.109 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T05:59:20.110 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T05:59:20.111 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T05:59:20.112 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T05:59:20.113 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T05:59:20.114 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T05:59:20.115 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T05:59:20.115 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T05:59:20.115 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T05:59:20.115 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T05:59:20.115 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T05:59:20.116 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T05:59:20.116 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T05:59:20.116 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T05:59:20.116 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T05:59:20.117 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T05:59:20.117 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T05:59:20.117 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T05:59:20.118 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T05:59:20.118 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T05:59:20.118 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T05:59:20.118 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T05:59:20.118 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T05:59:20.119 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T05:59:20.119 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T05:59:20.119 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T05:59:20.119 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T05:59:20.120 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T05:59:20.120 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T05:59:20.120 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T05:59:20.121 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T05:59:20.121 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T05:59:20.121 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T05:59:20.121 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T05:59:20.121 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T05:59:20.122 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T05:59:20.122 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T05:59:20.122 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T05:59:20.122 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T05:59:20.122 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T05:59:20.123 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T05:59:20.124 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T05:59:20.125 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T05:59:20.126 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T05:59:20.127 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T05:59:20.128 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T05:59:20.129 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T05:59:20.129 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T05:59:20.129 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T05:59:20.129 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T05:59:20.129 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T05:59:20.129 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T05:59:20.129 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T05:59:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T05:59:20.131 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T05:59:20.132 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T05:59:20.133 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T05:59:20.134 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T05:59:20.135 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T05:59:20.136 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T05:59:20.137 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T05:59:20.138 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T05:59:20.139 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T05:59:20.140 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T05:59:20.140 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T05:59:20.140 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T05:59:20.140 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T05:59:20.140 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T05:59:20.140 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T05:59:20.140 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T05:59:20.141 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T05:59:20.142 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T05:59:20.143 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T05:59:20.144 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T05:59:20.145 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T05:59:20.146 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T05:59:20.147 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T05:59:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T05:59:20.149 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T05:59:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T05:59:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T05:59:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T05:59:20.150 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T05:59:20.151 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T05:59:20.152 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T05:59:20.153 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T05:59:20.154 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T05:59:20.155 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T05:59:20.161 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T05:59:20.162 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T05:59:20.163 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T05:59:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T05:59:20.165 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T05:59:20.166 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T05:59:20.167 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T05:59:20.168 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T05:59:20.169 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T05:59:20.170 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T05:59:20.171 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T05:59:20.172 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T05:59:20.173 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T05:59:20.174 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T05:59:20.175 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T05:59:20.176 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T05:59:20.177 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T05:59:20.178 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T05:59:20.179 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T05:59:20.180 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T05:59:20.181 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T05:59:20.182 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T05:59:20.183 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T05:59:20.184 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T05:59:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T05:59:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T05:59:20.187 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T05:59:20.188 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T05:59:20.189 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T05:59:20.190 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T05:59:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T05:59:20.192 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T05:59:20.193 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T05:59:20.194 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T05:59:20.195 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T05:59:20.196 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T05:59:20.197 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T05:59:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T05:59:20.199 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T05:59:20.200 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T05:59:20.201 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T05:59:20.202 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T05:59:20.202 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T05:59:20.202 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T05:59:20.202 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T05:59:20.202 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T05:59:20.202 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T05:59:20.203 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T05:59:20.203 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T05:59:20.203 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T05:59:20.203 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T05:59:20.203 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T05:59:20.203 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T05:59:20.204 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T05:59:20.204 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T05:59:20.204 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T05:59:20.204 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T05:59:20.204 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T05:59:20.204 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T05:59:20.204 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T05:59:20.205 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T05:59:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T05:59:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T05:59:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T05:59:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T05:59:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T05:59:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T05:59:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T05:59:20.213 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T05:59:20.214 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T05:59:20.215 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T05:59:20.215 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T05:59:20.215 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T05:59:20.215 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T05:59:20.215 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T05:59:20.216 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T05:59:20.217 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T05:59:20.218 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T05:59:20.219 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T05:59:20.220 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T05:59:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T05:59:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T05:59:20.223 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T05:59:20.224 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T05:59:20.225 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T05:59:20.226 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T05:59:20.227 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T05:59:20.228 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T05:59:20.229 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T05:59:20.230 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T05:59:20.231 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T05:59:20.232 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T05:59:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T05:59:20.234 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T05:59:20.235 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T05:59:20.236 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T05:59:20.237 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T05:59:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T05:59:20.239 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T05:59:20.240 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T05:59:20.241 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T05:59:20.242 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T05:59:20.243 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T05:59:20.244 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T05:59:20.245 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T05:59:20.246 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T05:59:20.247 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T05:59:20.248 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T05:59:20.248 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T05:59:20.248 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T05:59:20.248 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T05:59:20.248 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T05:59:20.248 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T05:59:20.248 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T05:59:20.249 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T05:59:20.249 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T05:59:20.249 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T05:59:20.249 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T05:59:20.249 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T05:59:20.249 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T05:59:20.249 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T05:59:20.250 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T05:59:20.250 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T05:59:20.250 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T05:59:20.250 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T05:59:20.250 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T05:59:20.250 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T05:59:20.250 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T05:59:20.251 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T05:59:20.252 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T05:59:20.253 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T05:59:20.253 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T05:59:20.253 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T05:59:20.253 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T05:59:20.253 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T05:59:20.253 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T05:59:20.253 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T05:59:20.254 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T05:59:20.255 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T05:59:20.255 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T05:59:20.255 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T05:59:20.256 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T05:59:20.257 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T05:59:20.262 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T05:59:20.262 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T05:59:20.262 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T05:59:20.262 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T05:59:20.267 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T05:59:20.267 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T05:59:20.267 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T05:59:20.267 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T05:59:20.267 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T05:59:20.267 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T05:59:20.268 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T05:59:20.269 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T05:59:20.270 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T05:59:20.270 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T05:59:20.270 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T05:59:20.270 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T05:59:20.271 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T05:59:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T05:59:20.273 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T05:59:20.273 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T05:59:20.273 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T05:59:20.274 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T05:59:20.274 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T05:59:20.274 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T05:59:20.274 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T05:59:20.274 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T05:59:20.274 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T05:59:20.275 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T05:59:20.276 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T05:59:20.277 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T05:59:20.279 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T05:59:20.279 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T05:59:20.279 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T05:59:20.279 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T05:59:20.279 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T05:59:20.279 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T05:59:20.280 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T05:59:20.280 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T05:59:20.280 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T05:59:20.280 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T05:59:20.280 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T05:59:20.280 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T05:59:20.280 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T05:59:20.282 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T05:59:20.283 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T05:59:20.283 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T05:59:20.284 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T05:59:20.284 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T05:59:20.285 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T05:59:20.285 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T05:59:20.285 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T05:59:20.285 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T05:59:20.285 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T05:59:20.285 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T05:59:20.285 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T05:59:20.286 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T05:59:20.287 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T05:59:20.288 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T05:59:20.288 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T05:59:20.288 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T05:59:20.288 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T05:59:20.288 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T05:59:20.288 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T05:59:20.288 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T05:59:20.289 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T05:59:20.289 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T05:59:20.289 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T05:59:20.294 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T05:59:20.294 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T05:59:20.294 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T05:59:20.294 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T05:59:20.295 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T05:59:20.296 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T05:59:20.297 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T05:59:20.298 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T05:59:20.298 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T05:59:20.298 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T05:59:20.298 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T05:59:20.298 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T05:59:20.299 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T05:59:20.302 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T05:59:20.303 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T05:59:20.304 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T05:59:20.305 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T05:59:20.305 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T05:59:20.305 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T05:59:20.305 DEBUG:teuthology.orchestra.run.smithi188:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T05:59:20.330 INFO:teuthology.orchestra.run.smithi188.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T05:59:20.330 INFO:teuthology.orchestra.run.smithi188.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T05:59:20.331 INFO:teuthology.orchestra.run.smithi188.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:20.331 INFO:teuthology.orchestra.run.smithi188.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:20.331 INFO:teuthology.orchestra.run.smithi188.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:59:20.331 INFO:teuthology.orchestra.run.smithi188.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:20.332 INFO:teuthology.orchestra.run.smithi188.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:20.332 INFO:teuthology.orchestra.run.smithi188.stdout:fi 2023-11-24T05:59:20.332 INFO:teuthology.orchestra.run.smithi188.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T05:59:20.332 INFO:teuthology.orchestra.run.smithi188.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T05:59:20.332 INFO:teuthology.orchestra.run.smithi188.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T05:59:20.335 INFO:teuthology.orchestra.run.smithi188.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T05:59:20.335 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T05:59:20.335 INFO:teuthology.orchestra.run.smithi188.stdout:fi 2023-11-24T05:59:20.335 INFO:teuthology.orchestra.run.smithi188.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T05:59:20.335 INFO:teuthology.orchestra.run.smithi188.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T05:59:20.335 INFO:teuthology.orchestra.run.smithi188.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T05:59:20.335 INFO:teuthology.orchestra.run.smithi188.stdout:fi 2023-11-24T05:59:20.336 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -qi grub2-tools 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Name : grub2-tools 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Epoch : 1 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Version : 2.06 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Release : 68.el9 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: x86_64 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Group : Unspecified 2023-11-24T05:59:20.405 INFO:teuthology.orchestra.run.smithi188.stdout:Size : 8264254 2023-11-24T05:59:20.406 INFO:teuthology.orchestra.run.smithi188.stdout:License : GPLv3+ 2023-11-24T05:59:20.406 INFO:teuthology.orchestra.run.smithi188.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T05:59:20.406 INFO:teuthology.orchestra.run.smithi188.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T05:59:20.406 INFO:teuthology.orchestra.run.smithi188.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T05:59:20.407 INFO:teuthology.orchestra.run.smithi188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T05:59:20.411 INFO:teuthology.orchestra.run.smithi188.stdout:Packager : builder@centos.org 2023-11-24T05:59:20.411 INFO:teuthology.orchestra.run.smithi188.stdout:Vendor : CentOS 2023-11-24T05:59:20.411 INFO:teuthology.orchestra.run.smithi188.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T05:59:20.412 INFO:teuthology.orchestra.run.smithi188.stdout:Summary : Support tools for GRUB. 2023-11-24T05:59:20.412 INFO:teuthology.orchestra.run.smithi188.stdout:Description : 2023-11-24T05:59:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T05:59:20.413 INFO:teuthology.orchestra.run.smithi188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T05:59:20.413 INFO:teuthology.orchestra.run.smithi188.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T05:59:20.414 INFO:teuthology.orchestra.run.smithi188.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T05:59:20.414 INFO:teuthology.orchestra.run.smithi188.stdout:hardware devices. 2023-11-24T05:59:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T05:59:20.414 INFO:teuthology.orchestra.run.smithi188.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T05:59:20.415 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T05:59:20.416 INFO:teuthology.task.kernel:Updating grub on smithi188 to boot 6.6.0-g8247bbb5b470 2023-11-24T05:59:20.416 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T05:59:21.098 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2023-11-24T05:59:22.468 INFO:teuthology.orchestra.run.smithi188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T05:59:22.506 INFO:teuthology.orchestra.run.smithi188.stderr:done 2023-11-24T05:59:22.508 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2023-11-24T05:59:22.523 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.JTCDqxV0aM 2023-11-24T05:59:22.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JTCDqxV0aM 2023-11-24T05:59:22.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.JTCDqxV0aM 2023-11-24T05:59:22.737 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.JTCDqxV0aM is 6KB 2023-11-24T05:59:22.787 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.JTCDqxV0aM 2023-11-24T05:59:22.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T05:59:22.871 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T05:59:22.871 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T05:59:22.872 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T05:59:22.872 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T05:59:22.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T05:59:23.026 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2023-11-24T05:59:25.364 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T05:59:25.366 DEBUG:teuthology.orchestra.run.smithi037:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T05:59:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:59:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T05:59:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T05:59:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T05:59:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T05:59:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T05:59:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T05:59:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T05:59:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T05:59:25.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T05:59:25.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T05:59:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T05:59:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T05:59:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T05:59:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T05:59:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T05:59:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T05:59:25.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T05:59:25.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T05:59:25.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T05:59:25.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T05:59:25.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T05:59:25.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T05:59:25.492 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T05:59:25.493 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T05:59:25.494 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T05:59:25.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T05:59:25.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T05:59:25.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T05:59:25.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T05:59:25.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T05:59:25.496 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T05:59:25.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T05:59:25.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T05:59:25.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T05:59:25.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T05:59:25.497 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T05:59:25.498 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T05:59:25.499 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T05:59:25.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T05:59:25.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T05:59:25.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T05:59:25.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T05:59:25.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T05:59:25.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T05:59:25.500 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T05:59:25.501 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T05:59:25.502 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T05:59:25.503 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T05:59:25.504 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T05:59:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T05:59:25.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T05:59:25.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T05:59:25.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T05:59:25.512 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T05:59:25.513 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T05:59:25.514 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T05:59:25.515 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T05:59:25.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T05:59:25.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T05:59:25.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T05:59:25.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T05:59:25.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T05:59:25.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T05:59:25.516 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T05:59:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T05:59:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T05:59:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T05:59:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T05:59:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T05:59:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T05:59:25.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T05:59:25.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T05:59:25.518 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T05:59:25.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T05:59:25.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T05:59:25.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T05:59:25.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T05:59:25.519 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T05:59:25.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T05:59:25.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T05:59:25.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T05:59:25.520 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T05:59:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T05:59:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T05:59:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T05:59:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T05:59:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T05:59:25.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T05:59:25.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T05:59:25.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T05:59:25.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T05:59:25.522 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T05:59:25.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T05:59:25.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T05:59:25.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T05:59:25.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T05:59:25.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T05:59:25.524 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T05:59:25.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T05:59:25.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T05:59:25.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T05:59:25.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T05:59:25.525 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T05:59:25.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T05:59:25.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T05:59:25.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T05:59:25.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T05:59:25.526 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T05:59:25.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T05:59:25.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T05:59:25.527 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T05:59:25.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T05:59:25.528 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T05:59:25.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T05:59:25.529 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T05:59:25.535 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T05:59:25.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T05:59:25.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T05:59:25.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T05:59:25.538 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T05:59:25.539 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T05:59:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T05:59:25.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T05:59:25.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T05:59:25.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T05:59:25.541 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T05:59:25.542 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T05:59:25.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T05:59:25.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T05:59:25.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T05:59:25.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T05:59:25.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T05:59:25.544 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T05:59:25.545 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T05:59:25.546 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T05:59:25.547 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T05:59:25.548 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T05:59:25.549 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T05:59:25.550 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T05:59:25.551 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T05:59:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T05:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T05:59:25.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T05:59:25.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T05:59:25.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T05:59:25.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T05:59:25.554 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T05:59:25.555 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T05:59:25.556 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T05:59:25.557 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T05:59:25.558 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T05:59:25.559 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T05:59:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T05:59:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T05:59:25.562 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T05:59:25.563 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T05:59:25.564 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T05:59:25.565 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T05:59:25.566 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T05:59:25.567 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T05:59:25.568 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T05:59:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T05:59:25.570 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T05:59:25.571 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T05:59:25.572 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T05:59:25.573 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T05:59:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T05:59:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T05:59:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T05:59:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T05:59:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T05:59:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T05:59:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T05:59:25.575 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T05:59:25.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T05:59:25.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T05:59:25.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T05:59:25.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T05:59:25.576 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T05:59:25.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T05:59:25.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T05:59:25.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T05:59:25.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T05:59:25.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T05:59:25.577 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T05:59:25.578 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T05:59:25.579 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T05:59:25.580 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T05:59:25.581 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T05:59:25.582 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T05:59:25.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T05:59:25.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T05:59:25.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T05:59:25.583 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T05:59:25.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T05:59:25.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T05:59:25.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T05:59:25.590 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T05:59:25.591 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T05:59:25.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T05:59:25.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T05:59:25.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T05:59:25.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T05:59:25.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T05:59:25.592 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T05:59:25.593 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T05:59:25.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T05:59:25.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T05:59:25.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T05:59:25.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T05:59:25.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T05:59:25.594 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T05:59:25.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T05:59:25.605 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T05:59:25.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T05:59:25.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T05:59:25.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T05:59:25.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T05:59:25.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T05:59:25.606 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T05:59:25.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T05:59:25.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T05:59:25.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T05:59:25.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T05:59:25.607 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T05:59:25.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T05:59:25.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T05:59:25.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T05:59:25.608 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T05:59:25.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T05:59:25.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T05:59:25.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T05:59:25.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T05:59:25.611 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T05:59:25.612 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T05:59:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T05:59:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T05:59:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T05:59:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T05:59:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T05:59:25.617 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T05:59:25.618 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T05:59:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T05:59:25.620 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T05:59:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T05:59:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T05:59:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T05:59:25.624 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T05:59:25.625 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T05:59:25.626 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T05:59:25.627 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T05:59:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T05:59:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T05:59:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T05:59:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T05:59:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T05:59:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T05:59:25.632 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T05:59:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T05:59:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T05:59:25.635 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T05:59:25.636 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T05:59:25.637 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T05:59:25.638 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T05:59:25.639 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T05:59:25.640 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T05:59:25.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T05:59:25.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T05:59:25.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T05:59:25.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T05:59:25.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T05:59:25.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T05:59:25.641 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T05:59:25.642 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T05:59:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T05:59:25.644 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T05:59:25.645 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T05:59:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T05:59:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T05:59:25.648 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T05:59:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T05:59:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T05:59:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T05:59:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T05:59:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T05:59:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T05:59:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T05:59:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T05:59:25.654 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T05:59:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T05:59:25.656 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T05:59:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T05:59:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T05:59:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T05:59:25.660 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T05:59:25.661 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T05:59:25.662 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T05:59:25.663 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T05:59:25.664 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T05:59:25.665 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T05:59:25.666 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T05:59:25.667 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T05:59:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T05:59:25.669 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T05:59:25.670 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T05:59:25.671 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T05:59:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T05:59:25.673 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T05:59:25.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T05:59:25.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T05:59:25.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T05:59:25.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T05:59:25.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T05:59:25.674 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T05:59:25.675 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T05:59:25.676 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T05:59:25.677 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T05:59:25.678 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T05:59:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T05:59:25.680 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T05:59:25.681 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T05:59:25.682 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T05:59:25.683 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T05:59:25.684 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T05:59:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T05:59:25.686 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T05:59:25.687 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T05:59:25.688 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T05:59:25.689 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T05:59:25.690 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T05:59:25.691 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T05:59:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T05:59:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T05:59:25.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T05:59:25.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T05:59:25.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T05:59:25.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T05:59:25.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T05:59:25.694 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T05:59:25.695 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T05:59:25.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T05:59:25.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T05:59:25.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T05:59:25.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T05:59:25.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T05:59:25.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T05:59:25.696 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T05:59:25.697 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T05:59:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T05:59:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T05:59:25.700 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T05:59:25.701 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T05:59:25.702 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T05:59:25.703 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T05:59:25.704 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T05:59:25.705 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T05:59:25.706 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T05:59:25.707 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T05:59:25.708 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T05:59:25.709 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T05:59:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T05:59:25.711 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T05:59:25.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T05:59:25.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T05:59:25.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T05:59:25.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T05:59:25.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T05:59:25.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T05:59:25.712 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T05:59:25.713 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T05:59:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T05:59:25.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T05:59:25.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T05:59:25.715 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T05:59:25.715 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T05:59:25.715 DEBUG:teuthology.orchestra.run.smithi037:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T05:59:25.741 INFO:teuthology.orchestra.run.smithi037.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T05:59:25.742 INFO:teuthology.orchestra.run.smithi037.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T05:59:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T05:59:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-11-24T05:59:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T05:59:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T05:59:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T05:59:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-11-24T05:59:25.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 68.el9 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8264254 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2023-11-24T05:59:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T05:59:25.822 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2023-11-24T05:59:25.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T05:59:25.823 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T05:59:25.823 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T05:59:25.824 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 6.6.0-g8247bbb5b470 2023-11-24T05:59:25.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T05:59:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-11-24T05:59:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T05:59:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-11-24T05:59:27.870 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-11-24T05:59:27.885 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.HDabgpFN4U 2023-11-24T05:59:27.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HDabgpFN4U 2023-11-24T05:59:27.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.HDabgpFN4U 2023-11-24T05:59:28.103 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.HDabgpFN4U is 6KB 2023-11-24T05:59:28.151 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.HDabgpFN4U 2023-11-24T05:59:28.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T05:59:28.235 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T05:59:28.235 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T05:59:28.235 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T05:59:28.235 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T05:59:28.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T05:59:28.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-11-24T05:59:53.050 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-24T05:59:53.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-24T05:59:53.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T05:59:58.414 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-24T05:59:58.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-24T05:59:58.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:00:11.618 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-24T06:00:16.738 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-11-24T06:00:20.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-24T06:00:20.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:00:23.682 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-24T06:00:25.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-24T06:00:25.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:00:35.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-24T06:00:35.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:00:44.130 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-11-24T06:00:56.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-24T06:00:56.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:00:59.467 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-11-24T06:01:00.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-24T06:01:00.144 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-24T06:01:00.144 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-11-24T06:01:00.203 INFO:teuthology.orchestra.run.smithi037.stdout:6.6.0-g8247bbb5b470 2023-11-24T06:01:00.204 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T06:01:00.204 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T06:01:00.204 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T06:01:01.205 DEBUG:teuthology.parallel:result is None 2023-11-24T06:01:07.633 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-11-24T06:01:08.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-24T06:01:08.392 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-24T06:01:08.392 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2023-11-24T06:01:08.433 INFO:teuthology.orchestra.run.smithi188.stdout:6.6.0-g8247bbb5b470 2023-11-24T06:01:08.433 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T06:01:08.434 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T06:01:08.434 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T06:01:09.435 DEBUG:teuthology.parallel:result is None 2023-11-24T06:01:09.435 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T06:01:09.442 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T06:01:09.443 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T06:01:09.452 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T06:01:09.506 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T06:01:09.514 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T06:01:09.524 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T06:01:09.524 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T06:01:09.529 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T06:01:09.594 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T06:01:09.605 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T06:01:09.605 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T06:01:09.611 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T06:01:09.733 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:09.773 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:09.777 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:09.839 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:09.843 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T06:01:09.852 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T06:01:09.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T06:01:09.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T06:01:09.941 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T06:01:09.960 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T06:01:09.961 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T06:01:09.967 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T06:01:10.009 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:10.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:10.190 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:10.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:10.351 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:01:10.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T06:01:10.425 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:10.499 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:10.581 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:10.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:10.738 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:01:10.738 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T06:01:10.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-11-24T06:01:10.818 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2023-11-24T06:01:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:01:10.967 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:01:11.038 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T06:01:11.048 INFO:teuthology.task.internal:Starting timer... 2023-11-24T06:01:11.048 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T06:01:11.107 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T06:01:11.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-11-24T06:01:11.242 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-11-24T06:01:11.245 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2023-11-24T06:01:11.358 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2023-11-24T06:01:11.362 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T06:01:11.362 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-11-24T06:01:11.432 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-11-24T06:01:11.432 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2023-11-24T06:01:11.487 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2023-11-24T06:01:11.487 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2023-11-24T06:01:11.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:01:11.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:01:11.571 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:01:11.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:01:11.653 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T06:01:11.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-11-24T06:01:11.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2023-11-24T06:01:11.867 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T06:01:11.877 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-24T06:01:11.883 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-24T06:01:12.033 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T06:01:12.049 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T06:01:12.050 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T06:11:41.458 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2023-11-24T06:11:41.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-24T06:11:41.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:11:41.605 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-11-24T06:11:41.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-11-24T06:11:41.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-24T06:11:41.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:11:41.901 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-11-24T06:11:42.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-24T06:11:42.065 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T06:11:42.074 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T06:11:42.075 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:11:42.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:11:42.084 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:11:42.084 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:11:42.189 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T06:11:42.190 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T06:11:42.241 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T06:11:42.247 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T06:11:42.337 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2023-11-24T06:11:42.344 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-11-24T06:11:42.378 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2023-11-24T06:11:42.387 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-11-24T06:11:42.430 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T06:11:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T06:11:42.483 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T06:11:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T06:11:42.605 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:11:42.614 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:11:42.614 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2023-11-24T06:11:42.614 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.614 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.614 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.614 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:11:42.643 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:11:42.643 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-11-24T06:11:42.643 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.643 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.643 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.643 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:11:42.644 INFO:teuthology.run_tasks:Running task install... 2023-11-24T06:11:42.655 DEBUG:teuthology.task.install:project ceph 2023-11-24T06:11:42.655 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T06:11:42.656 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T06:11:42.656 INFO:teuthology.task.install:Using flavor: default 2023-11-24T06:11:42.662 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T06:11:42.662 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T06:11:42.662 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T06:11:42.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:11:42.664 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T06:11:42.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:11:42.819 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T06:11:42.819 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T06:11:42.824 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T06:11:42.825 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T06:11:42.931 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T06:11:42.931 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:11:42.931 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T06:11:43.033 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T06:11:43.034 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T06:11:43.138 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T06:11:43.138 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:11:43.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T06:11:43.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T06:11:43.246 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T06:11:43.246 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T06:11:43.309 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T06:11:43.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T06:11:43.398 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2023-11-24T06:11:43.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2023-11-24T06:11:43.542 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T06:11:43.638 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-11-24T06:11:43.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-11-24T06:11:43.769 INFO:teuthology.orchestra.run.smithi188.stdout:73 files removed 2023-11-24T06:11:43.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T06:11:44.024 INFO:teuthology.orchestra.run.smithi037.stdout:73 files removed 2023-11-24T06:11:44.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T06:11:44.736 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 188 kB/s | 78 kB 00:00 2023-11-24T06:11:45.079 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 162 kB/s | 78 kB 00:00 2023-11-24T06:11:45.312 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-11-24T06:11:45.505 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-11-24T06:11:45.862 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2023-11-24T06:11:46.047 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2023-11-24T06:11:46.591 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.4 MB 00:00 2023-11-24T06:11:47.176 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 6.1 MB/s | 6.4 MB 00:01 2023-11-24T06:11:48.258 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-11-24T06:11:49.035 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2023-11-24T06:11:51.189 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 7.9 MB 00:01 2023-11-24T06:11:51.845 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 7.9 MB 00:03 2023-11-24T06:11:53.332 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-11-24T06:11:53.913 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-11-24T06:11:58.640 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 5.8 MB 00:01 2023-11-24T06:11:58.649 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.8 MB 00:01 2023-11-24T06:12:00.233 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 15 kB 00:00 2023-11-24T06:12:00.383 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 15 kB 00:00 2023-11-24T06:12:01.511 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2023-11-24T06:12:04.998 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 20 MB 00:04 2023-11-24T06:12:07.344 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-11-24T06:12:10.355 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:12:10.357 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:12:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T06:12:10.381 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T06:12:10.382 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T06:12:10.384 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T06:12:10.387 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T06:12:10.391 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T06:12:10.392 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T06:12:10.477 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================ 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================ 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T06:12:10.500 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T06:12:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T06:12:10.502 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T06:12:10.503 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T06:12:10.504 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T06:12:10.505 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T06:12:10.506 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T06:12:10.507 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T06:12:10.508 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T06:12:10.509 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T06:12:10.510 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T06:12:10.511 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================ 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout:Install 132 Packages 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 15 Packages 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:12:10.513 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 204 M 2023-11-24T06:12:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-11-24T06:12:10.675 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-11-24T06:12:11.671 INFO:teuthology.orchestra.run.smithi037.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 16 kB/s | 6.5 kB 00:00 2023-11-24T06:12:12.188 INFO:teuthology.orchestra.run.smithi037.stdout:(2/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.6 MB/s | 859 kB 00:00 2023-11-24T06:12:12.279 INFO:teuthology.orchestra.run.smithi037.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 1.5 MB/s | 141 kB 00:00 2023-11-24T06:12:12.680 INFO:teuthology.orchestra.run.smithi037.stdout:(4/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x86 5.2 MB/s | 2.1 MB 00:00 2023-11-24T06:12:12.905 INFO:teuthology.orchestra.run.smithi037.stdout:(5/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 6.5 MB/s | 1.5 MB 00:00 2023-11-24T06:12:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:(6/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 9.6 MB/s | 4.4 MB 00:00 2023-11-24T06:12:13.541 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:12:13.543 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T06:12:13.564 INFO:teuthology.orchestra.run.smithi188.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T06:12:13.565 INFO:teuthology.orchestra.run.smithi188.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T06:12:13.569 INFO:teuthology.orchestra.run.smithi188.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T06:12:13.569 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T06:12:13.571 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T06:12:13.575 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T06:12:13.576 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T06:12:13.654 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-11-24T06:12:13.677 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2023-11-24T06:12:13.677 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T06:12:13.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T06:12:13.679 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T06:12:13.680 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T06:12:13.681 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T06:12:13.682 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T06:12:13.683 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T06:12:13.684 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T06:12:13.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T06:12:13.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T06:12:13.687 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T06:12:13.688 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T06:12:13.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:12:13.690 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-11-24T06:12:13.691 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2023-11-24T06:12:13.691 INFO:teuthology.orchestra.run.smithi188.stdout:Install 132 Packages 2023-11-24T06:12:13.691 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 15 Packages 2023-11-24T06:12:13.691 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:12:13.691 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 204 M 2023-11-24T06:12:13.691 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-11-24T06:12:13.789 INFO:teuthology.orchestra.run.smithi037.stdout:(7/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x8 2.1 MB/s | 5.2 MB 00:02 2023-11-24T06:12:14.314 INFO:teuthology.orchestra.run.smithi037.stdout:(8/147): ceph-common-18.0.0-7484.ga13ea5ff.el9. 6.2 MB/s | 19 MB 00:03 2023-11-24T06:12:14.398 INFO:teuthology.orchestra.run.smithi037.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 293 kB/s | 24 kB 00:00 2023-11-24T06:12:14.676 INFO:teuthology.orchestra.run.smithi188.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 15 kB/s | 6.5 kB 00:00 2023-11-24T06:12:14.873 INFO:teuthology.orchestra.run.smithi037.stdout:(10/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x8 12 MB/s | 18 MB 00:01 2023-11-24T06:12:15.015 INFO:teuthology.orchestra.run.smithi037.stdout:(11/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 1.5 MB/s | 217 kB 00:00 2023-11-24T06:12:15.115 INFO:teuthology.orchestra.run.smithi037.stdout:(12/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 315 kB/s | 31 kB 00:00 2023-11-24T06:12:15.265 INFO:teuthology.orchestra.run.smithi037.stdout:(13/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 4.7 MB/s | 719 kB 00:00 2023-11-24T06:12:15.374 INFO:teuthology.orchestra.run.smithi037.stdout:(14/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 1.5 MB/s | 163 kB 00:00 2023-11-24T06:12:15.566 INFO:teuthology.orchestra.run.smithi037.stdout:(15/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el 4.9 MB/s | 8.6 MB 00:01 2023-11-24T06:12:15.599 INFO:teuthology.orchestra.run.smithi037.stdout:(16/147): librados-devel-18.0.0-7484.ga13ea5ff. 563 kB/s | 126 kB 00:00 2023-11-24T06:12:15.808 INFO:teuthology.orchestra.run.smithi037.stdout:(17/147): libradosstriper1-18.0.0-7484.ga13ea5f 1.9 MB/s | 476 kB 00:00 2023-11-24T06:12:15.868 INFO:teuthology.orchestra.run.smithi188.stdout:(2/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 722 kB/s | 859 kB 00:01 2023-11-24T06:12:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.ga1 389 kB/s | 45 kB 00:00 2023-11-24T06:12:16.050 INFO:teuthology.orchestra.run.smithi037.stdout:(19/147): python3-ceph-common-18.0.0-7484.ga13e 1.0 MB/s | 129 kB 00:00 2023-11-24T06:12:16.085 INFO:teuthology.orchestra.run.smithi188.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 654 kB/s | 141 kB 00:00 2023-11-24T06:12:16.234 INFO:teuthology.orchestra.run.smithi037.stdout:(20/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 7.5 MB/s | 4.8 MB 00:00 2023-11-24T06:12:16.267 INFO:teuthology.orchestra.run.smithi037.stdout:(21/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 750 kB/s | 162 kB 00:00 2023-11-24T06:12:16.370 INFO:teuthology.orchestra.run.smithi037.stdout:(22/147): python3-rados-18.0.0-7484.ga13ea5ff.e 2.3 MB/s | 319 kB 00:00 2023-11-24T06:12:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:(23/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 2.2 MB/s | 298 kB 00:00 2023-11-24T06:12:16.495 INFO:teuthology.orchestra.run.smithi037.stdout:(24/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 800 kB/s | 99 kB 00:00 2023-11-24T06:12:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:(25/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 734 kB/s | 85 kB 00:00 2023-11-24T06:12:16.826 INFO:teuthology.orchestra.run.smithi188.stdout:(4/147): ceph-common-18.0.0-7484.ga13ea5ff.el9. 7.3 MB/s | 19 MB 00:02 2023-11-24T06:12:16.879 INFO:teuthology.orchestra.run.smithi037.stdout:(26/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 7.9 MB/s | 3.0 MB 00:00 2023-11-24T06:12:16.971 INFO:teuthology.orchestra.run.smithi037.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7484.g 309 kB/s | 28 kB 00:00 2023-11-24T06:12:17.038 INFO:teuthology.orchestra.run.smithi188.stdout:(5/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 7.0 MB/s | 1.5 MB 00:00 2023-11-24T06:12:17.071 INFO:teuthology.orchestra.run.smithi037.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 1.3 MB/s | 133 kB 00:00 2023-11-24T06:12:17.161 INFO:teuthology.orchestra.run.smithi188.stdout:(6/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x8 1.8 MB/s | 5.2 MB 00:02 2023-11-24T06:12:17.372 INFO:teuthology.orchestra.run.smithi037.stdout:(29/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 5.9 MB/s | 1.8 MB 00:00 2023-11-24T06:12:17.430 INFO:teuthology.orchestra.run.smithi037.stdout:(30/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 187 kB/s | 170 kB 00:00 2023-11-24T06:12:17.461 INFO:teuthology.orchestra.run.smithi188.stdout:(7/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 10 MB/s | 4.4 MB 00:00 2023-11-24T06:12:17.522 INFO:teuthology.orchestra.run.smithi037.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7484.ga1 2.6 MB/s | 243 kB 00:00 2023-11-24T06:12:18.231 INFO:teuthology.orchestra.run.smithi037.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 71 kB/s | 50 kB 00:00 2023-11-24T06:12:18.286 INFO:teuthology.orchestra.run.smithi188.stdout:(8/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el9 10 MB/s | 8.6 MB 00:00 2023-11-24T06:12:18.353 INFO:teuthology.orchestra.run.smithi188.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 366 kB/s | 24 kB 00:00 2023-11-24T06:12:18.406 INFO:teuthology.orchestra.run.smithi037.stdout:(33/147): ceph-mgr-diskprediction-local-18.0.0- 7.2 MB/s | 7.4 MB 00:01 2023-11-24T06:12:18.431 INFO:teuthology.orchestra.run.smithi037.stdout:(34/147): ceph-prometheus-alerts-18.0.0-7484.ga 76 kB/s | 15 kB 00:00 2023-11-24T06:12:18.515 INFO:teuthology.orchestra.run.smithi037.stdout:(35/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 2.4 MB/s | 262 kB 00:00 2023-11-24T06:12:18.598 INFO:teuthology.orchestra.run.smithi037.stdout:(36/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 222 kB/s | 18 kB 00:00 2023-11-24T06:12:18.769 INFO:teuthology.orchestra.run.smithi037.stdout:(37/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 2.2 MB/s | 772 kB 00:00 2023-11-24T06:12:18.886 INFO:teuthology.orchestra.run.smithi188.stdout:(10/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x8 763 kB/s | 2.1 MB 00:02 2023-11-24T06:12:18.957 INFO:teuthology.orchestra.run.smithi037.stdout:(38/147): bison-3.7.4-5.el9.x86_64.rpm 4.9 MB/s | 920 kB 00:00 2023-11-24T06:12:18.991 INFO:teuthology.orchestra.run.smithi037.stdout:(39/147): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 662 kB 00:00 2023-11-24T06:12:19.016 INFO:teuthology.orchestra.run.smithi037.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-11-24T06:12:19.041 INFO:teuthology.orchestra.run.smithi037.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 446 kB/s | 21 kB 00:00 2023-11-24T06:12:19.075 INFO:teuthology.orchestra.run.smithi037.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-11-24T06:12:19.100 INFO:teuthology.orchestra.run.smithi037.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 577 kB/s | 32 kB 00:00 2023-11-24T06:12:19.145 INFO:teuthology.orchestra.run.smithi188.stdout:(11/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 843 kB/s | 217 kB 00:00 2023-11-24T06:12:19.201 INFO:teuthology.orchestra.run.smithi037.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-11-24T06:12:19.226 INFO:teuthology.orchestra.run.smithi037.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 17 kB 00:00 2023-11-24T06:12:19.229 INFO:teuthology.orchestra.run.smithi188.stdout:(12/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 379 kB/s | 31 kB 00:00 2023-11-24T06:12:19.259 INFO:teuthology.orchestra.run.smithi037.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2023-11-24T06:12:19.284 INFO:teuthology.orchestra.run.smithi037.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 180 kB/s | 10 kB 00:00 2023-11-24T06:12:19.310 INFO:teuthology.orchestra.run.smithi037.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2023-11-24T06:12:19.356 INFO:teuthology.orchestra.run.smithi037.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 648 kB/s | 44 kB 00:00 2023-11-24T06:12:19.481 INFO:teuthology.orchestra.run.smithi037.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 3.8 MB/s | 661 kB 00:00 2023-11-24T06:12:19.670 INFO:teuthology.orchestra.run.smithi037.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 1.8 MB/s | 578 kB 00:00 2023-11-24T06:12:19.695 INFO:teuthology.orchestra.run.smithi037.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 118 kB/s | 24 kB 00:00 2023-11-24T06:12:19.720 INFO:teuthology.orchestra.run.smithi037.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 46 kB 00:00 2023-11-24T06:12:19.754 INFO:teuthology.orchestra.run.smithi037.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-11-24T06:12:19.754 INFO:teuthology.orchestra.run.smithi188.stdout:(13/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 1.3 MB/s | 719 kB 00:00 2023-11-24T06:12:19.787 INFO:teuthology.orchestra.run.smithi037.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-11-24T06:12:19.812 INFO:teuthology.orchestra.run.smithi037.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 614 kB/s | 34 kB 00:00 2023-11-24T06:12:19.946 INFO:teuthology.orchestra.run.smithi188.stdout:(14/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 857 kB/s | 163 kB 00:00 2023-11-24T06:12:19.963 INFO:teuthology.orchestra.run.smithi037.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-11-24T06:12:20.013 INFO:teuthology.orchestra.run.smithi037.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 8.2 MB/s | 1.5 MB 00:00 2023-11-24T06:12:20.063 INFO:teuthology.orchestra.run.smithi188.stdout:(15/147): librados-devel-18.0.0-7484.ga13ea5ff. 1.1 MB/s | 126 kB 00:00 2023-11-24T06:12:20.063 INFO:teuthology.orchestra.run.smithi037.stdout:(59/147): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-11-24T06:12:20.105 INFO:teuthology.orchestra.run.smithi037.stdout:(60/147): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-11-24T06:12:20.247 INFO:teuthology.orchestra.run.smithi037.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 32 MB/s | 5.7 MB 00:00 2023-11-24T06:12:20.389 INFO:teuthology.orchestra.run.smithi037.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-11-24T06:12:20.414 INFO:teuthology.orchestra.run.smithi037.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-11-24T06:12:20.464 INFO:teuthology.orchestra.run.smithi037.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 501 kB/s | 24 kB 00:00 2023-11-24T06:12:20.488 INFO:teuthology.orchestra.run.smithi188.stdout:(16/147): libradosstriper1-18.0.0-7484.ga13ea5f 1.1 MB/s | 476 kB 00:00 2023-11-24T06:12:20.523 INFO:teuthology.orchestra.run.smithi037.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 169 kB/s | 18 kB 00:00 2023-11-24T06:12:20.573 INFO:teuthology.orchestra.run.smithi037.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-11-24T06:12:20.598 INFO:teuthology.orchestra.run.smithi037.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 428 kB/s | 32 kB 00:00 2023-11-24T06:12:20.649 INFO:teuthology.orchestra.run.smithi037.stdout:(68/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.4 MB/s | 217 kB 00:00 2023-11-24T06:12:20.766 INFO:teuthology.orchestra.run.smithi037.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2023-11-24T06:12:20.791 INFO:teuthology.orchestra.run.smithi037.stdout:(70/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-11-24T06:12:21.247 INFO:teuthology.orchestra.run.smithi188.stdout:(17/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x8 4.3 MB/s | 18 MB 00:04 2023-11-24T06:12:21.250 INFO:teuthology.orchestra.run.smithi037.stdout:(71/147): ceph-test-18.0.0-7484.ga13ea5ff.el9.x 6.0 MB/s | 41 MB 00:06 2023-11-24T06:12:21.275 INFO:teuthology.orchestra.run.smithi037.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 85 kB/s | 41 kB 00:00 2023-11-24T06:12:21.300 INFO:teuthology.orchestra.run.smithi037.stdout:(73/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 261 kB/s | 132 kB 00:00 2023-11-24T06:12:21.321 INFO:teuthology.orchestra.run.smithi188.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.ga1 611 kB/s | 45 kB 00:00 2023-11-24T06:12:21.333 INFO:teuthology.orchestra.run.smithi037.stdout:(74/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-11-24T06:12:21.358 INFO:teuthology.orchestra.run.smithi037.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 853 kB/s | 47 kB 00:00 2023-11-24T06:12:21.384 INFO:teuthology.orchestra.run.smithi037.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 532 kB/s | 43 kB 00:00 2023-11-24T06:12:21.389 INFO:teuthology.orchestra.run.smithi188.stdout:(19/147): python3-ceph-common-18.0.0-7484.ga13e 1.9 MB/s | 129 kB 00:00 2023-11-24T06:12:21.676 INFO:teuthology.orchestra.run.smithi037.stdout:(77/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2023-11-24T06:12:21.692 INFO:teuthology.orchestra.run.smithi037.stdout:(78/147): python3-toml-0.10.2-6.el9.noarch.rpm 132 kB/s | 39 kB 00:00 2023-11-24T06:12:21.726 INFO:teuthology.orchestra.run.smithi037.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 918 kB/s | 300 kB 00:00 2023-11-24T06:12:21.793 INFO:teuthology.orchestra.run.smithi037.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 865 kB/s | 56 kB 00:00 2023-11-24T06:12:21.818 INFO:teuthology.orchestra.run.smithi037.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 946 kB/s | 85 kB 00:00 2023-11-24T06:12:21.839 INFO:teuthology.orchestra.run.smithi188.stdout:(20/147): ceph-test-18.0.0-7484.ga13ea5ff.el9.x 12 MB/s | 41 MB 00:03 2023-11-24T06:12:21.843 INFO:teuthology.orchestra.run.smithi037.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 545 kB/s | 63 kB 00:00 2023-11-24T06:12:21.872 INFO:teuthology.orchestra.run.smithi188.stdout:(21/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 336 kB/s | 162 kB 00:00 2023-11-24T06:12:21.893 INFO:teuthology.orchestra.run.smithi037.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 904 kB/s | 44 kB 00:00 2023-11-24T06:12:21.914 INFO:teuthology.orchestra.run.smithi188.stdout:(22/147): python3-rados-18.0.0-7484.ga13ea5ff.e 4.2 MB/s | 319 kB 00:00 2023-11-24T06:12:21.919 INFO:teuthology.orchestra.run.smithi037.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-11-24T06:12:21.961 INFO:teuthology.orchestra.run.smithi037.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2023-11-24T06:12:21.964 INFO:teuthology.orchestra.run.smithi188.stdout:(23/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 2.0 MB/s | 99 kB 00:00 2023-11-24T06:12:21.998 INFO:teuthology.orchestra.run.smithi188.stdout:(24/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 2.3 MB/s | 298 kB 00:00 2023-11-24T06:12:22.015 INFO:teuthology.orchestra.run.smithi188.stdout:(25/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.7 MB/s | 85 kB 00:00 2023-11-24T06:12:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2023-11-24T06:12:22.061 INFO:teuthology.orchestra.run.smithi037.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2023-11-24T06:12:22.065 INFO:teuthology.orchestra.run.smithi188.stdout:(26/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 3.3 MB/s | 170 kB 00:00 2023-11-24T06:12:22.103 INFO:teuthology.orchestra.run.smithi037.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.1 MB 00:00 2023-11-24T06:12:22.116 INFO:teuthology.orchestra.run.smithi188.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7484.g 570 kB/s | 28 kB 00:00 2023-11-24T06:12:22.153 INFO:teuthology.orchestra.run.smithi037.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 103 kB 00:00 2023-11-24T06:12:22.166 INFO:teuthology.orchestra.run.smithi188.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 2.6 MB/s | 133 kB 00:00 2023-11-24T06:12:22.178 INFO:teuthology.orchestra.run.smithi037.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-11-24T06:12:22.203 INFO:teuthology.orchestra.run.smithi037.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-11-24T06:12:22.254 INFO:teuthology.orchestra.run.smithi037.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.8 MB/s | 187 kB 00:00 2023-11-24T06:12:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2023-11-24T06:12:22.391 INFO:teuthology.orchestra.run.smithi188.stdout:(29/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 7.8 MB/s | 1.8 MB 00:00 2023-11-24T06:12:22.583 INFO:teuthology.orchestra.run.smithi188.stdout:(30/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 5.2 MB/s | 3.0 MB 00:00 2023-11-24T06:12:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 11 MB/s | 4.1 MB 00:00 2023-11-24T06:12:22.667 INFO:teuthology.orchestra.run.smithi188.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7484.ga1 2.9 MB/s | 243 kB 00:00 2023-11-24T06:12:22.742 INFO:teuthology.orchestra.run.smithi188.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 677 kB/s | 50 kB 00:00 2023-11-24T06:12:22.809 INFO:teuthology.orchestra.run.smithi188.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7484.ga 228 kB/s | 15 kB 00:00 2023-11-24T06:12:22.910 INFO:teuthology.orchestra.run.smithi188.stdout:(34/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 2.6 MB/s | 262 kB 00:00 2023-11-24T06:12:23.021 INFO:teuthology.orchestra.run.smithi037.stdout:(95/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 403 kB/s | 309 kB 00:00 2023-11-24T06:12:23.071 INFO:teuthology.orchestra.run.smithi037.stdout:(96/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 59 kB/s | 24 kB 00:00 2023-11-24T06:12:23.118 INFO:teuthology.orchestra.run.smithi188.stdout:(35/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 1.8 MB/s | 4.8 MB 00:02 2023-11-24T06:12:23.130 INFO:teuthology.orchestra.run.smithi037.stdout:(97/147): liboath-2.6.7-2.el9.x86_64.rpm 451 kB/s | 49 kB 00:00 2023-11-24T06:12:23.193 INFO:teuthology.orchestra.run.smithi188.stdout:(36/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 2.7 MB/s | 772 kB 00:00 2023-11-24T06:12:23.235 INFO:teuthology.orchestra.run.smithi188.stdout:(37/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 157 kB/s | 18 kB 00:00 2023-11-24T06:12:23.255 INFO:teuthology.orchestra.run.smithi037.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 368 kB/s | 67 kB 00:00 2023-11-24T06:12:23.339 INFO:teuthology.orchestra.run.smithi037.stdout:(99/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.9 MB/s | 837 kB 00:00 2023-11-24T06:12:23.447 INFO:teuthology.orchestra.run.smithi037.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 404 kB/s | 43 kB 00:00 2023-11-24T06:12:23.477 INFO:teuthology.orchestra.run.smithi188.stdout:(38/147): ceph-mgr-diskprediction-local-18.0.0- 6.8 MB/s | 7.4 MB 00:01 2023-11-24T06:12:23.548 INFO:teuthology.orchestra.run.smithi037.stdout:(101/147): python3-asyncssh-2.13.2-3.el9.noarch 1.8 MB/s | 548 kB 00:00 2023-11-24T06:12:23.573 INFO:teuthology.orchestra.run.smithi037.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 259 kB/s | 32 kB 00:00 2023-11-24T06:12:23.644 INFO:teuthology.orchestra.run.smithi188.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 920 kB 00:00 2023-11-24T06:12:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:(103/147): libarrow-9.0.0-9.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2023-11-24T06:12:23.723 INFO:teuthology.orchestra.run.smithi037.stdout:(104/147): python3-certifi-2021.10.8-2.el9.noar 86 kB/s | 15 kB 00:00 2023-11-24T06:12:23.757 INFO:teuthology.orchestra.run.smithi037.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 938 kB/s | 172 kB 00:00 2023-11-24T06:12:23.786 INFO:teuthology.orchestra.run.smithi188.stdout:(40/147): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 662 kB 00:00 2023-11-24T06:12:23.811 INFO:teuthology.orchestra.run.smithi188.stdout:(41/147): boost-program-options-1.75.0-8.el9.x8 321 kB/s | 106 kB 00:00 2023-11-24T06:12:23.816 INFO:teuthology.orchestra.run.smithi037.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2023-11-24T06:12:23.849 INFO:teuthology.orchestra.run.smithi037.stdout:(107/147): python3-google-auth-2.23.4-1.el9.noa 1.5 MB/s | 197 kB 00:00 2023-11-24T06:12:23.853 INFO:teuthology.orchestra.run.smithi188.stdout:(42/147): elfutils-libelf-devel-0.190-1.el9.x86 104 kB/s | 21 kB 00:00 2023-11-24T06:12:23.874 INFO:teuthology.orchestra.run.smithi037.stdout:(108/147): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2023-11-24T06:12:23.887 INFO:teuthology.orchestra.run.smithi188.stdout:(43/147): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 307 kB 00:00 2023-11-24T06:12:23.916 INFO:teuthology.orchestra.run.smithi037.stdout:(109/147): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2023-11-24T06:12:23.950 INFO:teuthology.orchestra.run.smithi037.stdout:(110/147): python3-jaraco-collections-3.0.0-8.e 232 kB/s | 23 kB 00:00 2023-11-24T06:12:23.975 INFO:teuthology.orchestra.run.smithi037.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2023-11-24T06:12:24.017 INFO:teuthology.orchestra.run.smithi037.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2023-11-24T06:12:24.051 INFO:teuthology.orchestra.run.smithi037.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-11-24T06:12:24.070 INFO:teuthology.orchestra.run.smithi188.stdout:(44/147): flexiblas-3.0.4-8.el9.x86_64.rpm 148 kB/s | 32 kB 00:00 2023-11-24T06:12:24.093 INFO:teuthology.orchestra.run.smithi037.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 351 kB/s | 41 kB 00:00 2023-11-24T06:12:24.168 INFO:teuthology.orchestra.run.smithi037.stdout:(115/147): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2023-11-24T06:12:24.193 INFO:teuthology.orchestra.run.smithi037.stdout:(116/147): python3-logutils-0.3.5-21.el9.noarch 327 kB/s | 46 kB 00:00 2023-11-24T06:12:24.209 INFO:teuthology.orchestra.run.smithi188.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 53 kB/s | 17 kB 00:00 2023-11-24T06:12:24.210 INFO:teuthology.orchestra.run.smithi037.stdout:(117/147): python3-more-itertools-8.12.0-2.el9. 676 kB/s | 79 kB 00:00 2023-11-24T06:12:24.277 INFO:teuthology.orchestra.run.smithi037.stdout:(118/147): python3-natsort-7.1.1-5.el9.noarch.r 534 kB/s | 58 kB 00:00 2023-11-24T06:12:24.304 INFO:teuthology.orchestra.run.smithi188.stdout:(46/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2023-11-24T06:12:24.310 INFO:teuthology.orchestra.run.smithi037.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2023-11-24T06:12:24.329 INFO:teuthology.orchestra.run.smithi188.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 730 kB/s | 186 kB 00:00 2023-11-24T06:12:24.336 INFO:teuthology.orchestra.run.smithi037.stdout:(120/147): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2023-11-24T06:12:24.371 INFO:teuthology.orchestra.run.smithi188.stdout:(48/147): libaio-devel-0.3.111-13.el9.x86_64.rp 66 kB/s | 10 kB 00:00 2023-11-24T06:12:24.386 INFO:teuthology.orchestra.run.smithi037.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 830 kB/s | 90 kB 00:00 2023-11-24T06:12:24.405 INFO:teuthology.orchestra.run.smithi188.stdout:(49/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2023-11-24T06:12:24.411 INFO:teuthology.orchestra.run.smithi037.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2023-11-24T06:12:24.445 INFO:teuthology.orchestra.run.smithi037.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-11-24T06:12:24.447 INFO:teuthology.orchestra.run.smithi188.stdout:(50/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 606 kB/s | 44 kB 00:00 2023-11-24T06:12:24.489 INFO:teuthology.orchestra.run.smithi188.stdout:(51/147): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 661 kB 00:00 2023-11-24T06:12:24.495 INFO:teuthology.orchestra.run.smithi037.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2023-11-24T06:12:24.523 INFO:teuthology.orchestra.run.smithi188.stdout:(52/147): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 578 kB 00:00 2023-11-24T06:12:24.573 INFO:teuthology.orchestra.run.smithi188.stdout:(53/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 206 kB/s | 24 kB 00:00 2023-11-24T06:12:24.621 INFO:teuthology.orchestra.run.smithi037.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 171 kB/s | 36 kB 00:00 2023-11-24T06:12:24.623 INFO:teuthology.orchestra.run.smithi188.stdout:(54/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 357 kB/s | 46 kB 00:00 2023-11-24T06:12:24.648 INFO:teuthology.orchestra.run.smithi188.stdout:(55/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-11-24T06:12:24.671 INFO:teuthology.orchestra.run.smithi037.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 226 kB/s | 51 kB 00:00 2023-11-24T06:12:24.673 INFO:teuthology.orchestra.run.smithi188.stdout:(56/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 217 kB 00:00 2023-11-24T06:12:24.705 INFO:teuthology.orchestra.run.smithi037.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2023-11-24T06:12:24.724 INFO:teuthology.orchestra.run.smithi188.stdout:(57/147): openblas-0.3.21-2.el9.x86_64.rpm 358 kB/s | 34 kB 00:00 2023-11-24T06:12:24.730 INFO:teuthology.orchestra.run.smithi037.stdout:(128/147): python3-websocket-client-1.2.3-2.el9 833 kB/s | 90 kB 00:00 2023-11-24T06:12:24.797 INFO:teuthology.orchestra.run.smithi037.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-11-24T06:12:24.814 INFO:teuthology.orchestra.run.smithi037.stdout:(130/147): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2023-11-24T06:12:24.847 INFO:teuthology.orchestra.run.smithi037.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-11-24T06:12:24.924 INFO:teuthology.orchestra.run.smithi188.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 6.1 MB/s | 1.5 MB 00:00 2023-11-24T06:12:25.025 INFO:teuthology.orchestra.run.smithi037.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2023-11-24T06:12:25.073 INFO:teuthology.orchestra.run.smithi037.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-24T06:12:25.149 INFO:teuthology.orchestra.run.smithi188.stdout:(59/147): openblas-openmp-0.3.21-2.el9.x86_64.r 10 MB/s | 4.7 MB 00:00 2023-11-24T06:12:25.181 INFO:teuthology.orchestra.run.smithi037.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-24T06:12:25.191 INFO:teuthology.orchestra.run.smithi188.stdout:(60/147): postgresql-contrib-13.11-1.el9.x86_64 1.7 MB/s | 811 kB 00:00 2023-11-24T06:12:25.241 INFO:teuthology.orchestra.run.smithi188.stdout:(61/147): postgresql-private-libs-13.11-1.el9.x 441 kB/s | 134 kB 00:00 2023-11-24T06:12:25.273 INFO:teuthology.orchestra.run.smithi037.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 19 MB/s | 1.8 MB 00:00 2023-11-24T06:12:25.316 INFO:teuthology.orchestra.run.smithi037.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 1.0 MB/s | 42 kB 00:00 2023-11-24T06:12:25.399 INFO:teuthology.orchestra.run.smithi037.stdout:(137/147): librados2-18.0.0-7484.ga13ea5ff.el9. 5.7 MB/s | 3.3 MB 00:00 2023-11-24T06:12:25.433 INFO:teuthology.orchestra.run.smithi037.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 2.1 MB/s | 245 kB 00:00 2023-11-24T06:12:25.458 INFO:teuthology.orchestra.run.smithi037.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-24T06:12:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 752 kB/s | 36 kB 00:00 2023-11-24T06:12:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2023-11-24T06:12:25.517 INFO:teuthology.orchestra.run.smithi188.stdout:(62/147): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2023-11-24T06:12:25.550 INFO:teuthology.orchestra.run.smithi188.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 775 kB/s | 228 kB 00:00 2023-11-24T06:12:25.583 INFO:teuthology.orchestra.run.smithi037.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 2.6 MB/s | 255 kB 00:00 2023-11-24T06:12:25.609 INFO:teuthology.orchestra.run.smithi037.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 248 kB/s | 22 kB 00:00 2023-11-24T06:12:25.643 INFO:teuthology.orchestra.run.smithi037.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-24T06:12:25.709 INFO:teuthology.orchestra.run.smithi188.stdout:(64/147): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2023-11-24T06:12:25.751 INFO:teuthology.orchestra.run.smithi037.stdout:(145/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 3.3 MB/s | 3.0 MB 00:00 2023-11-24T06:12:25.751 INFO:teuthology.orchestra.run.smithi188.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 108 kB/s | 24 kB 00:00 2023-11-24T06:12:25.793 INFO:teuthology.orchestra.run.smithi188.stdout:(66/147): python3-jsonpointer-2.0-4.el9.noarch. 79 kB/s | 18 kB 00:00 2023-11-24T06:12:25.819 INFO:teuthology.orchestra.run.smithi188.stdout:(67/147): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-11-24T06:12:25.868 INFO:teuthology.orchestra.run.smithi188.stdout:(68/147): python3-markupsafe-1.1.1-12.el9.x86_6 432 kB/s | 32 kB 00:00 2023-11-24T06:12:25.935 INFO:teuthology.orchestra.run.smithi037.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 3.8 MB/s | 1.2 MB 00:00 2023-11-24T06:12:26.019 INFO:teuthology.orchestra.run.smithi188.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2023-11-24T06:12:26.061 INFO:teuthology.orchestra.run.smithi188.stdout:(70/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 913 kB/s | 217 kB 00:00 2023-11-24T06:12:26.086 INFO:teuthology.orchestra.run.smithi188.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 858 kB/s | 174 kB 00:00 2023-11-24T06:12:26.128 INFO:teuthology.orchestra.run.smithi188.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 393 kB/s | 41 kB 00:00 2023-11-24T06:12:26.162 INFO:teuthology.orchestra.run.smithi188.stdout:(73/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-11-24T06:12:26.187 INFO:teuthology.orchestra.run.smithi188.stdout:(74/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2023-11-24T06:12:26.226 INFO:teuthology.orchestra.run.smithi037.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 3.7 MB/s | 2.2 MB 00:00 2023-11-24T06:12:26.240 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-11-24T06:12:26.241 INFO:teuthology.orchestra.run.smithi037.stdout:Total 13 MB/s | 204 MB 00:15 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi188.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 388 kB/s | 47 kB 00:00 2023-11-24T06:12:26.321 INFO:teuthology.orchestra.run.smithi188.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 324 kB/s | 43 kB 00:00 2023-11-24T06:12:26.474 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-11-24T06:12:26.646 INFO:teuthology.orchestra.run.smithi188.stdout:(77/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2023-11-24T06:12:26.688 INFO:teuthology.orchestra.run.smithi188.stdout:(78/147): python3-toml-0.10.2-6.el9.noarch.rpm 91 kB/s | 39 kB 00:00 2023-11-24T06:12:26.721 INFO:teuthology.orchestra.run.smithi188.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 775 kB/s | 300 kB 00:00 2023-11-24T06:12:26.763 INFO:teuthology.orchestra.run.smithi188.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 771 kB/s | 56 kB 00:00 2023-11-24T06:12:26.771 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-11-24T06:12:26.771 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-11-24T06:12:26.789 INFO:teuthology.orchestra.run.smithi188.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 869 kB/s | 85 kB 00:00 2023-11-24T06:12:26.830 INFO:teuthology.orchestra.run.smithi188.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 63 kB 00:00 2023-11-24T06:12:26.872 INFO:teuthology.orchestra.run.smithi188.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 536 kB/s | 44 kB 00:00 2023-11-24T06:12:26.898 INFO:teuthology.orchestra.run.smithi188.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 734 kB/s | 79 kB 00:00 2023-11-24T06:12:26.948 INFO:teuthology.orchestra.run.smithi188.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2023-11-24T06:12:26.990 INFO:teuthology.orchestra.run.smithi188.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-11-24T06:12:27.023 INFO:teuthology.orchestra.run.smithi188.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 241 kB 00:00 2023-11-24T06:12:27.082 INFO:teuthology.orchestra.run.smithi188.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 8.8 MB/s | 1.1 MB 00:00 2023-11-24T06:12:27.107 INFO:teuthology.orchestra.run.smithi188.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-11-24T06:12:27.133 INFO:teuthology.orchestra.run.smithi188.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-11-24T06:12:27.158 INFO:teuthology.orchestra.run.smithi188.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-24T06:12:27.192 INFO:teuthology.orchestra.run.smithi188.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-24T06:12:27.367 INFO:teuthology.orchestra.run.smithi188.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-11-24T06:12:27.593 INFO:teuthology.orchestra.run.smithi188.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 9.0 MB/s | 4.1 MB 00:00 2023-11-24T06:12:27.759 INFO:teuthology.orchestra.run.smithi188.stdout:(95/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 545 kB/s | 309 kB 00:00 2023-11-24T06:12:27.876 INFO:teuthology.orchestra.run.smithi188.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 430 kB/s | 49 kB 00:00 2023-11-24T06:12:27.918 INFO:teuthology.orchestra.run.smithi188.stdout:(97/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 76 kB/s | 24 kB 00:00 2023-11-24T06:12:27.977 INFO:teuthology.orchestra.run.smithi188.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 678 kB/s | 67 kB 00:00 2023-11-24T06:12:28.185 INFO:teuthology.orchestra.run.smithi188.stdout:(99/147): libarrow-9.0.0-9.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2023-11-24T06:12:28.227 INFO:teuthology.orchestra.run.smithi188.stdout:(100/147): python3-asyncssh-2.13.2-3.el9.noarch 2.1 MB/s | 548 kB 00:00 2023-11-24T06:12:28.303 INFO:teuthology.orchestra.run.smithi188.stdout:(101/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 373 kB/s | 43 kB 00:00 2023-11-24T06:12:28.353 INFO:teuthology.orchestra.run.smithi188.stdout:(102/147): python3-cachetools-4.2.4-1.el9.noarc 257 kB/s | 32 kB 00:00 2023-11-24T06:12:28.403 INFO:teuthology.orchestra.run.smithi188.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 151 kB/s | 15 kB 00:00 2023-11-24T06:12:28.462 INFO:teuthology.orchestra.run.smithi188.stdout:(104/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.5 MB/s | 837 kB 00:00 2023-11-24T06:12:28.487 INFO:teuthology.orchestra.run.smithi188.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-11-24T06:12:28.521 INFO:teuthology.orchestra.run.smithi188.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2023-11-24T06:12:28.588 INFO:teuthology.orchestra.run.smithi188.stdout:(107/147): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-11-24T06:12:28.638 INFO:teuthology.orchestra.run.smithi188.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2023-11-24T06:12:28.688 INFO:teuthology.orchestra.run.smithi188.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2023-11-24T06:12:28.714 INFO:teuthology.orchestra.run.smithi188.stdout:(110/147): python3-google-auth-2.23.4-1.el9.noa 789 kB/s | 197 kB 00:00 2023-11-24T06:12:28.756 INFO:teuthology.orchestra.run.smithi188.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2023-11-24T06:12:28.798 INFO:teuthology.orchestra.run.smithi188.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2023-11-24T06:12:28.848 INFO:teuthology.orchestra.run.smithi188.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 100 kB/s | 9.0 kB 00:00 2023-11-24T06:12:28.898 INFO:teuthology.orchestra.run.smithi188.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 290 kB/s | 41 kB 00:00 2023-11-24T06:12:28.923 INFO:teuthology.orchestra.run.smithi188.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 622 kB/s | 46 kB 00:00 2023-11-24T06:12:28.974 INFO:teuthology.orchestra.run.smithi188.stdout:(116/147): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-11-24T06:12:28.984 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-11-24T06:12:28.985 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-11-24T06:12:28.999 INFO:teuthology.orchestra.run.smithi188.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 774 kB/s | 58 kB 00:00 2023-11-24T06:12:29.024 INFO:teuthology.orchestra.run.smithi188.stdout:(118/147): python3-more-itertools-8.12.0-2.el9. 632 kB/s | 79 kB 00:00 2023-11-24T06:12:29.058 INFO:teuthology.orchestra.run.smithi188.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-11-24T06:12:29.075 INFO:teuthology.orchestra.run.smithi188.stdout:(120/147): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2023-11-24T06:12:29.117 INFO:teuthology.orchestra.run.smithi188.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 977 kB/s | 90 kB 00:00 2023-11-24T06:12:29.134 INFO:teuthology.orchestra.run.smithi188.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2023-11-24T06:12:29.176 INFO:teuthology.orchestra.run.smithi188.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-11-24T06:12:29.193 INFO:teuthology.orchestra.run.smithi188.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2023-11-24T06:12:29.210 INFO:teuthology.orchestra.run.smithi188.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2023-11-24T06:12:29.441 INFO:teuthology.orchestra.run.smithi188.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 193 kB/s | 51 kB 00:00 2023-11-24T06:12:29.477 INFO:teuthology.orchestra.run.smithi188.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 336 kB/s | 90 kB 00:00 2023-11-24T06:12:29.511 INFO:teuthology.orchestra.run.smithi188.stdout:(128/147): python3-webob-1.8.7-6.el9.noarch.rpm 724 kB/s | 230 kB 00:00 2023-11-24T06:12:29.544 INFO:teuthology.orchestra.run.smithi188.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2023-11-24T06:12:29.570 INFO:teuthology.orchestra.run.smithi188.stdout:(130/147): python3-zc-lockfile-2.0-10.el9.noarc 218 kB/s | 20 kB 00:00 2023-11-24T06:12:29.653 INFO:teuthology.orchestra.run.smithi188.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-11-24T06:12:29.720 INFO:teuthology.orchestra.run.smithi188.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2023-11-24T06:12:29.770 INFO:teuthology.orchestra.run.smithi188.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-24T06:12:29.871 INFO:teuthology.orchestra.run.smithi188.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 23 MB/s | 2.2 MB 00:00 2023-11-24T06:12:29.963 INFO:teuthology.orchestra.run.smithi188.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 19 MB/s | 1.8 MB 00:00 2023-11-24T06:12:30.005 INFO:teuthology.orchestra.run.smithi188.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 1.0 MB/s | 42 kB 00:00 2023-11-24T06:12:30.055 INFO:teuthology.orchestra.run.smithi188.stdout:(137/147): NetworkManager-tui-1.45.6-1.el9.x86_ 4.9 MB/s | 245 kB 00:00 2023-11-24T06:12:30.097 INFO:teuthology.orchestra.run.smithi188.stdout:(138/147): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-11-24T06:12:30.139 INFO:teuthology.orchestra.run.smithi188.stdout:(139/147): elfutils-debuginfod-client-0.190-1.e 895 kB/s | 36 kB 00:00 2023-11-24T06:12:30.189 INFO:teuthology.orchestra.run.smithi188.stdout:(140/147): elfutils-libelf-0.190-1.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-11-24T06:12:30.240 INFO:teuthology.orchestra.run.smithi188.stdout:(141/147): elfutils-libs-0.190-1.el9.x86_64.rpm 5.1 MB/s | 255 kB 00:00 2023-11-24T06:12:30.282 INFO:teuthology.orchestra.run.smithi188.stdout:(142/147): libacl-2.3.1-4.el9.x86_64.rpm 537 kB/s | 22 kB 00:00 2023-11-24T06:12:30.332 INFO:teuthology.orchestra.run.smithi188.stdout:(143/147): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2023-11-24T06:12:30.399 INFO:teuthology.orchestra.run.smithi188.stdout:(144/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 4.1 MB/s | 3.0 MB 00:00 2023-11-24T06:12:30.783 INFO:teuthology.orchestra.run.smithi188.stdout:(145/147): openssl-3.0.7-25.el9.x86_64.rpm 2.7 MB/s | 1.2 MB 00:00 2023-11-24T06:12:30.949 INFO:teuthology.orchestra.run.smithi188.stdout:(146/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 3.9 MB/s | 2.2 MB 00:00 2023-11-24T06:12:31.025 INFO:teuthology.orchestra.run.smithi188.stdout:(147/147): librados2-18.0.0-7484.ga13ea5ff.el9. 2.3 MB/s | 3.3 MB 00:01 2023-11-24T06:12:31.039 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-11-24T06:12:31.039 INFO:teuthology.orchestra.run.smithi188.stdout:Total 12 MB/s | 204 MB 00:17 2023-11-24T06:12:31.266 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-11-24T06:12:31.544 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-11-24T06:12:31.544 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-11-24T06:12:33.688 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-11-24T06:12:33.688 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-11-24T06:12:35.535 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-11-24T06:12:35.726 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T06:12:35.759 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T06:12:35.831 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T06:12:35.887 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T06:12:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T06:12:36.014 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T06:12:36.480 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T06:12:36.524 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:12:36.732 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:12:36.775 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:12:36.952 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:12:37.010 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:12:37.082 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T06:12:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T06:12:37.472 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T06:12:37.496 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:12:37.660 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:12:37.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:12:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:12:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T06:12:38.310 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:12:38.399 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:12:38.620 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:12:38.688 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:12:39.137 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:12:39.177 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T06:12:39.281 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T06:12:39.349 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T06:12:39.380 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T06:12:39.434 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T06:12:39.482 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T06:12:39.585 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T06:12:39.651 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T06:12:39.693 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T06:12:39.808 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T06:12:39.846 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T06:12:39.855 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-11-24T06:12:39.899 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T06:12:40.001 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T06:12:40.004 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T06:12:40.040 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T06:12:40.111 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T06:12:40.168 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T06:12:40.180 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T06:12:40.198 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T06:12:40.255 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T06:12:40.291 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T06:12:40.699 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T06:12:40.738 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:12:40.928 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:12:40.973 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:12:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T06:12:41.129 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:12:41.169 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:12:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T06:12:41.242 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T06:12:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T06:12:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T06:12:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T06:12:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T06:12:41.533 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T06:12:41.611 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:12:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T06:12:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T06:12:41.765 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T06:12:41.830 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:12:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T06:12:41.922 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T06:12:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T06:12:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T06:12:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T06:12:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T06:12:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T06:12:42.230 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T06:12:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T06:12:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T06:12:42.385 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:12:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T06:12:42.473 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T06:12:42.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T06:12:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:12:42.673 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T06:12:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:12:42.730 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T06:12:42.863 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T06:12:42.906 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T06:12:42.956 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T06:12:42.988 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T06:12:43.144 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T06:12:43.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T06:12:43.185 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T06:12:43.211 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T06:12:43.281 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T06:12:43.293 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T06:12:43.363 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T06:12:43.364 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T06:12:43.397 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T06:12:43.450 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T06:12:43.497 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T06:12:43.597 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T06:12:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T06:12:43.648 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T06:12:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T06:12:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T06:12:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T06:12:43.863 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T06:12:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T06:12:43.915 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T06:12:43.941 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T06:12:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T06:12:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T06:12:44.020 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T06:12:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T06:12:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T06:12:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T06:12:44.196 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T06:12:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T06:12:44.256 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T06:12:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T06:12:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T06:12:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T06:12:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T06:12:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T06:12:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T06:12:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T06:12:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T06:12:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T06:12:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T06:12:45.029 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T06:12:45.052 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T06:12:45.089 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T06:12:45.122 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T06:12:45.344 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T06:12:45.394 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T06:12:45.468 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T06:12:45.679 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T06:12:45.719 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T06:12:45.865 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T06:12:45.931 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T06:12:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T06:12:46.102 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T06:12:46.124 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T06:12:46.170 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T06:12:46.182 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T06:12:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T06:12:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T06:12:46.237 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T06:12:46.294 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T06:12:46.365 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T06:12:46.434 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T06:12:46.492 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T06:12:46.581 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T06:12:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T06:12:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T06:12:46.699 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T06:12:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T06:12:46.852 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T06:12:46.921 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T06:12:46.977 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T06:12:47.021 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T06:12:47.180 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T06:12:47.242 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T06:12:47.313 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T06:12:47.392 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T06:12:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T06:12:47.640 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T06:12:47.684 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T06:12:47.704 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T06:12:47.876 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T06:12:47.924 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T06:12:47.957 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T06:12:48.004 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T06:12:48.057 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T06:12:48.094 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T06:12:48.136 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T06:12:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T06:12:48.663 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T06:12:48.733 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T06:12:48.852 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T06:12:48.906 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T06:12:48.980 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T06:12:49.059 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T06:12:49.114 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T06:12:49.231 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T06:12:49.274 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T06:12:49.346 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T06:12:49.415 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T06:12:49.481 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T06:12:49.496 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T06:12:49.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T06:12:49.565 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T06:12:49.601 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T06:12:49.644 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T06:12:50.038 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T06:12:50.077 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:12:50.199 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:12:50.233 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T06:12:50.290 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T06:12:50.426 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T06:12:50.497 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T06:12:50.541 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T06:12:50.574 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T06:12:50.803 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T06:12:50.823 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T06:12:50.830 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:12:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T06:12:50.922 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:12:50.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T06:12:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T06:12:51.803 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T06:12:51.945 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T06:12:53.525 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T06:12:53.633 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T06:12:53.670 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T06:12:53.701 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T06:12:53.704 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:12:53.744 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T06:12:53.745 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:12:53.786 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T06:12:54.170 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T06:12:54.199 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:12:54.318 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T06:12:54.346 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T06:12:54.401 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T06:12:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:12:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:12:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:12:54.664 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T06:12:54.665 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T06:12:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:12:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:12:54.874 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T06:12:54.910 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:12:55.000 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T06:12:55.037 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T06:12:57.550 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:12:57.584 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:12:58.206 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T06:12:58.262 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:12:58.482 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T06:12:58.482 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T06:12:58.482 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T06:12:58.482 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:12:58.521 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:13:07.852 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-11-24T06:13:07.853 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:08.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:13:08.152 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:13:08.152 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:08.152 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T06:13:08.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:09.904 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:13:10.003 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:13:10.003 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:10.003 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T06:13:10.003 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:13:10.004 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:13:10.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:10.246 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:13:10.322 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:13:10.323 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:10.323 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T06:13:10.323 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:13:10.323 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:13:10.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:10.839 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:13:10.933 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:13:10.933 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:10.933 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T06:13:10.933 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:13:10.933 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:13:10.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:11.057 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T06:13:11.148 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2023-11-24T06:13:11.149 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:11.360 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:13:11.411 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T06:13:11.411 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:11.411 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T06:13:11.411 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:11.695 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:13:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:13:11.779 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T06:13:11.877 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T06:13:11.920 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:13:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:13:12.296 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:13:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:13:13.227 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T06:13:13.228 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:13.228 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T06:13:13.228 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:13:13.228 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T06:13:13.228 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:13.454 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:13:13.474 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:13:13.519 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:13:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T06:13:13.549 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:13.549 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T06:13:13.549 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:13:13.549 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T06:13:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:13.672 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:13:13.859 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T06:13:13.890 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:13:13.988 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:13:13.988 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:13.988 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T06:13:13.988 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:13:13.988 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:13:13.988 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:14.047 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:13:14.049 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:13:14.092 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:13:14.129 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T06:13:14.129 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:14.129 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T06:13:14.129 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:13:14.129 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T06:13:14.129 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:14.157 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T06:13:14.259 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T06:13:14.859 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:13:14.901 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T06:13:14.946 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T06:13:15.042 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T06:13:15.072 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:13:15.109 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T06:13:15.142 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:13:15.229 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:13:15.229 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:15.229 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T06:13:15.230 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:13:15.230 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:13:15.230 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:15.293 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:13:15.395 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:13:15.395 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:15.395 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T06:13:15.395 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:15.396 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T06:13:15.431 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:13:15.478 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:13:15.564 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:13:15.564 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:15.565 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T06:13:15.565 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:13:15.565 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:13:15.565 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:15.961 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:13:16.040 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:13:16.040 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:16.040 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T06:13:16.040 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:13:16.040 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:13:16.040 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T06:13:16.590 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:13:16.732 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T06:13:16.907 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T06:13:16.971 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:13:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T06:13:17.066 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:17.066 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T06:13:17.066 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:13:17.066 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T06:13:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:13:17.168 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T06:13:17.258 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T06:13:18.188 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T06:13:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:13:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T06:13:18.297 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:18.297 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T06:13:18.297 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:13:18.297 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T06:13:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:18.354 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:13:18.431 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T06:13:18.432 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:18.432 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T06:13:18.432 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:18.504 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:13:18.607 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T06:13:18.608 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:18.608 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T06:13:18.608 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:13:18.608 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T06:13:18.608 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:18.996 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:13:19.067 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T06:13:19.067 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T06:13:19.068 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T06:13:19.068 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:13:19.068 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T06:13:19.068 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:20.410 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T06:13:20.464 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T06:13:20.521 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T06:13:20.559 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T06:13:20.856 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T06:13:20.989 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T06:13:21.021 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T06:13:21.055 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T06:13:21.124 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T06:13:21.174 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T06:13:21.280 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T06:13:21.350 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T06:13:21.390 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T06:13:22.639 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:13:22.687 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:13:22.754 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:13:23.210 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T06:13:23.254 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T06:13:23.309 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T06:13:23.342 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T06:13:23.617 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T06:13:23.734 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T06:13:23.772 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T06:13:23.805 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T06:13:23.845 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T06:13:23.882 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T06:13:23.982 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T06:13:24.044 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T06:13:24.100 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T06:13:24.184 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T06:13:24.302 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T06:13:24.358 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T06:13:24.435 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T06:13:24.599 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T06:13:24.646 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T06:13:24.679 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T06:13:24.714 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T06:13:24.757 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T06:13:24.757 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:13:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:13:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T06:13:25.026 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T06:13:25.067 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T06:13:25.067 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:13:25.169 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:13:25.231 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:13:25.279 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:13:25.288 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T06:13:25.310 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T06:13:25.351 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:13:25.352 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:13:25.677 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:13:25.677 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:13:25.827 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:13:25.863 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T06:13:25.896 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T06:13:25.947 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T06:13:26.081 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:13:26.374 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:13:26.375 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T06:13:26.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:26.612 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T06:13:26.746 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T06:13:26.794 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T06:13:26.864 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T06:13:27.006 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T06:13:27.040 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T06:13:27.073 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T06:13:27.107 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T06:13:27.148 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T06:13:27.148 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:13:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T06:13:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T06:13:27.362 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T06:13:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T06:13:27.395 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:13:27.516 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T06:13:27.546 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T06:13:27.586 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:13:27.587 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:13:27.903 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T06:13:27.903 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:13:28.096 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T06:13:28.132 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T06:13:28.166 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T06:13:28.226 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T06:13:28.353 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:13:28.620 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T06:13:28.620 INFO:teuthology.orchestra.run.smithi188.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T06:13:28.620 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:31.020 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T06:13:31.626 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T06:13:31.626 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T06:13:31.626 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T06:13:31.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T06:13:31.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T06:13:31.629 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T06:13:31.630 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T06:13:31.631 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T06:13:31.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T06:13:31.633 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T06:13:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T06:13:31.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T06:13:31.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T06:13:31.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T06:13:31.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T06:13:31.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T06:13:33.222 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T06:13:33.222 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-11-24T06:13:33.222 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:33.222 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:33.222 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:33.222 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T06:13:33.223 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T06:13:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-16.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T06:13:33.228 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T06:13:33.229 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T06:13:33.230 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T06:13:33.231 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T06:13:33.232 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T06:13:33.233 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.234 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T06:13:33.235 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T06:13:33.236 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-11-24T06:13:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T06:13:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T06:13:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T06:13:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T06:13:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T06:13:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T06:13:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T06:13:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T06:13:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T06:13:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T06:13:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T06:13:33.250 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T06:13:33.251 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T06:13:33.252 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T06:13:33.253 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T06:13:33.254 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T06:13:33.255 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T06:13:33.256 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T06:13:33.257 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T06:13:33.258 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T06:13:33.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T06:13:33.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T06:13:33.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T06:13:33.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T06:13:33.259 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T06:13:33.805 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:35.332 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T06:13:35.332 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:35.332 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2023-11-24T06:13:35.332 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:35.332 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:35.332 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:35.332 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T06:13:35.333 INFO:teuthology.orchestra.run.smithi188.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.334 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.335 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T06:13:35.336 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: jq-1.6-16.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T06:13:35.337 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T06:13:35.338 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.339 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T06:13:35.340 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T06:13:35.341 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T06:13:35.342 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T06:13:35.342 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T06:13:35.342 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T06:13:35.342 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T06:13:35.342 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T06:13:35.342 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T06:13:35.342 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.343 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T06:13:35.344 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T06:13:35.345 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T06:13:35.346 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T06:13:35.346 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:35.346 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-11-24T06:13:35.921 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:35.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:13:36.144 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T06:13:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:13:36.213 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:13:36.213 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T06:13:36.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:13:36.355 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T06:13:36.411 INFO:teuthology.orchestra.run.smithi188.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:13:36.412 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T06:13:36.412 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T06:13:36.412 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T06:13:36.413 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:36.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:13:36.514 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:36.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:13:36.596 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T06:13:36.597 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:36.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:13:36.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:13:36.788 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:36.788 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:13:36.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:13:36.975 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T06:13:36.975 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:36.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:13:37.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:13:37.187 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:37.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:13:37.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:13:37.378 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T06:13:37.378 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:37.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:13:37.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:13:37.583 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:37.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:13:37.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:13:37.789 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T06:13:37.849 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T06:13:37.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-11-24T06:13:37.856 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2023-11-24T06:13:37.933 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T06:13:37.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:13:37.937 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:13:38.011 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T06:13:38.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:13:38.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:13:38.106 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T06:13:38.106 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T06:13:38.106 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T06:13:38.106 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:38.106 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:13:38.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:38.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:38.436 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:38.436 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:13:38.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:38.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:38.765 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T06:13:38.765 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T06:13:38.765 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': None, 'first_in_suite': False, 'job_id': '7465551', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mgr-vol-misc', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3305, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'rishabh-mgr-vol-misc', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5qF7p74YaACFye6SUxwuT6WvUyn9torgEIVYQMzkIKIAJUTWTSVfwaDzWjwxnyAKl9aBcgz4B3OilkZeHPWNU=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJweiEB58igV9ycutzsmY/QeiFksdxoOFacgsEqE6Rv1U8yi5jIsbOJE8kzhcIsnnqsblklgn6xyUB98S9h/MMw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes', 'tasks.cephfs.test_subvolume.TestSubvolume']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_05:41:33', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T06:13:38.766 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:13:38.772 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:13:38.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:13:38.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:13:38.928 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:38.928 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:13:38.967 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:13:38.967 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-11-24T06:13:39.049 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:13:39.049 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:39.050 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-11-24T06:13:39.050 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:39.050 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:39.050 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-11-24 06:13:26.850455392 +0000 2023-11-24T06:13:39.050 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-11-24 06:10:50.079542484 +0000 2023-11-24T06:13:39.050 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-11-24 06:10:50.079542484 +0000 2023-11-24T06:13:39.050 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-11-24 06:10:50.079542484 +0000 2023-11-24T06:13:39.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:13:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-11-24T06:13:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-11-24T06:13:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.00032975 s, 1.6 MB/s 2023-11-24T06:13:39.161 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:13:39.204 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-11-24T06:13:39.283 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-11-24 06:13:26.851455379 +0000 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-11-24 06:10:51.127528354 +0000 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-11-24 06:10:51.127528354 +0000 2023-11-24T06:13:39.284 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-11-24 06:10:51.127528354 +0000 2023-11-24T06:13:39.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:13:39.402 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-11-24T06:13:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-11-24T06:13:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000322086 s, 1.6 MB/s 2023-11-24T06:13:39.405 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:13:39.448 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-11-24T06:13:39.538 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-11-24 06:13:26.852455365 +0000 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-11-24 06:10:52.192513994 +0000 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-11-24 06:10:52.192513994 +0000 2023-11-24T06:13:39.539 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-11-24 06:10:52.192513994 +0000 2023-11-24T06:13:39.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:13:39.660 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-11-24T06:13:39.660 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-11-24T06:13:39.660 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000327925 s, 1.6 MB/s 2023-11-24T06:13:39.663 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:13:39.710 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-11-24 06:13:26.853455352 +0000 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-11-24 06:10:53.238499890 +0000 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-11-24 06:10:53.238499890 +0000 2023-11-24T06:13:39.753 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-11-24 06:10:53.238499890 +0000 2023-11-24T06:13:39.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:13:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-11-24T06:13:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-11-24T06:13:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000333757 s, 1.5 MB/s 2023-11-24T06:13:39.887 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:13:39.937 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:13:39.938 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:39.938 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:13:39.986 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:13:39.986 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-11-24 06:13:29.074848127 +0000 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-11-24 06:10:20.012598726 +0000 2023-11-24T06:13:40.070 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-11-24 06:10:20.012598726 +0000 2023-11-24T06:13:40.070 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-11-24 06:10:20.012598726 +0000 2023-11-24T06:13:40.070 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:13:40.186 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-11-24T06:13:40.186 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-11-24T06:13:40.186 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000355176 s, 1.4 MB/s 2023-11-24T06:13:40.189 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:13:40.232 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-11-24 06:13:29.075848109 +0000 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-11-24 06:10:21.030579762 +0000 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-11-24 06:10:21.030579762 +0000 2023-11-24T06:13:40.313 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-11-24 06:10:21.030579762 +0000 2023-11-24T06:13:40.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:13:40.447 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-11-24T06:13:40.448 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-11-24T06:13:40.448 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000375475 s, 1.4 MB/s 2023-11-24T06:13:40.452 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:13:40.510 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-11-24 06:13:29.076848090 +0000 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-11-24 06:10:22.022561282 +0000 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-11-24 06:10:22.022561282 +0000 2023-11-24T06:13:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-11-24 06:10:22.022561282 +0000 2023-11-24T06:13:40.556 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:13:40.668 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-11-24T06:13:40.668 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-11-24T06:13:40.668 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000742132 s, 690 kB/s 2023-11-24T06:13:40.671 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:13:40.712 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2023-11-24T06:13:40.795 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:13:40.795 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:13:40.796 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-11-24T06:13:40.796 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:13:40.796 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:13:40.796 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2023-11-24 06:13:29.077848071 +0000 2023-11-24T06:13:40.796 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2023-11-24 06:10:23.035542411 +0000 2023-11-24T06:13:40.796 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2023-11-24 06:10:23.035542411 +0000 2023-11-24T06:13:40.796 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2023-11-24 06:10:23.035542411 +0000 2023-11-24T06:13:40.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:13:40.906 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2023-11-24T06:13:40.906 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2023-11-24T06:13:40.906 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000268161 s, 1.9 MB/s 2023-11-24T06:13:40.909 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:13:40.951 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:13:40.952 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:13:40.952 INFO:tasks.ceph:Generating config... 2023-11-24T06:13:40.953 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T06:13:40.953 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T06:13:40.953 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T06:13:40.953 INFO:tasks.ceph:[client] pid file = 2023-11-24T06:13:40.954 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T06:13:40.954 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T06:13:40.954 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T06:13:40.954 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T06:13:40.955 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T06:13:40.955 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T06:13:40.955 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T06:13:40.955 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T06:13:40.955 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T06:13:40.956 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T06:13:40.957 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T06:13:40.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T06:13:41.113 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T06:13:41.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T06:13:41.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:13:41.353 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.188'), ('mon.c', '[v2:172.21.15.188:3301,v1:172.21.15.188:6790]')] 2023-11-24T06:13:41.353 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T06:13:41.354 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:41.354 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:13:41.409 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.188 --addv c '[v2:172.21.15.188:3301,v1:172.21.15.188:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:41.575 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:41.575 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3 2023-11-24T06:13:41.575 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:fsid f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-11-24T06:13:41.573854+0000 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-11-24T06:13:41.573854+0000 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.b 2023-11-24T06:13:41.576 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] mon.c 2023-11-24T06:13:41.577 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T06:13:41.579 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:13:41.634 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3... 2023-11-24T06:13:41.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:13:41.641 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:13:41.811 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2023-11-24T06:13:41.811 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2023-11-24T06:13:41.811 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:13:41.811 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2023-11-24T06:13:41.811 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.812 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:13:41.813 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.37,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2023-11-24T06:13:41.814 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on skipped message = False 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2023-11-24T06:13:41.815 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.816 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2023-11-24T06:13:41.817 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-11-24T06:13:41.818 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug finisher = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-11-24T06:13:41.819 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:13:41.820 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: mon op complaint time = 120 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:13:41.821 INFO:teuthology.orchestra.run.smithi188.stdout: client mount timeout = 600 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = "" 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2023-11-24T06:13:41.822 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds balancer = 20 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug frag = True 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug scatterstat = True 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: mds op complaint time = 180 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: mds verify scatter = True 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2023-11-24T06:13:41.823 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-11-24T06:13:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-11-24T06:13:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-11-24T06:13:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-11-24T06:13:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-11-24T06:13:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:13:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug finisher = 20 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-11-24T06:13:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:13:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-11-24T06:13:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-11-24T06:13:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-11-24T06:13:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-11-24T06:13:41.870 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T06:13:41.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T06:13:42.027 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T06:13:42.027 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:42.028 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T06:13:42.085 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:42.085 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T06:13:42.139 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:13:42.139 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:42.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:13:42.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:13:42.302 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:13:42.302 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:42.404 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:13:42.405 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:42.405 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:13:42.405 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:13:42.562 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:13:42.563 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:42.654 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T06:13:42.654 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T06:13:42.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:13:42.855 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:13:42.866 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:13:43.039 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:13:43.049 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T06:13:43.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:13:43.252 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:13:43.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T06:13:43.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:13:43.553 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:13:43.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T06:13:43.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:13:43.844 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:13:43.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T06:13:43.947 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:13:44.124 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:13:44.133 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T06:13:44.229 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T06:13:44.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T06:13:44.372 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T06:13:44.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T06:13:44.569 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T06:13:44.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T06:13:44.754 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T06:13:44.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T06:13:44.934 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T06:13:44.995 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T06:13:44.995 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:13:44.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T06:13:45.106 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:13:45.106 INFO:tasks.ceph:role: osd.0 2023-11-24T06:13:45.106 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:13:45.106 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:13:45.216 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:13:45.216 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:13:45.216 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:13:45.216 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:13:45.216 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:13:45.217 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:13:45.217 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:13:45.217 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:13:45.217 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:13:45.217 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:13:45.731 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-11-24T06:13:45.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-11-24T06:13:45.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T06:13:45.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T06:13:46.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T06:13:46.124 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:13:46.124 INFO:tasks.ceph:role: osd.1 2023-11-24T06:13:46.124 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:13:46.124 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:13:46.234 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:13:46.234 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:13:46.234 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:13:46.234 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:13:46.235 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:13:46.235 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:13:46.235 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:13:46.235 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:13:46.235 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:13:46.235 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:13:46.710 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-11-24T06:13:46.717 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-11-24T06:13:46.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T06:13:46.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T06:13:46.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T06:13:47.042 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:13:47.042 INFO:tasks.ceph:role: osd.2 2023-11-24T06:13:47.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:13:47.042 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:13:47.150 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:13:47.150 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:13:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:13:47.659 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-11-24T06:13:47.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-11-24T06:13:47.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T06:13:47.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T06:13:47.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T06:13:48.071 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:13:48.071 INFO:tasks.ceph:role: osd.3 2023-11-24T06:13:48.071 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:13:48.071 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:13:48.181 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:13:48.182 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:13:48.653 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-11-24T06:13:48.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-11-24T06:13:48.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T06:13:48.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T06:13:48.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:49.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:49.085+0000 7faae5f9f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T06:13:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:49.090+0000 7faae5f9f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T06:13:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:49.090+0000 7faae5f9f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:13:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:49.090+0000 7faae5f9f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:13:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:49.090+0000 7faae5f9f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:13:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:49.098+0000 7faae5f9f500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T06:13:52.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T06:13:52.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:52.551+0000 7f047980e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T06:13:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:52.552+0000 7f047980e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T06:13:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:52.552+0000 7f047980e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:13:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:52.552+0000 7f047980e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:13:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:52.552+0000 7f047980e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:13:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:52.554+0000 7f047980e500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T06:13:55.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T06:13:55.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:55.992+0000 7f1507a25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T06:13:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:55.993+0000 7f1507a25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T06:13:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:55.993+0000 7f1507a25500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:13:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:55.993+0000 7f1507a25500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:13:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:55.993+0000 7f1507a25500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:13:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:55.995+0000 7f1507a25500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T06:13:59.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T06:13:59.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:59.424+0000 7f274bc21500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T06:13:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:59.425+0000 7f274bc21500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T06:13:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:59.425+0000 7f274bc21500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:13:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:59.425+0000 7f274bc21500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:13:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:59.425+0000 7f274bc21500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:13:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:13:59.427+0000 7f274bc21500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T06:14:02.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T06:14:02.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T06:14:02.818 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:14:02.818 INFO:tasks.ceph:role: osd.4 2023-11-24T06:14:02.818 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:14:02.818 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:14:02.921 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:14:02.921 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:14:02.921 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:14:02.921 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:14:02.922 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:14:02.922 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:14:02.922 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:14:02.922 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:14:02.922 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:14:02.922 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:14:03.432 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-11-24T06:14:03.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-11-24T06:14:03.437 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T06:14:03.605 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T06:14:03.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T06:14:03.780 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:14:03.780 INFO:tasks.ceph:role: osd.5 2023-11-24T06:14:03.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:14:03.781 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:14:03.870 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:14:03.870 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:14:03.870 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:14:03.870 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:14:03.870 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:14:03.871 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:14:03.871 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:14:03.871 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:14:03.871 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:14:03.871 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:14:04.339 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-11-24T06:14:04.345 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-11-24T06:14:04.345 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T06:14:04.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T06:14:04.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T06:14:04.635 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:14:04.635 INFO:tasks.ceph:role: osd.6 2023-11-24T06:14:04.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:14:04.635 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:14:04.720 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:14:04.720 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:14:04.720 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:14:04.720 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:14:04.720 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:14:04.721 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:14:04.721 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:14:04.721 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:14:04.721 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:14:04.721 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:14:05.235 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-11-24T06:14:05.240 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-11-24T06:14:05.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T06:14:05.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T06:14:05.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T06:14:05.597 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:14:05.598 INFO:tasks.ceph:role: osd.7 2023-11-24T06:14:05.598 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:14:05.598 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:14:05.696 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:14:05.696 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:14:05.696 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:14:05.696 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T06:14:05.696 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:14:05.696 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:14:05.696 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:14:05.697 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T06:14:05.697 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:14:05.697 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:14:06.166 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2023-11-24T06:14:06.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2023-11-24T06:14:06.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T06:14:06.311 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T06:14:06.398 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:14:06.534 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:06.532+0000 7f6e7ae16500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T06:14:06.541 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:06.538+0000 7f6e7ae16500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T06:14:06.541 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:06.538+0000 7f6e7ae16500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:14:06.541 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:06.538+0000 7f6e7ae16500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:14:06.541 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:06.538+0000 7f6e7ae16500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:14:06.543 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:06.541+0000 7f6e7ae16500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T06:14:08.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:08.776 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:09.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T06:14:09.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:14:09.691 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:09.689+0000 7f65c322a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T06:14:09.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:09.690+0000 7f65c322a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T06:14:09.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:09.690+0000 7f65c322a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:14:09.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:09.690+0000 7f65c322a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:14:09.692 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:09.690+0000 7f65c322a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:14:09.694 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:09.692+0000 7f65c322a500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T06:14:12.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T06:14:12.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:14:13.119 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:13.117+0000 7f512aa27500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T06:14:13.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:13.117+0000 7f512aa27500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T06:14:13.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:13.117+0000 7f512aa27500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:14:13.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:13.118+0000 7f512aa27500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:14:13.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:13.118+0000 7f512aa27500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:14:13.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:13.120+0000 7f512aa27500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T06:14:16.040 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T06:14:16.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:14:16.279 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:16.276+0000 7fcacd212500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T06:14:16.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:16.277+0000 7fcacd212500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T06:14:16.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:16.277+0000 7fcacd212500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:14:16.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:16.277+0000 7fcacd212500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:14:16.280 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:16.277+0000 7fcacd212500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:14:16.282 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:16.279+0000 7fcacd212500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T06:14:19.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T06:14:19.548 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T06:14:19.548 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:19.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T06:14:19.659 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:19.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T06:14:19.763 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:19.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T06:14:19.866 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:19.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T06:14:19.969 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:19.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T06:14:20.067 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:20.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T06:14:20.159 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:20.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T06:14:20.253 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:20.253 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T06:14:20.353 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:20.353 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T06:14:20.447 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:20.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T06:14:20.542 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:20.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T06:14:20.632 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:20.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T06:14:20.727 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:20.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T06:14:20.823 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:21.081 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T06:14:21.182 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:21.183 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T06:14:21.245 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:21.246 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T06:14:21.302 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:21.302 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T06:14:21.357 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:21.357 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T06:14:21.408 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T06:14:21.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:14:21.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.y] 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAWP2Bl+PLrMhAA6Gc/HfKd/LAjoPsOGI1O6w== 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAXP2BlgknvDhAAb5FktSscZfBXGBuKWouBXA== 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAXP2Bl9wrhIBAAp1rkuZvYeDseCqvLIHzS3g== 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2023-11-24T06:14:21.509 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAdP2Blh/MmBRAAwJHTQ1wwlmIGG8B26AeHJw== 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAgP2BlWl7zIBAAat/1A8KGpPpqC1cmaGGN6g== 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAjP2Bl4Rk7OxAAJ86tWyBRTgnF5nyjFqTOKA== 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.3] 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAnP2BlpK9fGRAANr9PMAxN1uBbcKllLiUluA== 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.x] 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAXP2BlCBlAAhAATR60ipjSv9JZI4d7vH8t9Q== 2023-11-24T06:14:21.510 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAXP2BlJjg6MhAANLI6BPtnpgIn9G0CEPxTVQ== 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAYP2BlurVTBxAAgadZStT24OMDy63I86vTUA== 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.4] 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAuP2Bl1izGHxAAXjn5+EnnFQOnKxiuDeg1Ug== 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.5] 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAxP2BlSpciKRAAG5p7jzKUX0CDLhPbPGpV2g== 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.6] 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQA1P2BlTZUKBxAAYSXZ0hoJrqzN5I6NkT4RrA== 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.7] 2023-11-24T06:14:21.511 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQA4P2Bluo2REBAAnUZSYi+3ENutNfPVGxF8oQ== 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA== 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout:[client.2] 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAYP2BlLSTWIRAAntWBgOa+b6RFdEH4Jb9BjQ== 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout:[client.1] 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAYP2BlhpPeLBAA+FETlJwFxw/Un58VF8KxtQ== 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout:[client.3] 2023-11-24T06:14:21.512 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQAYP2BlIx2bNxAASM7PdeBoVMXV+iLedKvdfA== 2023-11-24T06:14:21.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-11-24T06:14:21.513 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAWP2Bl+PLrMhAA6Gc/HfKd/LAjoPsOGI1O6w== 2023-11-24T06:14:21.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-11-24T06:14:21.513 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAXP2BlgknvDhAAb5FktSscZfBXGBuKWouBXA== 2023-11-24T06:14:21.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAXP2Bl9wrhIBAAp1rkuZvYeDseCqvLIHzS3g== 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAdP2Blh/MmBRAAwJHTQ1wwlmIGG8B26AeHJw== 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAgP2BlWl7zIBAAat/1A8KGpPpqC1cmaGGN6g== 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAjP2Bl4Rk7OxAAJ86tWyBRTgnF5nyjFqTOKA== 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-11-24T06:14:21.514 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAnP2BlpK9fGRAANr9PMAxN1uBbcKllLiUluA== 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAXP2BlCBlAAhAATR60ipjSv9JZI4d7vH8t9Q== 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAXP2BlJjg6MhAANLI6BPtnpgIn9G0CEPxTVQ== 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2BlurVTBxAAgadZStT24OMDy63I86vTUA== 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAuP2Bl1izGHxAAXjn5+EnnFQOnKxiuDeg1Ug== 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAxP2BlSpciKRAAG5p7jzKUX0CDLhPbPGpV2g== 2023-11-24T06:14:21.515 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA1P2BlTZUKBxAAYSXZ0hoJrqzN5I6NkT4RrA== 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA4P2Bluo2REBAAnUZSYi+3ENutNfPVGxF8oQ== 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA== 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2BlLSTWIRAAntWBgOa+b6RFdEH4Jb9BjQ== 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2BlhpPeLBAA+FETlJwFxw/Un58VF8KxtQ== 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-11-24T06:14:21.516 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2BlIx2bNxAASM7PdeBoVMXV+iLedKvdfA== 2023-11-24T06:14:21.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:14:21.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:14:21.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:21.679 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:21.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:21.835 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:21.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:21.985 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:22.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:22.141 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:22.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:22.299 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:22.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:22.454 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:22.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:14:22.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:14:22.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:22.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:22.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:22.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:14:23.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.061 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:14:23.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:23.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:23.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:23.843 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:23.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:24.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:24.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:24.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:14:24.309 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T06:14:24.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T06:14:24.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:14:24.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T06:14:24.674 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T06:14:24.774 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:14:24.928 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T06:14:25.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T06:14:25.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:14:25.254 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T06:14:25.346 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:14:25.355 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:14:25.412 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T06:14:25.413 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T06:14:25.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T06:14:25.419 INFO:tasks.ceph.mon.a:Started 2023-11-24T06:14:25.419 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T06:14:25.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T06:14:25.424 INFO:tasks.ceph.mon.b:Started 2023-11-24T06:14:25.424 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T06:14:25.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T06:14:25.430 INFO:tasks.ceph.mon.c:Started 2023-11-24T06:14:25.430 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T06:14:25.430 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T06:14:25.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T06:14:25.435 INFO:tasks.ceph.mgr.y:Started 2023-11-24T06:14:25.436 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T06:14:25.436 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T06:14:25.441 INFO:tasks.ceph.mgr.x:Started 2023-11-24T06:14:25.441 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T06:14:25.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T06:14:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.631+0000 7feeb9b0f640 1 Processor -- start 2023-11-24T06:14:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.631+0000 7feeb9b0f640 1 -- start start 2023-11-24T06:14:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.632+0000 7feeb9b0f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7feeb41616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.632+0000 7feeb9b0f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb4161ce0 con 0x7feeb415d270 2023-11-24T06:14:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.632+0000 7feeb9b0f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb4161fc0 con 0x7feeb40ceb10 2023-11-24T06:14:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.632+0000 7feeb9b0f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40ce310 con 0x7feeb4161260 2023-11-24T06:14:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.633+0000 7feeb37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feeb415d270 0x7feeb415d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36880/0 (socket says 172.21.15.37:36880) 2023-11-24T06:14:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.633+0000 7feeb2ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7feeb41616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.633+0000 7feeb37fe640 1 -- 172.21.15.37:0/3547948995 learned_addr learned my addr 172.21.15.37:0/3547948995 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.633+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 msgr2=0x7feeb41616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T06:14:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.633+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 msgr2=0x7feeb41616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T06:14:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.633+0000 7feeb2ffd640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7feeb41616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T06:14:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.633+0000 7feeb2ffd640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7feeb41616c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T06:14:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.638+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916422131 0 0) 0x7feeb4161ce0 con 0x7feeb415d270 2023-11-24T06:14:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.638+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee9c003520 con 0x7feeb415d270 2023-11-24T06:14:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404629866 0 0) 0x7fee9c003520 con 0x7feeb415d270 2023-11-24T06:14:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 msgr2=0x7feeb41616c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:14:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7feeb41616c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 >> v1:172.21.15.188:6789/0 conn(0x7feeb40ceb10 legacy=0x7feeb40d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40ce5f0 con 0x7feeb415d270 2023-11-24T06:14:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7feea4001670 con 0x7feeb415d270 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 >> v1:172.21.15.37:6789/0 conn(0x7feeb415d270 legacy=0x7feeb415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7fee9c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee9c004020 0x7fee9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee9c004d00 0x7fee9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40ce310 con 0x7fee9c004d00 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c00bbc0 con 0x7fee9c004020 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c00bd80 con 0x7feeb4161260 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb37fe640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7fee9c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.639+0000 7feeb2ffd640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee9c004020 0x7fee9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.640+0000 7feeb3fff640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee9c004d00 0x7fee9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.640+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 msgr2=0x7fee9c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.640+0000 7feeb2ffd640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feeb4161260 0x7fee9c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.640+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3547948995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee9c004d00 msgr2=0x7fee9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.640+0000 7feeb2ffd640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee9c004d00 0x7fee9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.640+0000 7feeb2ffd640 1 -- 172.21.15.37:0/3547948995 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c003520 con 0x7fee9c004020 2023-11-24T06:14:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.640+0000 7feeb3fff640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee9c004d00 0x7fee9c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:25.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.641+0000 7feeb2ffd640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee9c004020 0x7fee9c0047c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feea800b9e0 tx=0x7fee9c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe20d535c29c1a6b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.642+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8032620 con 0x7fee9c004020 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.642+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8032780 con 0x7fee9c004020 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.642+0000 7feeb27fc640 1 -- 172.21.15.37:0/3547948995 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8032b70 con 0x7fee9c004020 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.643+0000 7feeb9b0f640 1 -- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee9c004020 msgr2=0x7fee9c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.643+0000 7feeb9b0f640 1 --2- 172.21.15.37:0/3547948995 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee9c004020 0x7fee9c0047c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feea800b9e0 tx=0x7fee9c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.643+0000 7feeb3fff640 1 -- 172.21.15.37:0/3547948995 reap_dead start 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.643+0000 7feeb9b0f640 1 -- 172.21.15.37:0/3547948995 shutdown_connections 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.643+0000 7feeb9b0f640 1 -- 172.21.15.37:0/3547948995 >> 172.21.15.37:0/3547948995 conn(0x7feeb408af60 msgr2=0x7feeb409c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.643+0000 7feeb9b0f640 1 -- 172.21.15.37:0/3547948995 shutdown_connections 2023-11-24T06:14:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.643+0000 7feeb9b0f640 1 -- 172.21.15.37:0/3547948995 wait complete. 2023-11-24T06:14:25.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.645+0000 7feeb9b0f640 1 Processor -- start 2023-11-24T06:14:25.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.645+0000 7feeb9b0f640 1 -- start start 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb9b0f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee9c004020 0x7feeb40b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb9b0f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feeb40b8100 0x7feeb4158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb9b0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb40b0d60 0x7feeb40b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb9b0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb415f8f0 con 0x7feeb40b0d60 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb9b0f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb415d650 con 0x7feeb40b8100 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb9b0f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40b1720 con 0x7fee9c004020 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb40b0d60 0x7feeb40b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.646+0000 7feeb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb40b0d60 0x7feeb40b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36424/0 (socket says 172.21.15.37:36424) 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb3fff640 1 -- 172.21.15.37:0/401280497 learned_addr learned my addr 172.21.15.37:0/401280497 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb2ffd640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feeb40b8100 0x7feeb4158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb37fe640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee9c004020 0x7feeb40b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb3fff640 1 -- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee9c004020 msgr2=0x7feeb40b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb3fff640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee9c004020 0x7feeb40b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb3fff640 1 -- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feeb40b8100 msgr2=0x7feeb4158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb3fff640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feeb40b8100 0x7feeb4158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb3fff640 1 -- 172.21.15.37:0/401280497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40b6610 con 0x7feeb40b0d60 2023-11-24T06:14:25.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.647+0000 7feeb3fff640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb40b0d60 0x7feeb40b11e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feeb40ca450 tx=0x7feeac00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.648+0000 7fee9bfff640 1 -- 172.21.15.37:0/401280497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003b80 con 0x7feeb40b0d60 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.648+0000 7fee9bfff640 1 -- 172.21.15.37:0/401280497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac003d00 con 0x7feeb40b0d60 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.648+0000 7fee9bfff640 1 -- 172.21.15.37:0/401280497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac00d9b0 con 0x7feeb40b0d60 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.648+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb40b68f0 con 0x7feeb40b0d60 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.648+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb40b6eb0 con 0x7feeb40b0d60 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.648+0000 7fee9bfff640 1 -- 172.21.15.37:0/401280497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feeac0050d0 con 0x7feeb40b0d60 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.648+0000 7fee9bfff640 1 -- 172.21.15.37:0/401280497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feeac01d530 con 0x7feeb40b0d60 2023-11-24T06:14:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.649+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb40d11e0 con 0x7feeb40b0d60 2023-11-24T06:14:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.652+0000 7fee9bfff640 1 -- 172.21.15.37:0/401280497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7feeac001a70 con 0x7feeb40b0d60 2023-11-24T06:14:25.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.724+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7feeb404e8b0 con 0x7feeb40b0d60 2023-11-24T06:14:25.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.728+0000 7fee9bfff640 1 -- 172.21.15.37:0/401280497 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7feeac005510 con 0x7feeb40b0d60 2023-11-24T06:14:25.731 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-11-24T06:14:25.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.729+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb40b0d60 msgr2=0x7feeb40b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.729+0000 7feeb9b0f640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb40b0d60 0x7feeb40b11e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feeb40ca450 tx=0x7feeac00ff70 comp rx=0 tx=0).stop 2023-11-24T06:14:25.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.729+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 shutdown_connections 2023-11-24T06:14:25.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.729+0000 7feeb9b0f640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feeb40b8100 0x7feeb4158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.730+0000 7feeb9b0f640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb40b0d60 0x7feeb40b11e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.730+0000 7feeb9b0f640 1 --2- 172.21.15.37:0/401280497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee9c004020 0x7feeb40b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.730+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 >> 172.21.15.37:0/401280497 conn(0x7feeb408af60 msgr2=0x7feeb415b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.730+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 shutdown_connections 2023-11-24T06:14:25.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:25.730+0000 7feeb9b0f640 1 -- 172.21.15.37:0/401280497 wait complete. 2023-11-24T06:14:25.751 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T06:14:25.751 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T06:14:25.751 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:25.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T06:14:25.841 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:25.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T06:14:25.915 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:25.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T06:14:26.051 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:14:26.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T06:14:26.150 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:26.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T06:14:26.242 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:26.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T06:14:26.371 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:26.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T06:14:26.377 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:26.375+0000 7f7bf2448040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:14:26.408 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:26.404+0000 7fb317832040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:14:26.444 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:26.442+0000 7f7bf2448040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:14:26.464 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:14:26.464 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T06:14:26.475 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:26.472+0000 7fb317832040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:14:26.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new c7ff11bf-51c8-47f0-8426-8d4005839088 0 2023-11-24T06:14:26.791 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.787+0000 7f619ef7c640 1 Processor -- start 2023-11-24T06:14:26.791 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.788+0000 7f619ef7c640 1 -- start start 2023-11-24T06:14:26.793 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f619ef7c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f61980d3a40 0x7f619806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.793 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f619ef7c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61980b1ed0 0x7f619806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.793 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f619ef7c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619815db00 con 0x7f619815d720 2023-11-24T06:14:26.793 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f619ef7c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980d0ce0 con 0x7f61980b1ed0 2023-11-24T06:14:26.793 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f619ef7c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619806d400 con 0x7f61980d3a40 2023-11-24T06:14:26.793 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f6197fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f61980d3a40 0x7f619806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.793 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f6197fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f61980d3a40 0x7f619806ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:54796/0 (socket says 172.21.15.188:54796) 2023-11-24T06:14:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.789+0000 7f6197fff640 1 -- 172.21.15.188:0/3388324441 learned_addr learned my addr 172.21.15.188:0/3388324441 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.790+0000 7f619d519640 1 --2- 172.21.15.188:0/3388324441 >> v2:172.21.15.37:3300/0 conn(0x7f61980b1ed0 0x7f619806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.790+0000 7f6197fff640 1 -- 172.21.15.188:0/3388324441 >> v2:172.21.15.37:3300/0 conn(0x7f61980b1ed0 msgr2=0x7f619806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.790+0000 7f6197fff640 1 --2- 172.21.15.188:0/3388324441 >> v2:172.21.15.37:3300/0 conn(0x7f61980b1ed0 0x7f619806bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.790+0000 7f6197fff640 1 -- 172.21.15.188:0/3388324441 >> v1:172.21.15.37:6789/0 conn(0x7f619815d720 legacy=0x7f61980d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.790+0000 7f6197fff640 1 -- 172.21.15.188:0/3388324441 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980b0100 con 0x7f61980d3a40 2023-11-24T06:14:26.794 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.790+0000 7f619d519640 1 --2- 172.21.15.188:0/3388324441 >> v2:172.21.15.37:3300/0 conn(0x7f61980b1ed0 0x7f619806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:26.795 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.791+0000 7f6197fff640 1 --2- 172.21.15.188:0/3388324441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61980d3a40 0x7f619806ba80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f619808d3a0 tx=0x7f618c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a244028db514c62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.795 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.791+0000 7f61977fe640 1 -- 172.21.15.188:0/3388324441 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0317e0 con 0x7f61980d3a40 2023-11-24T06:14:26.795 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.791+0000 7f61977fe640 1 -- 172.21.15.188:0/3388324441 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c031940 con 0x7f61980d3a40 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.791+0000 7f61977fe640 1 -- 172.21.15.188:0/3388324441 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c031cd0 con 0x7f61980d3a40 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 -- 172.21.15.188:0/3388324441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61980d3a40 msgr2=0x7f619806ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 --2- 172.21.15.188:0/3388324441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61980d3a40 0x7f619806ba80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f619808d3a0 tx=0x7f618c02b880 comp rx=0 tx=0).stop 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 -- 172.21.15.188:0/3388324441 shutdown_connections 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 --2- 172.21.15.188:0/3388324441 >> v2:172.21.15.37:3300/0 conn(0x7f61980b1ed0 0x7f619806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 --2- 172.21.15.188:0/3388324441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61980d3a40 0x7f619806ba80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 -- 172.21.15.188:0/3388324441 >> 172.21.15.188:0/3388324441 conn(0x7f619808af60 msgr2=0x7f619809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 -- 172.21.15.188:0/3388324441 shutdown_connections 2023-11-24T06:14:26.796 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.792+0000 7f619ef7c640 1 -- 172.21.15.188:0/3388324441 wait complete. 2023-11-24T06:14:26.797 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.794+0000 7f619ef7c640 1 Processor -- start 2023-11-24T06:14:26.797 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.794+0000 7f619ef7c640 1 -- start start 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619ef7c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61980b1ed0 0x7f6198160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619ef7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980d3a40 0x7f61980c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619ef7c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619815d720 0x7f6198156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619ef7c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619815e4f0 con 0x7f61980d3a40 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619ef7c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980c7e50 con 0x7f619815d720 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619ef7c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6198157520 con 0x7f61980b1ed0 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619815d720 0x7f6198156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619815d720 0x7f6198156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:54798/0 (socket says 172.21.15.188:54798) 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 -- 172.21.15.188:0/2978683594 learned_addr learned my addr 172.21.15.188:0/2978683594 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f6197fff640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980d3a40 0x7f61980c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619cd18640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61980b1ed0 0x7f6198160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.799 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 -- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61980b1ed0 msgr2=0x7f6198160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.800 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61980b1ed0 0x7f6198160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.800 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 -- 172.21.15.188:0/2978683594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980d3a40 msgr2=0x7f61980c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.800 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980d3a40 0x7f61980c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.800 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f619d519640 1 -- 172.21.15.188:0/2978683594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0094d0 con 0x7f619815d720 2023-11-24T06:14:26.800 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.795+0000 7f6197fff640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980d3a40 0x7f61980c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f619d519640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619815d720 0x7f6198156fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f619000cea0 tx=0x7f619000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f61957fa640 1 -- 172.21.15.188:0/2978683594 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190003b90 con 0x7f619815d720 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f61957fa640 1 -- 172.21.15.188:0/2978683594 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190003d10 con 0x7f619815d720 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f61957fa640 1 -- 172.21.15.188:0/2978683594 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190004260 con 0x7f619815d720 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61980c8040 con 0x7f619815d720 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619815e110 con 0x7f619815d720 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f61957fa640 1 -- 172.21.15.188:0/2978683594 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f61900046c0 con 0x7f619815d720 2023-11-24T06:14:26.801 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.796+0000 7f61957fa640 1 -- 172.21.15.188:0/2978683594 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6190015440 con 0x7f619815d720 2023-11-24T06:14:26.802 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.797+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61980d1870 con 0x7f619815d720 2023-11-24T06:14:26.803 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.800+0000 7f61957fa640 1 -- 172.21.15.188:0/2978683594 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6190023060 con 0x7f619815d720 2023-11-24T06:14:26.882 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.878+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7ff11bf-51c8-47f0-8426-8d4005839088", "id": 0} v 0) v1 -- 0x7f619815dc90 con 0x7f619815d720 2023-11-24T06:14:26.887 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.884+0000 7f61957fa640 1 -- 172.21.15.188:0/2978683594 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7ff11bf-51c8-47f0-8426-8d4005839088", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f619815dc90 con 0x7f619815d720 2023-11-24T06:14:26.888 INFO:teuthology.orchestra.run.smithi188.stdout:0 2023-11-24T06:14:26.889 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619815d720 msgr2=0x7f6198156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.889 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619815d720 0x7f6198156fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f619000cea0 tx=0x7f619000cf90 comp rx=0 tx=0).stop 2023-11-24T06:14:26.889 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 shutdown_connections 2023-11-24T06:14:26.890 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619815d720 0x7f6198156fe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.890 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980d3a40 0x7f61980c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.890 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 --2- 172.21.15.188:0/2978683594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61980b1ed0 0x7f6198160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.890 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 >> 172.21.15.188:0/2978683594 conn(0x7f619808af60 msgr2=0x7f61980b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:26.890 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 shutdown_connections 2023-11-24T06:14:26.890 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:26.886+0000 7f619ef7c640 1 -- 172.21.15.188:0/2978683594 wait complete. 2023-11-24T06:14:26.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 39d80199-292c-4234-b348-c46b381ef1bb 1 2023-11-24T06:14:27.092 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.088+0000 7fa03b52e640 1 Processor -- start 2023-11-24T06:14:27.092 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.088+0000 7fa03b52e640 1 -- start start 2023-11-24T06:14:27.093 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03b52e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0340d1a00 0x7fa0340b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.093 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03b52e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340b41b0 con 0x7fa0341609f0 2023-11-24T06:14:27.093 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03b52e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340b4490 con 0x7fa034160dd0 2023-11-24T06:14:27.093 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03b52e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0340b0090 con 0x7fa0340d1a00 2023-11-24T06:14:27.094 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03ad2d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fa034160dd0 0x7fa0340b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:56946/0 (socket says 172.21.15.188:56946) 2023-11-24T06:14:27.094 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03ad2d640 1 -- 172.21.15.188:0/3530581366 learned_addr learned my addr 172.21.15.188:0/3530581366 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-11-24T06:14:27.096 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3530581366 >> v2:172.21.15.37:3300/0 conn(0x7fa0340d1a00 0x7fa0340b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.096 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360267740 0 0) 0x7fa0340b4490 con 0x7fa034160dd0 2023-11-24T06:14:27.096 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.090+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa020003520 con 0x7fa034160dd0 2023-11-24T06:14:27.096 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3522208347 0 0) 0x7fa020003520 con 0x7fa034160dd0 2023-11-24T06:14:27.096 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 >> v2:172.21.15.37:3300/0 conn(0x7fa0340d1a00 msgr2=0x7fa0340b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.096 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 --2- 172.21.15.188:0/3530581366 >> v2:172.21.15.37:3300/0 conn(0x7fa0340d1a00 0x7fa0340b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.097 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 >> v1:172.21.15.37:6789/0 conn(0x7fa0341609f0 legacy=0x7fa0340d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.097 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340b0370 con 0x7fa034160dd0 2023-11-24T06:14:27.097 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fa02c0019f0 con 0x7fa034160dd0 2023-11-24T06:14:27.097 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 >> v1:172.21.15.188:6789/0 conn(0x7fa034160dd0 legacy=0x7fa0340b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.097 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0200039c0 0x7fa020003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.097 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa020004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.097 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa020005180 0x7fa02000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.098 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340b0090 con 0x7fa0200039c0 2023-11-24T06:14:27.098 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02000c080 con 0x7fa0200047c0 2023-11-24T06:14:27.098 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02000c240 con 0x7fa020005180 2023-11-24T06:14:27.098 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa020004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.098 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03ad2d640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa020005180 0x7fa02000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.098 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.091+0000 7fa03a52c640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0200039c0 0x7fa020003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.098 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.092+0000 7fa039d2b640 1 -- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa020005180 msgr2=0x7fa02000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.099 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.092+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa020005180 0x7fa02000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.099 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.092+0000 7fa039d2b640 1 -- 172.21.15.188:0/3530581366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0200039c0 msgr2=0x7fa020003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.099 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.092+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0200039c0 0x7fa020003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.099 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.092+0000 7fa039d2b640 1 -- 172.21.15.188:0/3530581366 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020003520 con 0x7fa0200047c0 2023-11-24T06:14:27.099 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.092+0000 7fa03ad2d640 1 -- 172.21.15.188:0/3530581366 reap_dead start 2023-11-24T06:14:27.102 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.093+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa020004c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa024009ac0 tx=0x7fa0200057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=151649738007ad2b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.102 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02402c6b0 con 0x7fa0200047c0 2023-11-24T06:14:27.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02402c810 con 0x7fa0200047c0 2023-11-24T06:14:27.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03952a640 1 -- 172.21.15.188:0/3530581366 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02402cba0 con 0x7fa0200047c0 2023-11-24T06:14:27.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03b52e640 1 -- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 msgr2=0x7fa020004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03b52e640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa020004c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa024009ac0 tx=0x7fa0200057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03b52e640 1 -- 172.21.15.188:0/3530581366 shutdown_connections 2023-11-24T06:14:27.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03b52e640 1 --2- 172.21.15.188:0/3530581366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa020004c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.103 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03b52e640 1 -- 172.21.15.188:0/3530581366 >> 172.21.15.188:0/3530581366 conn(0x7fa03409c5b0 msgr2=0x7fa0340d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.104 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.094+0000 7fa03b52e640 1 -- 172.21.15.188:0/3530581366 shutdown_connections 2023-11-24T06:14:27.104 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.095+0000 7fa03b52e640 1 -- 172.21.15.188:0/3530581366 wait complete. 2023-11-24T06:14:27.104 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.096+0000 7fa03b52e640 1 Processor -- start 2023-11-24T06:14:27.104 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.096+0000 7fa03b52e640 1 -- start start 2023-11-24T06:14:27.104 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03b52e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa0340c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.104 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03b52e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0340ceb10 0x7fa0340c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03b52e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0340cef90 0x7fa0340c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03b52e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341f31b0 con 0x7fa0340cef90 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03b52e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341f3400 con 0x7fa0200047c0 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03b52e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341f36e0 con 0x7fa0340ceb10 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03a52c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa0340c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa039d2b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0340ceb10 0x7fa0340c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03a52c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa0340c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43536/0 (socket says 172.21.15.188:43536) 2023-11-24T06:14:27.105 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.097+0000 7fa03a52c640 1 -- 172.21.15.188:0/3322947387 learned_addr learned my addr 172.21.15.188:0/3322947387 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:27.106 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa03ad2d640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0340cef90 0x7fa0340c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.106 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa039d2b640 1 -- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 msgr2=0x7fa0340c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.106 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa0340c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.106 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa039d2b640 1 -- 172.21.15.188:0/3322947387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0340cef90 msgr2=0x7fa0340c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.106 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0340cef90 0x7fa0340c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.106 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa039d2b640 1 -- 172.21.15.188:0/3322947387 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0341f39c0 con 0x7fa0340ceb10 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa03a52c640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa0340c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa03ad2d640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0340cef90 0x7fa0340c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa039d2b640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0340ceb10 0x7fa0340c87b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa024033000 tx=0x7fa024004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa02affd640 1 -- 172.21.15.188:0/3322947387 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024004520 con 0x7fa0340ceb10 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa02affd640 1 -- 172.21.15.188:0/3322947387 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa024003810 con 0x7fa0340ceb10 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa02affd640 1 -- 172.21.15.188:0/3322947387 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024003ba0 con 0x7fa0340ceb10 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.098+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0341f3ca0 con 0x7fa0340ceb10 2023-11-24T06:14:27.107 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.099+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0340cc7d0 con 0x7fa0340ceb10 2023-11-24T06:14:27.108 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.099+0000 7fa02affd640 1 -- 172.21.15.188:0/3322947387 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa024047450 con 0x7fa0340ceb10 2023-11-24T06:14:27.108 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.099+0000 7fa02affd640 1 -- 172.21.15.188:0/3322947387 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa0240348e0 con 0x7fa0340ceb10 2023-11-24T06:14:27.108 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.099+0000 7f7bf2448040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:14:27.109 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.100+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa034067990 con 0x7fa0340ceb10 2023-11-24T06:14:27.109 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.103+0000 7fa02affd640 1 -- 172.21.15.188:0/3322947387 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa024066ce0 con 0x7fa0340ceb10 2023-11-24T06:14:27.129 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.126+0000 7fb317832040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:14:27.166 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.163+0000 7f7bf2448040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:14:27.184 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.180+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "39d80199-292c-4234-b348-c46b381ef1bb", "id": 1} v 0) v1 -- 0x7fa03404e840 con 0x7fa0340ceb10 2023-11-24T06:14:27.192 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.189+0000 7fa02affd640 1 -- 172.21.15.188:0/3322947387 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39d80199-292c-4234-b348-c46b381ef1bb", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa024055070 con 0x7fa0340ceb10 2023-11-24T06:14:27.193 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.189+0000 7fb317832040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:14:27.193 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-11-24T06:14:27.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0340ceb10 msgr2=0x7fa0340c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0340ceb10 0x7fa0340c87b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa024033000 tx=0x7fa024004730 comp rx=0 tx=0).stop 2023-11-24T06:14:27.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 shutdown_connections 2023-11-24T06:14:27.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0340cef90 0x7fa0340c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0340ceb10 0x7fa0340c87b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.195 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 --2- 172.21.15.188:0/3322947387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0200047c0 0x7fa0340c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.196 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 >> 172.21.15.188:0/3322947387 conn(0x7fa03409c5b0 msgr2=0x7fa03415fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.196 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 shutdown_connections 2023-11-24T06:14:27.196 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.191+0000 7fa03b52e640 1 -- 172.21.15.188:0/3322947387 wait complete. 2023-11-24T06:14:27.216 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 70aa1a34-99ad-43fc-9514-63c77331e1a4 2 2023-11-24T06:14:27.219 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.216+0000 7f7bf2448040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:14:27.253 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.250+0000 7fb317832040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:14:27.284 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.282+0000 7f7bf2448040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:14:27.320 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.316+0000 7fb317832040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:14:27.336 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.333+0000 7f7bf2448040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:14:27.372 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.368+0000 7fb317832040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:14:27.407 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.404+0000 7f1239a2e640 1 Processor -- start 2023-11-24T06:14:27.408 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.404+0000 7f1239a2e640 1 -- start start 2023-11-24T06:14:27.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.406+0000 7f1239a2e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f12340d1550 0x7f12340d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.406+0000 7f1239a2e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340d1ae0 con 0x7f12340d3500 2023-11-24T06:14:27.409 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.406+0000 7f1239a2e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340d1dc0 con 0x7f1234160a00 2023-11-24T06:14:27.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.406+0000 7f1239a2e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12340d20a0 con 0x7f12340d1550 2023-11-24T06:14:27.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.406+0000 7f1238a2c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f1234160a00 0x7f12340d0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:56952/0 (socket says 172.21.15.188:56952) 2023-11-24T06:14:27.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.406+0000 7f1238a2c640 1 -- 172.21.15.188:0/99097316 learned_addr learned my addr 172.21.15.188:0/99097316 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-11-24T06:14:27.410 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.406+0000 7f1233fff640 1 --2- 172.21.15.188:0/99097316 >> v2:172.21.15.188:3300/0 conn(0x7f12340d1550 0x7f12340d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.407+0000 7f12337fe640 1 -- 172.21.15.188:0/99097316 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571253126 0 0) 0x7f12340d1dc0 con 0x7f1234160a00 2023-11-24T06:14:27.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.407+0000 7f12337fe640 1 -- 172.21.15.188:0/99097316 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f121c003520 con 0x7f1234160a00 2023-11-24T06:14:27.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.407+0000 7f1233fff640 1 -- 172.21.15.188:0/99097316 >> v1:172.21.15.188:6789/0 conn(0x7f1234160a00 legacy=0x7f12340d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.407+0000 7f1233fff640 1 -- 172.21.15.188:0/99097316 >> v1:172.21.15.37:6789/0 conn(0x7f12340d3500 legacy=0x7f12340ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.411 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.407+0000 7f1233fff640 1 -- 172.21.15.188:0/99097316 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340ce140 con 0x7f12340d1550 2023-11-24T06:14:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.408+0000 7f1233fff640 1 --2- 172.21.15.188:0/99097316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340d2fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12240097a0 tx=0x7f122402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5784ca9440450f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.408+0000 7f12337fe640 1 -- 172.21.15.188:0/99097316 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122402e070 con 0x7f12340d1550 2023-11-24T06:14:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.408+0000 7f12337fe640 1 -- 172.21.15.188:0/99097316 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12240315a0 con 0x7f12340d1550 2023-11-24T06:14:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.408+0000 7f12337fe640 1 -- 172.21.15.188:0/99097316 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224031930 con 0x7f12340d1550 2023-11-24T06:14:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.409+0000 7f1239a2e640 1 -- 172.21.15.188:0/99097316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 msgr2=0x7f12340d2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.409+0000 7f1239a2e640 1 --2- 172.21.15.188:0/99097316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340d2fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12240097a0 tx=0x7f122402b840 comp rx=0 tx=0).stop 2023-11-24T06:14:27.412 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.409+0000 7f1239a2e640 1 -- 172.21.15.188:0/99097316 shutdown_connections 2023-11-24T06:14:27.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.409+0000 7f1239a2e640 1 --2- 172.21.15.188:0/99097316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340d2fc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.409+0000 7f1239a2e640 1 -- 172.21.15.188:0/99097316 >> 172.21.15.188:0/99097316 conn(0x7f123408cc90 msgr2=0x7f123409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.409+0000 7f1239a2e640 1 -- 172.21.15.188:0/99097316 shutdown_connections 2023-11-24T06:14:27.413 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.409+0000 7f1239a2e640 1 -- 172.21.15.188:0/99097316 wait complete. 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.412+0000 7f1239a2e640 1 Processor -- start 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.412+0000 7f1239a2e640 1 -- start start 2023-11-24T06:14:27.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.413+0000 7f1239a2e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.413+0000 7f1239a2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12340d3500 0x7f12340b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.413+0000 7f1239a2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1234160a00 0x7f12340b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.413+0000 7f1239a2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b90c0 con 0x7f1234160a00 2023-11-24T06:14:27.418 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.413+0000 7f1239a2e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340cb1c0 con 0x7f12340d1550 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.413+0000 7f1239a2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123415bad0 con 0x7f12340d3500 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43564/0 (socket says 172.21.15.188:43564) 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 -- 172.21.15.188:0/3911726146 learned_addr learned my addr 172.21.15.188:0/3911726146 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1233fff640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12340d3500 0x7f12340b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 -- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12340d3500 msgr2=0x7f12340b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f123922d640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1234160a00 0x7f12340b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12340d3500 0x7f12340b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 -- 172.21.15.188:0/3911726146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1234160a00 msgr2=0x7f12340b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1234160a00 0x7f12340b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 -- 172.21.15.188:0/3911726146 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009400 con 0x7f12340d1550 2023-11-24T06:14:27.419 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f123922d640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1234160a00 0x7f12340b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.414+0000 7f1238a2c640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340ca340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f122800c410 tx=0x7f122800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.415+0000 7f12317fa640 1 -- 172.21.15.188:0/3911726146 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228005ce0 con 0x7f12340d1550 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.415+0000 7f12317fa640 1 -- 172.21.15.188:0/3911726146 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228005e40 con 0x7f12340d1550 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.415+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123415bdb0 con 0x7f12340d1550 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.415+0000 7f12317fa640 1 -- 172.21.15.188:0/3911726146 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280072f0 con 0x7f12340d1550 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.415+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12340b63b0 con 0x7f12340d1550 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.415+0000 7f12317fa640 1 -- 172.21.15.188:0/3911726146 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f122801c440 con 0x7f12340d1550 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.415+0000 7f12317fa640 1 -- 172.21.15.188:0/3911726146 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f1228012910 con 0x7f12340d1550 2023-11-24T06:14:27.420 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.416+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12340d3930 con 0x7f12340d1550 2023-11-24T06:14:27.422 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.419+0000 7f12317fa640 1 -- 172.21.15.188:0/3911726146 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1228017070 con 0x7f12340d1550 2023-11-24T06:14:27.456 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.453+0000 7f7bf2448040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T06:14:27.493 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.490+0000 7fb317832040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T06:14:27.499 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.495+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70aa1a34-99ad-43fc-9514-63c77331e1a4", "id": 2} v 0) v1 -- 0x7f123404e840 con 0x7f12340d1550 2023-11-24T06:14:27.506 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.503+0000 7f12317fa640 1 -- 172.21.15.188:0/3911726146 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70aa1a34-99ad-43fc-9514-63c77331e1a4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1228012d80 con 0x7f12340d1550 2023-11-24T06:14:27.506 INFO:teuthology.orchestra.run.smithi188.stdout:2 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 msgr2=0x7f12340ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340ca340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f122800c410 tx=0x7f122800c8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 shutdown_connections 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1234160a00 0x7f12340b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12340d3500 0x7f12340b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 --2- 172.21.15.188:0/3911726146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12340d1550 0x7f12340ca340 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 >> 172.21.15.188:0/3911726146 conn(0x7f123408cc90 msgr2=0x7f12340d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 shutdown_connections 2023-11-24T06:14:27.508 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.504+0000 7f1239a2e640 1 -- 172.21.15.188:0/3911726146 wait complete. 2023-11-24T06:14:27.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 7ae887cd-3392-49d5-8a73-6a31c2fba916 3 2023-11-24T06:14:27.540 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.537+0000 7f7bf2448040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:14:27.577 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.574+0000 7fb317832040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:14:27.596 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.593+0000 7f7bf2448040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:14:27.634 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.631+0000 7fb317832040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:14:27.659 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.657+0000 7f7bf2448040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:14:27.698 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.695+0000 7fb317832040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:14:27.717 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:27.714+0000 7f7bf2448040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:14:27.755 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:27.752+0000 7fb317832040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:14:27.761 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.758+0000 7ff7ace56640 1 Processor -- start 2023-11-24T06:14:27.762 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.758+0000 7ff7ace56640 1 -- start start 2023-11-24T06:14:27.763 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7ace56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7a80cb850 0x7ff7a80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7ace56640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80d0a00 0x7ff7a806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7ace56640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7a80b40d0 0x7ff7a80cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7ace56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a80cc170 con 0x7ff7a80cb850 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7ace56640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a8070870 con 0x7ff7a80b40d0 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7ace56640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8070b50 con 0x7ff7a80d0a00 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7a5d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80d0a00 0x7ff7a806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7a6d9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7a80b40d0 0x7ff7a80cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7a5d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80d0a00 0x7ff7a806ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:41564/0 (socket says 172.21.15.188:41564) 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7a6d9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7a80b40d0 0x7ff7a80cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43574/0 (socket says 172.21.15.188:43574) 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7a5d9b640 1 -- 172.21.15.188:0/518808138 learned_addr learned my addr 172.21.15.188:0/518808138 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:27.764 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.760+0000 7ff7a659c640 1 --2- 172.21.15.188:0/518808138 >> v2:172.21.15.37:3300/0 conn(0x7ff7a80cb850 0x7ff7a80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.765 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.761+0000 7ff7a6d9d640 1 -- 172.21.15.188:0/518808138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80d0a00 msgr2=0x7ff7a806ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.765 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.761+0000 7ff7a6d9d640 1 --2- 172.21.15.188:0/518808138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80d0a00 0x7ff7a806ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.765 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.761+0000 7ff7a6d9d640 1 -- 172.21.15.188:0/518808138 >> v2:172.21.15.37:3300/0 conn(0x7ff7a80cb850 msgr2=0x7ff7a80cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.766 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.761+0000 7ff7a6d9d640 1 --2- 172.21.15.188:0/518808138 >> v2:172.21.15.37:3300/0 conn(0x7ff7a80cb850 0x7ff7a80cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.766 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.761+0000 7ff7a6d9d640 1 -- 172.21.15.188:0/518808138 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8070e30 con 0x7ff7a80b40d0 2023-11-24T06:14:27.766 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.762+0000 7ff7a6d9d640 1 --2- 172.21.15.188:0/518808138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a80cf670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b0cf0 tx=0x7ff7a002bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921e47273b2c2958 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.766 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.762+0000 7ff7a559a640 1 -- 172.21.15.188:0/518808138 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a002cb40 con 0x7ff7a80b40d0 2023-11-24T06:14:27.766 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.762+0000 7ff7a559a640 1 -- 172.21.15.188:0/518808138 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a002cca0 con 0x7ff7a80b40d0 2023-11-24T06:14:27.766 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.762+0000 7ff7a559a640 1 -- 172.21.15.188:0/518808138 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0034660 con 0x7ff7a80b40d0 2023-11-24T06:14:27.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 -- 172.21.15.188:0/518808138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 msgr2=0x7ff7a80cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 --2- 172.21.15.188:0/518808138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a80cf670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b0cf0 tx=0x7ff7a002bd90 comp rx=0 tx=0).stop 2023-11-24T06:14:27.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 -- 172.21.15.188:0/518808138 shutdown_connections 2023-11-24T06:14:27.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 --2- 172.21.15.188:0/518808138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a80cf670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.767 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 --2- 172.21.15.188:0/518808138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80d0a00 0x7ff7a806ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 --2- 172.21.15.188:0/518808138 >> v2:172.21.15.37:3300/0 conn(0x7ff7a80cb850 0x7ff7a80cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 -- 172.21.15.188:0/518808138 >> 172.21.15.188:0/518808138 conn(0x7ff7a806e7d0 msgr2=0x7ff7a806ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 -- 172.21.15.188:0/518808138 shutdown_connections 2023-11-24T06:14:27.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.763+0000 7ff7ace56640 1 -- 172.21.15.188:0/518808138 wait complete. 2023-11-24T06:14:27.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.765+0000 7ff7ace56640 1 Processor -- start 2023-11-24T06:14:27.768 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.765+0000 7ff7ace56640 1 -- start start 2023-11-24T06:14:27.770 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7ace56640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a81f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7ace56640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80cb850 0x7ff7a80c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7ace56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a80d0a00 0x7ff7a8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7ace56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a81f40f0 con 0x7ff7a80d0a00 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7ace56640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a806c350 con 0x7ff7a80b40d0 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7ace56640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a806c630 con 0x7ff7a80cb850 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7a659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a81f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7a659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a81f3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43584/0 (socket says 172.21.15.188:43584) 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7a659c640 1 -- 172.21.15.188:0/1106576728 learned_addr learned my addr 172.21.15.188:0/1106576728 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7a5d9b640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80cb850 0x7ff7a80c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.766+0000 7ff7a6d9d640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a80d0a00 0x7ff7a8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.771 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7a659c640 1 -- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80cb850 msgr2=0x7ff7a80c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7a659c640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80cb850 0x7ff7a80c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7a659c640 1 -- 172.21.15.188:0/1106576728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a80d0a00 msgr2=0x7ff7a8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7a659c640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a80d0a00 0x7ff7a8156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7a659c640 1 -- 172.21.15.188:0/1106576728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0009a70 con 0x7ff7a80b40d0 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7a659c640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a81f3bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff79800e870 tx=0x7ff79800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff796ffd640 1 -- 172.21.15.188:0/1106576728 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980094f0 con 0x7ff7a80b40d0 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff796ffd640 1 -- 172.21.15.188:0/1106576728 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79800c940 con 0x7ff7a80b40d0 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a806c910 con 0x7ff7a80b40d0 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff796ffd640 1 -- 172.21.15.188:0/1106576728 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79800ccf0 con 0x7ff7a80b40d0 2023-11-24T06:14:27.772 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.767+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a806ced0 con 0x7ff7a80b40d0 2023-11-24T06:14:27.773 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.768+0000 7ff796ffd640 1 -- 172.21.15.188:0/1106576728 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff798013770 con 0x7ff7a80b40d0 2023-11-24T06:14:27.773 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.768+0000 7ff796ffd640 1 -- 172.21.15.188:0/1106576728 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ff79801cc80 con 0x7ff7a80b40d0 2023-11-24T06:14:27.773 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.768+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a804e890 con 0x7ff7a80b40d0 2023-11-24T06:14:27.774 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.771+0000 7ff796ffd640 1 -- 172.21.15.188:0/1106576728 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff798021060 con 0x7ff7a80b40d0 2023-11-24T06:14:27.852 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.848+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7ae887cd-3392-49d5-8a73-6a31c2fba916", "id": 3} v 0) v1 -- 0x7ff7a80ccce0 con 0x7ff7a80b40d0 2023-11-24T06:14:27.860 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.856+0000 7ff796ffd640 1 -- 172.21.15.188:0/1106576728 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ae887cd-3392-49d5-8a73-6a31c2fba916", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff798017070 con 0x7ff7a80b40d0 2023-11-24T06:14:27.860 INFO:teuthology.orchestra.run.smithi188.stdout:3 2023-11-24T06:14:27.861 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 msgr2=0x7ff7a81f3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.861 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a81f3bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff79800e870 tx=0x7ff79800ed30 comp rx=0 tx=0).stop 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 shutdown_connections 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a80d0a00 0x7ff7a8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7a80cb850 0x7ff7a80c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 --2- 172.21.15.188:0/1106576728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80b40d0 0x7ff7a81f3bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 >> 172.21.15.188:0/1106576728 conn(0x7ff7a806e7d0 msgr2=0x7ff7a80734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 shutdown_connections 2023-11-24T06:14:27.862 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:27.858+0000 7ff7ace56640 1 -- 172.21.15.188:0/1106576728 wait complete. 2023-11-24T06:14:27.877 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 057d1b9e-738e-403a-b13b-ae15009ff6c8 4 2023-11-24T06:14:28.118 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.114+0000 7fdde1967640 1 Processor -- start 2023-11-24T06:14:28.118 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.114+0000 7fdde1967640 1 -- start start 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde1967640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdddc1609f0 0x7fdddc0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde1967640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b2050 0x7fdddc0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde1967640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0b41b0 con 0x7fdddc160dd0 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde1967640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc0b4490 con 0x7fdddc1609f0 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde1967640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0b0090 con 0x7fdddc0b2050 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde0965640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdddc1609f0 0x7fdddc0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde1166640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b2050 0x7fdddc0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.120 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde0965640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdddc1609f0 0x7fdddc0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43590/0 (socket says 172.21.15.188:43590) 2023-11-24T06:14:28.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde0965640 1 -- 172.21.15.188:0/3779234279 learned_addr learned my addr 172.21.15.188:0/3779234279 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:28.121 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.116+0000 7fdde1166640 1 --2- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b2050 0x7fdddc0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:41580/0 (socket says 172.21.15.188:41580) 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.117+0000 7fdde0965640 1 -- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b2050 msgr2=0x7fdddc0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.117+0000 7fdde0965640 1 --2- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b2050 0x7fdddc0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.117+0000 7fdde0965640 1 -- 172.21.15.188:0/3779234279 >> v1:172.21.15.37:6789/0 conn(0x7fdddc160dd0 legacy=0x7fdddc0b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.117+0000 7fdde0965640 1 -- 172.21.15.188:0/3779234279 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0b0370 con 0x7fdddc1609f0 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.117+0000 7fdde1166640 1 --2- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b2050 0x7fdddc0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.118+0000 7fdde0965640 1 --2- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc0d12f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009870 tx=0x7fddd002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4eab0dfc464abe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.118+0000 7fdddb7fe640 1 -- 172.21.15.188:0/3779234279 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0030840 con 0x7fdddc1609f0 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.118+0000 7fdddb7fe640 1 -- 172.21.15.188:0/3779234279 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd00309a0 con 0x7fdddc1609f0 2023-11-24T06:14:28.122 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.118+0000 7fdddb7fe640 1 -- 172.21.15.188:0/3779234279 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0030d30 con 0x7fdddc1609f0 2023-11-24T06:14:28.123 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 -- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 msgr2=0x7fdddc0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.123 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 --2- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc0d12f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009870 tx=0x7fddd002b980 comp rx=0 tx=0).stop 2023-11-24T06:14:28.124 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 -- 172.21.15.188:0/3779234279 shutdown_connections 2023-11-24T06:14:28.124 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 --2- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b2050 0x7fdddc0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.124 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 --2- 172.21.15.188:0/3779234279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc0d12f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.124 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 -- 172.21.15.188:0/3779234279 >> 172.21.15.188:0/3779234279 conn(0x7fdddc09c5b0 msgr2=0x7fdddc0d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.124 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 -- 172.21.15.188:0/3779234279 shutdown_connections 2023-11-24T06:14:28.124 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.119+0000 7fdde1967640 1 -- 172.21.15.188:0/3779234279 wait complete. 2023-11-24T06:14:28.124 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.121+0000 7fdde1967640 1 Processor -- start 2023-11-24T06:14:28.125 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.121+0000 7fdde1967640 1 -- start start 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.122+0000 7fdde1967640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0b2050 0x7fdddc0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1967640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1967640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc160dd0 0x7fdddc1f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1967640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0cd300 con 0x7fdddc0b2050 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1967640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc152f70 con 0x7fdddc1609f0 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1967640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc152640 con 0x7fdddc160dd0 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1166640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc160dd0 0x7fdddc1f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.127 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43592/0 (socket says 172.21.15.188:43592) 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdddbfff640 1 -- 172.21.15.188:0/1064639843 learned_addr learned my addr 172.21.15.188:0/1064639843 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde0965640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0b2050 0x7fdddc0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1166640 1 -- 172.21.15.188:0/1064639843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 msgr2=0x7fdddc151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1166640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1166640 1 -- 172.21.15.188:0/1064639843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0b2050 msgr2=0x7fdddc0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1166640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0b2050 0x7fdddc0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.123+0000 7fdde1166640 1 -- 172.21.15.188:0/1064639843 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4009a70 con 0x7fdddc160dd0 2023-11-24T06:14:28.128 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.124+0000 7fdde1166640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc160dd0 0x7fdddc1f6600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fddd400efc0 tx=0x7fddd400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.129 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.124+0000 7fddd97fa640 1 -- 172.21.15.188:0/1064639843 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd400cd30 con 0x7fdddc160dd0 2023-11-24T06:14:28.129 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.124+0000 7fddd97fa640 1 -- 172.21.15.188:0/1064639843 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd400f040 con 0x7fdddc160dd0 2023-11-24T06:14:28.129 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.124+0000 7fddd97fa640 1 -- 172.21.15.188:0/1064639843 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4003bd0 con 0x7fdddc160dd0 2023-11-24T06:14:28.130 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.124+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00094d0 con 0x7fdddc160dd0 2023-11-24T06:14:28.130 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.124+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc152c00 con 0x7fdddc160dd0 2023-11-24T06:14:28.130 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.124+0000 7fddd97fa640 1 -- 172.21.15.188:0/1064639843 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fddd4014780 con 0x7fdddc160dd0 2023-11-24T06:14:28.130 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.125+0000 7fddd97fa640 1 -- 172.21.15.188:0/1064639843 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fddd401d410 con 0x7fdddc160dd0 2023-11-24T06:14:28.130 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.125+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04e840 con 0x7fdddc160dd0 2023-11-24T06:14:28.133 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.130+0000 7fddd97fa640 1 -- 172.21.15.188:0/1064639843 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fddd4018030 con 0x7fdddc160dd0 2023-11-24T06:14:28.191 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:28.188+0000 7f7bf2448040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T06:14:28.211 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.207+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "057d1b9e-738e-403a-b13b-ae15009ff6c8", "id": 4} v 0) v1 -- 0x7fdddc1530b0 con 0x7fdddc160dd0 2023-11-24T06:14:28.219 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.215+0000 7fddd97fa640 1 -- 172.21.15.188:0/1064639843 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "057d1b9e-738e-403a-b13b-ae15009ff6c8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fddd4014b60 con 0x7fdddc160dd0 2023-11-24T06:14:28.219 INFO:teuthology.orchestra.run.smithi188.stdout:4 2023-11-24T06:14:28.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc160dd0 msgr2=0x7fdddc1f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc160dd0 0x7fdddc1f6600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fddd400efc0 tx=0x7fddd400c490 comp rx=0 tx=0).stop 2023-11-24T06:14:28.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 shutdown_connections 2023-11-24T06:14:28.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc1609f0 0x7fdddc151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.221 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc160dd0 0x7fdddc1f6600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 --2- 172.21.15.188:0/1064639843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0b2050 0x7fdddc0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 >> 172.21.15.188:0/1064639843 conn(0x7fdddc09c5b0 msgr2=0x7fdddc0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 shutdown_connections 2023-11-24T06:14:28.222 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.217+0000 7fdde1967640 1 -- 172.21.15.188:0/1064639843 wait complete. 2023-11-24T06:14:28.235 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:28.232+0000 7fb317832040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T06:14:28.237 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 228d3443-fb4c-41e2-b10e-810193979c46 5 2023-11-24T06:14:28.359 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:28.356+0000 7f7bf2448040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:14:28.402 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:28.399+0000 7fb317832040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:14:28.423 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.420+0000 7f2023fff640 1 Processor -- start 2023-11-24T06:14:28.423 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.420+0000 7f2023fff640 1 -- start start 2023-11-24T06:14:28.425 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f2023fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20240b1c40 0x7f20240b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.426 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f2023fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f20240b2fb0 0x7f2024160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.426 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f2023fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202406a500 con 0x7f2024071d20 2023-11-24T06:14:28.426 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f2023fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202406a7e0 con 0x7f20240b1c40 2023-11-24T06:14:28.426 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f2023fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202406b380 con 0x7f20240b2fb0 2023-11-24T06:14:28.426 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f20227fc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f2024071d20 0x7f202406ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:56954/0 (socket says 172.21.15.188:56954) 2023-11-24T06:14:28.426 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f20227fc640 1 -- 172.21.15.188:0/3711452888 learned_addr learned my addr 172.21.15.188:0/3711452888 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-11-24T06:14:28.427 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f20237fe640 1 --2- 172.21.15.188:0/3711452888 >> v2:172.21.15.188:3300/0 conn(0x7f20240b2fb0 0x7f2024160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.427 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.422+0000 7f2022ffd640 1 --2- 172.21.15.188:0/3711452888 >> v2:172.21.15.37:3300/0 conn(0x7f20240b1c40 0x7f20240b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.423+0000 7f20237fe640 1 -- 172.21.15.188:0/3711452888 >> v2:172.21.15.37:3300/0 conn(0x7f20240b1c40 msgr2=0x7f20240b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:28.428 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.423+0000 7f20237fe640 1 --2- 172.21.15.188:0/3711452888 >> v2:172.21.15.37:3300/0 conn(0x7f20240b1c40 0x7f20240b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.423+0000 7f20237fe640 1 -- 172.21.15.188:0/3711452888 >> v1:172.21.15.188:6789/0 conn(0x7f2024071d20 legacy=0x7f202406ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.423+0000 7f20237fe640 1 -- 172.21.15.188:0/3711452888 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240b3570 con 0x7f20240b2fb0 2023-11-24T06:14:28.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.424+0000 7f20237fe640 1 --2- 172.21.15.188:0/3711452888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20240b2fb0 0x7f2024160ec0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f20240b5380 tx=0x7f201c02bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9f5ff5f22cd82a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.424+0000 7f2021ffb640 1 -- 172.21.15.188:0/3711452888 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c02cb50 con 0x7f20240b2fb0 2023-11-24T06:14:28.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.424+0000 7f2021ffb640 1 -- 172.21.15.188:0/3711452888 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c02ccb0 con 0x7f20240b2fb0 2023-11-24T06:14:28.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.424+0000 7f2021ffb640 1 -- 172.21.15.188:0/3711452888 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c034660 con 0x7f20240b2fb0 2023-11-24T06:14:28.429 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 -- 172.21.15.188:0/3711452888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20240b2fb0 msgr2=0x7f2024160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 --2- 172.21.15.188:0/3711452888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20240b2fb0 0x7f2024160ec0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f20240b5380 tx=0x7f201c02bda0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 -- 172.21.15.188:0/3711452888 shutdown_connections 2023-11-24T06:14:28.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 --2- 172.21.15.188:0/3711452888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20240b2fb0 0x7f2024160ec0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 --2- 172.21.15.188:0/3711452888 >> v2:172.21.15.37:3300/0 conn(0x7f20240b1c40 0x7f20240b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 -- 172.21.15.188:0/3711452888 >> 172.21.15.188:0/3711452888 conn(0x7f202406d680 msgr2=0x7f202406da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.430 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 -- 172.21.15.188:0/3711452888 shutdown_connections 2023-11-24T06:14:28.431 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.425+0000 7f2023fff640 1 -- 172.21.15.188:0/3711452888 wait complete. 2023-11-24T06:14:28.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.426+0000 7f2023fff640 1 Processor -- start 2023-11-24T06:14:28.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.427+0000 7f2023fff640 1 -- start start 2023-11-24T06:14:28.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.427+0000 7f2023fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2024071d20 0x7f2024158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.433 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.427+0000 7f2023fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20240b1c40 0x7f20241511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.427+0000 7f2023fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20240b2fb0 0x7f20241f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.427+0000 7f2023fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2024159db0 con 0x7f20240b1c40 2023-11-24T06:14:28.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.427+0000 7f2023fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20241591a0 con 0x7f2024071d20 2023-11-24T06:14:28.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.427+0000 7f2023fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2024159480 con 0x7f20240b2fb0 2023-11-24T06:14:28.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f2022ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2024071d20 0x7f2024158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.434 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20240b2fb0 0x7f20241f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20240b2fb0 0x7f20241f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:41602/0 (socket says 172.21.15.188:41602) 2023-11-24T06:14:28.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 -- 172.21.15.188:0/390117695 learned_addr learned my addr 172.21.15.188:0/390117695 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:28.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20227fc640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20240b1c40 0x7f20241511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 -- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2024071d20 msgr2=0x7f2024158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2024071d20 0x7f2024158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.435 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 -- 172.21.15.188:0/390117695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20240b1c40 msgr2=0x7f20241511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20240b1c40 0x7f20241511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 -- 172.21.15.188:0/390117695 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009a70 con 0x7f20240b2fb0 2023-11-24T06:14:28.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f2022ffd640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2024071d20 0x7f2024158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:28.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.428+0000 7f20237fe640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20240b2fb0 0x7f20241f2cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e80 tx=0x7f201c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.429+0000 7f200bfff640 1 -- 172.21.15.188:0/390117695 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c040650 con 0x7f20240b2fb0 2023-11-24T06:14:28.436 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.429+0000 7f200bfff640 1 -- 172.21.15.188:0/390117695 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0407b0 con 0x7f20240b2fb0 2023-11-24T06:14:28.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.429+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2024159760 con 0x7f20240b2fb0 2023-11-24T06:14:28.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.429+0000 7f200bfff640 1 -- 172.21.15.188:0/390117695 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c040b40 con 0x7f20240b2fb0 2023-11-24T06:14:28.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.429+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2024158e90 con 0x7f20240b2fb0 2023-11-24T06:14:28.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.429+0000 7f200bfff640 1 -- 172.21.15.188:0/390117695 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f201c049400 con 0x7f20240b2fb0 2023-11-24T06:14:28.437 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.429+0000 7f200bfff640 1 -- 172.21.15.188:0/390117695 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f201c049c30 con 0x7f20240b2fb0 2023-11-24T06:14:28.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.430+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2024159f60 con 0x7f20240b2fb0 2023-11-24T06:14:28.438 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.433+0000 7f200bfff640 1 -- 172.21.15.188:0/390117695 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f201c067ce0 con 0x7f20240b2fb0 2023-11-24T06:14:28.509 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:28.506+0000 7f7bf2448040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:14:28.514 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.510+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "228d3443-fb4c-41e2-b10e-810193979c46", "id": 5} v 0) v1 -- 0x7f20240b2500 con 0x7f20240b2fb0 2023-11-24T06:14:28.521 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.518+0000 7f200bfff640 1 -- 172.21.15.188:0/390117695 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "228d3443-fb4c-41e2-b10e-810193979c46", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f201c056030 con 0x7f20240b2fb0 2023-11-24T06:14:28.521 INFO:teuthology.orchestra.run.smithi188.stdout:5 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20240b2fb0 msgr2=0x7f20241f2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20240b2fb0 0x7f20241f2cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f201c009e80 tx=0x7f201c004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 shutdown_connections 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20240b2fb0 0x7f20241f2cf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20240b1c40 0x7f20241511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 --2- 172.21.15.188:0/390117695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2024071d20 0x7f2024158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 >> 172.21.15.188:0/390117695 conn(0x7f202406d680 msgr2=0x7f20240afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.523 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 shutdown_connections 2023-11-24T06:14:28.524 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.519+0000 7f2023fff640 1 -- 172.21.15.188:0/390117695 wait complete. 2023-11-24T06:14:28.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new b4fb09aa-d3f6-4133-9539-450e36215cdb 6 2023-11-24T06:14:28.554 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:28.551+0000 7fb317832040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:14:28.564 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:28.562+0000 7f7bf2448040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:14:28.610 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:28.606+0000 7fb317832040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:14:28.680 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:28.677+0000 7f7bf2448040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:14:28.727 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:28.723+0000 7fb317832040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:14:28.727 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.724+0000 7f7e158bb640 1 Processor -- start 2023-11-24T06:14:28.728 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.724+0000 7f7e158bb640 1 -- start start 2023-11-24T06:14:28.729 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e158bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e101609f0 0x7f7e100d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e158bb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7e10160dd0 0x7f7e100d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e158bb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100b41b0 con 0x7f7e100b2050 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e158bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e100b4490 con 0x7f7e101609f0 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e158bb640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e100b0090 con 0x7f7e10160dd0 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e0ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7e10160dd0 0x7f7e100d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e0ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7e10160dd0 0x7f7e100d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43616/0 (socket says 172.21.15.188:43616) 2023-11-24T06:14:28.730 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.726+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1162267363 learned_addr learned my addr 172.21.15.188:0/1162267363 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:28.731 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.727+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1162267363 >> v2:172.21.15.37:3300/0 conn(0x7f7e101609f0 msgr2=0x7f7e100d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:28.731 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.727+0000 7f7e0ffff640 1 --2- 172.21.15.188:0/1162267363 >> v2:172.21.15.37:3300/0 conn(0x7f7e101609f0 0x7f7e100d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.731 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.727+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1162267363 >> v1:172.21.15.37:6789/0 conn(0x7f7e100b2050 legacy=0x7f7e100b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:28.732 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.727+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1162267363 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100b0370 con 0x7f7e10160dd0 2023-11-24T06:14:28.732 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.728+0000 7f7e0ffff640 1 --2- 172.21.15.188:0/1162267363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e10160dd0 0x7f7e100d1830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e10067c70 tx=0x7f7dfc02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=630ced35bf209fcf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.732 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.728+0000 7f7e0f7fe640 1 -- 172.21.15.188:0/1162267363 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc031870 con 0x7f7e10160dd0 2023-11-24T06:14:28.732 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.728+0000 7f7e0f7fe640 1 -- 172.21.15.188:0/1162267363 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc0319d0 con 0x7f7e10160dd0 2023-11-24T06:14:28.732 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.728+0000 7f7e0f7fe640 1 -- 172.21.15.188:0/1162267363 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc031d60 con 0x7f7e10160dd0 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 -- 172.21.15.188:0/1162267363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e10160dd0 msgr2=0x7f7e100d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 --2- 172.21.15.188:0/1162267363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e10160dd0 0x7f7e100d1830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e10067c70 tx=0x7f7dfc02b910 comp rx=0 tx=0).stop 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 -- 172.21.15.188:0/1162267363 shutdown_connections 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 --2- 172.21.15.188:0/1162267363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e10160dd0 0x7f7e100d1830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 --2- 172.21.15.188:0/1162267363 >> v2:172.21.15.37:3300/0 conn(0x7f7e101609f0 0x7f7e100d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 -- 172.21.15.188:0/1162267363 >> 172.21.15.188:0/1162267363 conn(0x7f7e1009c5b0 msgr2=0x7f7e100d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 -- 172.21.15.188:0/1162267363 shutdown_connections 2023-11-24T06:14:28.733 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.729+0000 7f7e158bb640 1 -- 172.21.15.188:0/1162267363 wait complete. 2023-11-24T06:14:28.734 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.731+0000 7f7e158bb640 1 Processor -- start 2023-11-24T06:14:28.734 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.731+0000 7f7e158bb640 1 -- start start 2023-11-24T06:14:28.737 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e158bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e100b2050 0x7f7e10154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.737 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e158bb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e101609f0 0x7f7e100c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.737 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e158bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10160dd0 0x7f7e100c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.737 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e158bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100cd160 con 0x7f7e10160dd0 2023-11-24T06:14:28.738 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e158bb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100c74f0 con 0x7f7e100b2050 2023-11-24T06:14:28.738 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e158bb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100c77d0 con 0x7f7e101609f0 2023-11-24T06:14:28.738 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e101609f0 0x7f7e100c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.738 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e148b9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e100b2050 0x7f7e10154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.739 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e101609f0 0x7f7e100c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:41612/0 (socket says 172.21.15.188:41612) 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1686152623 learned_addr learned my addr 172.21.15.188:0/1686152623 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e150ba640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10160dd0 0x7f7e100c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e100b2050 msgr2=0x7f7e10154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e100b2050 0x7f7e10154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1686152623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10160dd0 msgr2=0x7f7e100c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10160dd0 0x7f7e100c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e0ffff640 1 -- 172.21.15.188:0/1686152623 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc0094d0 con 0x7f7e101609f0 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.732+0000 7f7e148b9640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e100b2050 0x7f7e10154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e0ffff640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e101609f0 0x7f7e100c6930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc000c00 tx=0x7f7dfc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.740 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e0d7fa640 1 -- 172.21.15.188:0/1686152623 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc03ad10 con 0x7f7e101609f0 2023-11-24T06:14:28.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e0d7fa640 1 -- 172.21.15.188:0/1686152623 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc03ae70 con 0x7f7e101609f0 2023-11-24T06:14:28.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e0d7fa640 1 -- 172.21.15.188:0/1686152623 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc044610 con 0x7f7e101609f0 2023-11-24T06:14:28.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e100c7ab0 con 0x7f7e101609f0 2023-11-24T06:14:28.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e10154f90 con 0x7f7e101609f0 2023-11-24T06:14:28.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e0d7fa640 1 -- 172.21.15.188:0/1686152623 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7dfc044a70 con 0x7f7e101609f0 2023-11-24T06:14:28.741 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.733+0000 7f7e0d7fa640 1 -- 172.21.15.188:0/1686152623 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7dfc02d040 con 0x7f7e101609f0 2023-11-24T06:14:28.742 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.734+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e100b4bb0 con 0x7f7e101609f0 2023-11-24T06:14:28.742 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.737+0000 7f7e0d7fa640 1 -- 172.21.15.188:0/1686152623 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7dfc035020 con 0x7f7e101609f0 2023-11-24T06:14:28.797 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:28.794+0000 7f7bf2448040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:14:28.819 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.815+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4fb09aa-d3f6-4133-9539-450e36215cdb", "id": 6} v 0) v1 -- 0x7f7e10156a90 con 0x7f7e101609f0 2023-11-24T06:14:28.827 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.823+0000 7f7e0d7fa640 1 -- 172.21.15.188:0/1686152623 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4fb09aa-d3f6-4133-9539-450e36215cdb", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e10156a90 con 0x7f7e101609f0 2023-11-24T06:14:28.827 INFO:teuthology.orchestra.run.smithi188.stdout:6 2023-11-24T06:14:28.828 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.824+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e101609f0 msgr2=0x7f7e100c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.828 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.824+0000 7f7e158bb640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e101609f0 0x7f7e100c6930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc000c00 tx=0x7f7dfc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.829 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.825+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 shutdown_connections 2023-11-24T06:14:28.829 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.825+0000 7f7e158bb640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10160dd0 0x7f7e100c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.829 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.825+0000 7f7e158bb640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e101609f0 0x7f7e100c6930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.829 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.825+0000 7f7e158bb640 1 --2- 172.21.15.188:0/1686152623 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e100b2050 0x7f7e10154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.829 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.825+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 >> 172.21.15.188:0/1686152623 conn(0x7f7e1009c5b0 msgr2=0x7f7e1006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.829 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.825+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 shutdown_connections 2023-11-24T06:14:28.830 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:28.825+0000 7f7e158bb640 1 -- 172.21.15.188:0/1686152623 wait complete. 2023-11-24T06:14:28.843 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new c5647f29-1d8c-4f36-8acb-5a91d0063625 7 2023-11-24T06:14:28.844 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:28.841+0000 7fb317832040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:14:28.965 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:28.961+0000 7f7bf2448040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:14:29.012 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:29.008+0000 7fb317832040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:14:29.016 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:29.013+0000 7f7bf2448040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:14:29.039 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.036+0000 7f816f397640 1 Processor -- start 2023-11-24T06:14:29.040 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.036+0000 7f816f397640 1 -- start start 2023-11-24T06:14:29.041 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816f397640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81680d2000 0x7f81680cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816f397640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f81680d0200 0x7f81681605f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816f397640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680ce410 con 0x7f81680d1c20 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816f397640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816806c270 con 0x7f81680d2000 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816f397640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81680d06f0 con 0x7f81680d0200 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816d133640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f81680d1c20 0x7f816806bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:56968/0 (socket says 172.21.15.188:56968) 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816d133640 1 -- 172.21.15.188:0/3261630896 learned_addr learned my addr 172.21.15.188:0/3261630896 (peer_addr_for_me v1:172.21.15.188:0/0) 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816d934640 1 --2- 172.21.15.188:0/3261630896 >> v2:172.21.15.188:3300/0 conn(0x7f81680d0200 0x7f81681605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.042 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.038+0000 7f816c932640 1 --2- 172.21.15.188:0/3261630896 >> v2:172.21.15.37:3300/0 conn(0x7f81680d2000 0x7f81680cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.039+0000 7f816d934640 1 -- 172.21.15.188:0/3261630896 >> v2:172.21.15.37:3300/0 conn(0x7f81680d2000 msgr2=0x7f81680cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.039+0000 7f816d934640 1 --2- 172.21.15.188:0/3261630896 >> v2:172.21.15.37:3300/0 conn(0x7f81680d2000 0x7f81680cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.039+0000 7f816d934640 1 -- 172.21.15.188:0/3261630896 >> v1:172.21.15.188:6789/0 conn(0x7f81680d1c20 legacy=0x7f816806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.039+0000 7f815ffff640 1 -- 172.21.15.188:0/3261630896 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495786912 0 0) 0x7f81680ce410 con 0x7f81680d1c20 2023-11-24T06:14:29.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.039+0000 7f816d934640 1 -- 172.21.15.188:0/3261630896 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680d09d0 con 0x7f81680d0200 2023-11-24T06:14:29.043 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.040+0000 7f816d934640 1 --2- 172.21.15.188:0/3261630896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81681605f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81680b94a0 tx=0x7f816002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f4b253c1fc72b27 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.041+0000 7f815ffff640 1 -- 172.21.15.188:0/3261630896 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816002cc80 con 0x7f81680d0200 2023-11-24T06:14:29.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.041+0000 7f815ffff640 1 -- 172.21.15.188:0/3261630896 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816002cde0 con 0x7f81680d0200 2023-11-24T06:14:29.044 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.041+0000 7f815ffff640 1 -- 172.21.15.188:0/3261630896 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160034660 con 0x7f81680d0200 2023-11-24T06:14:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.041+0000 7f816f397640 1 -- 172.21.15.188:0/3261630896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 msgr2=0x7f81681605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.041+0000 7f816f397640 1 --2- 172.21.15.188:0/3261630896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81681605f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81680b94a0 tx=0x7f816002bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.042+0000 7f816f397640 1 -- 172.21.15.188:0/3261630896 shutdown_connections 2023-11-24T06:14:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.042+0000 7f816f397640 1 --2- 172.21.15.188:0/3261630896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81681605f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.042+0000 7f816f397640 1 --2- 172.21.15.188:0/3261630896 >> v2:172.21.15.37:3300/0 conn(0x7f81680d2000 0x7f81680cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.042+0000 7f816f397640 1 -- 172.21.15.188:0/3261630896 >> 172.21.15.188:0/3261630896 conn(0x7f816808cea0 msgr2=0x7f816809c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.045 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.042+0000 7f816f397640 1 -- 172.21.15.188:0/3261630896 shutdown_connections 2023-11-24T06:14:29.046 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.042+0000 7f816f397640 1 -- 172.21.15.188:0/3261630896 wait complete. 2023-11-24T06:14:29.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.044+0000 7f816f397640 1 Processor -- start 2023-11-24T06:14:29.047 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.044+0000 7f816f397640 1 -- start start 2023-11-24T06:14:29.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816f397640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81680a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816f397640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81680d1c20 0x7f816815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816f397640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680d2000 0x7f816814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.049 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816f397640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816814d600 con 0x7f81680d2000 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816f397640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816814d8e0 con 0x7f81680d0200 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816f397640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816814dbc0 con 0x7f81680d1c20 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816d133640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81680a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816d133640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81680a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:43638/0 (socket says 172.21.15.188:43638) 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816d133640 1 -- 172.21.15.188:0/1019797904 learned_addr learned my addr 172.21.15.188:0/1019797904 (peer_addr_for_me v2:172.21.15.188:0/0) 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.045+0000 7f816c932640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81680d1c20 0x7f816815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f816d133640 1 -- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81680d1c20 msgr2=0x7f816815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f816d133640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81680d1c20 0x7f816815f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f816d133640 1 -- 172.21.15.188:0/1019797904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680d2000 msgr2=0x7f816814cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f816d133640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680d2000 0x7f816814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f816d133640 1 -- 172.21.15.188:0/1019797904 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160009a70 con 0x7f81680d0200 2023-11-24T06:14:29.050 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f816d133640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81680a0c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f816400c4d0 tx=0x7f816400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f815dffb640 1 -- 172.21.15.188:0/1019797904 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640074e0 con 0x7f81680d0200 2023-11-24T06:14:29.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f815dffb640 1 -- 172.21.15.188:0/1019797904 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8164007660 con 0x7f81680d0200 2023-11-24T06:14:29.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f815dffb640 1 -- 172.21.15.188:0/1019797904 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164004a20 con 0x7f81680d0200 2023-11-24T06:14:29.051 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.046+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816814dea0 con 0x7f81680d0200 2023-11-24T06:14:29.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.047+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816815f800 con 0x7f81680d0200 2023-11-24T06:14:29.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.047+0000 7f815dffb640 1 -- 172.21.15.188:0/1019797904 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8164012400 con 0x7f81680d0200 2023-11-24T06:14:29.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.047+0000 7f815dffb640 1 -- 172.21.15.188:0/1019797904 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f8164012d10 con 0x7f81680d0200 2023-11-24T06:14:29.052 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.048+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81680c6ee0 con 0x7f81680d0200 2023-11-24T06:14:29.053 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.050+0000 7f815dffb640 1 -- 172.21.15.188:0/1019797904 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8164018070 con 0x7f81680d0200 2023-11-24T06:14:29.065 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:29.062+0000 7fb317832040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:14:29.131 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.127+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c5647f29-1d8c-4f36-8acb-5a91d0063625", "id": 7} v 0) v1 -- 0x7f816814f900 con 0x7f81680d0200 2023-11-24T06:14:29.137 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.134+0000 7f815dffb640 1 -- 172.21.15.188:0/1019797904 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5647f29-1d8c-4f36-8acb-5a91d0063625", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81640127e0 con 0x7f81680d0200 2023-11-24T06:14:29.138 INFO:teuthology.orchestra.run.smithi188.stdout:7 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.135+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 msgr2=0x7f81680a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.135+0000 7f816f397640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81680a0c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f816400c4d0 tx=0x7f816400c990 comp rx=0 tx=0).stop 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.135+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 shutdown_connections 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.135+0000 7f816f397640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680d2000 0x7f816814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.135+0000 7f816f397640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81680d1c20 0x7f816815f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.135+0000 7f816f397640 1 --2- 172.21.15.188:0/1019797904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81680d0200 0x7f81680a0c00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.135+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 >> 172.21.15.188:0/1019797904 conn(0x7f816808cea0 msgr2=0x7f816806c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.136+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 shutdown_connections 2023-11-24T06:14:29.139 INFO:teuthology.orchestra.run.smithi188.stderr:2023-11-24T06:14:29.136+0000 7f816f397640 1 -- 172.21.15.188:0/1019797904 wait complete. 2023-11-24T06:14:29.156 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T06:14:29.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T06:14:29.165 INFO:tasks.ceph.osd.0:Started 2023-11-24T06:14:29.166 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T06:14:29.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T06:14:29.175 INFO:tasks.ceph.osd.1:Started 2023-11-24T06:14:29.175 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T06:14:29.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T06:14:29.180 INFO:tasks.ceph.osd.2:Started 2023-11-24T06:14:29.180 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T06:14:29.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T06:14:29.186 INFO:tasks.ceph.osd.3:Started 2023-11-24T06:14:29.187 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T06:14:29.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T06:14:29.187 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:29.181+0000 7f7bf2448040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:14:29.193 INFO:tasks.ceph.osd.4:Started 2023-11-24T06:14:29.193 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T06:14:29.193 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T06:14:29.201 INFO:tasks.ceph.osd.5:Started 2023-11-24T06:14:29.202 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T06:14:29.202 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T06:14:29.209 INFO:tasks.ceph.osd.6:Started 2023-11-24T06:14:29.209 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T06:14:29.209 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T06:14:29.216 INFO:tasks.ceph.osd.7:Started 2023-11-24T06:14:29.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:29.235 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:29.232+0000 7fb317832040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:14:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.445+0000 7f95729b0640 1 Processor -- start 2023-11-24T06:14:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.445+0000 7f95729b0640 1 -- start start 2023-11-24T06:14:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.446+0000 7f95729b0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f956c15eaf0 0x7f956c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.446+0000 7f95729b0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.446+0000 7f95729b0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c06d180 con 0x7f956c1461d0 2023-11-24T06:14:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.446+0000 7f95729b0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956c0b3d20 con 0x7f956c15eaf0 2023-11-24T06:14:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.446+0000 7f95729b0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c06ba70 con 0x7f956c0b3890 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.446+0000 7f956b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f956c15eaf0 0x7f956c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.447+0000 7f956b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f956c15eaf0 0x7f956c0b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:40942/0 (socket says 172.21.15.37:40942) 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.447+0000 7f9570f4d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.447+0000 7f956b7fe640 1 -- 172.21.15.37:0/1549263243 learned_addr learned my addr 172.21.15.37:0/1549263243 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.447+0000 7f9570f4d640 1 -- 172.21.15.37:0/1549263243 >> v2:172.21.15.188:3300/0 conn(0x7f956c15eaf0 msgr2=0x7f956c0b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.447+0000 7f9570f4d640 1 --2- 172.21.15.37:0/1549263243 >> v2:172.21.15.188:3300/0 conn(0x7f956c15eaf0 0x7f956c0b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.447+0000 7f9570f4d640 1 -- 172.21.15.37:0/1549263243 >> v1:172.21.15.188:6789/0 conn(0x7f956c1461d0 legacy=0x7f956c0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.447+0000 7f9570f4d640 1 -- 172.21.15.37:0/1549263243 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c06bd50 con 0x7f956c0b3890 2023-11-24T06:14:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.448+0000 7f9570f4d640 1 --2- 172.21.15.37:0/1549263243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c167110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9564009d90 tx=0x7f956402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a64054c8fa06cce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.448+0000 7f956affd640 1 -- 172.21.15.37:0/1549263243 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956402cc60 con 0x7f956c0b3890 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.448+0000 7f956affd640 1 -- 172.21.15.37:0/1549263243 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956402cdc0 con 0x7f956c0b3890 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.448+0000 7f956affd640 1 -- 172.21.15.37:0/1549263243 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564034660 con 0x7f956c0b3890 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 -- 172.21.15.37:0/1549263243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 msgr2=0x7f956c167110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 --2- 172.21.15.37:0/1549263243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c167110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9564009d90 tx=0x7f956402beb0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 -- 172.21.15.37:0/1549263243 shutdown_connections 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 --2- 172.21.15.37:0/1549263243 >> v2:172.21.15.188:3300/0 conn(0x7f956c15eaf0 0x7f956c0b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 --2- 172.21.15.37:0/1549263243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c167110 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 -- 172.21.15.37:0/1549263243 >> 172.21.15.37:0/1549263243 conn(0x7f956c061340 msgr2=0x7f956c061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 -- 172.21.15.37:0/1549263243 shutdown_connections 2023-11-24T06:14:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.449+0000 7f95729b0640 1 -- 172.21.15.37:0/1549263243 wait complete. 2023-11-24T06:14:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.451+0000 7f95729b0640 1 Processor -- start 2023-11-24T06:14:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.451+0000 7f95729b0640 1 -- start start 2023-11-24T06:14:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.451+0000 7f95729b0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c13fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f95729b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f956c1461d0 0x7f956c0d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f95729b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956c15eaf0 0x7f956c0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f95729b0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c140380 con 0x7f956c15eaf0 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f95729b0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c15cf70 con 0x7f956c1461d0 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f95729b0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0cf7a0 con 0x7f956c0b3890 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956c15eaf0 0x7f956c0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956c15eaf0 0x7f956c0cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36486/0 (socket says 172.21.15.37:36486) 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 -- 172.21.15.37:0/293966049 learned_addr learned my addr 172.21.15.37:0/293966049 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f956b7fe640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f956c1461d0 0x7f956c0d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f956bfff640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c13fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 -- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 msgr2=0x7f956c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c13fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 -- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f956c1461d0 msgr2=0x7f956c0d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f956c1461d0 0x7f956c0d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.452+0000 7f9570f4d640 1 -- 172.21.15.37:0/293966049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564009a70 con 0x7f956c15eaf0 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.453+0000 7f9570f4d640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956c15eaf0 0x7f956c0cec30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9564009d90 tx=0x7f9564004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.453+0000 7f9568ff9640 1 -- 172.21.15.37:0/293966049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564040650 con 0x7f956c15eaf0 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.453+0000 7f9568ff9640 1 -- 172.21.15.37:0/293966049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95640407b0 con 0x7f956c15eaf0 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.453+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c0cfa80 con 0x7f956c15eaf0 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.453+0000 7f9568ff9640 1 -- 172.21.15.37:0/293966049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564040b60 con 0x7f956c15eaf0 2023-11-24T06:14:29.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.453+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c0d0040 con 0x7f956c15eaf0 2023-11-24T06:14:29.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.454+0000 7f9568ff9640 1 -- 172.21.15.37:0/293966049 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9564049400 con 0x7f956c15eaf0 2023-11-24T06:14:29.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.454+0000 7f9568ff9640 1 -- 172.21.15.37:0/293966049 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f956403ead0 con 0x7f956c15eaf0 2023-11-24T06:14:29.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.454+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c0b32d0 con 0x7f956c15eaf0 2023-11-24T06:14:29.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.457+0000 7f9568ff9640 1 -- 172.21.15.37:0/293966049 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9564067ce0 con 0x7f956c15eaf0 2023-11-24T06:14:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.521+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f956c067470 con 0x7f956c15eaf0 2023-11-24T06:14:29.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.522+0000 7f9568ff9640 1 -- 172.21.15.37:0/293966049 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9564056030 con 0x7f956c15eaf0 2023-11-24T06:14:29.525 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:29.525 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:29.130794+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956c15eaf0 msgr2=0x7f956c0cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956c15eaf0 0x7f956c0cec30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9564009d90 tx=0x7f9564004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 shutdown_connections 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f956c1461d0 0x7f956c0d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956c15eaf0 0x7f956c0cec30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 --2- 172.21.15.37:0/293966049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f956c0b3890 0x7f956c13fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 >> 172.21.15.37:0/293966049 conn(0x7f956c061340 msgr2=0x7f956c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 shutdown_connections 2023-11-24T06:14:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:29.523+0000 7f95729b0640 1 -- 172.21.15.37:0/293966049 wait complete. 2023-11-24T06:14:29.542 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T06:14:29.542 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T06:14:29.885 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-11-24T06:14:29.881+0000 7f7fd380f500 -1 Falling back to public interface 2023-11-24T06:14:29.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-11-24T06:14:29.890+0000 7f1c52bbe500 -1 Falling back to public interface 2023-11-24T06:14:29.900 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-11-24T06:14:29.896+0000 7fb825c8c500 -1 Falling back to public interface 2023-11-24T06:14:29.900 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-11-24T06:14:29.897+0000 7fdfb2712500 -1 Falling back to public interface 2023-11-24T06:14:29.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-11-24T06:14:29.903+0000 7f3e8b22a500 -1 Falling back to public interface 2023-11-24T06:14:29.909 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-11-24T06:14:29.907+0000 7f5cd4811500 -1 Falling back to public interface 2023-11-24T06:14:29.910 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-11-24T06:14:29.907+0000 7f6a3c129500 -1 Falling back to public interface 2023-11-24T06:14:29.914 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-11-24T06:14:29.912+0000 7f6a3b0d0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6819/0: (98) Address already in use 2023-11-24T06:14:29.929 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-11-24T06:14:29.926+0000 7fcd15210500 -1 Falling back to public interface 2023-11-24T06:14:30.286 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:30.284+0000 7f7bf2448040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:14:30.306 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:30.302+0000 7fb317832040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:14:30.348 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:30.513 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.510+0000 7f420afec640 1 Processor -- start 2023-11-24T06:14:30.513 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.510+0000 7f420afec640 1 -- start start 2023-11-24T06:14:30.514 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.511+0000 7f420afec640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f42040aeec0 0x7f42040af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.514 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.511+0000 7f420afec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f420406a490 0x7f42040714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.514 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.511+0000 7f420afec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420406b3c0 con 0x7f42040d0c80 2023-11-24T06:14:30.515 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.511+0000 7f420afec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42040af7e0 con 0x7f420406a490 2023-11-24T06:14:30.515 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f420afec640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420406ae00 con 0x7f42040aeec0 2023-11-24T06:14:30.515 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4203fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f42040d0c80 0x7f420415e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36938/0 (socket says 172.21.15.37:36938) 2023-11-24T06:14:30.515 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4203fff640 1 -- 172.21.15.37:0/4065433312 learned_addr learned my addr 172.21.15.37:0/4065433312 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:30.515 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4209589640 1 --2- 172.21.15.37:0/4065433312 >> v2:172.21.15.37:3300/0 conn(0x7f420406a490 0x7f42040714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4208d88640 1 --2- 172.21.15.37:0/4065433312 >> v2:172.21.15.188:3300/0 conn(0x7f42040aeec0 0x7f42040af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f42037fe640 1 -- 172.21.15.37:0/4065433312 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998932733 0 0) 0x7f420406b3c0 con 0x7f42040d0c80 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f42037fe640 1 -- 172.21.15.37:0/4065433312 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f4003520 con 0x7f42040d0c80 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4209589640 1 -- 172.21.15.37:0/4065433312 >> v2:172.21.15.188:3300/0 conn(0x7f42040aeec0 msgr2=0x7f42040af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4209589640 1 --2- 172.21.15.37:0/4065433312 >> v2:172.21.15.188:3300/0 conn(0x7f42040aeec0 0x7f42040af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4209589640 1 -- 172.21.15.37:0/4065433312 >> v1:172.21.15.37:6789/0 conn(0x7f42040d0c80 legacy=0x7f420415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.512+0000 7f4209589640 1 -- 172.21.15.37:0/4065433312 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420406b0e0 con 0x7f420406a490 2023-11-24T06:14:30.516 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f4209589640 1 --2- 172.21.15.37:0/4065433312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42040714b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4204072650 tx=0x7f41fc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41eee2344cf74a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.517 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f42037fe640 1 -- 172.21.15.37:0/4065433312 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc02cc80 con 0x7f420406a490 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f42037fe640 1 -- 172.21.15.37:0/4065433312 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc02cde0 con 0x7f420406a490 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f42037fe640 1 -- 172.21.15.37:0/4065433312 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc034640 con 0x7f420406a490 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f420afec640 1 -- 172.21.15.37:0/4065433312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 msgr2=0x7f42040714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f420afec640 1 --2- 172.21.15.37:0/4065433312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42040714b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4204072650 tx=0x7f41fc02bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f420afec640 1 -- 172.21.15.37:0/4065433312 shutdown_connections 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f420afec640 1 --2- 172.21.15.37:0/4065433312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42040714b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f420afec640 1 --2- 172.21.15.37:0/4065433312 >> v2:172.21.15.188:3300/0 conn(0x7f42040aeec0 0x7f42040af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f420afec640 1 -- 172.21.15.37:0/4065433312 >> 172.21.15.37:0/4065433312 conn(0x7f42040d0040 msgr2=0x7f42040d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.514+0000 7f420afec640 1 -- 172.21.15.37:0/4065433312 shutdown_connections 2023-11-24T06:14:30.518 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.515+0000 7f420afec640 1 -- 172.21.15.37:0/4065433312 wait complete. 2023-11-24T06:14:30.519 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.516+0000 7f420afec640 1 Processor -- start 2023-11-24T06:14:30.519 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.516+0000 7f420afec640 1 -- start start 2023-11-24T06:14:30.520 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.517+0000 7f420afec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42041f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.520 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.517+0000 7f420afec640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f42040aeec0 0x7f42041611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.520 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.517+0000 7f420afec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4204161700 0x7f42040b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.520 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.517+0000 7f420afec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42041f3bd0 con 0x7f420406a490 2023-11-24T06:14:30.521 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.517+0000 7f420afec640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204161cf0 con 0x7f4204161700 2023-11-24T06:14:30.521 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.517+0000 7f420afec640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42041f2e10 con 0x7f42040aeec0 2023-11-24T06:14:30.521 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42041f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.521 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42041f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36502/0 (socket says 172.21.15.37:36502) 2023-11-24T06:14:30.521 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 -- 172.21.15.37:0/2133245028 learned_addr learned my addr 172.21.15.37:0/2133245028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:30.521 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4209589640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4204161700 0x7f42040b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.521 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4203fff640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f42040aeec0 0x7f42041611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.522 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 -- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f42040aeec0 msgr2=0x7f42041611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f42040aeec0 0x7f42041611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 -- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4204161700 msgr2=0x7f42040b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4204161700 0x7f42040b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 -- 172.21.15.37:0/2133245028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc009a70 con 0x7f420406a490 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.518+0000 7f4208d88640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42041f25c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f41f800e9b0 tx=0x7f41f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.519+0000 7f42017fa640 1 -- 172.21.15.37:0/2133245028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8009670 con 0x7f420406a490 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.519+0000 7f42017fa640 1 -- 172.21.15.37:0/2133245028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800c9a0 con 0x7f420406a490 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.519+0000 7f42017fa640 1 -- 172.21.15.37:0/2133245028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800cd50 con 0x7f420406a490 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.519+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42041f30f0 con 0x7f420406a490 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.519+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42041f36b0 con 0x7f420406a490 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.519+0000 7f42017fa640 1 -- 172.21.15.37:0/2133245028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f41f8013770 con 0x7f420406a490 2023-11-24T06:14:30.523 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.519+0000 7f42017fa640 1 -- 172.21.15.37:0/2133245028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f41f801c450 con 0x7f420406a490 2023-11-24T06:14:30.524 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.520+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42040748f0 con 0x7f420406a490 2023-11-24T06:14:30.525 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.523+0000 7f42017fa640 1 -- 172.21.15.37:0/2133245028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f41f8021060 con 0x7f420406a490 2023-11-24T06:14:30.590 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.587+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4204072720 con 0x7f420406a490 2023-11-24T06:14:30.591 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.588+0000 7f42017fa640 1 -- 172.21.15.37:0/2133245028 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f41f8017070 con 0x7f420406a490 2023-11-24T06:14:30.591 INFO:teuthology.misc.health.smithi037.stdout: 2023-11-24T06:14:30.591 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:29.130794+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:30.593 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.589+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 msgr2=0x7f42041f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.593 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.589+0000 7f420afec640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42041f25c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f41f800e9b0 tx=0x7f41f800ee70 comp rx=0 tx=0).stop 2023-11-24T06:14:30.593 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.590+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 shutdown_connections 2023-11-24T06:14:30.593 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.590+0000 7f420afec640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4204161700 0x7f42040b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.594 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.590+0000 7f420afec640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f42040aeec0 0x7f42041611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.594 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.590+0000 7f420afec640 1 --2- 172.21.15.37:0/2133245028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f420406a490 0x7f42041f25c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.594 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.590+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 >> 172.21.15.37:0/2133245028 conn(0x7f42040d0040 msgr2=0x7f420406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:30.594 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.590+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 shutdown_connections 2023-11-24T06:14:30.594 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:30.590+0000 7f420afec640 1 -- 172.21.15.37:0/2133245028 wait complete. 2023-11-24T06:14:30.605 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T06:14:30.614 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:30.612+0000 7f7bf2448040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:14:30.628 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:30.624+0000 7fb317832040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:14:30.678 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:30.675+0000 7f7bf2448040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:14:30.691 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:30.688+0000 7fb317832040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:14:30.796 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:30.794+0000 7f7bf2448040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:14:30.809 INFO:tasks.ceph.mgr.x.smithi188.stderr:2023-11-24T06:14:30.806+0000 7fb317832040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:14:31.827 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:31.824+0000 7f7b9379c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T06:14:31.832 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:14:31.829+0000 7f7b9379c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T06:14:33.427 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-11-24T06:14:33.424+0000 7fb825c8c500 -1 osd.7 0 log_to_monitors true 2023-11-24T06:14:33.474 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-11-24T06:14:33.472+0000 7fdfb2712500 -1 osd.6 0 log_to_monitors true 2023-11-24T06:14:33.486 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-11-24T06:14:33.483+0000 7fcd15210500 -1 osd.4 0 log_to_monitors true 2023-11-24T06:14:33.489 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-11-24T06:14:33.486+0000 7f6a3c129500 -1 osd.0 0 log_to_monitors true 2023-11-24T06:14:33.521 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-11-24T06:14:33.518+0000 7f5cd4811500 -1 osd.3 0 log_to_monitors true 2023-11-24T06:14:33.653 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-11-24T06:14:33.650+0000 7f7fd380f500 -1 osd.5 0 log_to_monitors true 2023-11-24T06:14:33.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-11-24T06:14:33.666+0000 7f1c52bbe500 -1 osd.2 0 log_to_monitors true 2023-11-24T06:14:33.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-11-24T06:14:33.711+0000 7f3e8b22a500 -1 osd.1 0 log_to_monitors true 2023-11-24T06:14:37.056 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-11-24T06:14:37.053+0000 7fdfade7d640 -1 osd.6 0 waiting for initial osdmap 2023-11-24T06:14:37.070 INFO:tasks.ceph.osd.6.smithi188.stderr:2023-11-24T06:14:37.067+0000 7fdfa64b6640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-11-24T06:14:37.137+0000 7f3e85fdb640 -1 osd.1 0 waiting for initial osdmap 2023-11-24T06:14:37.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-11-24T06:14:37.150+0000 7f3e7e614640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.160 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-11-24T06:14:37.158+0000 7fcd10386640 -1 osd.4 0 waiting for initial osdmap 2023-11-24T06:14:37.166 INFO:tasks.ceph.osd.4.smithi188.stderr:2023-11-24T06:14:37.164+0000 7fcd089bf640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.171 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-11-24T06:14:37.169+0000 7fb822c31640 -1 osd.7 0 waiting for initial osdmap 2023-11-24T06:14:37.177 INFO:tasks.ceph.osd.7.smithi188.stderr:2023-11-24T06:14:37.175+0000 7fb819a32640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.181 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-11-24T06:14:37.178+0000 7f5ccf8ab640 -1 osd.3 0 waiting for initial osdmap 2023-11-24T06:14:37.194 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-11-24T06:14:37.192+0000 7f5cc7ee4640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.210 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-11-24T06:14:37.208+0000 7f7fce8ab640 -1 osd.5 0 waiting for initial osdmap 2023-11-24T06:14:37.217 INFO:tasks.ceph.osd.5.smithi188.stderr:2023-11-24T06:14:37.214+0000 7f7fc6ee4640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-11-24T06:14:37.241+0000 7f1c4e32b640 -1 osd.2 0 waiting for initial osdmap 2023-11-24T06:14:37.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-11-24T06:14:37.249+0000 7f1c46964640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.294 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-11-24T06:14:37.291+0000 7f6a37894640 -1 osd.0 0 waiting for initial osdmap 2023-11-24T06:14:37.309 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-11-24T06:14:37.306+0000 7f6a2fecd640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:14:37.413 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:37.598 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.596+0000 7f8be0ed1640 1 Processor -- start 2023-11-24T06:14:37.599 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.596+0000 7f8be0ed1640 1 -- start start 2023-11-24T06:14:37.600 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.597+0000 7f8be0ed1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bdc0cdd40 0x7f8bdc0cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.601 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8be0ed1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc0b4ac0 con 0x7f8bdc15d720 2023-11-24T06:14:37.601 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8be0ed1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc0ce1c0 con 0x7f8bdc15d340 2023-11-24T06:14:37.601 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8be0ed1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc0cf260 con 0x7f8bdc0cdd40 2023-11-24T06:14:37.601 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8bdbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8bdc15d720 0x7f8bdc167360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43396/0 (socket says 172.21.15.37:43396) 2023-11-24T06:14:37.601 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8bdbfff640 1 -- 172.21.15.37:0/2981337571 learned_addr learned my addr 172.21.15.37:0/2981337571 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:37.601 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8bdaffd640 1 --2- 172.21.15.37:0/2981337571 >> v2:172.21.15.37:3300/0 conn(0x7f8bdc0cdd40 0x7f8bdc0cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.602 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8bda7fc640 1 -- 172.21.15.37:0/2981337571 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280485409 0 0) 0x7f8bdc0b4ac0 con 0x7f8bdc15d720 2023-11-24T06:14:37.602 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.598+0000 7f8bda7fc640 1 -- 172.21.15.37:0/2981337571 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bc8003520 con 0x7f8bdc15d720 2023-11-24T06:14:37.602 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.599+0000 7f8bdaffd640 1 -- 172.21.15.37:0/2981337571 >> v1:172.21.15.188:6789/0 conn(0x7f8bdc15d340 legacy=0x7f8bdc0d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.602 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.599+0000 7f8bdaffd640 1 -- 172.21.15.37:0/2981337571 >> v1:172.21.15.37:6789/0 conn(0x7f8bdc15d720 legacy=0x7f8bdc167360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.602 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.599+0000 7f8bdaffd640 1 -- 172.21.15.37:0/2981337571 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0ce4a0 con 0x7f8bdc0cdd40 2023-11-24T06:14:37.603 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.600+0000 7f8bdaffd640 1 --2- 172.21.15.37:0/2981337571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc0cdd40 0x7f8bdc0cfb90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009d90 tx=0x7f8bc402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222820e9e871a654 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.603 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.600+0000 7f8bda7fc640 1 -- 172.21.15.37:0/2981337571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc402ccf0 con 0x7f8bdc0cdd40 2023-11-24T06:14:37.603 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.600+0000 7f8bda7fc640 1 -- 172.21.15.37:0/2981337571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc402ce50 con 0x7f8bdc0cdd40 2023-11-24T06:14:37.603 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.600+0000 7f8bda7fc640 1 -- 172.21.15.37:0/2981337571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4034660 con 0x7f8bdc0cdd40 2023-11-24T06:14:37.604 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.601+0000 7f8be0ed1640 1 -- 172.21.15.37:0/2981337571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc0cdd40 msgr2=0x7f8bdc0cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.604 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.601+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/2981337571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc0cdd40 0x7f8bdc0cfb90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009d90 tx=0x7f8bc402bf40 comp rx=0 tx=0).stop 2023-11-24T06:14:37.604 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.601+0000 7f8be0ed1640 1 -- 172.21.15.37:0/2981337571 shutdown_connections 2023-11-24T06:14:37.604 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.601+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/2981337571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc0cdd40 0x7f8bdc0cfb90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.604 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.601+0000 7f8be0ed1640 1 -- 172.21.15.37:0/2981337571 >> 172.21.15.37:0/2981337571 conn(0x7f8bdc09c500 msgr2=0x7f8bdc0d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.604 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.601+0000 7f8be0ed1640 1 -- 172.21.15.37:0/2981337571 shutdown_connections 2023-11-24T06:14:37.604 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.601+0000 7f8be0ed1640 1 -- 172.21.15.37:0/2981337571 wait complete. 2023-11-24T06:14:37.605 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.603+0000 7f8be0ed1640 1 Processor -- start 2023-11-24T06:14:37.605 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.603+0000 7f8be0ed1640 1 -- start start 2023-11-24T06:14:37.607 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8be0ed1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bdc0cdd40 0x7f8bdc15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8be0ed1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bdc15d340 0x7f8bdc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8be0ed1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc15d720 0x7f8bdc15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8be0ed1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc15b840 con 0x7f8bdc15d720 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8be0ed1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc15e1c0 con 0x7f8bdc15d340 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8be0ed1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc15e4a0 con 0x7f8bdc0cdd40 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc15d720 0x7f8bdc15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc15d720 0x7f8bdc15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55996/0 (socket says 172.21.15.37:55996) 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.604+0000 7f8bdbfff640 1 -- 172.21.15.37:0/779702182 learned_addr learned my addr 172.21.15.37:0/779702182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bdc0cdd40 0x7f8bdc15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdaffd640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bdc15d340 0x7f8bdc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdbfff640 1 -- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bdc0cdd40 msgr2=0x7f8bdc15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.608 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bdc0cdd40 0x7f8bdc15f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.609 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdbfff640 1 -- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bdc15d340 msgr2=0x7f8bdc15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.609 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bdc15d340 0x7f8bdc15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.609 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdbfff640 1 -- 172.21.15.37:0/779702182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4009a70 con 0x7f8bdc15d720 2023-11-24T06:14:37.609 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdaffd640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bdc15d340 0x7f8bdc15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:37.609 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc15d720 0x7f8bdc15b300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c3c0 tx=0x7f8bd400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.610 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bd3fff640 1 -- 172.21.15.37:0/779702182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4005ce0 con 0x7f8bdc15d720 2023-11-24T06:14:37.610 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bd3fff640 1 -- 172.21.15.37:0/779702182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4005e40 con 0x7f8bdc15d720 2023-11-24T06:14:37.610 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8bd3fff640 1 -- 172.21.15.37:0/779702182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40072f0 con 0x7f8bdc15d720 2023-11-24T06:14:37.610 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.605+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc15e780 con 0x7f8bdc15d720 2023-11-24T06:14:37.610 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.606+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc15ed40 con 0x7f8bdc15d720 2023-11-24T06:14:37.610 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.607+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc15ef30 con 0x7f8bdc15d720 2023-11-24T06:14:37.610 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.608+0000 7f8bd3fff640 1 -- 172.21.15.37:0/779702182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f8bd4007510 con 0x7f8bdc15d720 2023-11-24T06:14:37.611 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.608+0000 7f8bd3fff640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8bbc06adb0 0x7f8bbc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.611 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.609+0000 7f8bd3fff640 1 -- 172.21.15.37:0/779702182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8bd4087d40 con 0x7f8bdc15d720 2023-11-24T06:14:37.611 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.609+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8bbc06adb0 0x7f8bbc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.612 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.609+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8bbc06adb0 0x7f8bbc06d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc000f60 tx=0x7f8bcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.616 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.614+0000 7f8bd3fff640 1 -- 172.21.15.37:0/779702182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8bd4053bc0 con 0x7f8bdc15d720 2023-11-24T06:14:37.802 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.799+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bdc068450 con 0x7f8bdc15d720 2023-11-24T06:14:37.803 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.800+0000 7f8bd3fff640 1 -- 172.21.15.37:0/779702182 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8bd4017070 con 0x7f8bdc15d720 2023-11-24T06:14:37.803 INFO:teuthology.misc.health.smithi037.stdout: 2023-11-24T06:14:37.803 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:34.827163+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:37.805 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8bbc06adb0 msgr2=0x7f8bbc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8bbc06adb0 0x7f8bbc06d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc000f60 tx=0x7f8bcc009040 comp rx=0 tx=0).stop 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc15d720 msgr2=0x7f8bdc15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc15d720 0x7f8bdc15b300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c3c0 tx=0x7f8bd400c880 comp rx=0 tx=0).stop 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 shutdown_connections 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8bbc06adb0 0x7f8bbc06d270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bdc15d340 0x7f8bdc15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc15d720 0x7f8bdc15b300 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 --2- 172.21.15.37:0/779702182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bdc0cdd40 0x7f8bdc15f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.806 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 >> 172.21.15.37:0/779702182 conn(0x7f8bdc09c500 msgr2=0x7f8bdc06b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.807 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 shutdown_connections 2023-11-24T06:14:37.807 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:37.803+0000 7f8be0ed1640 1 -- 172.21.15.37:0/779702182 wait complete. 2023-11-24T06:14:37.820 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T06:14:38.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:38.958 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:44.625 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:44.824 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.821+0000 7f19e28ea640 1 Processor -- start 2023-11-24T06:14:44.824 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.821+0000 7f19e28ea640 1 -- start start 2023-11-24T06:14:44.827 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.823+0000 7f19e28ea640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f19dc143c70 0x7f19dc15f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.827 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.823+0000 7f19e28ea640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc144380 0x7f19dc0b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.828 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.823+0000 7f19e28ea640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19dc0b4710 0x7f19dc0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.828 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.823+0000 7f19e28ea640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0b4b80 con 0x7f19dc0b4710 2023-11-24T06:14:44.828 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.823+0000 7f19e28ea640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0703b0 con 0x7f19dc143c70 2023-11-24T06:14:44.828 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.823+0000 7f19e28ea640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc15fb70 con 0x7f19dc144380 2023-11-24T06:14:44.828 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19dc0b4710 0x7f19dc0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.828 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19dc0b4710 0x7f19dc0cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32950/0 (socket says 172.21.15.37:32950) 2023-11-24T06:14:44.829 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 -- 172.21.15.37:0/3988521307 learned_addr learned my addr 172.21.15.37:0/3988521307 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:44.829 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e18e8640 1 --2- 172.21.15.37:0/3988521307 >> v2:172.21.15.188:3300/0 conn(0x7f19dc143c70 0x7f19dc15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.829 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e10e7640 1 --2- 172.21.15.37:0/3988521307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc144380 0x7f19dc0b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.829 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 -- 172.21.15.37:0/3988521307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc144380 msgr2=0x7f19dc0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:44.829 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 --2- 172.21.15.37:0/3988521307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc144380 0x7f19dc0b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.829 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 -- 172.21.15.37:0/3988521307 >> v2:172.21.15.188:3300/0 conn(0x7f19dc143c70 msgr2=0x7f19dc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:44.829 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 --2- 172.21.15.37:0/3988521307 >> v2:172.21.15.188:3300/0 conn(0x7f19dc143c70 0x7f19dc15f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.830 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.824+0000 7f19e20e9640 1 -- 172.21.15.37:0/3988521307 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc070650 con 0x7f19dc0b4710 2023-11-24T06:14:44.832 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.826+0000 7f19e20e9640 1 --2- 172.21.15.37:0/3988521307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc0b4710 0x7f19dc0cc570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0ced70 tx=0x7f19d402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c57f56a541b3c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:44.832 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.826+0000 7f19e08e6640 1 -- 172.21.15.37:0/3988521307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d402c950 con 0x7f19dc0b4710 2023-11-24T06:14:44.832 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.826+0000 7f19e08e6640 1 -- 172.21.15.37:0/3988521307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d402cab0 con 0x7f19dc0b4710 2023-11-24T06:14:44.832 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.826+0000 7f19e08e6640 1 -- 172.21.15.37:0/3988521307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d402ce40 con 0x7f19dc0b4710 2023-11-24T06:14:44.833 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 -- 172.21.15.37:0/3988521307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc0b4710 msgr2=0x7f19dc0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.833 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 --2- 172.21.15.37:0/3988521307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc0b4710 0x7f19dc0cc570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0ced70 tx=0x7f19d402bdb0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.833 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 -- 172.21.15.37:0/3988521307 shutdown_connections 2023-11-24T06:14:44.833 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 --2- 172.21.15.37:0/3988521307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc0b4710 0x7f19dc0cc570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.834 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 --2- 172.21.15.37:0/3988521307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc144380 0x7f19dc0b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.834 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 --2- 172.21.15.37:0/3988521307 >> v2:172.21.15.188:3300/0 conn(0x7f19dc143c70 0x7f19dc15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.834 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 -- 172.21.15.37:0/3988521307 >> 172.21.15.37:0/3988521307 conn(0x7f19dc06c460 msgr2=0x7f19dc06c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:44.834 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 -- 172.21.15.37:0/3988521307 shutdown_connections 2023-11-24T06:14:44.835 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.827+0000 7f19e28ea640 1 -- 172.21.15.37:0/3988521307 wait complete. 2023-11-24T06:14:44.835 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.829+0000 7f19e28ea640 1 Processor -- start 2023-11-24T06:14:44.835 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.829+0000 7f19e28ea640 1 -- start start 2023-11-24T06:14:44.840 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e28ea640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc0b4710 0x7f19dc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.840 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e28ea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19dc143c70 0x7f19dc13d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.840 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e28ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc144380 0x7f19dc139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.840 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e28ea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc15c890 con 0x7f19dc144380 2023-11-24T06:14:44.840 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e28ea640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0b2020 con 0x7f19dc143c70 2023-11-24T06:14:44.841 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e28ea640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0b28c0 con 0x7f19dc0b4710 2023-11-24T06:14:44.841 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e20e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc144380 0x7f19dc139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.841 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e20e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc144380 0x7f19dc139a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32966/0 (socket says 172.21.15.37:32966) 2023-11-24T06:14:44.841 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e20e9640 1 -- 172.21.15.37:0/2507841891 learned_addr learned my addr 172.21.15.37:0/2507841891 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:44.842 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e18e8640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc0b4710 0x7f19dc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.842 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.831+0000 7f19e10e7640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19dc143c70 0x7f19dc13d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.842 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e20e9640 1 -- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc0b4710 msgr2=0x7f19dc15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.842 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e20e9640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc0b4710 0x7f19dc15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.842 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e20e9640 1 -- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19dc143c70 msgr2=0x7f19dc13d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.842 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e20e9640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19dc143c70 0x7f19dc13d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.843 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e20e9640 1 -- 172.21.15.37:0/2507841891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4009b30 con 0x7f19dc144380 2023-11-24T06:14:44.843 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e20e9640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc144380 0x7f19dc139a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19d4036040 tx=0x7f19d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:44.843 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19d27fc640 1 -- 172.21.15.37:0/2507841891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4009510 con 0x7f19dc144380 2023-11-24T06:14:44.843 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19d27fc640 1 -- 172.21.15.37:0/2507841891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d403e450 con 0x7f19dc144380 2023-11-24T06:14:44.843 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19d27fc640 1 -- 172.21.15.37:0/2507841891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d403e800 con 0x7f19dc144380 2023-11-24T06:14:44.843 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc15c5b0 con 0x7f19dc144380 2023-11-24T06:14:44.844 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.832+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc0b2550 con 0x7f19dc144380 2023-11-24T06:14:44.844 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.834+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc0b2a70 con 0x7f19dc144380 2023-11-24T06:14:44.844 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.835+0000 7f19d27fc640 1 -- 172.21.15.37:0/2507841891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19d403e960 con 0x7f19dc144380 2023-11-24T06:14:44.844 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.836+0000 7f19d27fc640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.844 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.836+0000 7f19d27fc640 1 -- 172.21.15.37:0/2507841891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19d40ac070 con 0x7f19dc144380 2023-11-24T06:14:44.844 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.836+0000 7f19e18e8640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.844 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.837+0000 7f19e18e8640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19d8006fd0 tx=0x7f19d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:44.845 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:44.841+0000 7f19d27fc640 1 -- 172.21.15.37:0/2507841891 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19dc0b2a70 con 0x7f19dc144380 2023-11-24T06:14:45.040 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.038+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19dc0b2a30 con 0x7f19dc144380 2023-11-24T06:14:45.042 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.039+0000 7f19d27fc640 1 -- 172.21.15.37:0/2507841891 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f19d4077470 con 0x7f19dc144380 2023-11-24T06:14:45.042 INFO:teuthology.misc.health.smithi037.stdout: 2023-11-24T06:14:45.042 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":16,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:41.107605+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:45.045 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 msgr2=0x7f19c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.045 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19d8006fd0 tx=0x7f19d8008040 comp rx=0 tx=0).stop 2023-11-24T06:14:45.045 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc144380 msgr2=0x7f19dc139a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.045 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc144380 0x7f19dc139a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19d4036040 tx=0x7f19d4004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:45.045 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 shutdown_connections 2023-11-24T06:14:45.045 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.046 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19dc143c70 0x7f19dc13d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.046 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc144380 0x7f19dc139a30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.046 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 --2- 172.21.15.37:0/2507841891 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc0b4710 0x7f19dc15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.046 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 >> 172.21.15.37:0/2507841891 conn(0x7f19dc06c460 msgr2=0x7f19dc0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:45.046 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.042+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 shutdown_connections 2023-11-24T06:14:45.046 INFO:teuthology.misc.health.smithi037.stderr:2023-11-24T06:14:45.043+0000 7f19e28ea640 1 -- 172.21.15.37:0/2507841891 wait complete. 2023-11-24T06:14:45.060 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T06:14:45.060 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T06:14:45.061 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:14:45.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:14:45.069 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:14:45.070 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:14:45.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:14:45.078 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:14:45.078 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:14:45.079 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:14:45.087 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:14:45.088 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:14:45.088 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:14:45.097 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:14:45.097 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T06:14:45.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:45.230 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-11-24T06:14:45.242 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-11-24T06:14:45.254 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2023-11-24T06:14:45.258 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2023-11-24T06:14:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.290+0000 7f1599761640 1 Processor -- start 2023-11-24T06:14:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.290+0000 7f1599761640 1 -- start start 2023-11-24T06:14:45.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.291+0000 7f1599761640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15940d1ed0 0x7f15940d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.291+0000 7f1599761640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d22b0 0x7f15940ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.291+0000 7f1599761640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15940b2d90 con 0x7f15940ce710 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.291+0000 7f1599761640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15940ceb80 con 0x7f15940d1ed0 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.291+0000 7f1599761640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940d1540 con 0x7f15940d22b0 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.291+0000 7f1592ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15940d1ed0 0x7f15940d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.291+0000 7f15937fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15940ce710 0x7f15940cfdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34890/0 (socket says 172.21.15.37:34890) 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.292+0000 7f15937fe640 1 -- 172.21.15.37:0/370572965 learned_addr learned my addr 172.21.15.37:0/370572965 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.292+0000 7f15927fc640 1 --2- 172.21.15.37:0/370572965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d22b0 0x7f15940ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.292+0000 7f1592ffd640 1 -- 172.21.15.37:0/370572965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d22b0 msgr2=0x7f15940ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.292+0000 7f1592ffd640 1 --2- 172.21.15.37:0/370572965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d22b0 0x7f15940ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.292+0000 7f1592ffd640 1 -- 172.21.15.37:0/370572965 >> v1:172.21.15.37:6789/0 conn(0x7f15940ce710 legacy=0x7f15940cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.292+0000 7f1592ffd640 1 -- 172.21.15.37:0/370572965 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940b45f0 con 0x7f15940d1ed0 2023-11-24T06:14:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.292+0000 7f1591ffb640 1 -- 172.21.15.37:0/370572965 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032009529 0 0) 0x7f15940b2d90 con 0x7f15940ce710 2023-11-24T06:14:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.293+0000 7f1592ffd640 1 --2- 172.21.15.37:0/370572965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940d1ed0 0x7f15940d1000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15840097a0 tx=0x7f158402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783f4f41a7dd72ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.293+0000 7f1591ffb640 1 -- 172.21.15.37:0/370572965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158402e070 con 0x7f15940d1ed0 2023-11-24T06:14:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.293+0000 7f1591ffb640 1 -- 172.21.15.37:0/370572965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15840315a0 con 0x7f15940d1ed0 2023-11-24T06:14:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.293+0000 7f1591ffb640 1 -- 172.21.15.37:0/370572965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584031930 con 0x7f15940d1ed0 2023-11-24T06:14:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 -- 172.21.15.37:0/370572965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940d1ed0 msgr2=0x7f15940d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 --2- 172.21.15.37:0/370572965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940d1ed0 0x7f15940d1000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f15840097a0 tx=0x7f158402b840 comp rx=0 tx=0).stop 2023-11-24T06:14:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 -- 172.21.15.37:0/370572965 shutdown_connections 2023-11-24T06:14:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 --2- 172.21.15.37:0/370572965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d22b0 0x7f15940ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 --2- 172.21.15.37:0/370572965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940d1ed0 0x7f15940d1000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 -- 172.21.15.37:0/370572965 >> 172.21.15.37:0/370572965 conn(0x7f159408af60 msgr2=0x7f15940d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 -- 172.21.15.37:0/370572965 shutdown_connections 2023-11-24T06:14:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.294+0000 7f1599761640 1 -- 172.21.15.37:0/370572965 wait complete. 2023-11-24T06:14:45.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.296+0000 7f1599761640 1 Processor -- start 2023-11-24T06:14:45.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.296+0000 7f1599761640 1 -- start start 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.297+0000 7f1599761640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940ce710 0x7f15941e1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.297+0000 7f1599761640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d1ed0 0x7f15941e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.297+0000 7f1599761640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15940d22b0 0x7f15941e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.297+0000 7f1599761640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940b74d0 con 0x7f15940ce710 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.297+0000 7f1599761640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940b72d0 con 0x7f15940d22b0 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.297+0000 7f1599761640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940cd120 con 0x7f15940d1ed0 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.297+0000 7f1592ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940ce710 0x7f15941e1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940ce710 0x7f15941e1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33026/0 (socket says 172.21.15.37:33026) 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 -- 172.21.15.37:0/1702363093 learned_addr learned my addr 172.21.15.37:0/1702363093 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f15927fc640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d1ed0 0x7f15941e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f15937fe640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15940d22b0 0x7f15941e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 -- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d1ed0 msgr2=0x7f15941e5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d1ed0 0x7f15941e5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 -- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15940d22b0 msgr2=0x7f15941e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15940d22b0 0x7f15941e59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 -- 172.21.15.37:0/1702363093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584009400 con 0x7f15940ce710 2023-11-24T06:14:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.298+0000 7f1592ffd640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940ce710 0x7f15941e1bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1584034040 tx=0x7f15840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.299+0000 7f158b7fe640 1 -- 172.21.15.37:0/1702363093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584032840 con 0x7f15940ce710 2023-11-24T06:14:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.299+0000 7f158b7fe640 1 -- 172.21.15.37:0/1702363093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15840329a0 con 0x7f15940ce710 2023-11-24T06:14:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.299+0000 7f158b7fe640 1 -- 172.21.15.37:0/1702363093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584032d50 con 0x7f15940ce710 2023-11-24T06:14:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.299+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15941e5fe0 con 0x7f15940ce710 2023-11-24T06:14:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.299+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15941e65a0 con 0x7f15940ce710 2023-11-24T06:14:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.300+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1594067470 con 0x7f15940ce710 2023-11-24T06:14:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.301+0000 7f158b7fe640 1 -- 172.21.15.37:0/1702363093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f158404e430 con 0x7f15940ce710 2023-11-24T06:14:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.302+0000 7f158b7fe640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f157406ae40 0x7f157406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.302+0000 7f158b7fe640 1 -- 172.21.15.37:0/1702363093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f15840ab210 con 0x7f15940ce710 2023-11-24T06:14:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.302+0000 7f15927fc640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f157406ae40 0x7f157406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.303+0000 7f15927fc640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f157406ae40 0x7f157406d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15940b5ac0 tx=0x7f157c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.307+0000 7f158b7fe640 1 -- 172.21.15.37:0/1702363093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1584076620 con 0x7f15940ce710 2023-11-24T06:14:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.500+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15940b2b50 con 0x7f15940ce710 2023-11-24T06:14:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.501+0000 7f158b7fe640 1 -- 172.21.15.37:0/1702363093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f1584079c40 con 0x7f15940ce710 2023-11-24T06:14:45.504 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:45.505 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:41.107605+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f157406ae40 msgr2=0x7f157406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f157406ae40 0x7f157406d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15940b5ac0 tx=0x7f157c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940ce710 msgr2=0x7f15941e1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940ce710 0x7f15941e1bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1584034040 tx=0x7f15840046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 shutdown_connections 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f157406ae40 0x7f157406d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15940d22b0 0x7f15941e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15940d1ed0 0x7f15941e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 --2- 172.21.15.37:0/1702363093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15940ce710 0x7f15941e1bc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 >> 172.21.15.37:0/1702363093 conn(0x7f159408af60 msgr2=0x7f15940b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 shutdown_connections 2023-11-24T06:14:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.504+0000 7f1599761640 1 -- 172.21.15.37:0/1702363093 wait complete. 2023-11-24T06:14:45.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:45.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.749+0000 7f621e935640 1 Processor -- start 2023-11-24T06:14:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.750+0000 7f621e935640 1 -- start start 2023-11-24T06:14:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.751+0000 7f621e935640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6218160ab0 0x7f62180d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.751+0000 7f621e935640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62180d3ab0 0x7f62180cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.751+0000 7f621e935640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62180ce730 con 0x7f62180d1450 2023-11-24T06:14:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.751+0000 7f621e935640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62180cde00 con 0x7f62180d3ab0 2023-11-24T06:14:45.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.751+0000 7f621e935640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180ce0e0 con 0x7f6218160ab0 2023-11-24T06:14:45.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.751+0000 7f621d132640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62180d3ab0 0x7f62180cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.752+0000 7f621d132640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62180d3ab0 0x7f62180cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33028/0 (socket says 172.21.15.37:33028) 2023-11-24T06:14:45.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.752+0000 7f621d132640 1 -- 172.21.15.37:0/426491533 learned_addr learned my addr 172.21.15.37:0/426491533 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.752+0000 7f621d132640 1 -- 172.21.15.37:0/426491533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6218160ab0 msgr2=0x7f62180d0190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.752+0000 7f621d132640 1 --2- 172.21.15.37:0/426491533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6218160ab0 0x7f62180d0190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.752+0000 7f621d132640 1 -- 172.21.15.37:0/426491533 >> v1:172.21.15.188:6789/0 conn(0x7f62180d1450 legacy=0x7f62180afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.752+0000 7f621d132640 1 -- 172.21.15.37:0/426491533 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62180ce3c0 con 0x7f62180d3ab0 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.753+0000 7f621d132640 1 --2- 172.21.15.37:0/426491533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62180d3ab0 0x7f62180cebc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6208009870 tx=0x7f620802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7a1779a951dd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.753+0000 7f621c931640 1 -- 172.21.15.37:0/426491533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208031870 con 0x7f62180d3ab0 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.753+0000 7f621c931640 1 -- 172.21.15.37:0/426491533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080319d0 con 0x7f62180d3ab0 2023-11-24T06:14:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.753+0000 7f621c931640 1 -- 172.21.15.37:0/426491533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208031d60 con 0x7f62180d3ab0 2023-11-24T06:14:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 -- 172.21.15.37:0/426491533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62180d3ab0 msgr2=0x7f62180cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 --2- 172.21.15.37:0/426491533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62180d3ab0 0x7f62180cebc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6208009870 tx=0x7f620802b910 comp rx=0 tx=0).stop 2023-11-24T06:14:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 -- 172.21.15.37:0/426491533 shutdown_connections 2023-11-24T06:14:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 --2- 172.21.15.37:0/426491533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62180d3ab0 0x7f62180cebc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 --2- 172.21.15.37:0/426491533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6218160ab0 0x7f62180d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 -- 172.21.15.37:0/426491533 >> 172.21.15.37:0/426491533 conn(0x7f621809c4d0 msgr2=0x7f62180d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 -- 172.21.15.37:0/426491533 shutdown_connections 2023-11-24T06:14:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.754+0000 7f621e935640 1 -- 172.21.15.37:0/426491533 wait complete. 2023-11-24T06:14:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.756+0000 7f621e935640 1 Processor -- start 2023-11-24T06:14:45.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.756+0000 7f621e935640 1 -- start start 2023-11-24T06:14:45.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.757+0000 7f621e935640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62180d1450 0x7f621815f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.757+0000 7f621e935640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62180d3ab0 0x7f62180b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.757+0000 7f621e935640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218160ab0 0x7f62180c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.757+0000 7f621e935640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621814a100 con 0x7f6218160ab0 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.757+0000 7f621e935640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180c9ba0 con 0x7f62180d1450 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.757+0000 7f621e935640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621815eaa0 con 0x7f62180d3ab0 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218160ab0 0x7f62180c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218160ab0 0x7f62180c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33034/0 (socket says 172.21.15.37:33034) 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 -- 172.21.15.37:0/3591208372 learned_addr learned my addr 172.21.15.37:0/3591208372 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621d933640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62180d1450 0x7f621815f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621d132640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62180d3ab0 0x7f62180b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 -- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62180d3ab0 msgr2=0x7f62180b8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62180d3ab0 0x7f62180b8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 -- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62180d1450 msgr2=0x7f621815f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62180d1450 0x7f621815f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 -- 172.21.15.37:0/3591208372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62080094d0 con 0x7f6218160ab0 2023-11-24T06:14:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.758+0000 7f621e134640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218160ab0 0x7f62180c6cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f621000b410 tx=0x7f621000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.759+0000 7f620e7fc640 1 -- 172.21.15.37:0/3591208372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210004020 con 0x7f6218160ab0 2023-11-24T06:14:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.759+0000 7f620e7fc640 1 -- 172.21.15.37:0/3591208372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210004180 con 0x7f6218160ab0 2023-11-24T06:14:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.759+0000 7f620e7fc640 1 -- 172.21.15.37:0/3591208372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210011630 con 0x7f6218160ab0 2023-11-24T06:14:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.759+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621815ed80 con 0x7f6218160ab0 2023-11-24T06:14:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.759+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62180c9e80 con 0x7f6218160ab0 2023-11-24T06:14:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.760+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621815f2a0 con 0x7f6218160ab0 2023-11-24T06:14:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.761+0000 7f620e7fc640 1 -- 172.21.15.37:0/3591208372 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6210011790 con 0x7f6218160ab0 2023-11-24T06:14:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.762+0000 7f620e7fc640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f61fc06ae70 0x7f61fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.762+0000 7f620e7fc640 1 -- 172.21.15.37:0/3591208372 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6210088fb0 con 0x7f6218160ab0 2023-11-24T06:14:45.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.762+0000 7f621d933640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f61fc06ae70 0x7f61fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.763+0000 7f621d933640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f61fc06ae70 0x7f61fc06d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6214009f60 tx=0x7f62140094f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.767+0000 7f620e7fc640 1 -- 172.21.15.37:0/3591208372 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f621815f2a0 con 0x7f6218160ab0 2023-11-24T06:14:45.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.962+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f621815f2a0 con 0x7f6218160ab0 2023-11-24T06:14:45.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.963+0000 7f620e7fc640 1 -- 172.21.15.37:0/3591208372 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f621815f2a0 con 0x7f6218160ab0 2023-11-24T06:14:45.966 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:14:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.965+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f61fc06ae70 msgr2=0x7f61fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.965+0000 7f621e935640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f61fc06ae70 0x7f61fc06d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6214009f60 tx=0x7f62140094f0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.965+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218160ab0 msgr2=0x7f62180c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.965+0000 7f621e935640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218160ab0 0x7f62180c6cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f621000b410 tx=0x7f621000b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 shutdown_connections 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f61fc06ae70 0x7f61fc06d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218160ab0 0x7f62180c6cc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62180d3ab0 0x7f62180b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 --2- 172.21.15.37:0/3591208372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62180d1450 0x7f621815f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 >> 172.21.15.37:0/3591208372 conn(0x7f621809c4d0 msgr2=0x7f62180cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 shutdown_connections 2023-11-24T06:14:45.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:45.966+0000 7f621e935640 1 -- 172.21.15.37:0/3591208372 wait complete. 2023-11-24T06:14:45.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.209+0000 7f2332f99640 1 Processor -- start 2023-11-24T06:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.209+0000 7f2332f99640 1 -- start start 2023-11-24T06:14:46.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.210+0000 7f2332f99640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f232c15d4e0 0x7f232c0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.210+0000 7f2332f99640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f232c0d0240 0x7f232c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.210+0000 7f2332f99640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c0ce990 con 0x7f232c0d38e0 2023-11-24T06:14:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.210+0000 7f2332f99640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c0d4110 con 0x7f232c0d0240 2023-11-24T06:14:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.210+0000 7f2332f99640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c0cec70 con 0x7f232c15d4e0 2023-11-24T06:14:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2332798640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f232c0d0240 0x7f232c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2332798640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f232c0d0240 0x7f232c0b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33050/0 (socket says 172.21.15.37:33050) 2023-11-24T06:14:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2332798640 1 -- 172.21.15.37:0/4255673046 learned_addr learned my addr 172.21.15.37:0/4255673046 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2331f97640 1 --2- 172.21.15.37:0/4255673046 >> v2:172.21.15.188:3300/0 conn(0x7f232c15d4e0 0x7f232c0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2332798640 1 -- 172.21.15.37:0/4255673046 >> v2:172.21.15.188:3300/0 conn(0x7f232c15d4e0 msgr2=0x7f232c0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2332798640 1 --2- 172.21.15.37:0/4255673046 >> v2:172.21.15.188:3300/0 conn(0x7f232c15d4e0 0x7f232c0d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2332798640 1 -- 172.21.15.37:0/4255673046 >> v1:172.21.15.188:6789/0 conn(0x7f232c0d38e0 legacy=0x7f232c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.211+0000 7f2332798640 1 -- 172.21.15.37:0/4255673046 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0cef50 con 0x7f232c0d0240 2023-11-24T06:14:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.213+0000 7f2332798640 1 --2- 172.21.15.37:0/4255673046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d0240 0x7f232c0b2e50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f232c08b800 tx=0x7f232402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c38c02832f3015 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.213+0000 7f2330f95640 1 -- 172.21.15.37:0/4255673046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324031870 con 0x7f232c0d0240 2023-11-24T06:14:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.213+0000 7f2330f95640 1 -- 172.21.15.37:0/4255673046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23240319d0 con 0x7f232c0d0240 2023-11-24T06:14:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.213+0000 7f2330f95640 1 -- 172.21.15.37:0/4255673046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324031d60 con 0x7f232c0d0240 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 -- 172.21.15.37:0/4255673046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d0240 msgr2=0x7f232c0b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 --2- 172.21.15.37:0/4255673046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d0240 0x7f232c0b2e50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f232c08b800 tx=0x7f232402b910 comp rx=0 tx=0).stop 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 -- 172.21.15.37:0/4255673046 shutdown_connections 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 --2- 172.21.15.37:0/4255673046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d0240 0x7f232c0b2e50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 --2- 172.21.15.37:0/4255673046 >> v2:172.21.15.188:3300/0 conn(0x7f232c15d4e0 0x7f232c0d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 -- 172.21.15.37:0/4255673046 >> 172.21.15.37:0/4255673046 conn(0x7f232c09c510 msgr2=0x7f232c0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 -- 172.21.15.37:0/4255673046 shutdown_connections 2023-11-24T06:14:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.214+0000 7f2332f99640 1 -- 172.21.15.37:0/4255673046 wait complete. 2023-11-24T06:14:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.216+0000 7f2332f99640 1 Processor -- start 2023-11-24T06:14:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.216+0000 7f2332f99640 1 -- start start 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2332f99640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0d0240 0x7f232c0c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2332f99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d38e0 0x7f232c0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2332f99640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c15d4e0 0x7f232c1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2332f99640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0c8f50 con 0x7f232c0d38e0 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2332f99640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0b6290 con 0x7f232c15d4e0 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2332f99640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1f3e90 con 0x7f232c0d0240 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2331796640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d38e0 0x7f232c0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2331796640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d38e0 0x7f232c0c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33054/0 (socket says 172.21.15.37:33054) 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.217+0000 7f2331796640 1 -- 172.21.15.37:0/4273198919 learned_addr learned my addr 172.21.15.37:0/4273198919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2331f97640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0d0240 0x7f232c0c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2332798640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c15d4e0 0x7f232c1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2331796640 1 -- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0d0240 msgr2=0x7f232c0c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2331796640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0d0240 0x7f232c0c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2331796640 1 -- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c15d4e0 msgr2=0x7f232c1f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2331796640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c15d4e0 0x7f232c1f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2331796640 1 -- 172.21.15.37:0/4273198919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240094d0 con 0x7f232c0d38e0 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2332798640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c15d4e0 0x7f232c1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2331796640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d38e0 0x7f232c0c80a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c430 tx=0x7f231c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f23227fc640 1 -- 172.21.15.37:0/4273198919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c011790 con 0x7f232c0d38e0 2023-11-24T06:14:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f23227fc640 1 -- 172.21.15.37:0/4273198919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c0118f0 con 0x7f232c0d38e0 2023-11-24T06:14:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f23227fc640 1 -- 172.21.15.37:0/4273198919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c011ce0 con 0x7f232c0d38e0 2023-11-24T06:14:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.218+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c0c8990 con 0x7f232c0d38e0 2023-11-24T06:14:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.219+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c0b5f20 con 0x7f232c0d38e0 2023-11-24T06:14:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.220+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c0b6400 con 0x7f232c0d38e0 2023-11-24T06:14:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.221+0000 7f23227fc640 1 -- 172.21.15.37:0/4273198919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f231c01c460 con 0x7f232c0d38e0 2023-11-24T06:14:46.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.221+0000 7f23227fc640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f231006ae40 0x7f231006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.222+0000 7f23227fc640 1 -- 172.21.15.37:0/4273198919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f231c089270 con 0x7f232c0d38e0 2023-11-24T06:14:46.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.222+0000 7f2331f97640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f231006ae40 0x7f231006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.222+0000 7f2331f97640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f231006ae40 0x7f231006d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23280099c0 tx=0x7f2328003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.226+0000 7f23227fc640 1 -- 172.21.15.37:0/4273198919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f231c054660 con 0x7f232c0d38e0 2023-11-24T06:14:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.458+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f232c04e840 con 0x7f232c0d38e0 2023-11-24T06:14:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.459+0000 7f23227fc640 1 -- 172.21.15.37:0/4273198919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f231c057c80 con 0x7f232c0d38e0 2023-11-24T06:14:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:46.463 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-24T06:14:46.463 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-11-24T06:14:46.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f231006ae40 msgr2=0x7f231006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f231006ae40 0x7f231006d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23280099c0 tx=0x7f2328003990 comp rx=0 tx=0).stop 2023-11-24T06:14:46.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d38e0 msgr2=0x7f232c0c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d38e0 0x7f232c0c80a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c430 tx=0x7f231c00c8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 shutdown_connections 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f231006ae40 0x7f231006d300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c15d4e0 0x7f232c1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f232c0d38e0 0x7f232c0c80a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 --2- 172.21.15.37:0/4273198919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0d0240 0x7f232c0c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 >> 172.21.15.37:0/4273198919 conn(0x7f232c09c510 msgr2=0x7f232c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 shutdown_connections 2023-11-24T06:14:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.462+0000 7f2332f99640 1 -- 172.21.15.37:0/4273198919 wait complete. 2023-11-24T06:14:46.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.699+0000 7f1f9519a640 1 Processor -- start 2023-11-24T06:14:46.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.700+0000 7f1f9519a640 1 -- start start 2023-11-24T06:14:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.701+0000 7f1f9519a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f9015d4e0 0x7f1f900d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.701+0000 7f1f9519a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f900d0240 0x7f1f900b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.701+0000 7f1f9519a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f900ce990 con 0x7f1f900d38e0 2023-11-24T06:14:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.701+0000 7f1f9519a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f900d4110 con 0x7f1f9015d4e0 2023-11-24T06:14:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.701+0000 7f1f9519a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900cec70 con 0x7f1f900d0240 2023-11-24T06:14:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.701+0000 7f1f8ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f9015d4e0 0x7f1f900d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.702+0000 7f1f8f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1f900d38e0 0x7f1f900cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34898/0 (socket says 172.21.15.37:34898) 2023-11-24T06:14:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.702+0000 7f1f8f7fe640 1 -- 172.21.15.37:0/2897105891 learned_addr learned my addr 172.21.15.37:0/2897105891 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.702+0000 7f1f8ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f9015d4e0 0x7f1f900d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33066/0 (socket says 172.21.15.37:33066) 2023-11-24T06:14:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.702+0000 7f1f8ffff640 1 -- 172.21.15.37:0/2897105891 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f900d0240 msgr2=0x7f1f900b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.702+0000 7f1f8ffff640 1 --2- 172.21.15.37:0/2897105891 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f900d0240 0x7f1f900b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.702+0000 7f1f8ffff640 1 -- 172.21.15.37:0/2897105891 >> v1:172.21.15.37:6789/0 conn(0x7f1f900d38e0 legacy=0x7f1f900cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.702+0000 7f1f8ffff640 1 -- 172.21.15.37:0/2897105891 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900cef50 con 0x7f1f9015d4e0 2023-11-24T06:14:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.703+0000 7f1f8ffff640 1 --2- 172.21.15.37:0/2897105891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f9015d4e0 0x7f1f900d1e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009d90 tx=0x7f1f8002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54aaea29ef77037 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.703+0000 7f1f8effd640 1 -- 172.21.15.37:0/2897105891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8002cc60 con 0x7f1f9015d4e0 2023-11-24T06:14:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f8effd640 1 -- 172.21.15.37:0/2897105891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8002cdc0 con 0x7f1f9015d4e0 2023-11-24T06:14:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f8effd640 1 -- 172.21.15.37:0/2897105891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80034660 con 0x7f1f9015d4e0 2023-11-24T06:14:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 -- 172.21.15.37:0/2897105891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f9015d4e0 msgr2=0x7f1f900d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 --2- 172.21.15.37:0/2897105891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f9015d4e0 0x7f1f900d1e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009d90 tx=0x7f1f8002beb0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 -- 172.21.15.37:0/2897105891 shutdown_connections 2023-11-24T06:14:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 --2- 172.21.15.37:0/2897105891 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f900d0240 0x7f1f900b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 --2- 172.21.15.37:0/2897105891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f9015d4e0 0x7f1f900d1e20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 -- 172.21.15.37:0/2897105891 >> 172.21.15.37:0/2897105891 conn(0x7f1f9009c510 msgr2=0x7f1f900d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 -- 172.21.15.37:0/2897105891 shutdown_connections 2023-11-24T06:14:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.704+0000 7f1f9519a640 1 -- 172.21.15.37:0/2897105891 wait complete. 2023-11-24T06:14:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.706+0000 7f1f9519a640 1 Processor -- start 2023-11-24T06:14:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.706+0000 7f1f9519a640 1 -- start start 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f9519a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f900d0240 0x7f1f900b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f9519a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f900d38e0 0x7f1f900b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f9519a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f9015d4e0 0x7f1f900c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f9519a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9015e2c0 con 0x7f1f900d38e0 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f9519a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900b77f0 con 0x7f1f900d0240 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f9519a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900b7280 con 0x7f1f9015d4e0 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f8f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f900d38e0 0x7f1f900b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f8f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f900d38e0 0x7f1f900b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33076/0 (socket says 172.21.15.37:33076) 2023-11-24T06:14:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.707+0000 7f1f8f7fe640 1 -- 172.21.15.37:0/3533435668 learned_addr learned my addr 172.21.15.37:0/3533435668 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f94999640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f9015d4e0 0x7f1f900c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8f7fe640 1 -- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f9015d4e0 msgr2=0x7f1f900c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8f7fe640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f9015d4e0 0x7f1f900c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8f7fe640 1 -- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f900d0240 msgr2=0x7f1f900b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8f7fe640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f900d0240 0x7f1f900b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8f7fe640 1 -- 172.21.15.37:0/3533435668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80009a70 con 0x7f1f900d38e0 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f94999640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f9015d4e0 0x7f1f900c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8f7fe640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f900d38e0 0x7f1f900b6d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c450 tx=0x7f1f8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8cff9640 1 -- 172.21.15.37:0/3533435668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84005ce0 con 0x7f1f900d38e0 2023-11-24T06:14:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8cff9640 1 -- 172.21.15.37:0/3533435668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84005e40 con 0x7f1f900d38e0 2023-11-24T06:14:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f8cff9640 1 -- 172.21.15.37:0/3533435668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840072b0 con 0x7f1f900d38e0 2023-11-24T06:14:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.708+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f901f63a0 con 0x7f1f900d38e0 2023-11-24T06:14:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.709+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9015dc00 con 0x7f1f900d38e0 2023-11-24T06:14:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.710+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9015e400 con 0x7f1f900d38e0 2023-11-24T06:14:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.711+0000 7f1f8cff9640 1 -- 172.21.15.37:0/3533435668 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f84007410 con 0x7f1f900d38e0 2023-11-24T06:14:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.711+0000 7f1f8cff9640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f7c06ae40 0x7f1f7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.712+0000 7f1f8cff9640 1 -- 172.21.15.37:0/3533435668 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f84088810 con 0x7f1f900d38e0 2023-11-24T06:14:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.712+0000 7f1f8ffff640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f7c06ae40 0x7f1f7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.713+0000 7f1f8ffff640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f7c06ae40 0x7f1f7c06d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f80036000 tx=0x7f1f8002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.716+0000 7f1f8cff9640 1 -- 172.21.15.37:0/3533435668 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f9015e400 con 0x7f1f900d38e0 2023-11-24T06:14:46.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.912+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f9015e400 con 0x7f1f900d38e0 2023-11-24T06:14:46.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.914+0000 7f1f8cff9640 1 -- 172.21.15.37:0/3533435668 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f1f9015e400 con 0x7f1f900d38e0 2023-11-24T06:14:46.917 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:46.917 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:41.107605+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f7c06ae40 msgr2=0x7f1f7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f7c06ae40 0x7f1f7c06d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f80036000 tx=0x7f1f8002e000 comp rx=0 tx=0).stop 2023-11-24T06:14:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f900d38e0 msgr2=0x7f1f900b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f900d38e0 0x7f1f900b6d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c450 tx=0x7f1f8400c910 comp rx=0 tx=0).stop 2023-11-24T06:14:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 shutdown_connections 2023-11-24T06:14:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f7c06ae40 0x7f1f7c06d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f9015d4e0 0x7f1f900c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f900d38e0 0x7f1f900b6d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 --2- 172.21.15.37:0/3533435668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f900d0240 0x7f1f900b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 >> 172.21.15.37:0/3533435668 conn(0x7f1f9009c510 msgr2=0x7f1f9015c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 shutdown_connections 2023-11-24T06:14:46.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:46.917+0000 7f1f9519a640 1 -- 172.21.15.37:0/3533435668 wait complete. 2023-11-24T06:14:46.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:46.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:47.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.165+0000 7fd301aff640 1 Processor -- start 2023-11-24T06:14:47.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.165+0000 7fd301aff640 1 -- start start 2023-11-24T06:14:47.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd301aff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd2fc06c7c0 0x7fd2fc071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd301aff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2fc15aa80 0x7fd2fc06cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd301aff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc071620 0x7fd2fc15d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd301aff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc159f40 con 0x7fd2fc15aa80 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd301aff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc15b020 con 0x7fd2fc06c7c0 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd301aff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc06d0e0 con 0x7fd2fc071620 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd2fbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2fc15aa80 0x7fd2fc06cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd2fbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2fc15aa80 0x7fd2fc06cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33086/0 (socket says 172.21.15.37:33086) 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd2fbfff640 1 -- 172.21.15.37:0/2924956070 learned_addr learned my addr 172.21.15.37:0/2924956070 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd300afd640 1 --2- 172.21.15.37:0/2924956070 >> v2:172.21.15.188:3300/0 conn(0x7fd2fc06c7c0 0x7fd2fc071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd2fbfff640 1 -- 172.21.15.37:0/2924956070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc071620 msgr2=0x7fd2fc15d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd3012fe640 1 --2- 172.21.15.37:0/2924956070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc071620 0x7fd2fc15d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.167+0000 7fd2fbfff640 1 --2- 172.21.15.37:0/2924956070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc071620 0x7fd2fc15d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.168+0000 7fd2fbfff640 1 -- 172.21.15.37:0/2924956070 >> v2:172.21.15.188:3300/0 conn(0x7fd2fc06c7c0 msgr2=0x7fd2fc071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.168+0000 7fd2fbfff640 1 --2- 172.21.15.37:0/2924956070 >> v2:172.21.15.188:3300/0 conn(0x7fd2fc06c7c0 0x7fd2fc071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.168+0000 7fd2fbfff640 1 -- 172.21.15.37:0/2924956070 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc070860 con 0x7fd2fc15aa80 2023-11-24T06:14:47.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.168+0000 7fd300afd640 1 --2- 172.21.15.37:0/2924956070 >> v2:172.21.15.188:3300/0 conn(0x7fd2fc06c7c0 0x7fd2fc071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.169+0000 7fd2fbfff640 1 --2- 172.21.15.37:0/2924956070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc06cba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0ccc40 tx=0x7fd2e802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8c32aaca763e71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.169+0000 7fd2fb7fe640 1 -- 172.21.15.37:0/2924956070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8030860 con 0x7fd2fc15aa80 2023-11-24T06:14:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.169+0000 7fd2fb7fe640 1 -- 172.21.15.37:0/2924956070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e80309c0 con 0x7fd2fc15aa80 2023-11-24T06:14:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.169+0000 7fd2fb7fe640 1 -- 172.21.15.37:0/2924956070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8030d50 con 0x7fd2fc15aa80 2023-11-24T06:14:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 -- 172.21.15.37:0/2924956070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 msgr2=0x7fd2fc06cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 --2- 172.21.15.37:0/2924956070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc06cba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0ccc40 tx=0x7fd2e802b9a0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 -- 172.21.15.37:0/2924956070 shutdown_connections 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 --2- 172.21.15.37:0/2924956070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc071620 0x7fd2fc15d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 --2- 172.21.15.37:0/2924956070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc06cba0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 --2- 172.21.15.37:0/2924956070 >> v2:172.21.15.188:3300/0 conn(0x7fd2fc06c7c0 0x7fd2fc071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 -- 172.21.15.37:0/2924956070 >> 172.21.15.37:0/2924956070 conn(0x7fd2fc0cbb40 msgr2=0x7fd2fc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 -- 172.21.15.37:0/2924956070 shutdown_connections 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.170+0000 7fd301aff640 1 -- 172.21.15.37:0/2924956070 wait complete. 2023-11-24T06:14:47.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.171+0000 7fd301aff640 1 Processor -- start 2023-11-24T06:14:47.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.172+0000 7fd301aff640 1 -- start start 2023-11-24T06:14:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd301aff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc06c7c0 0x7fd2fc1ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd301aff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2fc071620 0x7fd2fc1e4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd301aff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc1e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd301aff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc1f3e20 con 0x7fd2fc15aa80 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd301aff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0c7f80 con 0x7fd2fc071620 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd301aff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0c8260 con 0x7fd2fc06c7c0 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc1e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc1e47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33102/0 (socket says 172.21.15.37:33102) 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 -- 172.21.15.37:0/836296509 learned_addr learned my addr 172.21.15.37:0/836296509 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd2fbfff640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2fc071620 0x7fd2fc1e4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd300afd640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc06c7c0 0x7fd2fc1ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 -- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc06c7c0 msgr2=0x7fd2fc1ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc06c7c0 0x7fd2fc1ecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 -- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2fc071620 msgr2=0x7fd2fc1e4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2fc071620 0x7fd2fc1e4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.173+0000 7fd3012fe640 1 -- 172.21.15.37:0/836296509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80094d0 con 0x7fd2fc15aa80 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.174+0000 7fd3012fe640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc1e47c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400cc30 tx=0x7fd2f400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.174+0000 7fd2f97fa640 1 -- 172.21.15.37:0/836296509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400ce40 con 0x7fd2fc15aa80 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.174+0000 7fd2f97fa640 1 -- 172.21.15.37:0/836296509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4003990 con 0x7fd2fc15aa80 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.174+0000 7fd2f97fa640 1 -- 172.21.15.37:0/836296509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4003d20 con 0x7fd2fc15aa80 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.174+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc0c8540 con 0x7fd2fc15aa80 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.174+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc1ed040 con 0x7fd2fc15aa80 2023-11-24T06:14:47.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.175+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc1f42b0 con 0x7fd2fc15aa80 2023-11-24T06:14:47.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.176+0000 7fd2f97fa640 1 -- 172.21.15.37:0/836296509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2f4003e80 con 0x7fd2fc15aa80 2023-11-24T06:14:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.177+0000 7fd2f97fa640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd2e006ae40 0x7fd2e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.177+0000 7fd2f97fa640 1 -- 172.21.15.37:0/836296509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2f4089600 con 0x7fd2fc15aa80 2023-11-24T06:14:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.178+0000 7fd300afd640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd2e006ae40 0x7fd2e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.178+0000 7fd300afd640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd2e006ae40 0x7fd2e006d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0ad490 tx=0x7fd2f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.182+0000 7fd2f97fa640 1 -- 172.21.15.37:0/836296509 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2f4054a90 con 0x7fd2fc15aa80 2023-11-24T06:14:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.375+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2fc0c8730 con 0x7fd2fc15aa80 2023-11-24T06:14:47.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.376+0000 7fd2f97fa640 1 -- 172.21.15.37:0/836296509 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2f401d020 con 0x7fd2fc15aa80 2023-11-24T06:14:47.379 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:14:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.378+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd2e006ae40 msgr2=0x7fd2e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.378+0000 7fd301aff640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd2e006ae40 0x7fd2e006d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0ad490 tx=0x7fd2f0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.378+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 msgr2=0x7fd2fc1e47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.378+0000 7fd301aff640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc1e47c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400cc30 tx=0x7fd2f400a5c0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 shutdown_connections 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd2e006ae40 0x7fd2e006d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2fc071620 0x7fd2fc1e4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2fc15aa80 0x7fd2fc1e47c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 --2- 172.21.15.37:0/836296509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2fc06c7c0 0x7fd2fc1ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 >> 172.21.15.37:0/836296509 conn(0x7fd2fc0cbb40 msgr2=0x7fd2fc0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 shutdown_connections 2023-11-24T06:14:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.379+0000 7fd301aff640 1 -- 172.21.15.37:0/836296509 wait complete. 2023-11-24T06:14:47.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:14:47.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.620+0000 7ff7c5b9e640 1 Processor -- start 2023-11-24T06:14:47.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.620+0000 7ff7c5b9e640 1 -- start start 2023-11-24T06:14:47.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.622+0000 7ff7c5b9e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 0x7ff7c015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.622+0000 7ff7c5b9e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c015bf80 con 0x7ff7c00b1de0 2023-11-24T06:14:47.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.622+0000 7ff7c5b9e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c00b1560 con 0x7ff7c0144b30 2023-11-24T06:14:47.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.622+0000 7ff7c5b9e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00b1280 con 0x7ff7c015c410 2023-11-24T06:14:47.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.622+0000 7ff7c539d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff7c00b1de0 0x7ff7c00b3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34902/0 (socket says 172.21.15.37:34902) 2023-11-24T06:14:47.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.622+0000 7ff7c539d640 1 -- 172.21.15.37:0/3544308568 learned_addr learned my addr 172.21.15.37:0/3544308568 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.622+0000 7ff7b7fff640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 0x7ff7c015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892044536 0 0) 0x7ff7c015bf80 con 0x7ff7c00b1de0 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a8003520 con 0x7ff7c00b1de0 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567329313 0 0) 0x7ff7a8003520 con 0x7ff7c00b1de0 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 msgr2=0x7ff7c015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 0x7ff7c015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 >> v1:172.21.15.188:6789/0 conn(0x7ff7c0144b30 legacy=0x7ff7c00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c015b930 con 0x7ff7c00b1de0 2023-11-24T06:14:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7ff7b80019f0 con 0x7ff7c00b1de0 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 >> v1:172.21.15.37:6789/0 conn(0x7ff7c00b1de0 legacy=0x7ff7c00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80039a0 0x7ff7a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 0x7ff7a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00b1280 con 0x7ff7a8004d00 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800ba60 con 0x7ff7a80039a0 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800bc20 con 0x7ff7c015c410 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.623+0000 7ff7c539d640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.624+0000 7ff7b7fff640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 0x7ff7a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.624+0000 7ff7c4b9c640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80039a0 0x7ff7a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.624+0000 7ff7c539d640 1 -- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 msgr2=0x7ff7a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.624+0000 7ff7c539d640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015c410 0x7ff7a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.624+0000 7ff7c539d640 1 -- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80039a0 msgr2=0x7ff7a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.624+0000 7ff7c539d640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7a80039a0 0x7ff7a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.624+0000 7ff7c539d640 1 -- 172.21.15.37:0/3544308568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8003520 con 0x7ff7a8004d00 2023-11-24T06:14:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.625+0000 7ff7c539d640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8002230 tx=0x7ff7a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49069442f9c675df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.625+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8034630 con 0x7ff7a8004d00 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.625+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b802f070 con 0x7ff7a8004d00 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.625+0000 7ff7b77fe640 1 -- 172.21.15.37:0/3544308568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8034a10 con 0x7ff7a8004d00 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.626+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3544308568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 msgr2=0x7ff7a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.626+0000 7ff7c5b9e640 1 --2- 172.21.15.37:0/3544308568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8002230 tx=0x7ff7a80057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.626+0000 7ff7c539d640 1 -- 172.21.15.37:0/3544308568 reap_dead start 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.626+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3544308568 shutdown_connections 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.626+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3544308568 >> 172.21.15.37:0/3544308568 conn(0x7ff7c00cb830 msgr2=0x7ff7c00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.626+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3544308568 shutdown_connections 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.626+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3544308568 wait complete. 2023-11-24T06:14:47.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.628+0000 7ff7c5b9e640 1 Processor -- start 2023-11-24T06:14:47.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.628+0000 7ff7c5b9e640 1 -- start start 2023-11-24T06:14:47.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c5b9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7c00b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c5b9e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015a4b0 0x7ff7c015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c5b9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7c0141da0 0x7ff7c0142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c5b9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c015ae70 con 0x7ff7a8004d00 2023-11-24T06:14:47.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c5b9e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0142b00 con 0x7ff7c0141da0 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c5b9e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0142de0 con 0x7ff7c015a4b0 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7c00b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7c00b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33128/0 (socket says 172.21.15.37:33128) 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 -- 172.21.15.37:0/3675074246 learned_addr learned my addr 172.21.15.37:0/3675074246 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 -- 172.21.15.37:0/3675074246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015a4b0 msgr2=0x7ff7c015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015a4b0 0x7ff7c015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 -- 172.21.15.37:0/3675074246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7c0141da0 msgr2=0x7ff7c0142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c539d640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7c0141da0 0x7ff7c0142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7c0141da0 0x7ff7c0142230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.629+0000 7ff7c4b9c640 1 -- 172.21.15.37:0/3675074246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c01430c0 con 0x7ff7a8004d00 2023-11-24T06:14:47.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.630+0000 7ff7c4b9c640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7c00b3ee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e550 tx=0x7ff7bc00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.630+0000 7ff7b57fa640 1 -- 172.21.15.37:0/3675074246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0052e0 con 0x7ff7a8004d00 2023-11-24T06:14:47.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.630+0000 7ff7b57fa640 1 -- 172.21.15.37:0/3675074246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc005440 con 0x7ff7a8004d00 2023-11-24T06:14:47.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.630+0000 7ff7b57fa640 1 -- 172.21.15.37:0/3675074246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc003810 con 0x7ff7a8004d00 2023-11-24T06:14:47.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.630+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c01433a0 con 0x7ff7a8004d00 2023-11-24T06:14:47.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.630+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c0143ba0 con 0x7ff7a8004d00 2023-11-24T06:14:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.631+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c004e840 con 0x7ff7a8004d00 2023-11-24T06:14:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.632+0000 7ff7b57fa640 1 -- 172.21.15.37:0/3675074246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7bc003970 con 0x7ff7a8004d00 2023-11-24T06:14:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.633+0000 7ff7b57fa640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff7ac06ae40 0x7ff7ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.633+0000 7ff7b57fa640 1 -- 172.21.15.37:0/3675074246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff7bc0890e0 con 0x7ff7a8004d00 2023-11-24T06:14:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.633+0000 7ff7b7fff640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff7ac06ae40 0x7ff7ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.634+0000 7ff7b7fff640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff7ac06ae40 0x7ff7ac06d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009910 tx=0x7ff7b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.637+0000 7ff7b57fa640 1 -- 172.21.15.37:0/3675074246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7bc054440 con 0x7ff7a8004d00 2023-11-24T06:14:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.825+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff7c013eeb0 con 0x7ff7a8004d00 2023-11-24T06:14:47.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.826+0000 7ff7b57fa640 1 -- 172.21.15.37:0/3675074246 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff7bc057a60 con 0x7ff7a8004d00 2023-11-24T06:14:47.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:47.829 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:14:47.830 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:14:47.830 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-11-24T06:14:47.830 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-11-24T06:14:47.830 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:14:47.830 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:14:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.828+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff7ac06ae40 msgr2=0x7ff7ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.828+0000 7ff7c5b9e640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff7ac06ae40 0x7ff7ac06d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009910 tx=0x7ff7b0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.828+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 msgr2=0x7ff7c00b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7c00b3ee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e550 tx=0x7ff7bc00ea10 comp rx=0 tx=0).stop 2023-11-24T06:14:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 shutdown_connections 2023-11-24T06:14:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff7ac06ae40 0x7ff7ac06d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7c0141da0 0x7ff7c0142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7c015a4b0 0x7ff7c015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 --2- 172.21.15.37:0/3675074246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a8004d00 0x7ff7c00b3ee0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 >> 172.21.15.37:0/3675074246 conn(0x7ff7c00cb830 msgr2=0x7ff7c00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 shutdown_connections 2023-11-24T06:14:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:47.829+0000 7ff7c5b9e640 1 -- 172.21.15.37:0/3675074246 wait complete. 2023-11-24T06:14:47.850 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:14:47.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:14:48.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.075+0000 7f638c91a640 1 Processor -- start 2023-11-24T06:14:48.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.075+0000 7f638c91a640 1 -- start start 2023-11-24T06:14:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.076+0000 7f638c91a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880d0050 0x7f638815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.076+0000 7f638c91a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638815ea30 con 0x7f6388160b00 2023-11-24T06:14:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.077+0000 7f638c91a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880d04e0 con 0x7f63880cfbe0 2023-11-24T06:14:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.077+0000 7f638c91a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638815de20 con 0x7f63880d0050 2023-11-24T06:14:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.077+0000 7f63877fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6388160b00 0x7f63880d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34904/0 (socket says 172.21.15.37:34904) 2023-11-24T06:14:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.077+0000 7f63877fe640 1 -- 172.21.15.37:0/3596724874 learned_addr learned my addr 172.21.15.37:0/3596724874 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.077+0000 7f6387fff640 1 --2- 172.21.15.37:0/3596724874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880d0050 0x7f638815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339319825 0 0) 0x7f638815ea30 con 0x7f6388160b00 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6370003520 con 0x7f6388160b00 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262977877 0 0) 0x7f63880d04e0 con 0x7f63880cfbe0 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f638815ea30 con 0x7f63880cfbe0 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811159202 0 0) 0x7f6370003520 con 0x7f6388160b00 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f6387fff640 1 -- 172.21.15.37:0/3596724874 >> v1:172.21.15.188:6789/0 conn(0x7f63880cfbe0 legacy=0x7f638815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f6387fff640 1 -- 172.21.15.37:0/3596724874 >> v1:172.21.15.37:6789/0 conn(0x7f6388160b00 legacy=0x7f63880d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.078+0000 7f6387fff640 1 -- 172.21.15.37:0/3596724874 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638815e100 con 0x7f63880d0050 2023-11-24T06:14:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.080+0000 7f6387fff640 1 --2- 172.21.15.37:0/3596724874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880d0050 0x7f638815d530 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f63800097d0 tx=0x7f638002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f96c11d467cde3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.081+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780019f0 con 0x7f63880d0050 2023-11-24T06:14:48.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.081+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638002e050 con 0x7f63880d0050 2023-11-24T06:14:48.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.081+0000 7f63867fc640 1 -- 172.21.15.37:0/3596724874 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380030730 con 0x7f63880d0050 2023-11-24T06:14:48.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.082+0000 7f638c91a640 1 -- 172.21.15.37:0/3596724874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880d0050 msgr2=0x7f638815d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.082+0000 7f638c91a640 1 --2- 172.21.15.37:0/3596724874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880d0050 0x7f638815d530 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f63800097d0 tx=0x7f638002b800 comp rx=0 tx=0).stop 2023-11-24T06:14:48.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.082+0000 7f638c91a640 1 -- 172.21.15.37:0/3596724874 shutdown_connections 2023-11-24T06:14:48.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.082+0000 7f638c91a640 1 --2- 172.21.15.37:0/3596724874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880d0050 0x7f638815d530 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.082+0000 7f638c91a640 1 -- 172.21.15.37:0/3596724874 >> 172.21.15.37:0/3596724874 conn(0x7f638809c510 msgr2=0x7f63880d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.082+0000 7f638c91a640 1 -- 172.21.15.37:0/3596724874 shutdown_connections 2023-11-24T06:14:48.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.082+0000 7f638c91a640 1 -- 172.21.15.37:0/3596724874 wait complete. 2023-11-24T06:14:48.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.084+0000 7f638c91a640 1 Processor -- start 2023-11-24T06:14:48.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.084+0000 7f638c91a640 1 -- start start 2023-11-24T06:14:48.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f638c91a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880cfbe0 0x7f63881f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f638c91a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63880d0050 0x7f63880cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f638c91a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6388160b00 0x7f63881f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f638c91a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63881f3c90 con 0x7f63880d0050 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f638c91a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63881f8200 con 0x7f6388160b00 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f638c91a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63881f7c40 con 0x7f63880cfbe0 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63880d0050 0x7f63880cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63880d0050 0x7f63880cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33130/0 (socket says 172.21.15.37:33130) 2023-11-24T06:14:48.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 -- 172.21.15.37:0/1434092461 learned_addr learned my addr 172.21.15.37:0/1434092461 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:48.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 -- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880cfbe0 msgr2=0x7f63881f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f63877fe640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880cfbe0 0x7f63881f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6387fff640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6388160b00 0x7f63881f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880cfbe0 0x7f63881f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 -- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6388160b00 msgr2=0x7f63881f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6388160b00 0x7f63881f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6386ffd640 1 -- 172.21.15.37:0/1434092461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009400 con 0x7f63880d0050 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.085+0000 7f6387fff640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6388160b00 0x7f63881f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.086+0000 7f6386ffd640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63880d0050 0x7f63880cc6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c430 tx=0x7f637c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.086+0000 7f636ffff640 1 -- 172.21.15.37:0/1434092461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c0052d0 con 0x7f63880d0050 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.086+0000 7f636ffff640 1 -- 172.21.15.37:0/1434092461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c005450 con 0x7f63880d0050 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.086+0000 7f636ffff640 1 -- 172.21.15.37:0/1434092461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c003830 con 0x7f63880d0050 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.086+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63881f7f20 con 0x7f63880d0050 2023-11-24T06:14:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.086+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63881f4160 con 0x7f63880d0050 2023-11-24T06:14:48.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.087+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638804e840 con 0x7f63880d0050 2023-11-24T06:14:48.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.088+0000 7f636ffff640 1 -- 172.21.15.37:0/1434092461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f637c003990 con 0x7f63880d0050 2023-11-24T06:14:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.089+0000 7f636ffff640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f637406ae40 0x7f637406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.089+0000 7f636ffff640 1 -- 172.21.15.37:0/1434092461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f637c0888d0 con 0x7f63880d0050 2023-11-24T06:14:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.089+0000 7f63877fe640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f637406ae40 0x7f637406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.090+0000 7f63877fe640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f637406ae40 0x7f637406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6378005c00 tx=0x7f6378009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.093+0000 7f636ffff640 1 -- 172.21.15.37:0/1434092461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f637c053cc0 con 0x7f63880d0050 2023-11-24T06:14:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.290+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f638815ee10 con 0x7f63880d0050 2023-11-24T06:14:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.652+0000 7f636ffff640 1 -- 172.21.15.37:0/1434092461 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f637c0170b0 con 0x7f63880d0050 2023-11-24T06:14:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-11-24T06:14:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.655+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f637406ae40 msgr2=0x7f637406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.655+0000 7f638c91a640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f637406ae40 0x7f637406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6378005c00 tx=0x7f6378009040 comp rx=0 tx=0).stop 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.655+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63880d0050 msgr2=0x7f63880cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.655+0000 7f638c91a640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63880d0050 0x7f63880cc6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c430 tx=0x7f637c00c8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.656+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 shutdown_connections 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.656+0000 7f638c91a640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f637406ae40 0x7f637406d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.656+0000 7f638c91a640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6388160b00 0x7f63881f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.656+0000 7f638c91a640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63880d0050 0x7f63880cc6e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.656+0000 7f638c91a640 1 --2- 172.21.15.37:0/1434092461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63880cfbe0 0x7f63881f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.656+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 >> 172.21.15.37:0/1434092461 conn(0x7f638809c510 msgr2=0x7f6388160ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.656+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 shutdown_connections 2023-11-24T06:14:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.657+0000 7f638c91a640 1 -- 172.21.15.37:0/1434092461 wait complete. 2023-11-24T06:14:48.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:14:48.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.904+0000 7ff1493db640 1 Processor -- start 2023-11-24T06:14:48.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.904+0000 7ff1493db640 1 -- start start 2023-11-24T06:14:48.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.905+0000 7ff1493db640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff144161810 0x7ff1440cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.905+0000 7ff1493db640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff1440c27a0 0x7ff144165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.906+0000 7ff1493db640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1440cec30 con 0x7ff1440ce480 2023-11-24T06:14:48.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.906+0000 7ff1493db640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1440ce950 con 0x7ff1440c27a0 2023-11-24T06:14:48.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.906+0000 7ff1493db640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440ccdc0 con 0x7ff144161810 2023-11-24T06:14:48.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.906+0000 7ff148bda640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff1440c27a0 0x7ff144165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.906+0000 7ff148bda640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff1440c27a0 0x7ff144165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:36370/0 (socket says 172.21.15.37:36370) 2023-11-24T06:14:48.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.906+0000 7ff148bda640 1 -- 172.21.15.37:0/614471743 learned_addr learned my addr 172.21.15.37:0/614471743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:48.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.906+0000 7ff143fff640 1 --2- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff144161810 0x7ff1440cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.907+0000 7ff148bda640 1 -- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff144161810 msgr2=0x7ff1440cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.907+0000 7ff148bda640 1 --2- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff144161810 0x7ff1440cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.907+0000 7ff148bda640 1 -- 172.21.15.37:0/614471743 >> v1:172.21.15.188:6789/0 conn(0x7ff1440ce480 legacy=0x7ff1440c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.907+0000 7ff148bda640 1 -- 172.21.15.37:0/614471743 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440cd0a0 con 0x7ff1440c27a0 2023-11-24T06:14:48.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.908+0000 7ff148bda640 1 --2- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 0x7ff144165380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a67fb2fd79842dc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.909+0000 7ff1437fe640 1 -- 172.21.15.37:0/614471743 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c031640 con 0x7ff1440c27a0 2023-11-24T06:14:48.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.909+0000 7ff1437fe640 1 -- 172.21.15.37:0/614471743 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c0317a0 con 0x7ff1440c27a0 2023-11-24T06:14:48.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.909+0000 7ff1437fe640 1 -- 172.21.15.37:0/614471743 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c031b30 con 0x7ff1440c27a0 2023-11-24T06:14:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 -- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 msgr2=0x7ff144165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 --2- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 0x7ff144165380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 -- 172.21.15.37:0/614471743 shutdown_connections 2023-11-24T06:14:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 --2- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 0x7ff144165380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 --2- 172.21.15.37:0/614471743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff144161810 0x7ff1440cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 -- 172.21.15.37:0/614471743 >> 172.21.15.37:0/614471743 conn(0x7ff1440cbb40 msgr2=0x7ff1440cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 -- 172.21.15.37:0/614471743 shutdown_connections 2023-11-24T06:14:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.910+0000 7ff1493db640 1 -- 172.21.15.37:0/614471743 wait complete. 2023-11-24T06:14:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.912+0000 7ff1493db640 1 Processor -- start 2023-11-24T06:14:48.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.912+0000 7ff1493db640 1 -- start start 2023-11-24T06:14:48.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff1493db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 0x7ff14415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff1493db640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1440ce480 0x7ff1440b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff1493db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff144161810 0x7ff1440c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff1493db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440ae190 con 0x7ff144161810 2023-11-24T06:14:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff1493db640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440aecd0 con 0x7ff1440c27a0 2023-11-24T06:14:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff1493db640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440ae3a0 con 0x7ff1440ce480 2023-11-24T06:14:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff148bda640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff144161810 0x7ff1440c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff148bda640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff144161810 0x7ff1440c3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33144/0 (socket says 172.21.15.37:33144) 2023-11-24T06:14:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff148bda640 1 -- 172.21.15.37:0/2839218733 learned_addr learned my addr 172.21.15.37:0/2839218733 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff143fff640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 0x7ff14415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.913+0000 7ff13b7fe640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1440ce480 0x7ff1440b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff148bda640 1 -- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1440ce480 msgr2=0x7ff1440b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff148bda640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1440ce480 0x7ff1440b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff148bda640 1 -- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 msgr2=0x7ff14415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff148bda640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 0x7ff14415e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff148bda640 1 -- 172.21.15.37:0/2839218733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0094d0 con 0x7ff144161810 2023-11-24T06:14:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff148bda640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff144161810 0x7ff1440c3b00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff1417fa640 1 -- 172.21.15.37:0/2839218733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c03a970 con 0x7ff144161810 2023-11-24T06:14:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff1417fa640 1 -- 172.21.15.37:0/2839218733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c03aad0 con 0x7ff144161810 2023-11-24T06:14:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff1417fa640 1 -- 172.21.15.37:0/2839218733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c03ae80 con 0x7ff144161810 2023-11-24T06:14:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.914+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1440ae680 con 0x7ff144161810 2023-11-24T06:14:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.915+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14415ea60 con 0x7ff144161810 2023-11-24T06:14:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.916+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14404e840 con 0x7ff144161810 2023-11-24T06:14:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.917+0000 7ff1417fa640 1 -- 172.21.15.37:0/2839218733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff13c02f050 con 0x7ff144161810 2023-11-24T06:14:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.918+0000 7ff1417fa640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff12406ae40 0x7ff12406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.918+0000 7ff1417fa640 1 -- 172.21.15.37:0/2839218733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff13c0ab170 con 0x7ff144161810 2023-11-24T06:14:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.918+0000 7ff143fff640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff12406ae40 0x7ff12406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.919+0000 7ff143fff640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff12406ae40 0x7ff12406d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1340074a0 tx=0x7ff13400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:48.923+0000 7ff1417fa640 1 -- 172.21.15.37:0/2839218733 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff13c076400 con 0x7ff144161810 2023-11-24T06:14:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.118+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff1440aee10 con 0x7ff144161810 2023-11-24T06:14:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.659+0000 7ff1417fa640 1 -- 172.21.15.37:0/2839218733 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff13c079a20 con 0x7ff144161810 2023-11-24T06:14:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-11-24T06:14:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff12406ae40 msgr2=0x7ff12406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff12406ae40 0x7ff12406d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1340074a0 tx=0x7ff13400b040 comp rx=0 tx=0).stop 2023-11-24T06:14:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff144161810 msgr2=0x7ff1440c3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff144161810 0x7ff1440c3b00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009870 tx=0x7ff13c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 shutdown_connections 2023-11-24T06:14:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff12406ae40 0x7ff12406d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff144161810 0x7ff1440c3b00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1440ce480 0x7ff1440b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 --2- 172.21.15.37:0/2839218733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff1440c27a0 0x7ff14415e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.664+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 >> 172.21.15.37:0/2839218733 conn(0x7ff1440cbb40 msgr2=0x7ff1440c2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.665+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 shutdown_connections 2023-11-24T06:14:49.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.665+0000 7ff1493db640 1 -- 172.21.15.37:0/2839218733 wait complete. 2023-11-24T06:14:49.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:14:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.896+0000 7f26762bb640 1 Processor -- start 2023-11-24T06:14:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.896+0000 7f26762bb640 1 -- start start 2023-11-24T06:14:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.898+0000 7f26762bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2670072160 0x7f267015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.898+0000 7f26762bb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267015ec90 con 0x7f26700c49f0 2023-11-24T06:14:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.898+0000 7f26762bb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26700cd530 con 0x7f267006de10 2023-11-24T06:14:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.898+0000 7f26762bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26700c4ed0 con 0x7f2670072160 2023-11-24T06:14:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.898+0000 7f266ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2670072160 0x7f267015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.898+0000 7f266f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26700c49f0 0x7f267006d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34912/0 (socket says 172.21.15.37:34912) 2023-11-24T06:14:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.898+0000 7f266f7fe640 1 -- 172.21.15.37:0/4034463410 learned_addr learned my addr 172.21.15.37:0/4034463410 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.899+0000 7f266effd640 1 -- 172.21.15.37:0/4034463410 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962784767 0 0) 0x7f2658001110 con 0x7f26700c49f0 2023-11-24T06:14:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.899+0000 7f266ffff640 1 -- 172.21.15.37:0/4034463410 >> v1:172.21.15.188:6789/0 conn(0x7f267006de10 legacy=0x7f26700705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.899+0000 7f266ffff640 1 -- 172.21.15.37:0/4034463410 >> v1:172.21.15.37:6789/0 conn(0x7f26700c49f0 legacy=0x7f267006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.899+0000 7f266ffff640 1 -- 172.21.15.37:0/4034463410 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700c51b0 con 0x7f2670072160 2023-11-24T06:14:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.900+0000 7f266ffff640 1 --2- 172.21.15.37:0/4034463410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2670072160 0x7f267015e750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2660009d90 tx=0x7f266002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7746e547c1fdae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.901+0000 7f266effd640 1 -- 172.21.15.37:0/4034463410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266002cd00 con 0x7f2670072160 2023-11-24T06:14:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.901+0000 7f266effd640 1 -- 172.21.15.37:0/4034463410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266002ce60 con 0x7f2670072160 2023-11-24T06:14:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.901+0000 7f266effd640 1 -- 172.21.15.37:0/4034463410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660034660 con 0x7f2670072160 2023-11-24T06:14:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.901+0000 7f26762bb640 1 -- 172.21.15.37:0/4034463410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2670072160 msgr2=0x7f267015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.901+0000 7f26762bb640 1 --2- 172.21.15.37:0/4034463410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2670072160 0x7f267015e750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2660009d90 tx=0x7f266002bf50 comp rx=0 tx=0).stop 2023-11-24T06:14:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.902+0000 7f26762bb640 1 -- 172.21.15.37:0/4034463410 shutdown_connections 2023-11-24T06:14:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.902+0000 7f26762bb640 1 --2- 172.21.15.37:0/4034463410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2670072160 0x7f267015e750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.902+0000 7f26762bb640 1 -- 172.21.15.37:0/4034463410 >> 172.21.15.37:0/4034463410 conn(0x7f26700b0c50 msgr2=0x7f26700b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.902+0000 7f26762bb640 1 -- 172.21.15.37:0/4034463410 shutdown_connections 2023-11-24T06:14:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.902+0000 7f26762bb640 1 -- 172.21.15.37:0/4034463410 wait complete. 2023-11-24T06:14:49.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.903+0000 7f26762bb640 1 Processor -- start 2023-11-24T06:14:49.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.904+0000 7f26762bb640 1 -- start start 2023-11-24T06:14:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.904+0000 7f26762bb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f267006de10 0x7f267014ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.904+0000 7f26762bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2670072160 0x7f2670153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f26762bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26700c49f0 0x7f2670153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f26762bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670153a80 con 0x7f26700c49f0 2023-11-24T06:14:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f26762bb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b0280 con 0x7f2670072160 2023-11-24T06:14:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f26762bb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b07b0 con 0x7f267006de10 2023-11-24T06:14:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26700c49f0 0x7f2670153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26700c49f0 0x7f2670153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33162/0 (socket says 172.21.15.37:33162) 2023-11-24T06:14:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 -- 172.21.15.37:0/1567359352 learned_addr learned my addr 172.21.15.37:0/1567359352 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f266f7fe640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2670072160 0x7f2670153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 -- 172.21.15.37:0/1567359352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f267006de10 msgr2=0x7f267014ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f267006de10 0x7f267014ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 -- 172.21.15.37:0/1567359352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2670072160 msgr2=0x7f2670153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2670072160 0x7f2670153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.905+0000 7f2674858640 1 -- 172.21.15.37:0/1567359352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660009a70 con 0x7f26700c49f0 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.906+0000 7f2674858640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26700c49f0 0x7f2670153d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f266800c3a0 tx=0x7f266800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.906+0000 7f266cff9640 1 -- 172.21.15.37:0/1567359352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680052d0 con 0x7f26700c49f0 2023-11-24T06:14:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.906+0000 7f266cff9640 1 -- 172.21.15.37:0/1567359352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668005430 con 0x7f26700c49f0 2023-11-24T06:14:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.906+0000 7f266cff9640 1 -- 172.21.15.37:0/1567359352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668003830 con 0x7f26700c49f0 2023-11-24T06:14:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.906+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26700b04d0 con 0x7f26700c49f0 2023-11-24T06:14:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.906+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26700cc590 con 0x7f26700c49f0 2023-11-24T06:14:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.907+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26700cc110 con 0x7f26700c49f0 2023-11-24T06:14:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.908+0000 7f266cff9640 1 -- 172.21.15.37:0/1567359352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2668003990 con 0x7f26700c49f0 2023-11-24T06:14:49.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.910+0000 7f266cff9640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f265006ae40 0x7f265006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.910+0000 7f266cff9640 1 -- 172.21.15.37:0/1567359352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2668088c00 con 0x7f26700c49f0 2023-11-24T06:14:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.910+0000 7f266ffff640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f265006ae40 0x7f265006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.911+0000 7f266ffff640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f265006ae40 0x7f265006d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f266002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:49.915+0000 7f266cff9640 1 -- 172.21.15.37:0/1567359352 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26700cc110 con 0x7f26700c49f0 2023-11-24T06:14:50.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.150+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f26700cc110 con 0x7f26700c49f0 2023-11-24T06:14:50.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.694+0000 7f266cff9640 1 -- 172.21.15.37:0/1567359352 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f26700cc110 con 0x7f26700c49f0 2023-11-24T06:14:50.696 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T06:14:50.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f265006ae40 msgr2=0x7f265006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f265006ae40 0x7f265006d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f266002e000 comp rx=0 tx=0).stop 2023-11-24T06:14:50.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26700c49f0 msgr2=0x7f2670153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26700c49f0 0x7f2670153d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f266800c3a0 tx=0x7f266800c860 comp rx=0 tx=0).stop 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 shutdown_connections 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f265006ae40 0x7f265006d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2670072160 0x7f2670153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26700c49f0 0x7f2670153d30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 --2- 172.21.15.37:0/1567359352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f267006de10 0x7f267014ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.697+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 >> 172.21.15.37:0/1567359352 conn(0x7f26700b0c50 msgr2=0x7f267006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.698+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 shutdown_connections 2023-11-24T06:14:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.698+0000 7f26762bb640 1 -- 172.21.15.37:0/1567359352 wait complete. 2023-11-24T06:14:50.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.910+0000 7fd14bfff640 1 Processor -- start 2023-11-24T06:14:50.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.910+0000 7fd14bfff640 1 -- start start 2023-11-24T06:14:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.911+0000 7fd14bfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd14c15c410 0x7fd14c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.911+0000 7fd14bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd14c0b1de0 0x7fd14c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.911+0000 7fd14bfff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14c15bf80 con 0x7fd14c144b30 2023-11-24T06:14:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.911+0000 7fd14bfff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c0b27b0 con 0x7fd14c0b1de0 2023-11-24T06:14:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.911+0000 7fd14bfff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c0b1560 con 0x7fd14c15c410 2023-11-24T06:14:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.912+0000 7fd14b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd14c0b1de0 0x7fd14c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.912+0000 7fd14b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd14c0b1de0 0x7fd14c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44280/0 (socket says 172.21.15.37:44280) 2023-11-24T06:14:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.912+0000 7fd14b7fe640 1 -- 172.21.15.37:0/866211437 learned_addr learned my addr 172.21.15.37:0/866211437 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.912+0000 7fd143fff640 1 --2- 172.21.15.37:0/866211437 >> v2:172.21.15.188:3300/0 conn(0x7fd14c15c410 0x7fd14c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.912+0000 7fd14b7fe640 1 -- 172.21.15.37:0/866211437 >> v2:172.21.15.188:3300/0 conn(0x7fd14c15c410 msgr2=0x7fd14c15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.912+0000 7fd14b7fe640 1 --2- 172.21.15.37:0/866211437 >> v2:172.21.15.188:3300/0 conn(0x7fd14c15c410 0x7fd14c15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.912+0000 7fd14b7fe640 1 -- 172.21.15.37:0/866211437 >> v1:172.21.15.37:6789/0 conn(0x7fd14c144b30 legacy=0x7fd14c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.913+0000 7fd14b7fe640 1 -- 172.21.15.37:0/866211437 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c0b1280 con 0x7fd14c0b1de0 2023-11-24T06:14:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.913+0000 7fd143fff640 1 --2- 172.21.15.37:0/866211437 >> v2:172.21.15.188:3300/0 conn(0x7fd14c15c410 0x7fd14c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.914+0000 7fd14b7fe640 1 --2- 172.21.15.37:0/866211437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0b2270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0cc7a0 tx=0x7fd14402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84974cb33ffe184a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.914+0000 7fd14a7fc640 1 -- 172.21.15.37:0/866211437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14402cb10 con 0x7fd14c0b1de0 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.914+0000 7fd14a7fc640 1 -- 172.21.15.37:0/866211437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14402cc70 con 0x7fd14c0b1de0 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.914+0000 7fd14a7fc640 1 -- 172.21.15.37:0/866211437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1440343f0 con 0x7fd14c0b1de0 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.914+0000 7fd14bfff640 1 -- 172.21.15.37:0/866211437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 msgr2=0x7fd14c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.914+0000 7fd14bfff640 1 --2- 172.21.15.37:0/866211437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0b2270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0cc7a0 tx=0x7fd14402bf70 comp rx=0 tx=0).stop 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.915+0000 7fd14bfff640 1 -- 172.21.15.37:0/866211437 shutdown_connections 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.915+0000 7fd14bfff640 1 --2- 172.21.15.37:0/866211437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0b2270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.915+0000 7fd14bfff640 1 --2- 172.21.15.37:0/866211437 >> v2:172.21.15.188:3300/0 conn(0x7fd14c15c410 0x7fd14c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.915+0000 7fd14bfff640 1 -- 172.21.15.37:0/866211437 >> 172.21.15.37:0/866211437 conn(0x7fd14c0cb830 msgr2=0x7fd14c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.915+0000 7fd14bfff640 1 -- 172.21.15.37:0/866211437 shutdown_connections 2023-11-24T06:14:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.915+0000 7fd14bfff640 1 -- 172.21.15.37:0/866211437 wait complete. 2023-11-24T06:14:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.917+0000 7fd14bfff640 1 Processor -- start 2023-11-24T06:14:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.917+0000 7fd14bfff640 1 -- start start 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd14c144b30 0x7fd14c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd14c15c410 0x7fd14c1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14bfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c1505b0 con 0x7fd14c0b1de0 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14bfff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c155b40 con 0x7fd14c15c410 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14bfff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c1552a0 con 0x7fd14c144b30 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44288/0 (socket says 172.21.15.37:44288) 2023-11-24T06:14:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 -- 172.21.15.37:0/928136179 learned_addr learned my addr 172.21.15.37:0/928136179 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd143fff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd14c144b30 0x7fd14c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 -- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd14c144b30 msgr2=0x7fd14c071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd14c144b30 0x7fd14c071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 -- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd14c15c410 msgr2=0x7fd14c1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14b7fe640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd14c15c410 0x7fd14c1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd14c15c410 0x7fd14c1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.918+0000 7fd14affd640 1 -- 172.21.15.37:0/928136179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd144009b30 con 0x7fd14c0b1de0 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.919+0000 7fd14b7fe640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd14c15c410 0x7fd14c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.919+0000 7fd14affd640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0ccf00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c450 tx=0x7fd13c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.919+0000 7fd1437fe640 1 -- 172.21.15.37:0/928136179 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0052d0 con 0x7fd14c0b1de0 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.919+0000 7fd1437fe640 1 -- 172.21.15.37:0/928136179 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c005430 con 0x7fd14c0b1de0 2023-11-24T06:14:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.919+0000 7fd1437fe640 1 -- 172.21.15.37:0/928136179 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c012870 con 0x7fd14c0b1de0 2023-11-24T06:14:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.919+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14c155580 con 0x7fd14c0b1de0 2023-11-24T06:14:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.919+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c070440 con 0x7fd14c0b1de0 2023-11-24T06:14:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.920+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c04e840 con 0x7fd14c0b1de0 2023-11-24T06:14:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.921+0000 7fd1437fe640 1 -- 172.21.15.37:0/928136179 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd13c0129d0 con 0x7fd14c0b1de0 2023-11-24T06:14:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.922+0000 7fd1437fe640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd13006ae40 0x7fd13006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.922+0000 7fd1437fe640 1 -- 172.21.15.37:0/928136179 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd13c089080 con 0x7fd14c0b1de0 2023-11-24T06:14:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.923+0000 7fd143fff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd13006ae40 0x7fd13006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.923+0000 7fd143fff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd13006ae40 0x7fd13006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd14c153410 tx=0x7fd134008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:50.927+0000 7fd1437fe640 1 -- 172.21.15.37:0/928136179 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd13c0541c0 con 0x7fd14c0b1de0 2023-11-24T06:14:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.121+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd14c06d860 con 0x7fd14c0b1de0 2023-11-24T06:14:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.123+0000 7fd1437fe640 1 -- 172.21.15.37:0/928136179 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fd13c0577e0 con 0x7fd14c0b1de0 2023-11-24T06:14:51.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:51.127 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:50.151695+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd13006ae40 msgr2=0x7fd13006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd13006ae40 0x7fd13006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd14c153410 tx=0x7fd134008040 comp rx=0 tx=0).stop 2023-11-24T06:14:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 msgr2=0x7fd14c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0ccf00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c450 tx=0x7fd13c00c910 comp rx=0 tx=0).stop 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 shutdown_connections 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd13006ae40 0x7fd13006d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd14c15c410 0x7fd14c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd14c144b30 0x7fd14c071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 --2- 172.21.15.37:0/928136179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14c0b1de0 0x7fd14c0ccf00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 >> 172.21.15.37:0/928136179 conn(0x7fd14c0cb830 msgr2=0x7fd14c0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 shutdown_connections 2023-11-24T06:14:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.126+0000 7fd14bfff640 1 -- 172.21.15.37:0/928136179 wait complete. 2023-11-24T06:14:51.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:51.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.364+0000 7f4352dd4640 1 Processor -- start 2023-11-24T06:14:51.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.364+0000 7f4352dd4640 1 -- start start 2023-11-24T06:14:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f4352dd4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f434c0703f0 0x7f434c162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f4352dd4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f434c0cd160 0x7f434c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f4352dd4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434c162eb0 con 0x7f434c14b100 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f4352dd4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434c0cdb10 con 0x7f434c0cd160 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f4352dd4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434c1654a0 con 0x7f434c0703f0 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f43525d3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f434c0cd160 0x7f434c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f43525d3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f434c0cd160 0x7f434c0cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44302/0 (socket says 172.21.15.37:44302) 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.366+0000 7f43525d3640 1 -- 172.21.15.37:0/1974674054 learned_addr learned my addr 172.21.15.37:0/1974674054 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.367+0000 7f43515d1640 1 --2- 172.21.15.37:0/1974674054 >> v2:172.21.15.188:3300/0 conn(0x7f434c0703f0 0x7f434c162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.367+0000 7f43525d3640 1 -- 172.21.15.37:0/1974674054 >> v2:172.21.15.188:3300/0 conn(0x7f434c0703f0 msgr2=0x7f434c162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.367+0000 7f43525d3640 1 --2- 172.21.15.37:0/1974674054 >> v2:172.21.15.188:3300/0 conn(0x7f434c0703f0 0x7f434c162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.367+0000 7f43525d3640 1 -- 172.21.15.37:0/1974674054 >> v1:172.21.15.188:6789/0 conn(0x7f434c14b100 legacy=0x7f434c165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.367+0000 7f43525d3640 1 -- 172.21.15.37:0/1974674054 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c0ccf00 con 0x7f434c0cd160 2023-11-24T06:14:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.368+0000 7f43525d3640 1 --2- 172.21.15.37:0/1974674054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c0cd5d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f434c06e510 tx=0x7f434402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d46e88bbf7f3c27 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.368+0000 7f4350dd0640 1 -- 172.21.15.37:0/1974674054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434402c9f0 con 0x7f434c0cd160 2023-11-24T06:14:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.368+0000 7f4350dd0640 1 -- 172.21.15.37:0/1974674054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434402cb50 con 0x7f434c0cd160 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.368+0000 7f4350dd0640 1 -- 172.21.15.37:0/1974674054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43440343f0 con 0x7f434c0cd160 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 -- 172.21.15.37:0/1974674054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 msgr2=0x7f434c0cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 --2- 172.21.15.37:0/1974674054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c0cd5d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f434c06e510 tx=0x7f434402be50 comp rx=0 tx=0).stop 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 -- 172.21.15.37:0/1974674054 shutdown_connections 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 --2- 172.21.15.37:0/1974674054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c0cd5d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 --2- 172.21.15.37:0/1974674054 >> v2:172.21.15.188:3300/0 conn(0x7f434c0703f0 0x7f434c162970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 -- 172.21.15.37:0/1974674054 >> 172.21.15.37:0/1974674054 conn(0x7f434c0cb830 msgr2=0x7f434c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 -- 172.21.15.37:0/1974674054 shutdown_connections 2023-11-24T06:14:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.369+0000 7f4352dd4640 1 -- 172.21.15.37:0/1974674054 wait complete. 2023-11-24T06:14:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.371+0000 7f4352dd4640 1 Processor -- start 2023-11-24T06:14:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.371+0000 7f4352dd4640 1 -- start start 2023-11-24T06:14:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f4352dd4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f434c0703f0 0x7f434c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f4352dd4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f4352dd4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f434c14b100 0x7f434c1610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f4352dd4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c13c9f0 con 0x7f434c0cd160 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f4352dd4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0a9b50 con 0x7f434c14b100 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f4352dd4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0a9e30 con 0x7f434c0703f0 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f43515d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f43515d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c160b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44316/0 (socket says 172.21.15.37:44316) 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.372+0000 7f43515d1640 1 -- 172.21.15.37:0/529975826 learned_addr learned my addr 172.21.15.37:0/529975826 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43525d3640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f434c14b100 0x7f434c1610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f4351dd2640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f434c0703f0 0x7f434c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43515d1640 1 -- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f434c0703f0 msgr2=0x7f434c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43515d1640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f434c0703f0 0x7f434c0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43515d1640 1 -- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f434c14b100 msgr2=0x7f434c1610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43515d1640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f434c14b100 0x7f434c1610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43515d1640 1 -- 172.21.15.37:0/529975826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4344009b30 con 0x7f434c0cd160 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f4351dd2640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f434c0703f0 0x7f434c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43515d1640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c160b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f433c00d7d0 tx=0x7f433c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43427fc640 1 -- 172.21.15.37:0/529975826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00b6c0 con 0x7f434c0cd160 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43427fc640 1 -- 172.21.15.37:0/529975826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00b840 con 0x7f434c0cd160 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f43427fc640 1 -- 172.21.15.37:0/529975826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00bbf0 con 0x7f434c0cd160 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.373+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c13cc40 con 0x7f434c0cd160 2023-11-24T06:14:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.374+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c0ad330 con 0x7f434c0cd160 2023-11-24T06:14:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.375+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c0aa050 con 0x7f434c0cd160 2023-11-24T06:14:51.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.376+0000 7f43427fc640 1 -- 172.21.15.37:0/529975826 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f433c00bd50 con 0x7f434c0cd160 2023-11-24T06:14:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.376+0000 7f43427fc640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.377+0000 7f43427fc640 1 -- 172.21.15.37:0/529975826 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f433c089a60 con 0x7f434c0cd160 2023-11-24T06:14:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.377+0000 7f4351dd2640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.377+0000 7f4351dd2640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f433006aec0 0x7f433006d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f434800a830 tx=0x7f4348008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.381+0000 7f43427fc640 1 -- 172.21.15.37:0/529975826 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f433c054bf0 con 0x7f434c0cd160 2023-11-24T06:14:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.578+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f434c0ad4c0 con 0x7f434c0cd160 2023-11-24T06:14:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.581+0000 7f43427fc640 1 -- 172.21.15.37:0/529975826 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f433c058210 con 0x7f434c0cd160 2023-11-24T06:14:51.584 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:51.584 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:50.151695+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:51.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.583+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f433006aec0 msgr2=0x7f433006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.583+0000 7f4352dd4640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f433006aec0 0x7f433006d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f434800a830 tx=0x7f4348008040 comp rx=0 tx=0).stop 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.583+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 msgr2=0x7f434c160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.583+0000 7f4352dd4640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c160b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f433c00d7d0 tx=0x7f433c00dc90 comp rx=0 tx=0).stop 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 shutdown_connections 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f434c14b100 0x7f434c1610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434c0cd160 0x7f434c160b80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 --2- 172.21.15.37:0/529975826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f434c0703f0 0x7f434c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 >> 172.21.15.37:0/529975826 conn(0x7f434c0cb830 msgr2=0x7f434c165c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 shutdown_connections 2023-11-24T06:14:51.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.584+0000 7f4352dd4640 1 -- 172.21.15.37:0/529975826 wait complete. 2023-11-24T06:14:51.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:14:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.837+0000 7fc38acd1640 1 Processor -- start 2023-11-24T06:14:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.837+0000 7fc38acd1640 1 -- start start 2023-11-24T06:14:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.838+0000 7fc38acd1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc384160870 0x7fc3840b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc38acd1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3840d4050 con 0x7fc3840b4330 2023-11-24T06:14:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc38acd1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3840b3760 con 0x7fc384160c50 2023-11-24T06:14:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc38acd1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3840b3a40 con 0x7fc384160870 2023-11-24T06:14:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc389ccf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc384160870 0x7fc3840b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc3894ce640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc3840b4330 0x7fc3840b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47418/0 (socket says 172.21.15.37:47418) 2023-11-24T06:14:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc3894ce640 1 -- 172.21.15.37:0/3583269736 learned_addr learned my addr 172.21.15.37:0/3583269736 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc389ccf640 1 -- 172.21.15.37:0/3583269736 >> v1:172.21.15.188:6789/0 conn(0x7fc384160c50 legacy=0x7fc3841671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc389ccf640 1 -- 172.21.15.37:0/3583269736 >> v1:172.21.15.37:6789/0 conn(0x7fc3840b4330 legacy=0x7fc3840b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc389ccf640 1 -- 172.21.15.37:0/3583269736 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840b3d20 con 0x7fc384160870 2023-11-24T06:14:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.839+0000 7fc388ccd640 1 -- 172.21.15.37:0/3583269736 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969469557 0 0) 0x7fc3840d4050 con 0x7fc3840b4330 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.840+0000 7fc389ccf640 1 --2- 172.21.15.37:0/3583269736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160870 0x7fc3840b47f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3800097a0 tx=0x7fc38002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cadd9ed20dca89 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc388ccd640 1 -- 172.21.15.37:0/3583269736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380031830 con 0x7fc384160870 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc388ccd640 1 -- 172.21.15.37:0/3583269736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc380031990 con 0x7fc384160870 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc388ccd640 1 -- 172.21.15.37:0/3583269736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380031d20 con 0x7fc384160870 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc38acd1640 1 -- 172.21.15.37:0/3583269736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160870 msgr2=0x7fc3840b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc38acd1640 1 --2- 172.21.15.37:0/3583269736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160870 0x7fc3840b47f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3800097a0 tx=0x7fc38002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc38acd1640 1 -- 172.21.15.37:0/3583269736 shutdown_connections 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc38acd1640 1 --2- 172.21.15.37:0/3583269736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160870 0x7fc3840b47f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc38acd1640 1 -- 172.21.15.37:0/3583269736 >> 172.21.15.37:0/3583269736 conn(0x7fc38409c5c0 msgr2=0x7fc3840d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc38acd1640 1 -- 172.21.15.37:0/3583269736 shutdown_connections 2023-11-24T06:14:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.841+0000 7fc38acd1640 1 -- 172.21.15.37:0/3583269736 wait complete. 2023-11-24T06:14:51.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.843+0000 7fc38acd1640 1 Processor -- start 2023-11-24T06:14:51.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.843+0000 7fc38acd1640 1 -- start start 2023-11-24T06:14:51.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38acd1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3840b4330 0x7fc38415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38acd1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc384160870 0x7fc3840c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38acd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160c50 0x7fc3840cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38acd1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840c8710 con 0x7fc384160c50 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38acd1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840c7b00 con 0x7fc384160870 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38acd1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840c7de0 con 0x7fc3840b4330 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38a4d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160c50 0x7fc3840cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38a4d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160c50 0x7fc3840cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44332/0 (socket says 172.21.15.37:44332) 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.844+0000 7fc38a4d0640 1 -- 172.21.15.37:0/102889854 learned_addr learned my addr 172.21.15.37:0/102889854 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc3894ce640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc384160870 0x7fc3840c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc389ccf640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3840b4330 0x7fc38415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc38a4d0640 1 -- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3840b4330 msgr2=0x7fc38415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc38a4d0640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3840b4330 0x7fc38415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc38a4d0640 1 -- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc384160870 msgr2=0x7fc3840c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc38a4d0640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc384160870 0x7fc3840c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc38a4d0640 1 -- 172.21.15.37:0/102889854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc380009400 con 0x7fc384160c50 2023-11-24T06:14:51.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc389ccf640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3840b4330 0x7fc38415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:51.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc38a4d0640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160c50 0x7fc3840cc4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00b990 tx=0x7fc37c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.845+0000 7fc37a7fc640 1 -- 172.21.15.37:0/102889854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00cba0 con 0x7fc384160c50 2023-11-24T06:14:51.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.846+0000 7fc37a7fc640 1 -- 172.21.15.37:0/102889854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c00cd00 con 0x7fc384160c50 2023-11-24T06:14:51.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.846+0000 7fc37a7fc640 1 -- 172.21.15.37:0/102889854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c014680 con 0x7fc384160c50 2023-11-24T06:14:51.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.846+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3840c80c0 con 0x7fc384160c50 2023-11-24T06:14:51.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.846+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3840b8610 con 0x7fc384160c50 2023-11-24T06:14:51.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.847+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3840ca340 con 0x7fc384160c50 2023-11-24T06:14:51.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.848+0000 7fc37a7fc640 1 -- 172.21.15.37:0/102889854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc37c01d3b0 con 0x7fc384160c50 2023-11-24T06:14:51.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.848+0000 7fc37a7fc640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc36806ae40 0x7fc36806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.849+0000 7fc37a7fc640 1 -- 172.21.15.37:0/102889854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc37c089590 con 0x7fc384160c50 2023-11-24T06:14:51.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.849+0000 7fc389ccf640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc36806ae40 0x7fc36806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.850+0000 7fc389ccf640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc36806ae40 0x7fc36806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc380036000 tx=0x7fc380008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:51.855+0000 7fc37a7fc640 1 -- 172.21.15.37:0/102889854 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3840ca340 con 0x7fc384160c50 2023-11-24T06:14:52.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.078+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc3840ca340 con 0x7fc384160c50 2023-11-24T06:14:52.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.716+0000 7fc37a7fc640 1 -- 172.21.15.37:0/102889854 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc3840ca340 con 0x7fc384160c50 2023-11-24T06:14:52.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc36806ae40 msgr2=0x7fc36806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc36806ae40 0x7fc36806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc380036000 tx=0x7fc380008030 comp rx=0 tx=0).stop 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160c50 msgr2=0x7fc3840cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160c50 0x7fc3840cc4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00b990 tx=0x7fc37c00be50 comp rx=0 tx=0).stop 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 shutdown_connections 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc36806ae40 0x7fc36806d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc384160870 0x7fc3840c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc384160c50 0x7fc3840cc4c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 --2- 172.21.15.37:0/102889854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3840b4330 0x7fc38415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.719+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 >> 172.21.15.37:0/102889854 conn(0x7fc38409c5c0 msgr2=0x7fc3840b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.720+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 shutdown_connections 2023-11-24T06:14:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.720+0000 7fc38acd1640 1 -- 172.21.15.37:0/102889854 wait complete. 2023-11-24T06:14:52.742 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:14:52.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:14:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.953+0000 7f6a126e1640 1 Processor -- start 2023-11-24T06:14:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.954+0000 7f6a126e1640 1 -- start start 2023-11-24T06:14:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.955+0000 7f6a126e1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 0x7f6a0c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.955+0000 7f6a126e1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a0c06e580 0x7f6a0c0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.955+0000 7f6a126e1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6a0c0b1080 0x7f6a0c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.955+0000 7f6a126e1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b1530 con 0x7f6a0c06e580 2023-11-24T06:14:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.955+0000 7f6a126e1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c15b640 con 0x7f6a0c0b1080 2023-11-24T06:14:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.955+0000 7f6a126e1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c15ed20 con 0x7f6a0c15b260 2023-11-24T06:14:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a0c06e580 0x7f6a0c0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a0c06e580 0x7f6a0c0b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44346/0 (socket says 172.21.15.37:44346) 2023-11-24T06:14:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 -- 172.21.15.37:0/915004830 learned_addr learned my addr 172.21.15.37:0/915004830 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a11ee0640 1 --2- 172.21.15.37:0/915004830 >> v2:172.21.15.188:3300/0 conn(0x7f6a0c0b1080 0x7f6a0c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 -- 172.21.15.37:0/915004830 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 msgr2=0x7f6a0c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 --2- 172.21.15.37:0/915004830 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 0x7f6a0c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 -- 172.21.15.37:0/915004830 >> v2:172.21.15.188:3300/0 conn(0x7f6a0c0b1080 msgr2=0x7f6a0c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 --2- 172.21.15.37:0/915004830 >> v2:172.21.15.188:3300/0 conn(0x7f6a0c0b1080 0x7f6a0c0ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a10ede640 1 -- 172.21.15.37:0/915004830 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c15f8a0 con 0x7f6a0c06e580 2023-11-24T06:14:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.956+0000 7f6a11ee0640 1 --2- 172.21.15.37:0/915004830 >> v2:172.21.15.188:3300/0 conn(0x7f6a0c0b1080 0x7f6a0c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.957+0000 7f6a10ede640 1 --2- 172.21.15.37:0/915004830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c06e580 0x7f6a0c0b0b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c06dfd0 tx=0x7f69fc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910413d781576316 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a03fff640 1 -- 172.21.15.37:0/915004830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc031740 con 0x7f6a0c06e580 2023-11-24T06:14:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a03fff640 1 -- 172.21.15.37:0/915004830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc0318a0 con 0x7f6a0c06e580 2023-11-24T06:14:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a03fff640 1 -- 172.21.15.37:0/915004830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc031c30 con 0x7f6a0c06e580 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 -- 172.21.15.37:0/915004830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c06e580 msgr2=0x7f6a0c0b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 --2- 172.21.15.37:0/915004830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c06e580 0x7f6a0c0b0b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c06dfd0 tx=0x7f69fc02b7e0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 -- 172.21.15.37:0/915004830 shutdown_connections 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 --2- 172.21.15.37:0/915004830 >> v2:172.21.15.188:3300/0 conn(0x7f6a0c0b1080 0x7f6a0c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 --2- 172.21.15.37:0/915004830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c06e580 0x7f6a0c0b0b40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 --2- 172.21.15.37:0/915004830 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 0x7f6a0c06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 -- 172.21.15.37:0/915004830 >> 172.21.15.37:0/915004830 conn(0x7f6a0c0cbb40 msgr2=0x7f6a0c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 -- 172.21.15.37:0/915004830 shutdown_connections 2023-11-24T06:14:52.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.958+0000 7f6a126e1640 1 -- 172.21.15.37:0/915004830 wait complete. 2023-11-24T06:14:52.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.960+0000 7f6a126e1640 1 Processor -- start 2023-11-24T06:14:52.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.960+0000 7f6a126e1640 1 -- start start 2023-11-24T06:14:52.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.961+0000 7f6a126e1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c06e580 0x7f6a0c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.961+0000 7f6a126e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0b1080 0x7f6a0c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.961+0000 7f6a126e1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 0x7f6a0c0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.961+0000 7f6a126e1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1588c0 con 0x7f6a0c0b1080 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.961+0000 7f6a126e1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1566c0 con 0x7f6a0c06e580 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.961+0000 7f6a126e1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c157cb0 con 0x7f6a0c15b260 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0b1080 0x7f6a0c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0b1080 0x7f6a0c0b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44350/0 (socket says 172.21.15.37:44350) 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 -- 172.21.15.37:0/1774054245 learned_addr learned my addr 172.21.15.37:0/1774054245 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:52.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a116df640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c06e580 0x7f6a0c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a11ee0640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 0x7f6a0c0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 -- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 msgr2=0x7f6a0c0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 0x7f6a0c0b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 -- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c06e580 msgr2=0x7f6a0c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c06e580 0x7f6a0c156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.962+0000 7f6a10ede640 1 -- 172.21.15.37:0/1774054245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0094d0 con 0x7f6a0c0b1080 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.963+0000 7f6a10ede640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0b1080 0x7f6a0c0b0020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69fc000c00 tx=0x7f69fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.963+0000 7f6a01ffb640 1 -- 172.21.15.37:0/1774054245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc033c50 con 0x7f6a0c0b1080 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.963+0000 7f6a01ffb640 1 -- 172.21.15.37:0/1774054245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc033db0 con 0x7f6a0c0b1080 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.963+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c157f90 con 0x7f6a0c0b1080 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.963+0000 7f6a01ffb640 1 -- 172.21.15.37:0/1774054245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc03d6b0 con 0x7f6a0c0b1080 2023-11-24T06:14:52.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.963+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c158550 con 0x7f6a0c0b1080 2023-11-24T06:14:52.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.964+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c04e840 con 0x7f6a0c0b1080 2023-11-24T06:14:52.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.965+0000 7f6a01ffb640 1 -- 172.21.15.37:0/1774054245 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f69fc03a040 con 0x7f6a0c0b1080 2023-11-24T06:14:52.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.966+0000 7f6a01ffb640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69f006ae40 0x7f69f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.966+0000 7f6a01ffb640 1 -- 172.21.15.37:0/1774054245 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69fc0ab570 con 0x7f6a0c0b1080 2023-11-24T06:14:52.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.966+0000 7f6a116df640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69f006ae40 0x7f69f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.967+0000 7f6a116df640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69f006ae40 0x7f69f006d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009890 tx=0x7f6a08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:52.970+0000 7f6a01ffb640 1 -- 172.21.15.37:0/1774054245 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69fc076610 con 0x7f6a0c0b1080 2023-11-24T06:14:53.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.204+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6a0c0ce640 con 0x7f6a0c0b1080 2023-11-24T06:14:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.728+0000 7f6a01ffb640 1 -- 172.21.15.37:0/1774054245 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f69fc079c30 con 0x7f6a0c0b1080 2023-11-24T06:14:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.731+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69f006ae40 msgr2=0x7f69f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.731+0000 7f6a126e1640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69f006ae40 0x7f69f006d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009890 tx=0x7f6a08008040 comp rx=0 tx=0).stop 2023-11-24T06:14:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.731+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0b1080 msgr2=0x7f6a0c0b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.731+0000 7f6a126e1640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0b1080 0x7f6a0c0b0020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69fc000c00 tx=0x7f69fc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 shutdown_connections 2023-11-24T06:14:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69f006ae40 0x7f69f006d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15b260 0x7f6a0c0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0b1080 0x7f6a0c0b0020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 --2- 172.21.15.37:0/1774054245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c06e580 0x7f6a0c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 >> 172.21.15.37:0/1774054245 conn(0x7f6a0c0cbb40 msgr2=0x7f6a0c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 shutdown_connections 2023-11-24T06:14:53.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.732+0000 7f6a126e1640 1 -- 172.21.15.37:0/1774054245 wait complete. 2023-11-24T06:14:53.755 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:14:53.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.974+0000 7f3701675640 1 Processor -- start 2023-11-24T06:14:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.974+0000 7f3701675640 1 -- start start 2023-11-24T06:14:53.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f3701675640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 0x7f36fc06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f3701675640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f36fc0cf450 0x7f36fc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f3701675640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc0cece0 con 0x7f36fc0cdfb0 2023-11-24T06:14:53.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f3701675640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc156010 con 0x7f36fc0cf450 2023-11-24T06:14:53.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f3701675640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc06ce30 con 0x7f36fc15c7f0 2023-11-24T06:14:53.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f36fb7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f36fc0cdfb0 0x7f36fc0ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47424/0 (socket says 172.21.15.37:47424) 2023-11-24T06:14:53.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f36fb7fe640 1 -- 172.21.15.37:0/2257181253 learned_addr learned my addr 172.21.15.37:0/2257181253 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:53.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004849594 0 0) 0x7f36fc0cece0 con 0x7f36fc0cdfb0 2023-11-24T06:14:53.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f36fa7fc640 1 --2- 172.21.15.37:0/2257181253 >> v2:172.21.15.188:3300/0 conn(0x7f36fc0cf450 0x7f36fc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e4003520 con 0x7f36fc0cdfb0 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.976+0000 7f36faffd640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 0x7f36fc06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2804565402 0 0) 0x7f36e4003520 con 0x7f36fc0cdfb0 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 msgr2=0x7f36fc06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 0x7f36fc06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 >> v2:172.21.15.188:3300/0 conn(0x7f36fc0cf450 msgr2=0x7f36fc0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 --2- 172.21.15.37:0/2257181253 >> v2:172.21.15.188:3300/0 conn(0x7f36fc0cf450 0x7f36fc0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc06d040 con 0x7f36fc0cdfb0 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f36f40019f0 con 0x7f36fc0cdfb0 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 >> v1:172.21.15.37:6789/0 conn(0x7f36fc0cdfb0 legacy=0x7f36fc0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e4003970 0x7f36e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 0x7f36e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4004d00 0x7f36e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc156010 con 0x7f36e4003970 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc06ce30 con 0x7f36e4004d00 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e400b980 con 0x7f36fc15c7f0 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.977+0000 7f36faffd640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e4003970 0x7f36e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.978+0000 7f36fb7fe640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4004d00 0x7f36e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.978+0000 7f36fa7fc640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 0x7f36e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.978+0000 7f36faffd640 1 -- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 msgr2=0x7f36e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.978+0000 7f36faffd640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc15c7f0 0x7f36e40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.978+0000 7f36faffd640 1 -- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4004d00 msgr2=0x7f36e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.978+0000 7f36faffd640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4004d00 0x7f36e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.978+0000 7f36faffd640 1 -- 172.21.15.37:0/2257181253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4003520 con 0x7f36e4003970 2023-11-24T06:14:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.979+0000 7f36faffd640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e4003970 0x7f36e4003d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009ac0 tx=0x7f36e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9d712a6c6ed722 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.979+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec02c6b0 con 0x7f36e4003970 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.979+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec02c810 con 0x7f36e4003970 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.979+0000 7f36f9ffb640 1 -- 172.21.15.37:0/2257181253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec02cba0 con 0x7f36e4003970 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.980+0000 7f3701675640 1 -- 172.21.15.37:0/2257181253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e4003970 msgr2=0x7f36e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.980+0000 7f3701675640 1 --2- 172.21.15.37:0/2257181253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e4003970 0x7f36e4003d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009ac0 tx=0x7f36e40057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.980+0000 7f36fb7fe640 1 -- 172.21.15.37:0/2257181253 reap_dead start 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.980+0000 7f3701675640 1 -- 172.21.15.37:0/2257181253 shutdown_connections 2023-11-24T06:14:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.980+0000 7f3701675640 1 -- 172.21.15.37:0/2257181253 >> 172.21.15.37:0/2257181253 conn(0x7f36fc06a920 msgr2=0x7f36fc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.980+0000 7f3701675640 1 -- 172.21.15.37:0/2257181253 shutdown_connections 2023-11-24T06:14:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.980+0000 7f3701675640 1 -- 172.21.15.37:0/2257181253 wait complete. 2023-11-24T06:14:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.982+0000 7f3701675640 1 Processor -- start 2023-11-24T06:14:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.982+0000 7f3701675640 1 -- start start 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f3701675640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4003970 0x7f36fc152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f3701675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36fc153f90 0x7f36fc154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f3701675640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc1574e0 0x7f36fc157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f3701675640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc1f1030 con 0x7f36fc153f90 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f3701675640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc154950 con 0x7f36e4003970 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f3701675640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc15a0e0 con 0x7f36fc1574e0 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f36fa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36fc153f90 0x7f36fc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f36fa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36fc153f90 0x7f36fc154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44370/0 (socket says 172.21.15.37:44370) 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.983+0000 7f36fa7fc640 1 -- 172.21.15.37:0/2989344220 learned_addr learned my addr 172.21.15.37:0/2989344220 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36faffd640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4003970 0x7f36fc152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36fb7fe640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc1574e0 0x7f36fc157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36fa7fc640 1 -- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc1574e0 msgr2=0x7f36fc157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36fa7fc640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc1574e0 0x7f36fc157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36fa7fc640 1 -- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4003970 msgr2=0x7f36fc152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36fa7fc640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4003970 0x7f36fc152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36fa7fc640 1 -- 172.21.15.37:0/2989344220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc15a350 con 0x7f36fc153f90 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36fa7fc640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36fc153f90 0x7f36fc154410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36f0010910 tx=0x7f36f0010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36e37fe640 1 -- 172.21.15.37:0/2989344220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0009690 con 0x7f36fc153f90 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36e37fe640 1 -- 172.21.15.37:0/2989344220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f000ec20 con 0x7f36fc153f90 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f36e37fe640 1 -- 172.21.15.37:0/2989344220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f001c400 con 0x7f36fc153f90 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.984+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc15a630 con 0x7f36fc153f90 2023-11-24T06:14:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.985+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc15abf0 con 0x7f36fc153f90 2023-11-24T06:14:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.986+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc1f1180 con 0x7f36fc153f90 2023-11-24T06:14:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.987+0000 7f36e37fe640 1 -- 172.21.15.37:0/2989344220 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36f001c560 con 0x7f36fc153f90 2023-11-24T06:14:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.987+0000 7f36e37fe640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f36e806ae70 0x7f36e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.988+0000 7f36e37fe640 1 -- 172.21.15.37:0/2989344220 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36f0089b00 con 0x7f36fc153f90 2023-11-24T06:14:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.988+0000 7f36faffd640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f36e806ae70 0x7f36e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.989+0000 7f36faffd640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f36e806ae70 0x7f36e806d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36ec036000 tx=0x7f36ec030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:53.992+0000 7f36e37fe640 1 -- 172.21.15.37:0/2989344220 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36fc1f1180 con 0x7f36fc153f90 2023-11-24T06:14:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.221+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36fc1f1180 con 0x7f36fc153f90 2023-11-24T06:14:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.223+0000 7f36e37fe640 1 -- 172.21.15.37:0/2989344220 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f36f008be60 con 0x7f36fc153f90 2023-11-24T06:14:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:54.226 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:14:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:14:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f36e806ae70 msgr2=0x7f36e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f36e806ae70 0x7f36e806d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36ec036000 tx=0x7f36ec030000 comp rx=0 tx=0).stop 2023-11-24T06:14:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36fc153f90 msgr2=0x7f36fc154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36fc153f90 0x7f36fc154410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36f0010910 tx=0x7f36f0010dd0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 shutdown_connections 2023-11-24T06:14:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f36e806ae70 0x7f36e806d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36fc1574e0 0x7f36fc157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36fc153f90 0x7f36fc154410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 --2- 172.21.15.37:0/2989344220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36e4003970 0x7f36fc152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.225+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 >> 172.21.15.37:0/2989344220 conn(0x7f36fc06a920 msgr2=0x7f36fc0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.226+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 shutdown_connections 2023-11-24T06:14:54.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.226+0000 7f3701675640 1 -- 172.21.15.37:0/2989344220 wait complete. 2023-11-24T06:14:54.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:54.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.463+0000 7f4466199640 1 Processor -- start 2023-11-24T06:14:54.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.463+0000 7f4466199640 1 -- start start 2023-11-24T06:14:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.464+0000 7f4466199640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 0x7f4460168080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.464+0000 7f4466199640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44600ce990 con 0x7f446015d4e0 2023-11-24T06:14:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.464+0000 7f4466199640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44600cec70 con 0x7f44600d1e20 2023-11-24T06:14:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.464+0000 7f4466199640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44600d4110 con 0x7f44600d0240 2023-11-24T06:14:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.464+0000 7f4465197640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f446015d4e0 0x7f44600d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47440/0 (socket says 172.21.15.37:47440) 2023-11-24T06:14:54.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.464+0000 7f4465197640 1 -- 172.21.15.37:0/3990339034 learned_addr learned my addr 172.21.15.37:0/3990339034 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4465998640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 0x7f4460168080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382703741 0 0) 0x7f44600ce990 con 0x7f446015d4e0 2023-11-24T06:14:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f444c003520 con 0x7f446015d4e0 2023-11-24T06:14:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4093460783 0 0) 0x7f444c003520 con 0x7f446015d4e0 2023-11-24T06:14:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 msgr2=0x7f4460168080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 0x7f4460168080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 >> v1:172.21.15.188:6789/0 conn(0x7f44600d1e20 legacy=0x7f44600cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44600cef50 con 0x7f446015d4e0 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f445c001670 con 0x7f446015d4e0 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 >> v1:172.21.15.37:6789/0 conn(0x7f446015d4e0 legacy=0x7f44600d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f444c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 0x7f444c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f444c004d00 0x7f444c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600d4110 con 0x7f444c0039a0 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c00bb60 con 0x7f444c004d00 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.465+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c00bd20 con 0x7f44600d0240 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465197640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f444c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465998640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f444c004d00 0x7f444c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4464996640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 0x7f444c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465197640 1 -- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 msgr2=0x7f444c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465197640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600d0240 0x7f444c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465197640 1 -- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f444c004d00 msgr2=0x7f444c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465197640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f444c004d00 0x7f444c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465197640 1 -- 172.21.15.37:0/3990339034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c003520 con 0x7f444c0039a0 2023-11-24T06:14:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.466+0000 7f4465998640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f444c004d00 0x7f444c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.467+0000 7f4465197640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f444c003dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c0e0 tx=0x7f444c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab268e68342b05a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.467+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c005ad0 con 0x7f444c0039a0 2023-11-24T06:14:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.467+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c005c30 con 0x7f444c0039a0 2023-11-24T06:14:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.467+0000 7f4457fff640 1 -- 172.21.15.37:0/3990339034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c02c7d0 con 0x7f444c0039a0 2023-11-24T06:14:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.468+0000 7f4466199640 1 -- 172.21.15.37:0/3990339034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 msgr2=0x7f444c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.468+0000 7f4466199640 1 --2- 172.21.15.37:0/3990339034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f444c003dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c0e0 tx=0x7f444c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.468+0000 7f4465998640 1 -- 172.21.15.37:0/3990339034 reap_dead start 2023-11-24T06:14:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.468+0000 7f4466199640 1 -- 172.21.15.37:0/3990339034 shutdown_connections 2023-11-24T06:14:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.468+0000 7f4466199640 1 -- 172.21.15.37:0/3990339034 >> 172.21.15.37:0/3990339034 conn(0x7f446009c510 msgr2=0x7f44600d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.468+0000 7f4466199640 1 -- 172.21.15.37:0/3990339034 shutdown_connections 2023-11-24T06:14:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.468+0000 7f4466199640 1 -- 172.21.15.37:0/3990339034 wait complete. 2023-11-24T06:14:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.470+0000 7f4466199640 1 Processor -- start 2023-11-24T06:14:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.470+0000 7f4466199640 1 -- start start 2023-11-24T06:14:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4466199640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f44601f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4466199640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44600c90e0 0x7f44600c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4466199640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600cc380 0x7f44600cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4466199640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600c9aa0 con 0x7f444c0039a0 2023-11-24T06:14:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4466199640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600cb000 con 0x7f44600c90e0 2023-11-24T06:14:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4466199640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44600cb2e0 con 0x7f44600cc380 2023-11-24T06:14:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4465197640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f44601f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4465197640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f44601f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44400/0 (socket says 172.21.15.37:44400) 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.471+0000 7f4465197640 1 -- 172.21.15.37:0/3023968513 learned_addr learned my addr 172.21.15.37:0/3023968513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4465197640 1 -- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600cc380 msgr2=0x7f44600cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4465197640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600cc380 0x7f44600cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4464996640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44600c90e0 0x7f44600c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4465197640 1 -- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44600c90e0 msgr2=0x7f44600c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4465197640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44600c90e0 0x7f44600c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4465197640 1 -- 172.21.15.37:0/3023968513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44600cb5c0 con 0x7f444c0039a0 2023-11-24T06:14:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4464996640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44600c90e0 0x7f44600c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4465197640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f44601f3390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c0e0 tx=0x7f446006b0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.472+0000 7f4455ffb640 1 -- 172.21.15.37:0/3023968513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c02cca0 con 0x7f444c0039a0 2023-11-24T06:14:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.473+0000 7f4455ffb640 1 -- 172.21.15.37:0/3023968513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c03a070 con 0x7f444c0039a0 2023-11-24T06:14:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.473+0000 7f4455ffb640 1 -- 172.21.15.37:0/3023968513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c007070 con 0x7f444c0039a0 2023-11-24T06:14:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.473+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44600cb8a0 con 0x7f444c0039a0 2023-11-24T06:14:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.473+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44600cbe60 con 0x7f444c0039a0 2023-11-24T06:14:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.474+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446004e840 con 0x7f444c0039a0 2023-11-24T06:14:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.475+0000 7f4455ffb640 1 -- 172.21.15.37:0/3023968513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f445c032070 con 0x7f444c0039a0 2023-11-24T06:14:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.476+0000 7f4455ffb640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f444406ae40 0x7f444406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.476+0000 7f4455ffb640 1 -- 172.21.15.37:0/3023968513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f445c0aa870 con 0x7f444c0039a0 2023-11-24T06:14:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.476+0000 7f4464996640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f444406ae40 0x7f444406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.477+0000 7f4464996640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f444406ae40 0x7f444406d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4450007fd0 tx=0x7f4450009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.480+0000 7f4455ffb640 1 -- 172.21.15.37:0/3023968513 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f445c075880 con 0x7f444c0039a0 2023-11-24T06:14:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.677+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4460156e30 con 0x7f444c0039a0 2023-11-24T06:14:54.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.679+0000 7f4455ffb640 1 -- 172.21.15.37:0/3023968513 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f445c045020 con 0x7f444c0039a0 2023-11-24T06:14:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:54.683 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f444406ae40 msgr2=0x7f444406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f444406ae40 0x7f444406d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4450007fd0 tx=0x7f4450009040 comp rx=0 tx=0).stop 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 msgr2=0x7f44601f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f44601f3390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c0e0 tx=0x7f446006b0c0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 shutdown_connections 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f444406ae40 0x7f444406d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44600c90e0 0x7f44600c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44600cc380 0x7f44600cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 --2- 172.21.15.37:0/3023968513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f444c0039a0 0x7f44601f3390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 >> 172.21.15.37:0/3023968513 conn(0x7f446009c510 msgr2=0x7f446006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 shutdown_connections 2023-11-24T06:14:54.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.683+0000 7f4466199640 1 -- 172.21.15.37:0/3023968513 wait complete. 2023-11-24T06:14:54.706 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:14:54.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:54.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.929+0000 7fccf2e3d640 1 Processor -- start 2023-11-24T06:14:54.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.930+0000 7fccf2e3d640 1 -- start start 2023-11-24T06:14:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.931+0000 7fccf2e3d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccec147dc0 0x7fccec165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.931+0000 7fccf2e3d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec06cb90 0x7fccec0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.931+0000 7fccf2e3d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec070db0 con 0x7fccec0d11a0 2023-11-24T06:14:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.931+0000 7fccf2e3d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec0d1b70 con 0x7fccec147dc0 2023-11-24T06:14:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.931+0000 7fccf2e3d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec1481a0 con 0x7fccec06cb90 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf0bd9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccec147dc0 0x7fccec165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf0bd9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccec147dc0 0x7fccec165ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44416/0 (socket says 172.21.15.37:44416) 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3031962064 learned_addr learned my addr 172.21.15.37:0/3031962064 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf13da640 1 --2- 172.21.15.37:0/3031962064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec06cb90 0x7fccec0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccebfff640 1 --1- 172.21.15.37:0/3031962064 >> v1:172.21.15.188:6789/0 conn(0x7fccec0d11a0 0x7fccec0b4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50350/0 (socket says 172.21.15.37:50350) 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3031962064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec06cb90 msgr2=0x7fccec0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf0bd9640 1 --2- 172.21.15.37:0/3031962064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec06cb90 0x7fccec0d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3031962064 >> v1:172.21.15.188:6789/0 conn(0x7fccec0d11a0 legacy=0x7fccec0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.932+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3031962064 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0701a0 con 0x7fccec147dc0 2023-11-24T06:14:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.934+0000 7fccf0bd9640 1 --2- 172.21.15.37:0/3031962064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec147dc0 0x7fccec165ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009e50 tx=0x7fccdc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00586f335ab2394 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.934+0000 7fcceb7fe640 1 -- 172.21.15.37:0/3031962064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc02cb00 con 0x7fccec147dc0 2023-11-24T06:14:54.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.934+0000 7fcceb7fe640 1 -- 172.21.15.37:0/3031962064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc02cc60 con 0x7fccec147dc0 2023-11-24T06:14:54.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.934+0000 7fcceb7fe640 1 -- 172.21.15.37:0/3031962064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0343f0 con 0x7fccec147dc0 2023-11-24T06:14:54.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3031962064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec147dc0 msgr2=0x7fccec165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3031962064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec147dc0 0x7fccec165ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009e50 tx=0x7fccdc02bf60 comp rx=0 tx=0).stop 2023-11-24T06:14:54.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3031962064 shutdown_connections 2023-11-24T06:14:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3031962064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec06cb90 0x7fccec0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3031962064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec147dc0 0x7fccec165ce0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3031962064 >> 172.21.15.37:0/3031962064 conn(0x7fccec06e8a0 msgr2=0x7fccec06ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3031962064 shutdown_connections 2023-11-24T06:14:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.935+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3031962064 wait complete. 2023-11-24T06:14:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.937+0000 7fccf2e3d640 1 Processor -- start 2023-11-24T06:14:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.937+0000 7fccf2e3d640 1 -- start start 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf2e3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec06cb90 0x7fccec0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf2e3d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccec0d11a0 0x7fccec161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf2e3d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec147dc0 0x7fccec1f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf2e3d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec146010 con 0x7fccec06cb90 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf2e3d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec1f8040 con 0x7fccec0d11a0 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf2e3d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec1f8320 con 0x7fccec147dc0 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf0bd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec06cb90 0x7fccec0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf0bd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec06cb90 0x7fccec0cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44428/0 (socket says 172.21.15.37:44428) 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.938+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3641669989 learned_addr learned my addr 172.21.15.37:0/3641669989 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccebfff640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccec0d11a0 0x7fccec161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccf13da640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec147dc0 0x7fccec1f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec147dc0 msgr2=0x7fccec1f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccf0bd9640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec147dc0 0x7fccec1f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccec0d11a0 msgr2=0x7fccec161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccf0bd9640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccec0d11a0 0x7fccec161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccf0bd9640 1 -- 172.21.15.37:0/3641669989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009b30 con 0x7fccec06cb90 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.939+0000 7fccf0bd9640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec06cb90 0x7fccec0cf420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000f80 tx=0x7fccdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.940+0000 7fcce97fa640 1 -- 172.21.15.37:0/3641669989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc009510 con 0x7fccec06cb90 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.940+0000 7fcce97fa640 1 -- 172.21.15.37:0/3641669989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc03e450 con 0x7fccec06cb90 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.940+0000 7fcce97fa640 1 -- 172.21.15.37:0/3641669989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc03e800 con 0x7fccec06cb90 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.940+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec1f8600 con 0x7fccec06cb90 2023-11-24T06:14:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.940+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec1616d0 con 0x7fccec06cb90 2023-11-24T06:14:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.941+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec0cdab0 con 0x7fccec06cb90 2023-11-24T06:14:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.942+0000 7fcce97fa640 1 -- 172.21.15.37:0/3641669989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fccdc03e960 con 0x7fccec06cb90 2023-11-24T06:14:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.943+0000 7fcce97fa640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcccc06ae40 0x7fcccc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.943+0000 7fcce97fa640 1 -- 172.21.15.37:0/3641669989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccdc0ac3b0 con 0x7fccec06cb90 2023-11-24T06:14:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.943+0000 7fccebfff640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcccc06ae40 0x7fcccc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.944+0000 7fccebfff640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcccc06ae40 0x7fcccc06d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fccec0cda80 tx=0x7fccd4007c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:54.947+0000 7fcce97fa640 1 -- 172.21.15.37:0/3641669989 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fccdc0773d0 con 0x7fccec06cb90 2023-11-24T06:14:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.138+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccec070a40 con 0x7fcccc06ae40 2023-11-24T06:14:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.163+0000 7fcce97fa640 1 -- 172.21.15.37:0/3641669989 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264486 (secure 0 0 0) 0x7fccd4005a50 con 0x7fcccc06ae40 2023-11-24T06:14:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:14:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.169+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcccc06ae40 msgr2=0x7fcccc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.169+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcccc06ae40 0x7fcccc06d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fccec0cda80 tx=0x7fccd4007c80 comp rx=0 tx=0).stop 2023-11-24T06:14:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.169+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec06cb90 msgr2=0x7fccec0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.169+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec06cb90 0x7fccec0cf420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000f80 tx=0x7fccdc004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 shutdown_connections 2023-11-24T06:14:55.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcccc06ae40 0x7fcccc06d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccec0d11a0 0x7fccec161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccec147dc0 0x7fccec1f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 --2- 172.21.15.37:0/3641669989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccec06cb90 0x7fccec0cf420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 >> 172.21.15.37:0/3641669989 conn(0x7fccec06e8a0 msgr2=0x7fccec0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 shutdown_connections 2023-11-24T06:14:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.170+0000 7fccf2e3d640 1 -- 172.21.15.37:0/3641669989 wait complete. 2023-11-24T06:14:55.192 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-24T06:14:54.814315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001635"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100558+0000","last_change":"2023-11-24T06:14:50.682748+0000","last_active":"2023-11-24T06:14:52.100558+0000","last_peered":"2023-11-24T06:14:52.100558+0000","last_clean":"2023-11-24T06:14:52.100558+0000","last_became_active":"2023-11-24T06:14:50.682229+0000","last_became_peered":"2023-11-24T06:14:50.682229+0000","last_unstale":"2023-11-24T06:14:52.100558+0000","last_undegraded":"2023-11-24T06:14:52.100558+0000","last_fullsized":"2023-11-24T06:14:52.100558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:31.904106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643746+0000","last_change":"2023-11-24T06:14:50.672740+0000","last_active":"2023-11-24T06:14:51.643746+0000","last_peered":"2023-11-24T06:14:51.643746+0000","last_clean":"2023-11-24T06:14:51.643746+0000","last_became_active":"2023-11-24T06:14:50.672321+0000","last_became_peered":"2023-11-24T06:14:50.672321+0000","last_unstale":"2023-11-24T06:14:51.643746+0000","last_undegraded":"2023-11-24T06:14:51.643746+0000","last_fullsized":"2023-11-24T06:14:51.643746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100183+0000","last_change":"2023-11-24T06:14:50.682497+0000","last_active":"2023-11-24T06:14:52.100183+0000","last_peered":"2023-11-24T06:14:52.100183+0000","last_clean":"2023-11-24T06:14:52.100183+0000","last_became_active":"2023-11-24T06:14:50.682193+0000","last_became_peered":"2023-11-24T06:14:50.682193+0000","last_unstale":"2023-11-24T06:14:52.100183+0000","last_undegraded":"2023-11-24T06:14:52.100183+0000","last_fullsized":"2023-11-24T06:14:52.100183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648766+0000","last_change":"2023-11-24T06:14:50.674687+0000","last_active":"2023-11-24T06:14:51.648766+0000","last_peered":"2023-11-24T06:14:51.648766+0000","last_clean":"2023-11-24T06:14:51.648766+0000","last_became_active":"2023-11-24T06:14:50.673159+0000","last_became_peered":"2023-11-24T06:14:50.673159+0000","last_unstale":"2023-11-24T06:14:51.648766+0000","last_undegraded":"2023-11-24T06:14:51.648766+0000","last_fullsized":"2023-11-24T06:14:51.648766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100007+0000","last_change":"2023-11-24T06:14:50.672761+0000","last_active":"2023-11-24T06:14:52.100007+0000","last_peered":"2023-11-24T06:14:52.100007+0000","last_clean":"2023-11-24T06:14:52.100007+0000","last_became_active":"2023-11-24T06:14:50.672175+0000","last_became_peered":"2023-11-24T06:14:50.672175+0000","last_unstale":"2023-11-24T06:14:52.100007+0000","last_undegraded":"2023-11-24T06:14:52.100007+0000","last_fullsized":"2023-11-24T06:14:52.100007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647948+0000","last_change":"2023-11-24T06:14:50.676313+0000","last_active":"2023-11-24T06:14:51.647948+0000","last_peered":"2023-11-24T06:14:51.647948+0000","last_clean":"2023-11-24T06:14:51.647948+0000","last_became_active":"2023-11-24T06:14:50.675981+0000","last_became_peered":"2023-11-24T06:14:50.675981+0000","last_unstale":"2023-11-24T06:14:51.647948+0000","last_undegraded":"2023-11-24T06:14:51.647948+0000","last_fullsized":"2023-11-24T06:14:51.647948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099417+0000","last_change":"2023-11-24T06:14:50.678743+0000","last_active":"2023-11-24T06:14:52.099417+0000","last_peered":"2023-11-24T06:14:52.099417+0000","last_clean":"2023-11-24T06:14:52.099417+0000","last_became_active":"2023-11-24T06:14:50.677585+0000","last_became_peered":"2023-11-24T06:14:50.677585+0000","last_unstale":"2023-11-24T06:14:52.099417+0000","last_undegraded":"2023-11-24T06:14:52.099417+0000","last_fullsized":"2023-11-24T06:14:52.099417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098443+0000","last_change":"2023-11-24T06:14:50.671307+0000","last_active":"2023-11-24T06:14:52.098443+0000","last_peered":"2023-11-24T06:14:52.098443+0000","last_clean":"2023-11-24T06:14:52.098443+0000","last_became_active":"2023-11-24T06:14:50.670760+0000","last_became_peered":"2023-11-24T06:14:50.670760+0000","last_unstale":"2023-11-24T06:14:52.098443+0000","last_undegraded":"2023-11-24T06:14:52.098443+0000","last_fullsized":"2023-11-24T06:14:52.098443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100556+0000","last_change":"2023-11-24T06:14:50.686106+0000","last_active":"2023-11-24T06:14:52.100556+0000","last_peered":"2023-11-24T06:14:52.100556+0000","last_clean":"2023-11-24T06:14:52.100556+0000","last_became_active":"2023-11-24T06:14:50.685766+0000","last_became_peered":"2023-11-24T06:14:50.685766+0000","last_unstale":"2023-11-24T06:14:52.100556+0000","last_undegraded":"2023-11-24T06:14:52.100556+0000","last_fullsized":"2023-11-24T06:14:52.100556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087249+0000","last_change":"2023-11-24T06:14:50.668109+0000","last_active":"2023-11-24T06:14:52.087249+0000","last_peered":"2023-11-24T06:14:52.087249+0000","last_clean":"2023-11-24T06:14:52.087249+0000","last_became_active":"2023-11-24T06:14:50.667876+0000","last_became_peered":"2023-11-24T06:14:50.667876+0000","last_unstale":"2023-11-24T06:14:52.087249+0000","last_undegraded":"2023-11-24T06:14:52.087249+0000","last_fullsized":"2023-11-24T06:14:52.087249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086961+0000","last_change":"2023-11-24T06:14:50.669500+0000","last_active":"2023-11-24T06:14:52.086961+0000","last_peered":"2023-11-24T06:14:52.086961+0000","last_clean":"2023-11-24T06:14:52.086961+0000","last_became_active":"2023-11-24T06:14:50.667834+0000","last_became_peered":"2023-11-24T06:14:50.667834+0000","last_unstale":"2023-11-24T06:14:52.086961+0000","last_undegraded":"2023-11-24T06:14:52.086961+0000","last_fullsized":"2023-11-24T06:14:52.086961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649114+0000","last_change":"2023-11-24T06:14:50.669357+0000","last_active":"2023-11-24T06:14:51.649114+0000","last_peered":"2023-11-24T06:14:51.649114+0000","last_clean":"2023-11-24T06:14:51.649114+0000","last_became_active":"2023-11-24T06:14:50.669083+0000","last_became_peered":"2023-11-24T06:14:50.669083+0000","last_unstale":"2023-11-24T06:14:51.649114+0000","last_undegraded":"2023-11-24T06:14:51.649114+0000","last_fullsized":"2023-11-24T06:14:51.649114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:27.615626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098696+0000","last_change":"2023-11-24T06:14:50.682270+0000","last_active":"2023-11-24T06:14:52.098696+0000","last_peered":"2023-11-24T06:14:52.098696+0000","last_clean":"2023-11-24T06:14:52.098696+0000","last_became_active":"2023-11-24T06:14:50.681919+0000","last_became_peered":"2023-11-24T06:14:50.681919+0000","last_unstale":"2023-11-24T06:14:52.098696+0000","last_undegraded":"2023-11-24T06:14:52.098696+0000","last_fullsized":"2023-11-24T06:14:52.098696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099796+0000","last_change":"2023-11-24T06:14:50.674645+0000","last_active":"2023-11-24T06:14:52.099796+0000","last_peered":"2023-11-24T06:14:52.099796+0000","last_clean":"2023-11-24T06:14:52.099796+0000","last_became_active":"2023-11-24T06:14:50.673843+0000","last_became_peered":"2023-11-24T06:14:50.673843+0000","last_unstale":"2023-11-24T06:14:52.099796+0000","last_undegraded":"2023-11-24T06:14:52.099796+0000","last_fullsized":"2023-11-24T06:14:52.099796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:43.740152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643448+0000","last_change":"2023-11-24T06:14:50.671555+0000","last_active":"2023-11-24T06:14:51.643448+0000","last_peered":"2023-11-24T06:14:51.643448+0000","last_clean":"2023-11-24T06:14:51.643448+0000","last_became_active":"2023-11-24T06:14:50.671247+0000","last_became_peered":"2023-11-24T06:14:50.671247+0000","last_unstale":"2023-11-24T06:14:51.643448+0000","last_undegraded":"2023-11-24T06:14:51.643448+0000","last_fullsized":"2023-11-24T06:14:51.643448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647469+0000","last_change":"2023-11-24T06:14:50.670462+0000","last_active":"2023-11-24T06:14:51.647469+0000","last_peered":"2023-11-24T06:14:51.647469+0000","last_clean":"2023-11-24T06:14:51.647469+0000","last_became_active":"2023-11-24T06:14:50.670143+0000","last_became_peered":"2023-11-24T06:14:50.670143+0000","last_unstale":"2023-11-24T06:14:51.647469+0000","last_undegraded":"2023-11-24T06:14:51.647469+0000","last_fullsized":"2023-11-24T06:14:51.647469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650874+0000","last_change":"2023-11-24T06:14:50.681286+0000","last_active":"2023-11-24T06:14:51.650874+0000","last_peered":"2023-11-24T06:14:51.650874+0000","last_clean":"2023-11-24T06:14:51.650874+0000","last_became_active":"2023-11-24T06:14:50.680323+0000","last_became_peered":"2023-11-24T06:14:50.680323+0000","last_unstale":"2023-11-24T06:14:51.650874+0000","last_undegraded":"2023-11-24T06:14:51.650874+0000","last_fullsized":"2023-11-24T06:14:51.650874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096934+0000","last_change":"2023-11-24T06:14:50.680143+0000","last_active":"2023-11-24T06:14:52.096934+0000","last_peered":"2023-11-24T06:14:52.096934+0000","last_clean":"2023-11-24T06:14:52.096934+0000","last_became_active":"2023-11-24T06:14:50.679818+0000","last_became_peered":"2023-11-24T06:14:50.679818+0000","last_unstale":"2023-11-24T06:14:52.096934+0000","last_undegraded":"2023-11-24T06:14:52.096934+0000","last_fullsized":"2023-11-24T06:14:52.096934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100469+0000","last_change":"2023-11-24T06:14:50.677609+0000","last_active":"2023-11-24T06:14:52.100469+0000","last_peered":"2023-11-24T06:14:52.100469+0000","last_clean":"2023-11-24T06:14:52.100469+0000","last_became_active":"2023-11-24T06:14:50.677066+0000","last_became_peered":"2023-11-24T06:14:50.677066+0000","last_unstale":"2023-11-24T06:14:52.100469+0000","last_undegraded":"2023-11-24T06:14:52.100469+0000","last_fullsized":"2023-11-24T06:14:52.100469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087142+0000","last_change":"2023-11-24T06:14:50.683104+0000","last_active":"2023-11-24T06:14:52.087142+0000","last_peered":"2023-11-24T06:14:52.087142+0000","last_clean":"2023-11-24T06:14:52.087142+0000","last_became_active":"2023-11-24T06:14:50.682658+0000","last_became_peered":"2023-11-24T06:14:50.682658+0000","last_unstale":"2023-11-24T06:14:52.087142+0000","last_undegraded":"2023-11-24T06:14:52.087142+0000","last_fullsized":"2023-11-24T06:14:52.087142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099758+0000","last_change":"2023-11-24T06:14:50.679645+0000","last_active":"2023-11-24T06:14:52.099758+0000","last_peered":"2023-11-24T06:14:52.099758+0000","last_clean":"2023-11-24T06:14:52.099758+0000","last_became_active":"2023-11-24T06:14:50.675742+0000","last_became_peered":"2023-11-24T06:14:50.675742+0000","last_unstale":"2023-11-24T06:14:52.099758+0000","last_undegraded":"2023-11-24T06:14:52.099758+0000","last_fullsized":"2023-11-24T06:14:52.099758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:09.290044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649295+0000","last_change":"2023-11-24T06:14:50.681368+0000","last_active":"2023-11-24T06:14:51.649295+0000","last_peered":"2023-11-24T06:14:51.649295+0000","last_clean":"2023-11-24T06:14:51.649295+0000","last_became_active":"2023-11-24T06:14:50.680084+0000","last_became_peered":"2023-11-24T06:14:50.680084+0000","last_unstale":"2023-11-24T06:14:51.649295+0000","last_undegraded":"2023-11-24T06:14:51.649295+0000","last_fullsized":"2023-11-24T06:14:51.649295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098619+0000","last_change":"2023-11-24T06:14:50.673670+0000","last_active":"2023-11-24T06:14:52.098619+0000","last_peered":"2023-11-24T06:14:52.098619+0000","last_clean":"2023-11-24T06:14:52.098619+0000","last_became_active":"2023-11-24T06:14:50.673403+0000","last_became_peered":"2023-11-24T06:14:50.673403+0000","last_unstale":"2023-11-24T06:14:52.098619+0000","last_undegraded":"2023-11-24T06:14:52.098619+0000","last_fullsized":"2023-11-24T06:14:52.098619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648773+0000","last_change":"2023-11-24T06:14:50.674073+0000","last_active":"2023-11-24T06:14:51.648773+0000","last_peered":"2023-11-24T06:14:51.648773+0000","last_clean":"2023-11-24T06:14:51.648773+0000","last_became_active":"2023-11-24T06:14:50.673664+0000","last_became_peered":"2023-11-24T06:14:50.673664+0000","last_unstale":"2023-11-24T06:14:51.648773+0000","last_undegraded":"2023-11-24T06:14:51.648773+0000","last_fullsized":"2023-11-24T06:14:51.648773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099308+0000","last_change":"2023-11-24T06:14:50.678205+0000","last_active":"2023-11-24T06:14:52.099308+0000","last_peered":"2023-11-24T06:14:52.099308+0000","last_clean":"2023-11-24T06:14:52.099308+0000","last_became_active":"2023-11-24T06:14:50.677191+0000","last_became_peered":"2023-11-24T06:14:50.677191+0000","last_unstale":"2023-11-24T06:14:52.099308+0000","last_undegraded":"2023-11-24T06:14:52.099308+0000","last_fullsized":"2023-11-24T06:14:52.099308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087355+0000","last_change":"2023-11-24T06:14:50.676733+0000","last_active":"2023-11-24T06:14:52.087355+0000","last_peered":"2023-11-24T06:14:52.087355+0000","last_clean":"2023-11-24T06:14:52.087355+0000","last_became_active":"2023-11-24T06:14:50.676449+0000","last_became_peered":"2023-11-24T06:14:50.676449+0000","last_unstale":"2023-11-24T06:14:52.087355+0000","last_undegraded":"2023-11-24T06:14:52.087355+0000","last_fullsized":"2023-11-24T06:14:52.087355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643784+0000","last_change":"2023-11-24T06:14:50.673695+0000","last_active":"2023-11-24T06:14:51.643784+0000","last_peered":"2023-11-24T06:14:51.643784+0000","last_clean":"2023-11-24T06:14:51.643784+0000","last_became_active":"2023-11-24T06:14:50.673352+0000","last_became_peered":"2023-11-24T06:14:50.673352+0000","last_unstale":"2023-11-24T06:14:51.643784+0000","last_undegraded":"2023-11-24T06:14:51.643784+0000","last_fullsized":"2023-11-24T06:14:51.643784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099455+0000","last_change":"2023-11-24T06:14:50.676349+0000","last_active":"2023-11-24T06:14:52.099455+0000","last_peered":"2023-11-24T06:14:52.099455+0000","last_clean":"2023-11-24T06:14:52.099455+0000","last_became_active":"2023-11-24T06:14:50.676071+0000","last_became_peered":"2023-11-24T06:14:50.676071+0000","last_unstale":"2023-11-24T06:14:52.099455+0000","last_undegraded":"2023-11-24T06:14:52.099455+0000","last_fullsized":"2023-11-24T06:14:52.099455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099881+0000","last_change":"2023-11-24T06:14:50.680531+0000","last_active":"2023-11-24T06:14:52.099881+0000","last_peered":"2023-11-24T06:14:52.099881+0000","last_clean":"2023-11-24T06:14:52.099881+0000","last_became_active":"2023-11-24T06:14:50.680165+0000","last_became_peered":"2023-11-24T06:14:50.680165+0000","last_unstale":"2023-11-24T06:14:52.099881+0000","last_undegraded":"2023-11-24T06:14:52.099881+0000","last_fullsized":"2023-11-24T06:14:52.099881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649625+0000","last_change":"2023-11-24T06:14:50.670339+0000","last_active":"2023-11-24T06:14:51.649625+0000","last_peered":"2023-11-24T06:14:51.649625+0000","last_clean":"2023-11-24T06:14:51.649625+0000","last_became_active":"2023-11-24T06:14:50.670090+0000","last_became_peered":"2023-11-24T06:14:50.670090+0000","last_unstale":"2023-11-24T06:14:51.649625+0000","last_undegraded":"2023-11-24T06:14:51.649625+0000","last_fullsized":"2023-11-24T06:14:51.649625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096750+0000","last_change":"2023-11-24T06:14:50.666860+0000","last_active":"2023-11-24T06:14:52.096750+0000","last_peered":"2023-11-24T06:14:52.096750+0000","last_clean":"2023-11-24T06:14:52.096750+0000","last_became_active":"2023-11-24T06:14:50.666581+0000","last_became_peered":"2023-11-24T06:14:50.666581+0000","last_unstale":"2023-11-24T06:14:52.096750+0000","last_undegraded":"2023-11-24T06:14:52.096750+0000","last_fullsized":"2023-11-24T06:14:52.096750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087368+0000","last_change":"2023-11-24T06:14:50.674598+0000","last_active":"2023-11-24T06:14:52.087368+0000","last_peered":"2023-11-24T06:14:52.087368+0000","last_clean":"2023-11-24T06:14:52.087368+0000","last_became_active":"2023-11-24T06:14:50.674093+0000","last_became_peered":"2023-11-24T06:14:50.674093+0000","last_unstale":"2023-11-24T06:14:52.087368+0000","last_undegraded":"2023-11-24T06:14:52.087368+0000","last_fullsized":"2023-11-24T06:14:52.087368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650044+0000","last_change":"2023-11-24T06:14:50.668892+0000","last_active":"2023-11-24T06:14:51.650044+0000","last_peered":"2023-11-24T06:14:51.650044+0000","last_clean":"2023-11-24T06:14:51.650044+0000","last_became_active":"2023-11-24T06:14:50.668376+0000","last_became_peered":"2023-11-24T06:14:50.668376+0000","last_unstale":"2023-11-24T06:14:51.650044+0000","last_undegraded":"2023-11-24T06:14:51.650044+0000","last_fullsized":"2023-11-24T06:14:51.650044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708546+0000","last_change":"2023-11-24T06:14:49.697821+0000","last_active":"2023-11-24T06:14:50.708546+0000","last_peered":"2023-11-24T06:14:50.708546+0000","last_clean":"2023-11-24T06:14:50.708546+0000","last_became_active":"2023-11-24T06:14:49.697563+0000","last_became_peered":"2023-11-24T06:14:49.697563+0000","last_unstale":"2023-11-24T06:14:50.708546+0000","last_undegraded":"2023-11-24T06:14:50.708546+0000","last_fullsized":"2023-11-24T06:14:50.708546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100036+0000","last_change":"2023-11-24T06:14:50.679328+0000","last_active":"2023-11-24T06:14:52.100036+0000","last_peered":"2023-11-24T06:14:52.100036+0000","last_clean":"2023-11-24T06:14:52.100036+0000","last_became_active":"2023-11-24T06:14:50.675211+0000","last_became_peered":"2023-11-24T06:14:50.675211+0000","last_unstale":"2023-11-24T06:14:52.100036+0000","last_undegraded":"2023-11-24T06:14:52.100036+0000","last_fullsized":"2023-11-24T06:14:52.100036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708071+0000","last_change":"2023-11-24T06:14:49.695142+0000","last_active":"2023-11-24T06:14:50.708071+0000","last_peered":"2023-11-24T06:14:50.708071+0000","last_clean":"2023-11-24T06:14:50.708071+0000","last_became_active":"2023-11-24T06:14:49.694825+0000","last_became_peered":"2023-11-24T06:14:49.694825+0000","last_unstale":"2023-11-24T06:14:50.708071+0000","last_undegraded":"2023-11-24T06:14:50.708071+0000","last_fullsized":"2023-11-24T06:14:50.708071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.664430+0000","last_change":"2023-11-24T06:14:49.706014+0000","last_active":"2023-11-24T06:14:50.664430+0000","last_peered":"2023-11-24T06:14:50.664430+0000","last_clean":"2023-11-24T06:14:50.664430+0000","last_became_active":"2023-11-24T06:14:49.705727+0000","last_became_peered":"2023-11-24T06:14:49.705727+0000","last_unstale":"2023-11-24T06:14:50.664430+0000","last_undegraded":"2023-11-24T06:14:50.664430+0000","last_fullsized":"2023-11-24T06:14:50.664430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098742+0000","last_change":"2023-11-24T06:14:50.679393+0000","last_active":"2023-11-24T06:14:52.098742+0000","last_peered":"2023-11-24T06:14:52.098742+0000","last_clean":"2023-11-24T06:14:52.098742+0000","last_became_active":"2023-11-24T06:14:50.679078+0000","last_became_peered":"2023-11-24T06:14:50.679078+0000","last_unstale":"2023-11-24T06:14:52.098742+0000","last_undegraded":"2023-11-24T06:14:52.098742+0000","last_fullsized":"2023-11-24T06:14:52.098742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655585+0000","last_change":"2023-11-24T06:14:49.702941+0000","last_active":"2023-11-24T06:14:50.655585+0000","last_peered":"2023-11-24T06:14:50.655585+0000","last_clean":"2023-11-24T06:14:50.655585+0000","last_became_active":"2023-11-24T06:14:49.701670+0000","last_became_peered":"2023-11-24T06:14:49.701670+0000","last_unstale":"2023-11-24T06:14:50.655585+0000","last_undegraded":"2023-11-24T06:14:50.655585+0000","last_fullsized":"2023-11-24T06:14:50.655585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643424+0000","last_change":"2023-11-24T06:14:50.675363+0000","last_active":"2023-11-24T06:14:51.643424+0000","last_peered":"2023-11-24T06:14:51.643424+0000","last_clean":"2023-11-24T06:14:51.643424+0000","last_became_active":"2023-11-24T06:14:50.675034+0000","last_became_peered":"2023-11-24T06:14:50.675034+0000","last_unstale":"2023-11-24T06:14:51.643424+0000","last_undegraded":"2023-11-24T06:14:51.643424+0000","last_fullsized":"2023-11-24T06:14:51.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.657217+0000","last_change":"2023-11-24T06:14:49.703756+0000","last_active":"2023-11-24T06:14:50.657217+0000","last_peered":"2023-11-24T06:14:50.657217+0000","last_clean":"2023-11-24T06:14:50.657217+0000","last_became_active":"2023-11-24T06:14:49.703456+0000","last_became_peered":"2023-11-24T06:14:49.703456+0000","last_unstale":"2023-11-24T06:14:50.657217+0000","last_undegraded":"2023-11-24T06:14:50.657217+0000","last_fullsized":"2023-11-24T06:14:50.657217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650542+0000","last_change":"2023-11-24T06:14:50.680598+0000","last_active":"2023-11-24T06:14:51.650542+0000","last_peered":"2023-11-24T06:14:51.650542+0000","last_clean":"2023-11-24T06:14:51.650542+0000","last_became_active":"2023-11-24T06:14:50.680267+0000","last_became_peered":"2023-11-24T06:14:50.680267+0000","last_unstale":"2023-11-24T06:14:51.650542+0000","last_undegraded":"2023-11-24T06:14:51.650542+0000","last_fullsized":"2023-11-24T06:14:51.650542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.659528+0000","last_change":"2023-11-24T06:14:49.705839+0000","last_active":"2023-11-24T06:14:50.659528+0000","last_peered":"2023-11-24T06:14:50.659528+0000","last_clean":"2023-11-24T06:14:50.659528+0000","last_became_active":"2023-11-24T06:14:49.705477+0000","last_became_peered":"2023-11-24T06:14:49.705477+0000","last_unstale":"2023-11-24T06:14:50.659528+0000","last_undegraded":"2023-11-24T06:14:50.659528+0000","last_fullsized":"2023-11-24T06:14:50.659528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:31.756581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100424+0000","last_change":"2023-11-24T06:14:50.673579+0000","last_active":"2023-11-24T06:14:52.100424+0000","last_peered":"2023-11-24T06:14:52.100424+0000","last_clean":"2023-11-24T06:14:52.100424+0000","last_became_active":"2023-11-24T06:14:50.673282+0000","last_became_peered":"2023-11-24T06:14:50.673282+0000","last_unstale":"2023-11-24T06:14:52.100424+0000","last_undegraded":"2023-11-24T06:14:52.100424+0000","last_fullsized":"2023-11-24T06:14:52.100424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712613+0000","last_change":"2023-11-24T06:14:49.701007+0000","last_active":"2023-11-24T06:14:50.712613+0000","last_peered":"2023-11-24T06:14:50.712613+0000","last_clean":"2023-11-24T06:14:50.712613+0000","last_became_active":"2023-11-24T06:14:49.700724+0000","last_became_peered":"2023-11-24T06:14:49.700724+0000","last_unstale":"2023-11-24T06:14:50.712613+0000","last_undegraded":"2023-11-24T06:14:50.712613+0000","last_fullsized":"2023-11-24T06:14:50.712613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649436+0000","last_change":"2023-11-24T06:14:50.673608+0000","last_active":"2023-11-24T06:14:51.649436+0000","last_peered":"2023-11-24T06:14:51.649436+0000","last_clean":"2023-11-24T06:14:51.649436+0000","last_became_active":"2023-11-24T06:14:50.673301+0000","last_became_peered":"2023-11-24T06:14:50.673301+0000","last_unstale":"2023-11-24T06:14:51.649436+0000","last_undegraded":"2023-11-24T06:14:51.649436+0000","last_fullsized":"2023-11-24T06:14:51.649436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.714522+0000","last_change":"2023-11-24T06:14:49.704014+0000","last_active":"2023-11-24T06:14:50.714522+0000","last_peered":"2023-11-24T06:14:50.714522+0000","last_clean":"2023-11-24T06:14:50.714522+0000","last_became_active":"2023-11-24T06:14:49.703708+0000","last_became_peered":"2023-11-24T06:14:49.703708+0000","last_unstale":"2023-11-24T06:14:50.714522+0000","last_undegraded":"2023-11-24T06:14:50.714522+0000","last_fullsized":"2023-11-24T06:14:50.714522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099830+0000","last_change":"2023-11-24T06:14:50.677436+0000","last_active":"2023-11-24T06:14:52.099830+0000","last_peered":"2023-11-24T06:14:52.099830+0000","last_clean":"2023-11-24T06:14:52.099830+0000","last_became_active":"2023-11-24T06:14:50.676715+0000","last_became_peered":"2023-11-24T06:14:50.676715+0000","last_unstale":"2023-11-24T06:14:52.099830+0000","last_undegraded":"2023-11-24T06:14:52.099830+0000","last_fullsized":"2023-11-24T06:14:52.099830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712757+0000","last_change":"2023-11-24T06:14:49.693145+0000","last_active":"2023-11-24T06:14:50.712757+0000","last_peered":"2023-11-24T06:14:50.712757+0000","last_clean":"2023-11-24T06:14:50.712757+0000","last_became_active":"2023-11-24T06:14:49.692740+0000","last_became_peered":"2023-11-24T06:14:49.692740+0000","last_unstale":"2023-11-24T06:14:50.712757+0000","last_undegraded":"2023-11-24T06:14:50.712757+0000","last_fullsized":"2023-11-24T06:14:50.712757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100100+0000","last_change":"2023-11-24T06:14:50.679348+0000","last_active":"2023-11-24T06:14:52.100100+0000","last_peered":"2023-11-24T06:14:52.100100+0000","last_clean":"2023-11-24T06:14:52.100100+0000","last_became_active":"2023-11-24T06:14:50.679013+0000","last_became_peered":"2023-11-24T06:14:50.679013+0000","last_unstale":"2023-11-24T06:14:52.100100+0000","last_undegraded":"2023-11-24T06:14:52.100100+0000","last_fullsized":"2023-11-24T06:14:52.100100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650013+0000","last_change":"2023-11-24T06:14:49.694677+0000","last_active":"2023-11-24T06:14:50.650013+0000","last_peered":"2023-11-24T06:14:50.650013+0000","last_clean":"2023-11-24T06:14:50.650013+0000","last_became_active":"2023-11-24T06:14:49.694383+0000","last_became_peered":"2023-11-24T06:14:49.694383+0000","last_unstale":"2023-11-24T06:14:50.650013+0000","last_undegraded":"2023-11-24T06:14:50.650013+0000","last_fullsized":"2023-11-24T06:14:50.650013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099792+0000","last_change":"2023-11-24T06:14:50.677961+0000","last_active":"2023-11-24T06:14:52.099792+0000","last_peered":"2023-11-24T06:14:52.099792+0000","last_clean":"2023-11-24T06:14:52.099792+0000","last_became_active":"2023-11-24T06:14:50.675864+0000","last_became_peered":"2023-11-24T06:14:50.675864+0000","last_unstale":"2023-11-24T06:14:52.099792+0000","last_undegraded":"2023-11-24T06:14:52.099792+0000","last_fullsized":"2023-11-24T06:14:52.099792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.654827+0000","last_change":"2023-11-24T06:14:49.698393+0000","last_active":"2023-11-24T06:14:50.654827+0000","last_peered":"2023-11-24T06:14:50.654827+0000","last_clean":"2023-11-24T06:14:50.654827+0000","last_became_active":"2023-11-24T06:14:49.698130+0000","last_became_peered":"2023-11-24T06:14:49.698130+0000","last_unstale":"2023-11-24T06:14:50.654827+0000","last_undegraded":"2023-11-24T06:14:50.654827+0000","last_fullsized":"2023-11-24T06:14:50.654827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087151+0000","last_change":"2023-11-24T06:14:50.674381+0000","last_active":"2023-11-24T06:14:52.087151+0000","last_peered":"2023-11-24T06:14:52.087151+0000","last_clean":"2023-11-24T06:14:52.087151+0000","last_became_active":"2023-11-24T06:14:50.673643+0000","last_became_peered":"2023-11-24T06:14:50.673643+0000","last_unstale":"2023-11-24T06:14:52.087151+0000","last_undegraded":"2023-11-24T06:14:52.087151+0000","last_fullsized":"2023-11-24T06:14:52.087151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.713585+0000","last_change":"2023-11-24T06:14:49.685131+0000","last_active":"2023-11-24T06:14:50.713585+0000","last_peered":"2023-11-24T06:14:50.713585+0000","last_clean":"2023-11-24T06:14:50.713585+0000","last_became_active":"2023-11-24T06:14:49.684509+0000","last_became_peered":"2023-11-24T06:14:49.684509+0000","last_unstale":"2023-11-24T06:14:50.713585+0000","last_undegraded":"2023-11-24T06:14:50.713585+0000","last_fullsized":"2023-11-24T06:14:50.713585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099960+0000","last_change":"2023-11-24T06:14:50.679197+0000","last_active":"2023-11-24T06:14:52.099960+0000","last_peered":"2023-11-24T06:14:52.099960+0000","last_clean":"2023-11-24T06:14:52.099960+0000","last_became_active":"2023-11-24T06:14:50.676823+0000","last_became_peered":"2023-11-24T06:14:50.676823+0000","last_unstale":"2023-11-24T06:14:52.099960+0000","last_undegraded":"2023-11-24T06:14:52.099960+0000","last_fullsized":"2023-11-24T06:14:52.099960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710348+0000","last_change":"2023-11-24T06:14:49.698361+0000","last_active":"2023-11-24T06:14:50.710348+0000","last_peered":"2023-11-24T06:14:50.710348+0000","last_clean":"2023-11-24T06:14:50.710348+0000","last_became_active":"2023-11-24T06:14:49.698063+0000","last_became_peered":"2023-11-24T06:14:49.698063+0000","last_unstale":"2023-11-24T06:14:50.710348+0000","last_undegraded":"2023-11-24T06:14:50.710348+0000","last_fullsized":"2023-11-24T06:14:50.710348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100144+0000","last_change":"2023-11-24T06:14:50.678280+0000","last_active":"2023-11-24T06:14:52.100144+0000","last_peered":"2023-11-24T06:14:52.100144+0000","last_clean":"2023-11-24T06:14:52.100144+0000","last_became_active":"2023-11-24T06:14:50.677222+0000","last_became_peered":"2023-11-24T06:14:50.677222+0000","last_unstale":"2023-11-24T06:14:52.100144+0000","last_undegraded":"2023-11-24T06:14:52.100144+0000","last_fullsized":"2023-11-24T06:14:52.100144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709589+0000","last_change":"2023-11-24T06:14:49.686043+0000","last_active":"2023-11-24T06:14:50.709589+0000","last_peered":"2023-11-24T06:14:50.709589+0000","last_clean":"2023-11-24T06:14:50.709589+0000","last_became_active":"2023-11-24T06:14:49.685728+0000","last_became_peered":"2023-11-24T06:14:49.685728+0000","last_unstale":"2023-11-24T06:14:50.709589+0000","last_undegraded":"2023-11-24T06:14:50.709589+0000","last_fullsized":"2023-11-24T06:14:50.709589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100809+0000","last_change":"2023-11-24T06:14:50.685979+0000","last_active":"2023-11-24T06:14:52.100809+0000","last_peered":"2023-11-24T06:14:52.100809+0000","last_clean":"2023-11-24T06:14:52.100809+0000","last_became_active":"2023-11-24T06:14:50.685166+0000","last_became_peered":"2023-11-24T06:14:50.685166+0000","last_unstale":"2023-11-24T06:14:52.100809+0000","last_undegraded":"2023-11-24T06:14:52.100809+0000","last_fullsized":"2023-11-24T06:14:52.100809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:41.237889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712701+0000","last_change":"2023-11-24T06:14:49.689763+0000","last_active":"2023-11-24T06:14:50.712701+0000","last_peered":"2023-11-24T06:14:50.712701+0000","last_clean":"2023-11-24T06:14:50.712701+0000","last_became_active":"2023-11-24T06:14:49.689550+0000","last_became_peered":"2023-11-24T06:14:49.689550+0000","last_unstale":"2023-11-24T06:14:50.712701+0000","last_undegraded":"2023-11-24T06:14:50.712701+0000","last_fullsized":"2023-11-24T06:14:50.712701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649468+0000","last_change":"2023-11-24T06:14:50.674890+0000","last_active":"2023-11-24T06:14:51.649468+0000","last_peered":"2023-11-24T06:14:51.649468+0000","last_clean":"2023-11-24T06:14:51.649468+0000","last_became_active":"2023-11-24T06:14:50.674553+0000","last_became_peered":"2023-11-24T06:14:50.674553+0000","last_unstale":"2023-11-24T06:14:51.649468+0000","last_undegraded":"2023-11-24T06:14:51.649468+0000","last_fullsized":"2023-11-24T06:14:51.649468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655833+0000","last_change":"2023-11-24T06:14:49.694356+0000","last_active":"2023-11-24T06:14:50.655833+0000","last_peered":"2023-11-24T06:14:50.655833+0000","last_clean":"2023-11-24T06:14:50.655833+0000","last_became_active":"2023-11-24T06:14:49.694071+0000","last_became_peered":"2023-11-24T06:14:49.694071+0000","last_unstale":"2023-11-24T06:14:50.655833+0000","last_undegraded":"2023-11-24T06:14:50.655833+0000","last_fullsized":"2023-11-24T06:14:50.655833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100208+0000","last_change":"2023-11-24T06:14:50.678368+0000","last_active":"2023-11-24T06:14:52.100208+0000","last_peered":"2023-11-24T06:14:52.100208+0000","last_clean":"2023-11-24T06:14:52.100208+0000","last_became_active":"2023-11-24T06:14:50.678080+0000","last_became_peered":"2023-11-24T06:14:50.678080+0000","last_unstale":"2023-11-24T06:14:52.100208+0000","last_undegraded":"2023-11-24T06:14:52.100208+0000","last_fullsized":"2023-11-24T06:14:52.100208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.662084+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:14:50.662084+0000","last_peered":"2023-11-24T06:14:50.662084+0000","last_clean":"2023-11-24T06:14:50.662084+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:14:50.662084+0000","last_undegraded":"2023-11-24T06:14:50.662084+0000","last_fullsized":"2023-11-24T06:14:50.662084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655544+0000","last_change":"2023-11-24T06:14:49.696906+0000","last_active":"2023-11-24T06:14:50.655544+0000","last_peered":"2023-11-24T06:14:50.655544+0000","last_clean":"2023-11-24T06:14:50.655544+0000","last_became_active":"2023-11-24T06:14:49.696642+0000","last_became_peered":"2023-11-24T06:14:49.696642+0000","last_unstale":"2023-11-24T06:14:50.655544+0000","last_undegraded":"2023-11-24T06:14:50.655544+0000","last_fullsized":"2023-11-24T06:14:50.655544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:22.648754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098494+0000","last_change":"2023-11-24T06:14:50.668661+0000","last_active":"2023-11-24T06:14:52.098494+0000","last_peered":"2023-11-24T06:14:52.098494+0000","last_clean":"2023-11-24T06:14:52.098494+0000","last_became_active":"2023-11-24T06:14:50.668333+0000","last_became_peered":"2023-11-24T06:14:50.668333+0000","last_unstale":"2023-11-24T06:14:52.098494+0000","last_undegraded":"2023-11-24T06:14:52.098494+0000","last_fullsized":"2023-11-24T06:14:52.098494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661983+0000","last_change":"2023-11-24T06:14:49.710092+0000","last_active":"2023-11-24T06:14:50.661983+0000","last_peered":"2023-11-24T06:14:50.661983+0000","last_clean":"2023-11-24T06:14:50.661983+0000","last_became_active":"2023-11-24T06:14:49.709784+0000","last_became_peered":"2023-11-24T06:14:49.709784+0000","last_unstale":"2023-11-24T06:14:50.661983+0000","last_undegraded":"2023-11-24T06:14:50.661983+0000","last_fullsized":"2023-11-24T06:14:50.661983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099297+0000","last_change":"2023-11-24T06:14:50.676764+0000","last_active":"2023-11-24T06:14:52.099297+0000","last_peered":"2023-11-24T06:14:52.099297+0000","last_clean":"2023-11-24T06:14:52.099297+0000","last_became_active":"2023-11-24T06:14:50.676031+0000","last_became_peered":"2023-11-24T06:14:50.676031+0000","last_unstale":"2023-11-24T06:14:52.099297+0000","last_undegraded":"2023-11-24T06:14:52.099297+0000","last_fullsized":"2023-11-24T06:14:52.099297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:59.786496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655216+0000","last_change":"2023-11-24T06:14:49.687348+0000","last_active":"2023-11-24T06:14:50.655216+0000","last_peered":"2023-11-24T06:14:50.655216+0000","last_clean":"2023-11-24T06:14:50.655216+0000","last_became_active":"2023-11-24T06:14:49.685807+0000","last_became_peered":"2023-11-24T06:14:49.685807+0000","last_unstale":"2023-11-24T06:14:50.655216+0000","last_undegraded":"2023-11-24T06:14:50.655216+0000","last_fullsized":"2023-11-24T06:14:50.655216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643489+0000","last_change":"2023-11-24T06:14:50.662346+0000","last_active":"2023-11-24T06:14:51.643489+0000","last_peered":"2023-11-24T06:14:51.643489+0000","last_clean":"2023-11-24T06:14:51.643489+0000","last_became_active":"2023-11-24T06:14:50.661969+0000","last_became_peered":"2023-11-24T06:14:50.661969+0000","last_unstale":"2023-11-24T06:14:51.643489+0000","last_undegraded":"2023-11-24T06:14:51.643489+0000","last_fullsized":"2023-11-24T06:14:51.643489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650302+0000","last_change":"2023-11-24T06:14:49.693881+0000","last_active":"2023-11-24T06:14:50.650302+0000","last_peered":"2023-11-24T06:14:50.650302+0000","last_clean":"2023-11-24T06:14:50.650302+0000","last_became_active":"2023-11-24T06:14:49.692876+0000","last_became_peered":"2023-11-24T06:14:49.692876+0000","last_unstale":"2023-11-24T06:14:50.650302+0000","last_undegraded":"2023-11-24T06:14:50.650302+0000","last_fullsized":"2023-11-24T06:14:50.650302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649095+0000","last_change":"2023-11-24T06:14:50.685296+0000","last_active":"2023-11-24T06:14:51.649095+0000","last_peered":"2023-11-24T06:14:51.649095+0000","last_clean":"2023-11-24T06:14:51.649095+0000","last_became_active":"2023-11-24T06:14:50.681627+0000","last_became_peered":"2023-11-24T06:14:50.681627+0000","last_unstale":"2023-11-24T06:14:51.649095+0000","last_undegraded":"2023-11-24T06:14:51.649095+0000","last_fullsized":"2023-11-24T06:14:51.649095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:02.302315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645831+0000","last_change":"2023-11-24T06:14:49.694973+0000","last_active":"2023-11-24T06:14:50.645831+0000","last_peered":"2023-11-24T06:14:50.645831+0000","last_clean":"2023-11-24T06:14:50.645831+0000","last_became_active":"2023-11-24T06:14:49.694351+0000","last_became_peered":"2023-11-24T06:14:49.694351+0000","last_unstale":"2023-11-24T06:14:50.645831+0000","last_undegraded":"2023-11-24T06:14:50.645831+0000","last_fullsized":"2023-11-24T06:14:50.645831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650479+0000","last_change":"2023-11-24T06:14:50.674491+0000","last_active":"2023-11-24T06:14:51.650479+0000","last_peered":"2023-11-24T06:14:51.650479+0000","last_clean":"2023-11-24T06:14:51.650479+0000","last_became_active":"2023-11-24T06:14:50.674140+0000","last_became_peered":"2023-11-24T06:14:50.674140+0000","last_unstale":"2023-11-24T06:14:51.650479+0000","last_undegraded":"2023-11-24T06:14:51.650479+0000","last_fullsized":"2023-11-24T06:14:51.650479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.665634+0000","last_change":"2023-11-24T06:14:49.710812+0000","last_active":"2023-11-24T06:14:50.665634+0000","last_peered":"2023-11-24T06:14:50.665634+0000","last_clean":"2023-11-24T06:14:50.665634+0000","last_became_active":"2023-11-24T06:14:49.710500+0000","last_became_peered":"2023-11-24T06:14:49.710500+0000","last_unstale":"2023-11-24T06:14:50.665634+0000","last_undegraded":"2023-11-24T06:14:50.665634+0000","last_fullsized":"2023-11-24T06:14:50.665634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:48.196535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643655+0000","last_change":"2023-11-24T06:14:50.669928+0000","last_active":"2023-11-24T06:14:51.643655+0000","last_peered":"2023-11-24T06:14:51.643655+0000","last_clean":"2023-11-24T06:14:51.643655+0000","last_became_active":"2023-11-24T06:14:50.666246+0000","last_became_peered":"2023-11-24T06:14:50.666246+0000","last_unstale":"2023-11-24T06:14:51.643655+0000","last_undegraded":"2023-11-24T06:14:51.643655+0000","last_fullsized":"2023-11-24T06:14:51.643655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.646019+0000","last_change":"2023-11-24T06:14:49.703013+0000","last_active":"2023-11-24T06:14:50.646019+0000","last_peered":"2023-11-24T06:14:50.646019+0000","last_clean":"2023-11-24T06:14:50.646019+0000","last_became_active":"2023-11-24T06:14:49.702599+0000","last_became_peered":"2023-11-24T06:14:49.702599+0000","last_unstale":"2023-11-24T06:14:50.646019+0000","last_undegraded":"2023-11-24T06:14:50.646019+0000","last_fullsized":"2023-11-24T06:14:50.646019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099635+0000","last_change":"2023-11-24T06:14:50.677366+0000","last_active":"2023-11-24T06:14:52.099635+0000","last_peered":"2023-11-24T06:14:52.099635+0000","last_clean":"2023-11-24T06:14:52.099635+0000","last_became_active":"2023-11-24T06:14:50.677021+0000","last_became_peered":"2023-11-24T06:14:50.677021+0000","last_unstale":"2023-11-24T06:14:52.099635+0000","last_undegraded":"2023-11-24T06:14:52.099635+0000","last_fullsized":"2023-11-24T06:14:52.099635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708120+0000","last_change":"2023-11-24T06:14:49.705904+0000","last_active":"2023-11-24T06:14:50.708120+0000","last_peered":"2023-11-24T06:14:50.708120+0000","last_clean":"2023-11-24T06:14:50.708120+0000","last_became_active":"2023-11-24T06:14:49.705615+0000","last_became_peered":"2023-11-24T06:14:49.705615+0000","last_unstale":"2023-11-24T06:14:50.708120+0000","last_undegraded":"2023-11-24T06:14:50.708120+0000","last_fullsized":"2023-11-24T06:14:50.708120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100419+0000","last_change":"2023-11-24T06:14:50.670885+0000","last_active":"2023-11-24T06:14:52.100419+0000","last_peered":"2023-11-24T06:14:52.100419+0000","last_clean":"2023-11-24T06:14:52.100419+0000","last_became_active":"2023-11-24T06:14:50.670481+0000","last_became_peered":"2023-11-24T06:14:50.670481+0000","last_unstale":"2023-11-24T06:14:52.100419+0000","last_undegraded":"2023-11-24T06:14:52.100419+0000","last_fullsized":"2023-11-24T06:14:52.100419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661454+0000","last_change":"2023-11-24T06:14:49.710392+0000","last_active":"2023-11-24T06:14:50.661454+0000","last_peered":"2023-11-24T06:14:50.661454+0000","last_clean":"2023-11-24T06:14:50.661454+0000","last_became_active":"2023-11-24T06:14:49.710102+0000","last_became_peered":"2023-11-24T06:14:49.710102+0000","last_unstale":"2023-11-24T06:14:50.661454+0000","last_undegraded":"2023-11-24T06:14:50.661454+0000","last_fullsized":"2023-11-24T06:14:50.661454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648534+0000","last_change":"2023-11-24T06:14:50.667556+0000","last_active":"2023-11-24T06:14:51.648534+0000","last_peered":"2023-11-24T06:14:51.648534+0000","last_clean":"2023-11-24T06:14:51.648534+0000","last_became_active":"2023-11-24T06:14:50.667254+0000","last_became_peered":"2023-11-24T06:14:50.667254+0000","last_unstale":"2023-11-24T06:14:51.648534+0000","last_undegraded":"2023-11-24T06:14:51.648534+0000","last_fullsized":"2023-11-24T06:14:51.648534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:41.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645782+0000","last_change":"2023-11-24T06:14:49.700284+0000","last_active":"2023-11-24T06:14:50.645782+0000","last_peered":"2023-11-24T06:14:50.645782+0000","last_clean":"2023-11-24T06:14:50.645782+0000","last_became_active":"2023-11-24T06:14:49.699898+0000","last_became_peered":"2023-11-24T06:14:49.699898+0000","last_unstale":"2023-11-24T06:14:50.645782+0000","last_undegraded":"2023-11-24T06:14:50.645782+0000","last_fullsized":"2023-11-24T06:14:50.645782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098745+0000","last_change":"2023-11-24T06:14:50.671052+0000","last_active":"2023-11-24T06:14:52.098745+0000","last_peered":"2023-11-24T06:14:52.098745+0000","last_clean":"2023-11-24T06:14:52.098745+0000","last_became_active":"2023-11-24T06:14:50.670386+0000","last_became_peered":"2023-11-24T06:14:50.670386+0000","last_unstale":"2023-11-24T06:14:52.098745+0000","last_undegraded":"2023-11-24T06:14:52.098745+0000","last_fullsized":"2023-11-24T06:14:52.098745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.643772+0000","last_change":"2023-11-24T06:14:49.684530+0000","last_active":"2023-11-24T06:14:50.643772+0000","last_peered":"2023-11-24T06:14:50.643772+0000","last_clean":"2023-11-24T06:14:50.643772+0000","last_became_active":"2023-11-24T06:14:49.684174+0000","last_became_peered":"2023-11-24T06:14:49.684174+0000","last_unstale":"2023-11-24T06:14:50.643772+0000","last_undegraded":"2023-11-24T06:14:50.643772+0000","last_fullsized":"2023-11-24T06:14:50.643772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098771+0000","last_change":"2023-11-24T06:14:50.685541+0000","last_active":"2023-11-24T06:14:52.098771+0000","last_peered":"2023-11-24T06:14:52.098771+0000","last_clean":"2023-11-24T06:14:52.098771+0000","last_became_active":"2023-11-24T06:14:50.685197+0000","last_became_peered":"2023-11-24T06:14:50.685197+0000","last_unstale":"2023-11-24T06:14:52.098771+0000","last_undegraded":"2023-11-24T06:14:52.098771+0000","last_fullsized":"2023-11-24T06:14:52.098771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.706856+0000","last_change":"2023-11-24T06:14:49.708039+0000","last_active":"2023-11-24T06:14:50.706856+0000","last_peered":"2023-11-24T06:14:50.706856+0000","last_clean":"2023-11-24T06:14:50.706856+0000","last_became_active":"2023-11-24T06:14:49.707647+0000","last_became_peered":"2023-11-24T06:14:49.707647+0000","last_unstale":"2023-11-24T06:14:50.706856+0000","last_undegraded":"2023-11-24T06:14:50.706856+0000","last_fullsized":"2023-11-24T06:14:50.706856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086649+0000","last_change":"2023-11-24T06:14:50.677402+0000","last_active":"2023-11-24T06:14:52.086649+0000","last_peered":"2023-11-24T06:14:52.086649+0000","last_clean":"2023-11-24T06:14:52.086649+0000","last_became_active":"2023-11-24T06:14:50.677099+0000","last_became_peered":"2023-11-24T06:14:50.677099+0000","last_unstale":"2023-11-24T06:14:52.086649+0000","last_undegraded":"2023-11-24T06:14:52.086649+0000","last_fullsized":"2023-11-24T06:14:52.086649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650383+0000","last_change":"2023-11-24T06:14:50.675498+0000","last_active":"2023-11-24T06:14:51.650383+0000","last_peered":"2023-11-24T06:14:51.650383+0000","last_clean":"2023-11-24T06:14:51.650383+0000","last_became_active":"2023-11-24T06:14:50.675047+0000","last_became_peered":"2023-11-24T06:14:50.675047+0000","last_unstale":"2023-11-24T06:14:51.650383+0000","last_undegraded":"2023-11-24T06:14:51.650383+0000","last_fullsized":"2023-11-24T06:14:51.650383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708991+0000","last_change":"2023-11-24T06:14:49.712534+0000","last_active":"2023-11-24T06:14:50.708991+0000","last_peered":"2023-11-24T06:14:50.708991+0000","last_clean":"2023-11-24T06:14:50.708991+0000","last_became_active":"2023-11-24T06:14:49.712227+0000","last_became_peered":"2023-11-24T06:14:49.712227+0000","last_unstale":"2023-11-24T06:14:50.708991+0000","last_undegraded":"2023-11-24T06:14:50.708991+0000","last_fullsized":"2023-11-24T06:14:50.708991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649128+0000","last_change":"2023-11-24T06:14:50.679678+0000","last_active":"2023-11-24T06:14:51.649128+0000","last_peered":"2023-11-24T06:14:51.649128+0000","last_clean":"2023-11-24T06:14:51.649128+0000","last_became_active":"2023-11-24T06:14:50.679409+0000","last_became_peered":"2023-11-24T06:14:50.679409+0000","last_unstale":"2023-11-24T06:14:51.649128+0000","last_undegraded":"2023-11-24T06:14:51.649128+0000","last_fullsized":"2023-11-24T06:14:51.649128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709115+0000","last_change":"2023-11-24T06:14:49.712744+0000","last_active":"2023-11-24T06:14:50.709115+0000","last_peered":"2023-11-24T06:14:50.709115+0000","last_clean":"2023-11-24T06:14:50.709115+0000","last_became_active":"2023-11-24T06:14:49.712445+0000","last_became_peered":"2023-11-24T06:14:49.712445+0000","last_unstale":"2023-11-24T06:14:50.709115+0000","last_undegraded":"2023-11-24T06:14:50.709115+0000","last_fullsized":"2023-11-24T06:14:50.709115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100288+0000","last_change":"2023-11-24T06:14:50.673586+0000","last_active":"2023-11-24T06:14:52.100288+0000","last_peered":"2023-11-24T06:14:52.100288+0000","last_clean":"2023-11-24T06:14:52.100288+0000","last_became_active":"2023-11-24T06:14:50.672630+0000","last_became_peered":"2023-11-24T06:14:50.672630+0000","last_unstale":"2023-11-24T06:14:52.100288+0000","last_undegraded":"2023-11-24T06:14:52.100288+0000","last_fullsized":"2023-11-24T06:14:52.100288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710407+0000","last_change":"2023-11-24T06:14:49.695261+0000","last_active":"2023-11-24T06:14:50.710407+0000","last_peered":"2023-11-24T06:14:50.710407+0000","last_clean":"2023-11-24T06:14:50.710407+0000","last_became_active":"2023-11-24T06:14:49.692908+0000","last_became_peered":"2023-11-24T06:14:49.692908+0000","last_unstale":"2023-11-24T06:14:50.710407+0000","last_undegraded":"2023-11-24T06:14:50.710407+0000","last_fullsized":"2023-11-24T06:14:50.710407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099034+0000","last_change":"2023-11-24T06:14:50.682523+0000","last_active":"2023-11-24T06:14:52.099034+0000","last_peered":"2023-11-24T06:14:52.099034+0000","last_clean":"2023-11-24T06:14:52.099034+0000","last_became_active":"2023-11-24T06:14:50.682208+0000","last_became_peered":"2023-11-24T06:14:50.682208+0000","last_unstale":"2023-11-24T06:14:52.099034+0000","last_undegraded":"2023-11-24T06:14:52.099034+0000","last_fullsized":"2023-11-24T06:14:52.099034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710033+0000","last_change":"2023-11-24T06:14:49.701899+0000","last_active":"2023-11-24T06:14:50.710033+0000","last_peered":"2023-11-24T06:14:50.710033+0000","last_clean":"2023-11-24T06:14:50.710033+0000","last_became_active":"2023-11-24T06:14:49.701658+0000","last_became_peered":"2023-11-24T06:14:49.701658+0000","last_unstale":"2023-11-24T06:14:50.710033+0000","last_undegraded":"2023-11-24T06:14:50.710033+0000","last_fullsized":"2023-11-24T06:14:50.710033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:07.157268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1070000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:55.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.461+0000 7fef37fff640 1 Processor -- start 2023-11-24T06:14:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.461+0000 7fef37fff640 1 -- start start 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef37fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef38143870 0x7fef38146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef37fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef38161080 0x7fef380b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef37fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fef38146eb0 0x7fef380b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef37fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef38070460 con 0x7fef38143870 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef37fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef38161510 con 0x7fef38146eb0 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef37fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef381617f0 con 0x7fef38161080 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef36ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef38143870 0x7fef38146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef36ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef38143870 0x7fef38146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44430/0 (socket says 172.21.15.37:44430) 2023-11-24T06:14:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.463+0000 7fef36ffd640 1 -- 172.21.15.37:0/1830264826 learned_addr learned my addr 172.21.15.37:0/1830264826 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef2ffff640 1 --2- 172.21.15.37:0/1830264826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef38161080 0x7fef380b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef377fe640 1 --2- 172.21.15.37:0/1830264826 >> v2:172.21.15.188:3300/0 conn(0x7fef38146eb0 0x7fef380b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef36ffd640 1 -- 172.21.15.37:0/1830264826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef38161080 msgr2=0x7fef380b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef36ffd640 1 --2- 172.21.15.37:0/1830264826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef38161080 0x7fef380b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef36ffd640 1 -- 172.21.15.37:0/1830264826 >> v2:172.21.15.188:3300/0 conn(0x7fef38146eb0 msgr2=0x7fef380b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef36ffd640 1 --2- 172.21.15.37:0/1830264826 >> v2:172.21.15.188:3300/0 conn(0x7fef38146eb0 0x7fef380b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef36ffd640 1 -- 172.21.15.37:0/1830264826 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38161ad0 con 0x7fef38143870 2023-11-24T06:14:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef377fe640 1 --2- 172.21.15.37:0/1830264826 >> v2:172.21.15.188:3300/0 conn(0x7fef38146eb0 0x7fef380b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.464+0000 7fef2ffff640 1 --2- 172.21.15.37:0/1830264826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef38161080 0x7fef380b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.465+0000 7fef36ffd640 1 --2- 172.21.15.37:0/1830264826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38146970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef380ad6f0 tx=0x7fef2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4482638986a16f1e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.465+0000 7fef367fc640 1 -- 172.21.15.37:0/1830264826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28031870 con 0x7fef38143870 2023-11-24T06:14:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.465+0000 7fef367fc640 1 -- 172.21.15.37:0/1830264826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef280319d0 con 0x7fef38143870 2023-11-24T06:14:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.465+0000 7fef367fc640 1 -- 172.21.15.37:0/1830264826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28031d60 con 0x7fef38143870 2023-11-24T06:14:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 -- 172.21.15.37:0/1830264826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 msgr2=0x7fef38146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 --2- 172.21.15.37:0/1830264826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38146970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef380ad6f0 tx=0x7fef2802b910 comp rx=0 tx=0).stop 2023-11-24T06:14:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 -- 172.21.15.37:0/1830264826 shutdown_connections 2023-11-24T06:14:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 --2- 172.21.15.37:0/1830264826 >> v2:172.21.15.188:3300/0 conn(0x7fef38146eb0 0x7fef380b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 --2- 172.21.15.37:0/1830264826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef38161080 0x7fef380b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 --2- 172.21.15.37:0/1830264826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38146970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 -- 172.21.15.37:0/1830264826 >> 172.21.15.37:0/1830264826 conn(0x7fef380cb830 msgr2=0x7fef380cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 -- 172.21.15.37:0/1830264826 shutdown_connections 2023-11-24T06:14:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.466+0000 7fef37fff640 1 -- 172.21.15.37:0/1830264826 wait complete. 2023-11-24T06:14:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.468+0000 7fef37fff640 1 Processor -- start 2023-11-24T06:14:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.468+0000 7fef37fff640 1 -- start start 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef37fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef37fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef38146eb0 0x7fef381f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef37fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef3815e910 0x7fef381f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef37fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3815f690 con 0x7fef38143870 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef37fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3815edf0 con 0x7fef38146eb0 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef37fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3815f0d0 con 0x7fef3815e910 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef36ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef36ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44432/0 (socket says 172.21.15.37:44432) 2023-11-24T06:14:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef36ffd640 1 -- 172.21.15.37:0/87522383 learned_addr learned my addr 172.21.15.37:0/87522383 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef36ffd640 1 -- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef3815e910 msgr2=0x7fef381f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef2ffff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef38146eb0 0x7fef381f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef36ffd640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef3815e910 0x7fef381f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.469+0000 7fef36ffd640 1 -- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef38146eb0 msgr2=0x7fef381f2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef36ffd640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef38146eb0 0x7fef381f2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef36ffd640 1 -- 172.21.15.37:0/87522383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280094d0 con 0x7fef38143870 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef2ffff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef38146eb0 0x7fef381f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef36ffd640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38160340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef2802b950 tx=0x7fef280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef2f7fe640 1 -- 172.21.15.37:0/87522383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28031860 con 0x7fef38143870 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef2f7fe640 1 -- 172.21.15.37:0/87522383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef280443f0 con 0x7fef38143870 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef2f7fe640 1 -- 172.21.15.37:0/87522383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef280447a0 con 0x7fef38143870 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3815f3b0 con 0x7fef38143870 2023-11-24T06:14:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.470+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3813ece0 con 0x7fef38143870 2023-11-24T06:14:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.472+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef380b3450 con 0x7fef38143870 2023-11-24T06:14:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.473+0000 7fef2f7fe640 1 -- 172.21.15.37:0/87522383 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef2804d450 con 0x7fef38143870 2023-11-24T06:14:55.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.474+0000 7fef2f7fe640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fef1806ae40 0x7fef1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.474+0000 7fef2f7fe640 1 -- 172.21.15.37:0/87522383 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef2802d040 con 0x7fef38143870 2023-11-24T06:14:55.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.474+0000 7fef2ffff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fef1806ae40 0x7fef1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.475+0000 7fef2ffff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fef1806ae40 0x7fef1806d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef20006fd0 tx=0x7fef20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.478+0000 7fef2f7fe640 1 -- 172.21.15.37:0/87522383 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef380b3450 con 0x7fef38143870 2023-11-24T06:14:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.670+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef38143c50 con 0x7fef1806ae40 2023-11-24T06:14:55.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.691+0000 7fef2f7fe640 1 -- 172.21.15.37:0/87522383 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264486 (secure 0 0 0) 0x7fef2000c040 con 0x7fef1806ae40 2023-11-24T06:14:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:55.699 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:14:55.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fef1806ae40 msgr2=0x7fef1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fef1806ae40 0x7fef1806d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef20006fd0 tx=0x7fef20008040 comp rx=0 tx=0).stop 2023-11-24T06:14:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 msgr2=0x7fef38160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38160340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef2802b950 tx=0x7fef280046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 shutdown_connections 2023-11-24T06:14:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fef1806ae40 0x7fef1806d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef38146eb0 0x7fef381f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef3815e910 0x7fef381f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 --2- 172.21.15.37:0/87522383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef38143870 0x7fef38160340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.698+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 >> 172.21.15.37:0/87522383 conn(0x7fef380cb830 msgr2=0x7fef381442d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.699+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 shutdown_connections 2023-11-24T06:14:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.699+0000 7fef37fff640 1 -- 172.21.15.37:0/87522383 wait complete. 2023-11-24T06:14:55.722 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-24T06:14:54.814315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001635"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100558+0000","last_change":"2023-11-24T06:14:50.682748+0000","last_active":"2023-11-24T06:14:52.100558+0000","last_peered":"2023-11-24T06:14:52.100558+0000","last_clean":"2023-11-24T06:14:52.100558+0000","last_became_active":"2023-11-24T06:14:50.682229+0000","last_became_peered":"2023-11-24T06:14:50.682229+0000","last_unstale":"2023-11-24T06:14:52.100558+0000","last_undegraded":"2023-11-24T06:14:52.100558+0000","last_fullsized":"2023-11-24T06:14:52.100558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:31.904106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643746+0000","last_change":"2023-11-24T06:14:50.672740+0000","last_active":"2023-11-24T06:14:51.643746+0000","last_peered":"2023-11-24T06:14:51.643746+0000","last_clean":"2023-11-24T06:14:51.643746+0000","last_became_active":"2023-11-24T06:14:50.672321+0000","last_became_peered":"2023-11-24T06:14:50.672321+0000","last_unstale":"2023-11-24T06:14:51.643746+0000","last_undegraded":"2023-11-24T06:14:51.643746+0000","last_fullsized":"2023-11-24T06:14:51.643746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100183+0000","last_change":"2023-11-24T06:14:50.682497+0000","last_active":"2023-11-24T06:14:52.100183+0000","last_peered":"2023-11-24T06:14:52.100183+0000","last_clean":"2023-11-24T06:14:52.100183+0000","last_became_active":"2023-11-24T06:14:50.682193+0000","last_became_peered":"2023-11-24T06:14:50.682193+0000","last_unstale":"2023-11-24T06:14:52.100183+0000","last_undegraded":"2023-11-24T06:14:52.100183+0000","last_fullsized":"2023-11-24T06:14:52.100183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648766+0000","last_change":"2023-11-24T06:14:50.674687+0000","last_active":"2023-11-24T06:14:51.648766+0000","last_peered":"2023-11-24T06:14:51.648766+0000","last_clean":"2023-11-24T06:14:51.648766+0000","last_became_active":"2023-11-24T06:14:50.673159+0000","last_became_peered":"2023-11-24T06:14:50.673159+0000","last_unstale":"2023-11-24T06:14:51.648766+0000","last_undegraded":"2023-11-24T06:14:51.648766+0000","last_fullsized":"2023-11-24T06:14:51.648766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100007+0000","last_change":"2023-11-24T06:14:50.672761+0000","last_active":"2023-11-24T06:14:52.100007+0000","last_peered":"2023-11-24T06:14:52.100007+0000","last_clean":"2023-11-24T06:14:52.100007+0000","last_became_active":"2023-11-24T06:14:50.672175+0000","last_became_peered":"2023-11-24T06:14:50.672175+0000","last_unstale":"2023-11-24T06:14:52.100007+0000","last_undegraded":"2023-11-24T06:14:52.100007+0000","last_fullsized":"2023-11-24T06:14:52.100007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647948+0000","last_change":"2023-11-24T06:14:50.676313+0000","last_active":"2023-11-24T06:14:51.647948+0000","last_peered":"2023-11-24T06:14:51.647948+0000","last_clean":"2023-11-24T06:14:51.647948+0000","last_became_active":"2023-11-24T06:14:50.675981+0000","last_became_peered":"2023-11-24T06:14:50.675981+0000","last_unstale":"2023-11-24T06:14:51.647948+0000","last_undegraded":"2023-11-24T06:14:51.647948+0000","last_fullsized":"2023-11-24T06:14:51.647948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099417+0000","last_change":"2023-11-24T06:14:50.678743+0000","last_active":"2023-11-24T06:14:52.099417+0000","last_peered":"2023-11-24T06:14:52.099417+0000","last_clean":"2023-11-24T06:14:52.099417+0000","last_became_active":"2023-11-24T06:14:50.677585+0000","last_became_peered":"2023-11-24T06:14:50.677585+0000","last_unstale":"2023-11-24T06:14:52.099417+0000","last_undegraded":"2023-11-24T06:14:52.099417+0000","last_fullsized":"2023-11-24T06:14:52.099417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098443+0000","last_change":"2023-11-24T06:14:50.671307+0000","last_active":"2023-11-24T06:14:52.098443+0000","last_peered":"2023-11-24T06:14:52.098443+0000","last_clean":"2023-11-24T06:14:52.098443+0000","last_became_active":"2023-11-24T06:14:50.670760+0000","last_became_peered":"2023-11-24T06:14:50.670760+0000","last_unstale":"2023-11-24T06:14:52.098443+0000","last_undegraded":"2023-11-24T06:14:52.098443+0000","last_fullsized":"2023-11-24T06:14:52.098443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100556+0000","last_change":"2023-11-24T06:14:50.686106+0000","last_active":"2023-11-24T06:14:52.100556+0000","last_peered":"2023-11-24T06:14:52.100556+0000","last_clean":"2023-11-24T06:14:52.100556+0000","last_became_active":"2023-11-24T06:14:50.685766+0000","last_became_peered":"2023-11-24T06:14:50.685766+0000","last_unstale":"2023-11-24T06:14:52.100556+0000","last_undegraded":"2023-11-24T06:14:52.100556+0000","last_fullsized":"2023-11-24T06:14:52.100556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087249+0000","last_change":"2023-11-24T06:14:50.668109+0000","last_active":"2023-11-24T06:14:52.087249+0000","last_peered":"2023-11-24T06:14:52.087249+0000","last_clean":"2023-11-24T06:14:52.087249+0000","last_became_active":"2023-11-24T06:14:50.667876+0000","last_became_peered":"2023-11-24T06:14:50.667876+0000","last_unstale":"2023-11-24T06:14:52.087249+0000","last_undegraded":"2023-11-24T06:14:52.087249+0000","last_fullsized":"2023-11-24T06:14:52.087249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086961+0000","last_change":"2023-11-24T06:14:50.669500+0000","last_active":"2023-11-24T06:14:52.086961+0000","last_peered":"2023-11-24T06:14:52.086961+0000","last_clean":"2023-11-24T06:14:52.086961+0000","last_became_active":"2023-11-24T06:14:50.667834+0000","last_became_peered":"2023-11-24T06:14:50.667834+0000","last_unstale":"2023-11-24T06:14:52.086961+0000","last_undegraded":"2023-11-24T06:14:52.086961+0000","last_fullsized":"2023-11-24T06:14:52.086961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649114+0000","last_change":"2023-11-24T06:14:50.669357+0000","last_active":"2023-11-24T06:14:51.649114+0000","last_peered":"2023-11-24T06:14:51.649114+0000","last_clean":"2023-11-24T06:14:51.649114+0000","last_became_active":"2023-11-24T06:14:50.669083+0000","last_became_peered":"2023-11-24T06:14:50.669083+0000","last_unstale":"2023-11-24T06:14:51.649114+0000","last_undegraded":"2023-11-24T06:14:51.649114+0000","last_fullsized":"2023-11-24T06:14:51.649114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:27.615626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098696+0000","last_change":"2023-11-24T06:14:50.682270+0000","last_active":"2023-11-24T06:14:52.098696+0000","last_peered":"2023-11-24T06:14:52.098696+0000","last_clean":"2023-11-24T06:14:52.098696+0000","last_became_active":"2023-11-24T06:14:50.681919+0000","last_became_peered":"2023-11-24T06:14:50.681919+0000","last_unstale":"2023-11-24T06:14:52.098696+0000","last_undegraded":"2023-11-24T06:14:52.098696+0000","last_fullsized":"2023-11-24T06:14:52.098696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099796+0000","last_change":"2023-11-24T06:14:50.674645+0000","last_active":"2023-11-24T06:14:52.099796+0000","last_peered":"2023-11-24T06:14:52.099796+0000","last_clean":"2023-11-24T06:14:52.099796+0000","last_became_active":"2023-11-24T06:14:50.673843+0000","last_became_peered":"2023-11-24T06:14:50.673843+0000","last_unstale":"2023-11-24T06:14:52.099796+0000","last_undegraded":"2023-11-24T06:14:52.099796+0000","last_fullsized":"2023-11-24T06:14:52.099796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:43.740152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643448+0000","last_change":"2023-11-24T06:14:50.671555+0000","last_active":"2023-11-24T06:14:51.643448+0000","last_peered":"2023-11-24T06:14:51.643448+0000","last_clean":"2023-11-24T06:14:51.643448+0000","last_became_active":"2023-11-24T06:14:50.671247+0000","last_became_peered":"2023-11-24T06:14:50.671247+0000","last_unstale":"2023-11-24T06:14:51.643448+0000","last_undegraded":"2023-11-24T06:14:51.643448+0000","last_fullsized":"2023-11-24T06:14:51.643448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647469+0000","last_change":"2023-11-24T06:14:50.670462+0000","last_active":"2023-11-24T06:14:51.647469+0000","last_peered":"2023-11-24T06:14:51.647469+0000","last_clean":"2023-11-24T06:14:51.647469+0000","last_became_active":"2023-11-24T06:14:50.670143+0000","last_became_peered":"2023-11-24T06:14:50.670143+0000","last_unstale":"2023-11-24T06:14:51.647469+0000","last_undegraded":"2023-11-24T06:14:51.647469+0000","last_fullsized":"2023-11-24T06:14:51.647469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650874+0000","last_change":"2023-11-24T06:14:50.681286+0000","last_active":"2023-11-24T06:14:51.650874+0000","last_peered":"2023-11-24T06:14:51.650874+0000","last_clean":"2023-11-24T06:14:51.650874+0000","last_became_active":"2023-11-24T06:14:50.680323+0000","last_became_peered":"2023-11-24T06:14:50.680323+0000","last_unstale":"2023-11-24T06:14:51.650874+0000","last_undegraded":"2023-11-24T06:14:51.650874+0000","last_fullsized":"2023-11-24T06:14:51.650874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096934+0000","last_change":"2023-11-24T06:14:50.680143+0000","last_active":"2023-11-24T06:14:52.096934+0000","last_peered":"2023-11-24T06:14:52.096934+0000","last_clean":"2023-11-24T06:14:52.096934+0000","last_became_active":"2023-11-24T06:14:50.679818+0000","last_became_peered":"2023-11-24T06:14:50.679818+0000","last_unstale":"2023-11-24T06:14:52.096934+0000","last_undegraded":"2023-11-24T06:14:52.096934+0000","last_fullsized":"2023-11-24T06:14:52.096934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100469+0000","last_change":"2023-11-24T06:14:50.677609+0000","last_active":"2023-11-24T06:14:52.100469+0000","last_peered":"2023-11-24T06:14:52.100469+0000","last_clean":"2023-11-24T06:14:52.100469+0000","last_became_active":"2023-11-24T06:14:50.677066+0000","last_became_peered":"2023-11-24T06:14:50.677066+0000","last_unstale":"2023-11-24T06:14:52.100469+0000","last_undegraded":"2023-11-24T06:14:52.100469+0000","last_fullsized":"2023-11-24T06:14:52.100469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087142+0000","last_change":"2023-11-24T06:14:50.683104+0000","last_active":"2023-11-24T06:14:52.087142+0000","last_peered":"2023-11-24T06:14:52.087142+0000","last_clean":"2023-11-24T06:14:52.087142+0000","last_became_active":"2023-11-24T06:14:50.682658+0000","last_became_peered":"2023-11-24T06:14:50.682658+0000","last_unstale":"2023-11-24T06:14:52.087142+0000","last_undegraded":"2023-11-24T06:14:52.087142+0000","last_fullsized":"2023-11-24T06:14:52.087142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099758+0000","last_change":"2023-11-24T06:14:50.679645+0000","last_active":"2023-11-24T06:14:52.099758+0000","last_peered":"2023-11-24T06:14:52.099758+0000","last_clean":"2023-11-24T06:14:52.099758+0000","last_became_active":"2023-11-24T06:14:50.675742+0000","last_became_peered":"2023-11-24T06:14:50.675742+0000","last_unstale":"2023-11-24T06:14:52.099758+0000","last_undegraded":"2023-11-24T06:14:52.099758+0000","last_fullsized":"2023-11-24T06:14:52.099758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:09.290044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649295+0000","last_change":"2023-11-24T06:14:50.681368+0000","last_active":"2023-11-24T06:14:51.649295+0000","last_peered":"2023-11-24T06:14:51.649295+0000","last_clean":"2023-11-24T06:14:51.649295+0000","last_became_active":"2023-11-24T06:14:50.680084+0000","last_became_peered":"2023-11-24T06:14:50.680084+0000","last_unstale":"2023-11-24T06:14:51.649295+0000","last_undegraded":"2023-11-24T06:14:51.649295+0000","last_fullsized":"2023-11-24T06:14:51.649295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098619+0000","last_change":"2023-11-24T06:14:50.673670+0000","last_active":"2023-11-24T06:14:52.098619+0000","last_peered":"2023-11-24T06:14:52.098619+0000","last_clean":"2023-11-24T06:14:52.098619+0000","last_became_active":"2023-11-24T06:14:50.673403+0000","last_became_peered":"2023-11-24T06:14:50.673403+0000","last_unstale":"2023-11-24T06:14:52.098619+0000","last_undegraded":"2023-11-24T06:14:52.098619+0000","last_fullsized":"2023-11-24T06:14:52.098619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648773+0000","last_change":"2023-11-24T06:14:50.674073+0000","last_active":"2023-11-24T06:14:51.648773+0000","last_peered":"2023-11-24T06:14:51.648773+0000","last_clean":"2023-11-24T06:14:51.648773+0000","last_became_active":"2023-11-24T06:14:50.673664+0000","last_became_peered":"2023-11-24T06:14:50.673664+0000","last_unstale":"2023-11-24T06:14:51.648773+0000","last_undegraded":"2023-11-24T06:14:51.648773+0000","last_fullsized":"2023-11-24T06:14:51.648773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099308+0000","last_change":"2023-11-24T06:14:50.678205+0000","last_active":"2023-11-24T06:14:52.099308+0000","last_peered":"2023-11-24T06:14:52.099308+0000","last_clean":"2023-11-24T06:14:52.099308+0000","last_became_active":"2023-11-24T06:14:50.677191+0000","last_became_peered":"2023-11-24T06:14:50.677191+0000","last_unstale":"2023-11-24T06:14:52.099308+0000","last_undegraded":"2023-11-24T06:14:52.099308+0000","last_fullsized":"2023-11-24T06:14:52.099308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087355+0000","last_change":"2023-11-24T06:14:50.676733+0000","last_active":"2023-11-24T06:14:52.087355+0000","last_peered":"2023-11-24T06:14:52.087355+0000","last_clean":"2023-11-24T06:14:52.087355+0000","last_became_active":"2023-11-24T06:14:50.676449+0000","last_became_peered":"2023-11-24T06:14:50.676449+0000","last_unstale":"2023-11-24T06:14:52.087355+0000","last_undegraded":"2023-11-24T06:14:52.087355+0000","last_fullsized":"2023-11-24T06:14:52.087355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643784+0000","last_change":"2023-11-24T06:14:50.673695+0000","last_active":"2023-11-24T06:14:51.643784+0000","last_peered":"2023-11-24T06:14:51.643784+0000","last_clean":"2023-11-24T06:14:51.643784+0000","last_became_active":"2023-11-24T06:14:50.673352+0000","last_became_peered":"2023-11-24T06:14:50.673352+0000","last_unstale":"2023-11-24T06:14:51.643784+0000","last_undegraded":"2023-11-24T06:14:51.643784+0000","last_fullsized":"2023-11-24T06:14:51.643784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099455+0000","last_change":"2023-11-24T06:14:50.676349+0000","last_active":"2023-11-24T06:14:52.099455+0000","last_peered":"2023-11-24T06:14:52.099455+0000","last_clean":"2023-11-24T06:14:52.099455+0000","last_became_active":"2023-11-24T06:14:50.676071+0000","last_became_peered":"2023-11-24T06:14:50.676071+0000","last_unstale":"2023-11-24T06:14:52.099455+0000","last_undegraded":"2023-11-24T06:14:52.099455+0000","last_fullsized":"2023-11-24T06:14:52.099455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099881+0000","last_change":"2023-11-24T06:14:50.680531+0000","last_active":"2023-11-24T06:14:52.099881+0000","last_peered":"2023-11-24T06:14:52.099881+0000","last_clean":"2023-11-24T06:14:52.099881+0000","last_became_active":"2023-11-24T06:14:50.680165+0000","last_became_peered":"2023-11-24T06:14:50.680165+0000","last_unstale":"2023-11-24T06:14:52.099881+0000","last_undegraded":"2023-11-24T06:14:52.099881+0000","last_fullsized":"2023-11-24T06:14:52.099881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649625+0000","last_change":"2023-11-24T06:14:50.670339+0000","last_active":"2023-11-24T06:14:51.649625+0000","last_peered":"2023-11-24T06:14:51.649625+0000","last_clean":"2023-11-24T06:14:51.649625+0000","last_became_active":"2023-11-24T06:14:50.670090+0000","last_became_peered":"2023-11-24T06:14:50.670090+0000","last_unstale":"2023-11-24T06:14:51.649625+0000","last_undegraded":"2023-11-24T06:14:51.649625+0000","last_fullsized":"2023-11-24T06:14:51.649625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096750+0000","last_change":"2023-11-24T06:14:50.666860+0000","last_active":"2023-11-24T06:14:52.096750+0000","last_peered":"2023-11-24T06:14:52.096750+0000","last_clean":"2023-11-24T06:14:52.096750+0000","last_became_active":"2023-11-24T06:14:50.666581+0000","last_became_peered":"2023-11-24T06:14:50.666581+0000","last_unstale":"2023-11-24T06:14:52.096750+0000","last_undegraded":"2023-11-24T06:14:52.096750+0000","last_fullsized":"2023-11-24T06:14:52.096750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087368+0000","last_change":"2023-11-24T06:14:50.674598+0000","last_active":"2023-11-24T06:14:52.087368+0000","last_peered":"2023-11-24T06:14:52.087368+0000","last_clean":"2023-11-24T06:14:52.087368+0000","last_became_active":"2023-11-24T06:14:50.674093+0000","last_became_peered":"2023-11-24T06:14:50.674093+0000","last_unstale":"2023-11-24T06:14:52.087368+0000","last_undegraded":"2023-11-24T06:14:52.087368+0000","last_fullsized":"2023-11-24T06:14:52.087368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650044+0000","last_change":"2023-11-24T06:14:50.668892+0000","last_active":"2023-11-24T06:14:51.650044+0000","last_peered":"2023-11-24T06:14:51.650044+0000","last_clean":"2023-11-24T06:14:51.650044+0000","last_became_active":"2023-11-24T06:14:50.668376+0000","last_became_peered":"2023-11-24T06:14:50.668376+0000","last_unstale":"2023-11-24T06:14:51.650044+0000","last_undegraded":"2023-11-24T06:14:51.650044+0000","last_fullsized":"2023-11-24T06:14:51.650044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708546+0000","last_change":"2023-11-24T06:14:49.697821+0000","last_active":"2023-11-24T06:14:50.708546+0000","last_peered":"2023-11-24T06:14:50.708546+0000","last_clean":"2023-11-24T06:14:50.708546+0000","last_became_active":"2023-11-24T06:14:49.697563+0000","last_became_peered":"2023-11-24T06:14:49.697563+0000","last_unstale":"2023-11-24T06:14:50.708546+0000","last_undegraded":"2023-11-24T06:14:50.708546+0000","last_fullsized":"2023-11-24T06:14:50.708546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100036+0000","last_change":"2023-11-24T06:14:50.679328+0000","last_active":"2023-11-24T06:14:52.100036+0000","last_peered":"2023-11-24T06:14:52.100036+0000","last_clean":"2023-11-24T06:14:52.100036+0000","last_became_active":"2023-11-24T06:14:50.675211+0000","last_became_peered":"2023-11-24T06:14:50.675211+0000","last_unstale":"2023-11-24T06:14:52.100036+0000","last_undegraded":"2023-11-24T06:14:52.100036+0000","last_fullsized":"2023-11-24T06:14:52.100036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708071+0000","last_change":"2023-11-24T06:14:49.695142+0000","last_active":"2023-11-24T06:14:50.708071+0000","last_peered":"2023-11-24T06:14:50.708071+0000","last_clean":"2023-11-24T06:14:50.708071+0000","last_became_active":"2023-11-24T06:14:49.694825+0000","last_became_peered":"2023-11-24T06:14:49.694825+0000","last_unstale":"2023-11-24T06:14:50.708071+0000","last_undegraded":"2023-11-24T06:14:50.708071+0000","last_fullsized":"2023-11-24T06:14:50.708071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.664430+0000","last_change":"2023-11-24T06:14:49.706014+0000","last_active":"2023-11-24T06:14:50.664430+0000","last_peered":"2023-11-24T06:14:50.664430+0000","last_clean":"2023-11-24T06:14:50.664430+0000","last_became_active":"2023-11-24T06:14:49.705727+0000","last_became_peered":"2023-11-24T06:14:49.705727+0000","last_unstale":"2023-11-24T06:14:50.664430+0000","last_undegraded":"2023-11-24T06:14:50.664430+0000","last_fullsized":"2023-11-24T06:14:50.664430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098742+0000","last_change":"2023-11-24T06:14:50.679393+0000","last_active":"2023-11-24T06:14:52.098742+0000","last_peered":"2023-11-24T06:14:52.098742+0000","last_clean":"2023-11-24T06:14:52.098742+0000","last_became_active":"2023-11-24T06:14:50.679078+0000","last_became_peered":"2023-11-24T06:14:50.679078+0000","last_unstale":"2023-11-24T06:14:52.098742+0000","last_undegraded":"2023-11-24T06:14:52.098742+0000","last_fullsized":"2023-11-24T06:14:52.098742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655585+0000","last_change":"2023-11-24T06:14:49.702941+0000","last_active":"2023-11-24T06:14:50.655585+0000","last_peered":"2023-11-24T06:14:50.655585+0000","last_clean":"2023-11-24T06:14:50.655585+0000","last_became_active":"2023-11-24T06:14:49.701670+0000","last_became_peered":"2023-11-24T06:14:49.701670+0000","last_unstale":"2023-11-24T06:14:50.655585+0000","last_undegraded":"2023-11-24T06:14:50.655585+0000","last_fullsized":"2023-11-24T06:14:50.655585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643424+0000","last_change":"2023-11-24T06:14:50.675363+0000","last_active":"2023-11-24T06:14:51.643424+0000","last_peered":"2023-11-24T06:14:51.643424+0000","last_clean":"2023-11-24T06:14:51.643424+0000","last_became_active":"2023-11-24T06:14:50.675034+0000","last_became_peered":"2023-11-24T06:14:50.675034+0000","last_unstale":"2023-11-24T06:14:51.643424+0000","last_undegraded":"2023-11-24T06:14:51.643424+0000","last_fullsized":"2023-11-24T06:14:51.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.657217+0000","last_change":"2023-11-24T06:14:49.703756+0000","last_active":"2023-11-24T06:14:50.657217+0000","last_peered":"2023-11-24T06:14:50.657217+0000","last_clean":"2023-11-24T06:14:50.657217+0000","last_became_active":"2023-11-24T06:14:49.703456+0000","last_became_peered":"2023-11-24T06:14:49.703456+0000","last_unstale":"2023-11-24T06:14:50.657217+0000","last_undegraded":"2023-11-24T06:14:50.657217+0000","last_fullsized":"2023-11-24T06:14:50.657217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650542+0000","last_change":"2023-11-24T06:14:50.680598+0000","last_active":"2023-11-24T06:14:51.650542+0000","last_peered":"2023-11-24T06:14:51.650542+0000","last_clean":"2023-11-24T06:14:51.650542+0000","last_became_active":"2023-11-24T06:14:50.680267+0000","last_became_peered":"2023-11-24T06:14:50.680267+0000","last_unstale":"2023-11-24T06:14:51.650542+0000","last_undegraded":"2023-11-24T06:14:51.650542+0000","last_fullsized":"2023-11-24T06:14:51.650542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.659528+0000","last_change":"2023-11-24T06:14:49.705839+0000","last_active":"2023-11-24T06:14:50.659528+0000","last_peered":"2023-11-24T06:14:50.659528+0000","last_clean":"2023-11-24T06:14:50.659528+0000","last_became_active":"2023-11-24T06:14:49.705477+0000","last_became_peered":"2023-11-24T06:14:49.705477+0000","last_unstale":"2023-11-24T06:14:50.659528+0000","last_undegraded":"2023-11-24T06:14:50.659528+0000","last_fullsized":"2023-11-24T06:14:50.659528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:31.756581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100424+0000","last_change":"2023-11-24T06:14:50.673579+0000","last_active":"2023-11-24T06:14:52.100424+0000","last_peered":"2023-11-24T06:14:52.100424+0000","last_clean":"2023-11-24T06:14:52.100424+0000","last_became_active":"2023-11-24T06:14:50.673282+0000","last_became_peered":"2023-11-24T06:14:50.673282+0000","last_unstale":"2023-11-24T06:14:52.100424+0000","last_undegraded":"2023-11-24T06:14:52.100424+0000","last_fullsized":"2023-11-24T06:14:52.100424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712613+0000","last_change":"2023-11-24T06:14:49.701007+0000","last_active":"2023-11-24T06:14:50.712613+0000","last_peered":"2023-11-24T06:14:50.712613+0000","last_clean":"2023-11-24T06:14:50.712613+0000","last_became_active":"2023-11-24T06:14:49.700724+0000","last_became_peered":"2023-11-24T06:14:49.700724+0000","last_unstale":"2023-11-24T06:14:50.712613+0000","last_undegraded":"2023-11-24T06:14:50.712613+0000","last_fullsized":"2023-11-24T06:14:50.712613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649436+0000","last_change":"2023-11-24T06:14:50.673608+0000","last_active":"2023-11-24T06:14:51.649436+0000","last_peered":"2023-11-24T06:14:51.649436+0000","last_clean":"2023-11-24T06:14:51.649436+0000","last_became_active":"2023-11-24T06:14:50.673301+0000","last_became_peered":"2023-11-24T06:14:50.673301+0000","last_unstale":"2023-11-24T06:14:51.649436+0000","last_undegraded":"2023-11-24T06:14:51.649436+0000","last_fullsized":"2023-11-24T06:14:51.649436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.714522+0000","last_change":"2023-11-24T06:14:49.704014+0000","last_active":"2023-11-24T06:14:50.714522+0000","last_peered":"2023-11-24T06:14:50.714522+0000","last_clean":"2023-11-24T06:14:50.714522+0000","last_became_active":"2023-11-24T06:14:49.703708+0000","last_became_peered":"2023-11-24T06:14:49.703708+0000","last_unstale":"2023-11-24T06:14:50.714522+0000","last_undegraded":"2023-11-24T06:14:50.714522+0000","last_fullsized":"2023-11-24T06:14:50.714522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099830+0000","last_change":"2023-11-24T06:14:50.677436+0000","last_active":"2023-11-24T06:14:52.099830+0000","last_peered":"2023-11-24T06:14:52.099830+0000","last_clean":"2023-11-24T06:14:52.099830+0000","last_became_active":"2023-11-24T06:14:50.676715+0000","last_became_peered":"2023-11-24T06:14:50.676715+0000","last_unstale":"2023-11-24T06:14:52.099830+0000","last_undegraded":"2023-11-24T06:14:52.099830+0000","last_fullsized":"2023-11-24T06:14:52.099830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712757+0000","last_change":"2023-11-24T06:14:49.693145+0000","last_active":"2023-11-24T06:14:50.712757+0000","last_peered":"2023-11-24T06:14:50.712757+0000","last_clean":"2023-11-24T06:14:50.712757+0000","last_became_active":"2023-11-24T06:14:49.692740+0000","last_became_peered":"2023-11-24T06:14:49.692740+0000","last_unstale":"2023-11-24T06:14:50.712757+0000","last_undegraded":"2023-11-24T06:14:50.712757+0000","last_fullsized":"2023-11-24T06:14:50.712757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100100+0000","last_change":"2023-11-24T06:14:50.679348+0000","last_active":"2023-11-24T06:14:52.100100+0000","last_peered":"2023-11-24T06:14:52.100100+0000","last_clean":"2023-11-24T06:14:52.100100+0000","last_became_active":"2023-11-24T06:14:50.679013+0000","last_became_peered":"2023-11-24T06:14:50.679013+0000","last_unstale":"2023-11-24T06:14:52.100100+0000","last_undegraded":"2023-11-24T06:14:52.100100+0000","last_fullsized":"2023-11-24T06:14:52.100100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650013+0000","last_change":"2023-11-24T06:14:49.694677+0000","last_active":"2023-11-24T06:14:50.650013+0000","last_peered":"2023-11-24T06:14:50.650013+0000","last_clean":"2023-11-24T06:14:50.650013+0000","last_became_active":"2023-11-24T06:14:49.694383+0000","last_became_peered":"2023-11-24T06:14:49.694383+0000","last_unstale":"2023-11-24T06:14:50.650013+0000","last_undegraded":"2023-11-24T06:14:50.650013+0000","last_fullsized":"2023-11-24T06:14:50.650013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099792+0000","last_change":"2023-11-24T06:14:50.677961+0000","last_active":"2023-11-24T06:14:52.099792+0000","last_peered":"2023-11-24T06:14:52.099792+0000","last_clean":"2023-11-24T06:14:52.099792+0000","last_became_active":"2023-11-24T06:14:50.675864+0000","last_became_peered":"2023-11-24T06:14:50.675864+0000","last_unstale":"2023-11-24T06:14:52.099792+0000","last_undegraded":"2023-11-24T06:14:52.099792+0000","last_fullsized":"2023-11-24T06:14:52.099792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.654827+0000","last_change":"2023-11-24T06:14:49.698393+0000","last_active":"2023-11-24T06:14:50.654827+0000","last_peered":"2023-11-24T06:14:50.654827+0000","last_clean":"2023-11-24T06:14:50.654827+0000","last_became_active":"2023-11-24T06:14:49.698130+0000","last_became_peered":"2023-11-24T06:14:49.698130+0000","last_unstale":"2023-11-24T06:14:50.654827+0000","last_undegraded":"2023-11-24T06:14:50.654827+0000","last_fullsized":"2023-11-24T06:14:50.654827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087151+0000","last_change":"2023-11-24T06:14:50.674381+0000","last_active":"2023-11-24T06:14:52.087151+0000","last_peered":"2023-11-24T06:14:52.087151+0000","last_clean":"2023-11-24T06:14:52.087151+0000","last_became_active":"2023-11-24T06:14:50.673643+0000","last_became_peered":"2023-11-24T06:14:50.673643+0000","last_unstale":"2023-11-24T06:14:52.087151+0000","last_undegraded":"2023-11-24T06:14:52.087151+0000","last_fullsized":"2023-11-24T06:14:52.087151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.713585+0000","last_change":"2023-11-24T06:14:49.685131+0000","last_active":"2023-11-24T06:14:50.713585+0000","last_peered":"2023-11-24T06:14:50.713585+0000","last_clean":"2023-11-24T06:14:50.713585+0000","last_became_active":"2023-11-24T06:14:49.684509+0000","last_became_peered":"2023-11-24T06:14:49.684509+0000","last_unstale":"2023-11-24T06:14:50.713585+0000","last_undegraded":"2023-11-24T06:14:50.713585+0000","last_fullsized":"2023-11-24T06:14:50.713585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099960+0000","last_change":"2023-11-24T06:14:50.679197+0000","last_active":"2023-11-24T06:14:52.099960+0000","last_peered":"2023-11-24T06:14:52.099960+0000","last_clean":"2023-11-24T06:14:52.099960+0000","last_became_active":"2023-11-24T06:14:50.676823+0000","last_became_peered":"2023-11-24T06:14:50.676823+0000","last_unstale":"2023-11-24T06:14:52.099960+0000","last_undegraded":"2023-11-24T06:14:52.099960+0000","last_fullsized":"2023-11-24T06:14:52.099960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710348+0000","last_change":"2023-11-24T06:14:49.698361+0000","last_active":"2023-11-24T06:14:50.710348+0000","last_peered":"2023-11-24T06:14:50.710348+0000","last_clean":"2023-11-24T06:14:50.710348+0000","last_became_active":"2023-11-24T06:14:49.698063+0000","last_became_peered":"2023-11-24T06:14:49.698063+0000","last_unstale":"2023-11-24T06:14:50.710348+0000","last_undegraded":"2023-11-24T06:14:50.710348+0000","last_fullsized":"2023-11-24T06:14:50.710348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100144+0000","last_change":"2023-11-24T06:14:50.678280+0000","last_active":"2023-11-24T06:14:52.100144+0000","last_peered":"2023-11-24T06:14:52.100144+0000","last_clean":"2023-11-24T06:14:52.100144+0000","last_became_active":"2023-11-24T06:14:50.677222+0000","last_became_peered":"2023-11-24T06:14:50.677222+0000","last_unstale":"2023-11-24T06:14:52.100144+0000","last_undegraded":"2023-11-24T06:14:52.100144+0000","last_fullsized":"2023-11-24T06:14:52.100144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709589+0000","last_change":"2023-11-24T06:14:49.686043+0000","last_active":"2023-11-24T06:14:50.709589+0000","last_peered":"2023-11-24T06:14:50.709589+0000","last_clean":"2023-11-24T06:14:50.709589+0000","last_became_active":"2023-11-24T06:14:49.685728+0000","last_became_peered":"2023-11-24T06:14:49.685728+0000","last_unstale":"2023-11-24T06:14:50.709589+0000","last_undegraded":"2023-11-24T06:14:50.709589+0000","last_fullsized":"2023-11-24T06:14:50.709589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100809+0000","last_change":"2023-11-24T06:14:50.685979+0000","last_active":"2023-11-24T06:14:52.100809+0000","last_peered":"2023-11-24T06:14:52.100809+0000","last_clean":"2023-11-24T06:14:52.100809+0000","last_became_active":"2023-11-24T06:14:50.685166+0000","last_became_peered":"2023-11-24T06:14:50.685166+0000","last_unstale":"2023-11-24T06:14:52.100809+0000","last_undegraded":"2023-11-24T06:14:52.100809+0000","last_fullsized":"2023-11-24T06:14:52.100809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:41.237889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712701+0000","last_change":"2023-11-24T06:14:49.689763+0000","last_active":"2023-11-24T06:14:50.712701+0000","last_peered":"2023-11-24T06:14:50.712701+0000","last_clean":"2023-11-24T06:14:50.712701+0000","last_became_active":"2023-11-24T06:14:49.689550+0000","last_became_peered":"2023-11-24T06:14:49.689550+0000","last_unstale":"2023-11-24T06:14:50.712701+0000","last_undegraded":"2023-11-24T06:14:50.712701+0000","last_fullsized":"2023-11-24T06:14:50.712701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649468+0000","last_change":"2023-11-24T06:14:50.674890+0000","last_active":"2023-11-24T06:14:51.649468+0000","last_peered":"2023-11-24T06:14:51.649468+0000","last_clean":"2023-11-24T06:14:51.649468+0000","last_became_active":"2023-11-24T06:14:50.674553+0000","last_became_peered":"2023-11-24T06:14:50.674553+0000","last_unstale":"2023-11-24T06:14:51.649468+0000","last_undegraded":"2023-11-24T06:14:51.649468+0000","last_fullsized":"2023-11-24T06:14:51.649468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655833+0000","last_change":"2023-11-24T06:14:49.694356+0000","last_active":"2023-11-24T06:14:50.655833+0000","last_peered":"2023-11-24T06:14:50.655833+0000","last_clean":"2023-11-24T06:14:50.655833+0000","last_became_active":"2023-11-24T06:14:49.694071+0000","last_became_peered":"2023-11-24T06:14:49.694071+0000","last_unstale":"2023-11-24T06:14:50.655833+0000","last_undegraded":"2023-11-24T06:14:50.655833+0000","last_fullsized":"2023-11-24T06:14:50.655833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100208+0000","last_change":"2023-11-24T06:14:50.678368+0000","last_active":"2023-11-24T06:14:52.100208+0000","last_peered":"2023-11-24T06:14:52.100208+0000","last_clean":"2023-11-24T06:14:52.100208+0000","last_became_active":"2023-11-24T06:14:50.678080+0000","last_became_peered":"2023-11-24T06:14:50.678080+0000","last_unstale":"2023-11-24T06:14:52.100208+0000","last_undegraded":"2023-11-24T06:14:52.100208+0000","last_fullsized":"2023-11-24T06:14:52.100208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.662084+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:14:50.662084+0000","last_peered":"2023-11-24T06:14:50.662084+0000","last_clean":"2023-11-24T06:14:50.662084+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:14:50.662084+0000","last_undegraded":"2023-11-24T06:14:50.662084+0000","last_fullsized":"2023-11-24T06:14:50.662084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655544+0000","last_change":"2023-11-24T06:14:49.696906+0000","last_active":"2023-11-24T06:14:50.655544+0000","last_peered":"2023-11-24T06:14:50.655544+0000","last_clean":"2023-11-24T06:14:50.655544+0000","last_became_active":"2023-11-24T06:14:49.696642+0000","last_became_peered":"2023-11-24T06:14:49.696642+0000","last_unstale":"2023-11-24T06:14:50.655544+0000","last_undegraded":"2023-11-24T06:14:50.655544+0000","last_fullsized":"2023-11-24T06:14:50.655544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:22.648754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098494+0000","last_change":"2023-11-24T06:14:50.668661+0000","last_active":"2023-11-24T06:14:52.098494+0000","last_peered":"2023-11-24T06:14:52.098494+0000","last_clean":"2023-11-24T06:14:52.098494+0000","last_became_active":"2023-11-24T06:14:50.668333+0000","last_became_peered":"2023-11-24T06:14:50.668333+0000","last_unstale":"2023-11-24T06:14:52.098494+0000","last_undegraded":"2023-11-24T06:14:52.098494+0000","last_fullsized":"2023-11-24T06:14:52.098494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661983+0000","last_change":"2023-11-24T06:14:49.710092+0000","last_active":"2023-11-24T06:14:50.661983+0000","last_peered":"2023-11-24T06:14:50.661983+0000","last_clean":"2023-11-24T06:14:50.661983+0000","last_became_active":"2023-11-24T06:14:49.709784+0000","last_became_peered":"2023-11-24T06:14:49.709784+0000","last_unstale":"2023-11-24T06:14:50.661983+0000","last_undegraded":"2023-11-24T06:14:50.661983+0000","last_fullsized":"2023-11-24T06:14:50.661983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099297+0000","last_change":"2023-11-24T06:14:50.676764+0000","last_active":"2023-11-24T06:14:52.099297+0000","last_peered":"2023-11-24T06:14:52.099297+0000","last_clean":"2023-11-24T06:14:52.099297+0000","last_became_active":"2023-11-24T06:14:50.676031+0000","last_became_peered":"2023-11-24T06:14:50.676031+0000","last_unstale":"2023-11-24T06:14:52.099297+0000","last_undegraded":"2023-11-24T06:14:52.099297+0000","last_fullsized":"2023-11-24T06:14:52.099297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:59.786496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655216+0000","last_change":"2023-11-24T06:14:49.687348+0000","last_active":"2023-11-24T06:14:50.655216+0000","last_peered":"2023-11-24T06:14:50.655216+0000","last_clean":"2023-11-24T06:14:50.655216+0000","last_became_active":"2023-11-24T06:14:49.685807+0000","last_became_peered":"2023-11-24T06:14:49.685807+0000","last_unstale":"2023-11-24T06:14:50.655216+0000","last_undegraded":"2023-11-24T06:14:50.655216+0000","last_fullsized":"2023-11-24T06:14:50.655216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643489+0000","last_change":"2023-11-24T06:14:50.662346+0000","last_active":"2023-11-24T06:14:51.643489+0000","last_peered":"2023-11-24T06:14:51.643489+0000","last_clean":"2023-11-24T06:14:51.643489+0000","last_became_active":"2023-11-24T06:14:50.661969+0000","last_became_peered":"2023-11-24T06:14:50.661969+0000","last_unstale":"2023-11-24T06:14:51.643489+0000","last_undegraded":"2023-11-24T06:14:51.643489+0000","last_fullsized":"2023-11-24T06:14:51.643489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650302+0000","last_change":"2023-11-24T06:14:49.693881+0000","last_active":"2023-11-24T06:14:50.650302+0000","last_peered":"2023-11-24T06:14:50.650302+0000","last_clean":"2023-11-24T06:14:50.650302+0000","last_became_active":"2023-11-24T06:14:49.692876+0000","last_became_peered":"2023-11-24T06:14:49.692876+0000","last_unstale":"2023-11-24T06:14:50.650302+0000","last_undegraded":"2023-11-24T06:14:50.650302+0000","last_fullsized":"2023-11-24T06:14:50.650302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649095+0000","last_change":"2023-11-24T06:14:50.685296+0000","last_active":"2023-11-24T06:14:51.649095+0000","last_peered":"2023-11-24T06:14:51.649095+0000","last_clean":"2023-11-24T06:14:51.649095+0000","last_became_active":"2023-11-24T06:14:50.681627+0000","last_became_peered":"2023-11-24T06:14:50.681627+0000","last_unstale":"2023-11-24T06:14:51.649095+0000","last_undegraded":"2023-11-24T06:14:51.649095+0000","last_fullsized":"2023-11-24T06:14:51.649095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:02.302315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645831+0000","last_change":"2023-11-24T06:14:49.694973+0000","last_active":"2023-11-24T06:14:50.645831+0000","last_peered":"2023-11-24T06:14:50.645831+0000","last_clean":"2023-11-24T06:14:50.645831+0000","last_became_active":"2023-11-24T06:14:49.694351+0000","last_became_peered":"2023-11-24T06:14:49.694351+0000","last_unstale":"2023-11-24T06:14:50.645831+0000","last_undegraded":"2023-11-24T06:14:50.645831+0000","last_fullsized":"2023-11-24T06:14:50.645831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650479+0000","last_change":"2023-11-24T06:14:50.674491+0000","last_active":"2023-11-24T06:14:51.650479+0000","last_peered":"2023-11-24T06:14:51.650479+0000","last_clean":"2023-11-24T06:14:51.650479+0000","last_became_active":"2023-11-24T06:14:50.674140+0000","last_became_peered":"2023-11-24T06:14:50.674140+0000","last_unstale":"2023-11-24T06:14:51.650479+0000","last_undegraded":"2023-11-24T06:14:51.650479+0000","last_fullsized":"2023-11-24T06:14:51.650479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.665634+0000","last_change":"2023-11-24T06:14:49.710812+0000","last_active":"2023-11-24T06:14:50.665634+0000","last_peered":"2023-11-24T06:14:50.665634+0000","last_clean":"2023-11-24T06:14:50.665634+0000","last_became_active":"2023-11-24T06:14:49.710500+0000","last_became_peered":"2023-11-24T06:14:49.710500+0000","last_unstale":"2023-11-24T06:14:50.665634+0000","last_undegraded":"2023-11-24T06:14:50.665634+0000","last_fullsized":"2023-11-24T06:14:50.665634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:48.196535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643655+0000","last_change":"2023-11-24T06:14:50.669928+0000","last_active":"2023-11-24T06:14:51.643655+0000","last_peered":"2023-11-24T06:14:51.643655+0000","last_clean":"2023-11-24T06:14:51.643655+0000","last_became_active":"2023-11-24T06:14:50.666246+0000","last_became_peered":"2023-11-24T06:14:50.666246+0000","last_unstale":"2023-11-24T06:14:51.643655+0000","last_undegraded":"2023-11-24T06:14:51.643655+0000","last_fullsized":"2023-11-24T06:14:51.643655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.646019+0000","last_change":"2023-11-24T06:14:49.703013+0000","last_active":"2023-11-24T06:14:50.646019+0000","last_peered":"2023-11-24T06:14:50.646019+0000","last_clean":"2023-11-24T06:14:50.646019+0000","last_became_active":"2023-11-24T06:14:49.702599+0000","last_became_peered":"2023-11-24T06:14:49.702599+0000","last_unstale":"2023-11-24T06:14:50.646019+0000","last_undegraded":"2023-11-24T06:14:50.646019+0000","last_fullsized":"2023-11-24T06:14:50.646019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099635+0000","last_change":"2023-11-24T06:14:50.677366+0000","last_active":"2023-11-24T06:14:52.099635+0000","last_peered":"2023-11-24T06:14:52.099635+0000","last_clean":"2023-11-24T06:14:52.099635+0000","last_became_active":"2023-11-24T06:14:50.677021+0000","last_became_peered":"2023-11-24T06:14:50.677021+0000","last_unstale":"2023-11-24T06:14:52.099635+0000","last_undegraded":"2023-11-24T06:14:52.099635+0000","last_fullsized":"2023-11-24T06:14:52.099635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708120+0000","last_change":"2023-11-24T06:14:49.705904+0000","last_active":"2023-11-24T06:14:50.708120+0000","last_peered":"2023-11-24T06:14:50.708120+0000","last_clean":"2023-11-24T06:14:50.708120+0000","last_became_active":"2023-11-24T06:14:49.705615+0000","last_became_peered":"2023-11-24T06:14:49.705615+0000","last_unstale":"2023-11-24T06:14:50.708120+0000","last_undegraded":"2023-11-24T06:14:50.708120+0000","last_fullsized":"2023-11-24T06:14:50.708120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100419+0000","last_change":"2023-11-24T06:14:50.670885+0000","last_active":"2023-11-24T06:14:52.100419+0000","last_peered":"2023-11-24T06:14:52.100419+0000","last_clean":"2023-11-24T06:14:52.100419+0000","last_became_active":"2023-11-24T06:14:50.670481+0000","last_became_peered":"2023-11-24T06:14:50.670481+0000","last_unstale":"2023-11-24T06:14:52.100419+0000","last_undegraded":"2023-11-24T06:14:52.100419+0000","last_fullsized":"2023-11-24T06:14:52.100419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661454+0000","last_change":"2023-11-24T06:14:49.710392+0000","last_active":"2023-11-24T06:14:50.661454+0000","last_peered":"2023-11-24T06:14:50.661454+0000","last_clean":"2023-11-24T06:14:50.661454+0000","last_became_active":"2023-11-24T06:14:49.710102+0000","last_became_peered":"2023-11-24T06:14:49.710102+0000","last_unstale":"2023-11-24T06:14:50.661454+0000","last_undegraded":"2023-11-24T06:14:50.661454+0000","last_fullsized":"2023-11-24T06:14:50.661454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648534+0000","last_change":"2023-11-24T06:14:50.667556+0000","last_active":"2023-11-24T06:14:51.648534+0000","last_peered":"2023-11-24T06:14:51.648534+0000","last_clean":"2023-11-24T06:14:51.648534+0000","last_became_active":"2023-11-24T06:14:50.667254+0000","last_became_peered":"2023-11-24T06:14:50.667254+0000","last_unstale":"2023-11-24T06:14:51.648534+0000","last_undegraded":"2023-11-24T06:14:51.648534+0000","last_fullsized":"2023-11-24T06:14:51.648534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:41.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645782+0000","last_change":"2023-11-24T06:14:49.700284+0000","last_active":"2023-11-24T06:14:50.645782+0000","last_peered":"2023-11-24T06:14:50.645782+0000","last_clean":"2023-11-24T06:14:50.645782+0000","last_became_active":"2023-11-24T06:14:49.699898+0000","last_became_peered":"2023-11-24T06:14:49.699898+0000","last_unstale":"2023-11-24T06:14:50.645782+0000","last_undegraded":"2023-11-24T06:14:50.645782+0000","last_fullsized":"2023-11-24T06:14:50.645782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098745+0000","last_change":"2023-11-24T06:14:50.671052+0000","last_active":"2023-11-24T06:14:52.098745+0000","last_peered":"2023-11-24T06:14:52.098745+0000","last_clean":"2023-11-24T06:14:52.098745+0000","last_became_active":"2023-11-24T06:14:50.670386+0000","last_became_peered":"2023-11-24T06:14:50.670386+0000","last_unstale":"2023-11-24T06:14:52.098745+0000","last_undegraded":"2023-11-24T06:14:52.098745+0000","last_fullsized":"2023-11-24T06:14:52.098745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.643772+0000","last_change":"2023-11-24T06:14:49.684530+0000","last_active":"2023-11-24T06:14:50.643772+0000","last_peered":"2023-11-24T06:14:50.643772+0000","last_clean":"2023-11-24T06:14:50.643772+0000","last_became_active":"2023-11-24T06:14:49.684174+0000","last_became_peered":"2023-11-24T06:14:49.684174+0000","last_unstale":"2023-11-24T06:14:50.643772+0000","last_undegraded":"2023-11-24T06:14:50.643772+0000","last_fullsized":"2023-11-24T06:14:50.643772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098771+0000","last_change":"2023-11-24T06:14:50.685541+0000","last_active":"2023-11-24T06:14:52.098771+0000","last_peered":"2023-11-24T06:14:52.098771+0000","last_clean":"2023-11-24T06:14:52.098771+0000","last_became_active":"2023-11-24T06:14:50.685197+0000","last_became_peered":"2023-11-24T06:14:50.685197+0000","last_unstale":"2023-11-24T06:14:52.098771+0000","last_undegraded":"2023-11-24T06:14:52.098771+0000","last_fullsized":"2023-11-24T06:14:52.098771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.706856+0000","last_change":"2023-11-24T06:14:49.708039+0000","last_active":"2023-11-24T06:14:50.706856+0000","last_peered":"2023-11-24T06:14:50.706856+0000","last_clean":"2023-11-24T06:14:50.706856+0000","last_became_active":"2023-11-24T06:14:49.707647+0000","last_became_peered":"2023-11-24T06:14:49.707647+0000","last_unstale":"2023-11-24T06:14:50.706856+0000","last_undegraded":"2023-11-24T06:14:50.706856+0000","last_fullsized":"2023-11-24T06:14:50.706856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086649+0000","last_change":"2023-11-24T06:14:50.677402+0000","last_active":"2023-11-24T06:14:52.086649+0000","last_peered":"2023-11-24T06:14:52.086649+0000","last_clean":"2023-11-24T06:14:52.086649+0000","last_became_active":"2023-11-24T06:14:50.677099+0000","last_became_peered":"2023-11-24T06:14:50.677099+0000","last_unstale":"2023-11-24T06:14:52.086649+0000","last_undegraded":"2023-11-24T06:14:52.086649+0000","last_fullsized":"2023-11-24T06:14:52.086649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650383+0000","last_change":"2023-11-24T06:14:50.675498+0000","last_active":"2023-11-24T06:14:51.650383+0000","last_peered":"2023-11-24T06:14:51.650383+0000","last_clean":"2023-11-24T06:14:51.650383+0000","last_became_active":"2023-11-24T06:14:50.675047+0000","last_became_peered":"2023-11-24T06:14:50.675047+0000","last_unstale":"2023-11-24T06:14:51.650383+0000","last_undegraded":"2023-11-24T06:14:51.650383+0000","last_fullsized":"2023-11-24T06:14:51.650383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708991+0000","last_change":"2023-11-24T06:14:49.712534+0000","last_active":"2023-11-24T06:14:50.708991+0000","last_peered":"2023-11-24T06:14:50.708991+0000","last_clean":"2023-11-24T06:14:50.708991+0000","last_became_active":"2023-11-24T06:14:49.712227+0000","last_became_peered":"2023-11-24T06:14:49.712227+0000","last_unstale":"2023-11-24T06:14:50.708991+0000","last_undegraded":"2023-11-24T06:14:50.708991+0000","last_fullsized":"2023-11-24T06:14:50.708991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649128+0000","last_change":"2023-11-24T06:14:50.679678+0000","last_active":"2023-11-24T06:14:51.649128+0000","last_peered":"2023-11-24T06:14:51.649128+0000","last_clean":"2023-11-24T06:14:51.649128+0000","last_became_active":"2023-11-24T06:14:50.679409+0000","last_became_peered":"2023-11-24T06:14:50.679409+0000","last_unstale":"2023-11-24T06:14:51.649128+0000","last_undegraded":"2023-11-24T06:14:51.649128+0000","last_fullsized":"2023-11-24T06:14:51.649128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709115+0000","last_change":"2023-11-24T06:14:49.712744+0000","last_active":"2023-11-24T06:14:50.709115+0000","last_peered":"2023-11-24T06:14:50.709115+0000","last_clean":"2023-11-24T06:14:50.709115+0000","last_became_active":"2023-11-24T06:14:49.712445+0000","last_became_peered":"2023-11-24T06:14:49.712445+0000","last_unstale":"2023-11-24T06:14:50.709115+0000","last_undegraded":"2023-11-24T06:14:50.709115+0000","last_fullsized":"2023-11-24T06:14:50.709115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100288+0000","last_change":"2023-11-24T06:14:50.673586+0000","last_active":"2023-11-24T06:14:52.100288+0000","last_peered":"2023-11-24T06:14:52.100288+0000","last_clean":"2023-11-24T06:14:52.100288+0000","last_became_active":"2023-11-24T06:14:50.672630+0000","last_became_peered":"2023-11-24T06:14:50.672630+0000","last_unstale":"2023-11-24T06:14:52.100288+0000","last_undegraded":"2023-11-24T06:14:52.100288+0000","last_fullsized":"2023-11-24T06:14:52.100288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710407+0000","last_change":"2023-11-24T06:14:49.695261+0000","last_active":"2023-11-24T06:14:50.710407+0000","last_peered":"2023-11-24T06:14:50.710407+0000","last_clean":"2023-11-24T06:14:50.710407+0000","last_became_active":"2023-11-24T06:14:49.692908+0000","last_became_peered":"2023-11-24T06:14:49.692908+0000","last_unstale":"2023-11-24T06:14:50.710407+0000","last_undegraded":"2023-11-24T06:14:50.710407+0000","last_fullsized":"2023-11-24T06:14:50.710407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099034+0000","last_change":"2023-11-24T06:14:50.682523+0000","last_active":"2023-11-24T06:14:52.099034+0000","last_peered":"2023-11-24T06:14:52.099034+0000","last_clean":"2023-11-24T06:14:52.099034+0000","last_became_active":"2023-11-24T06:14:50.682208+0000","last_became_peered":"2023-11-24T06:14:50.682208+0000","last_unstale":"2023-11-24T06:14:52.099034+0000","last_undegraded":"2023-11-24T06:14:52.099034+0000","last_fullsized":"2023-11-24T06:14:52.099034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710033+0000","last_change":"2023-11-24T06:14:49.701899+0000","last_active":"2023-11-24T06:14:50.710033+0000","last_peered":"2023-11-24T06:14:50.710033+0000","last_clean":"2023-11-24T06:14:50.710033+0000","last_became_active":"2023-11-24T06:14:49.701658+0000","last_became_peered":"2023-11-24T06:14:49.701658+0000","last_unstale":"2023-11-24T06:14:50.710033+0000","last_undegraded":"2023-11-24T06:14:50.710033+0000","last_fullsized":"2023-11-24T06:14:50.710033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:07.157268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1070000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:55.727 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:14:55.727 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T06:14:55.727 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T06:14:55.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T06:14:55.728 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T06:14:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.992+0000 7f268b59e640 1 Processor -- start 2023-11-24T06:14:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.993+0000 7f268b59e640 1 -- start start 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268b59e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f268c144b30 0x7f268c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268b59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c15c410 0x7f268c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268b59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f268c0b1de0 0x7f268c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268b59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c0b27b0 con 0x7f268c0b1de0 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268b59e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c15bf80 con 0x7f268c144b30 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268b59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0b1560 con 0x7f268c15c410 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f268c0b1de0 0x7f268c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f268c0b1de0 0x7f268c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44440/0 (socket says 172.21.15.37:44440) 2023-11-24T06:14:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.994+0000 7f268ad9d640 1 -- 172.21.15.37:0/1823930965 learned_addr learned my addr 172.21.15.37:0/1823930965 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f268a59c640 1 --2- 172.21.15.37:0/1823930965 >> v2:172.21.15.188:3300/0 conn(0x7f268c144b30 0x7f268c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f2683fff640 1 --2- 172.21.15.37:0/1823930965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c15c410 0x7f268c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f268ad9d640 1 -- 172.21.15.37:0/1823930965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c15c410 msgr2=0x7f268c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f268ad9d640 1 --2- 172.21.15.37:0/1823930965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c15c410 0x7f268c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f268ad9d640 1 -- 172.21.15.37:0/1823930965 >> v2:172.21.15.188:3300/0 conn(0x7f268c144b30 msgr2=0x7f268c15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f268ad9d640 1 --2- 172.21.15.37:0/1823930965 >> v2:172.21.15.188:3300/0 conn(0x7f268c144b30 0x7f268c15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f268ad9d640 1 -- 172.21.15.37:0/1823930965 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0b0fb0 con 0x7f268c0b1de0 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f268a59c640 1 --2- 172.21.15.37:0/1823930965 >> v2:172.21.15.188:3300/0 conn(0x7f268c144b30 0x7f268c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.995+0000 7f2683fff640 1 --2- 172.21.15.37:0/1823930965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c15c410 0x7f268c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.996+0000 7f268ad9d640 1 --2- 172.21.15.37:0/1823930965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c0b1de0 0x7f268c0b2270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f268c06f690 tx=0x7f268402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8896b0c298e6a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.996+0000 7f2689d9b640 1 -- 172.21.15.37:0/1823930965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268402ca70 con 0x7f268c0b1de0 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.996+0000 7f2689d9b640 1 -- 172.21.15.37:0/1823930965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268402cbd0 con 0x7f268c0b1de0 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.996+0000 7f2689d9b640 1 -- 172.21.15.37:0/1823930965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840343f0 con 0x7f268c0b1de0 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 -- 172.21.15.37:0/1823930965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c0b1de0 msgr2=0x7f268c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 --2- 172.21.15.37:0/1823930965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c0b1de0 0x7f268c0b2270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f268c06f690 tx=0x7f268402bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 -- 172.21.15.37:0/1823930965 shutdown_connections 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 --2- 172.21.15.37:0/1823930965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c0b1de0 0x7f268c0b2270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 --2- 172.21.15.37:0/1823930965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c15c410 0x7f268c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 --2- 172.21.15.37:0/1823930965 >> v2:172.21.15.188:3300/0 conn(0x7f268c144b30 0x7f268c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 -- 172.21.15.37:0/1823930965 >> 172.21.15.37:0/1823930965 conn(0x7f268c0cb830 msgr2=0x7f268c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 -- 172.21.15.37:0/1823930965 shutdown_connections 2023-11-24T06:14:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.997+0000 7f268b59e640 1 -- 172.21.15.37:0/1823930965 wait complete. 2023-11-24T06:14:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.999+0000 7f268b59e640 1 Processor -- start 2023-11-24T06:14:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:55.999+0000 7f268b59e640 1 -- start start 2023-11-24T06:14:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.000+0000 7f268b59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c0b1de0 0x7f268c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.000+0000 7f268b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c144b30 0x7f268c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.000+0000 7f268b59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f268c15c410 0x7f268c136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.000+0000 7f268b59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c138820 con 0x7f268c144b30 2023-11-24T06:14:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.000+0000 7f268b59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c138b00 con 0x7f268c15c410 2023-11-24T06:14:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.000+0000 7f268b59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c138de0 con 0x7f268c0b1de0 2023-11-24T06:14:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c144b30 0x7f268c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c144b30 0x7f268c0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44446/0 (socket says 172.21.15.37:44446) 2023-11-24T06:14:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 -- 172.21.15.37:0/4207161488 learned_addr learned my addr 172.21.15.37:0/4207161488 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f268a59c640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c0b1de0 0x7f268c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f268ad9d640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f268c15c410 0x7f268c136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 -- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c0b1de0 msgr2=0x7f268c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c0b1de0 0x7f268c15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 -- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f268c15c410 msgr2=0x7f268c136420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f268c15c410 0x7f268c136420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f2683fff640 1 -- 172.21.15.37:0/4207161488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684009b30 con 0x7f268c144b30 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f268a59c640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c0b1de0 0x7f268c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.001+0000 7f268ad9d640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f268c15c410 0x7f268c136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.002+0000 7f2683fff640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c144b30 0x7f268c0c9dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f267400c7f0 tx=0x7f267400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.002+0000 7f2682ffd640 1 -- 172.21.15.37:0/4207161488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674007820 con 0x7f268c144b30 2023-11-24T06:14:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.002+0000 7f2682ffd640 1 -- 172.21.15.37:0/4207161488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674007980 con 0x7f268c144b30 2023-11-24T06:14:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.002+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c1390c0 con 0x7f268c144b30 2023-11-24T06:14:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.002+0000 7f2682ffd640 1 -- 172.21.15.37:0/4207161488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674007cf0 con 0x7f268c144b30 2023-11-24T06:14:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.002+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c0c8d00 con 0x7f268c144b30 2023-11-24T06:14:56.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.003+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c0b3610 con 0x7f268c144b30 2023-11-24T06:14:56.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.004+0000 7f2682ffd640 1 -- 172.21.15.37:0/4207161488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26740113f0 con 0x7f268c144b30 2023-11-24T06:14:56.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.005+0000 7f2682ffd640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f266c06ae40 0x7f266c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.005+0000 7f2682ffd640 1 -- 172.21.15.37:0/4207161488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26740899c0 con 0x7f268c144b30 2023-11-24T06:14:56.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.005+0000 7f268a59c640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f266c06ae40 0x7f266c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.006+0000 7f268a59c640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f266c06ae40 0x7f266c06d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f267c006b10 tx=0x7f267c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.010+0000 7f2682ffd640 1 -- 172.21.15.37:0/4207161488 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f268c0b3610 con 0x7f268c144b30 2023-11-24T06:14:56.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.253+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f268c0b3610 con 0x7f268c144b30 2023-11-24T06:14:56.256 INFO:tasks.ceph.mds.b.smithi188.stderr:2023-11-24T06:14:56.254+0000 7f59dd083640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:14:56.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.257+0000 7f2682ffd640 1 -- 172.21.15.37:0/4207161488 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171032 (secure 0 0 0) 0x7f268c0b3610 con 0x7f268c144b30 2023-11-24T06:14:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.260+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f266c06ae40 msgr2=0x7f266c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.260+0000 7f268b59e640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f266c06ae40 0x7f266c06d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f267c006b10 tx=0x7f267c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.260+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c144b30 msgr2=0x7f268c0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.260+0000 7f268b59e640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c144b30 0x7f268c0c9dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f267400c7f0 tx=0x7f267400ccb0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 shutdown_connections 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f266c06ae40 0x7f266c06d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f268c15c410 0x7f268c136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268c144b30 0x7f268c0c9dd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 --2- 172.21.15.37:0/4207161488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f268c0b1de0 0x7f268c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 >> 172.21.15.37:0/4207161488 conn(0x7f268c0cb830 msgr2=0x7f268c15cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 shutdown_connections 2023-11-24T06:14:56.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.261+0000 7f268b59e640 1 -- 172.21.15.37:0/4207161488 wait complete. 2023-11-24T06:14:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3129158683},{"type":"v1","addr":"172.21.15.37:6833","nonce":3129158683}]},"active_addr":"172.21.15.37:6833/3129158683","active_change":"2023-11-24T06:14:30.796682+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2073634643}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1530313499}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3295959076}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3384021395}]}]} 2023-11-24T06:14:56.286 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T06:14:56.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T06:14:56.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.509+0000 7fc702d61640 1 Processor -- start 2023-11-24T06:14:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.509+0000 7fc702d61640 1 -- start start 2023-11-24T06:14:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.511+0000 7fc702d61640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 0x7fc6fc161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.511+0000 7fc702d61640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc0ce0b0 con 0x7fc6fc15e390 2023-11-24T06:14:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.511+0000 7fc702d61640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc161960 con 0x7fc6fc0cf450 2023-11-24T06:14:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.511+0000 7fc702d61640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc15e8d0 con 0x7fc6fc157c70 2023-11-24T06:14:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.511+0000 7fc7012fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6fc15e390 0x7fc6fc0b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47450/0 (socket says 172.21.15.37:47450) 2023-11-24T06:14:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.511+0000 7fc7012fe640 1 -- 172.21.15.37:0/1927861728 learned_addr learned my addr 172.21.15.37:0/1927861728 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc700afd640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 0x7fc6fc161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025502078 0 0) 0x7fc6fc0ce0b0 con 0x7fc6fc15e390 2023-11-24T06:14:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6ec003520 con 0x7fc6fc15e390 2023-11-24T06:14:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219193817 0 0) 0x7fc6ec003520 con 0x7fc6fc15e390 2023-11-24T06:14:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 msgr2=0x7fc6fc161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 0x7fc6fc161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 >> v1:172.21.15.188:6789/0 conn(0x7fc6fc0cf450 legacy=0x7fc6fc15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc15ebb0 con 0x7fc6fc15e390 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fc6f40019f0 con 0x7fc6fc15e390 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.512+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 >> v1:172.21.15.37:6789/0 conn(0x7fc6fc15e390 legacy=0x7fc6fc0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc6fb7fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ec0039a0 0x7fc6ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc6fb7fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 0x7fc6ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc6fb7fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec004d00 0x7fc6ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc15e8d0 con 0x7fc6ec004d00 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec00bb10 con 0x7fc6ec0039a0 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec00bcd0 con 0x7fc6fc157c70 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc7012fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec004d00 0x7fc6ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc6fbfff640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 0x7fc6ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc700afd640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ec0039a0 0x7fc6ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc7012fe640 1 -- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 msgr2=0x7fc6ec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc7012fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6fc157c70 0x7fc6ec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc7012fe640 1 -- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ec0039a0 msgr2=0x7fc6ec003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc7012fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ec0039a0 0x7fc6ec003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.513+0000 7fc7012fe640 1 -- 172.21.15.37:0/1927861728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec003520 con 0x7fc6ec004d00 2023-11-24T06:14:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.514+0000 7fc7012fe640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec004d00 0x7fc6ec005180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc15e800 tx=0x7fc6ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dfcdcdc505515e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4034630 con 0x7fc6ec004d00 2023-11-24T06:14:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f402f070 con 0x7fc6ec004d00 2023-11-24T06:14:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc6fb7fe640 1 -- 172.21.15.37:0/1927861728 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4034a10 con 0x7fc6ec004d00 2023-11-24T06:14:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc702d61640 1 -- 172.21.15.37:0/1927861728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec004d00 msgr2=0x7fc6ec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc702d61640 1 --2- 172.21.15.37:0/1927861728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec004d00 0x7fc6ec005180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc15e800 tx=0x7fc6ec0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc7012fe640 1 -- 172.21.15.37:0/1927861728 reap_dead start 2023-11-24T06:14:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc702d61640 1 -- 172.21.15.37:0/1927861728 shutdown_connections 2023-11-24T06:14:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc702d61640 1 -- 172.21.15.37:0/1927861728 >> 172.21.15.37:0/1927861728 conn(0x7fc6fc06a920 msgr2=0x7fc6fc06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.515+0000 7fc702d61640 1 -- 172.21.15.37:0/1927861728 shutdown_connections 2023-11-24T06:14:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.516+0000 7fc702d61640 1 -- 172.21.15.37:0/1927861728 wait complete. 2023-11-24T06:14:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.517+0000 7fc702d61640 1 Processor -- start 2023-11-24T06:14:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.517+0000 7fc702d61640 1 -- start start 2023-11-24T06:14:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.518+0000 7fc702d61640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ec004d00 0x7fc6fc0ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.518+0000 7fc702d61640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6fc14d210 0x7fc6fc13e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.518+0000 7fc702d61640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6fc14d690 0x7fc6fc13e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.518+0000 7fc702d61640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0ad6d0 con 0x7fc6fc14d210 2023-11-24T06:14:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.518+0000 7fc702d61640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0aca50 con 0x7fc6fc14d690 2023-11-24T06:14:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.518+0000 7fc702d61640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0acd30 con 0x7fc6ec004d00 2023-11-24T06:14:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6fc14d210 0x7fc6fc13e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6fc14d210 0x7fc6fc13e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44464/0 (socket says 172.21.15.37:44464) 2023-11-24T06:14:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 -- 172.21.15.37:0/1031800357 learned_addr learned my addr 172.21.15.37:0/1031800357 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc7012fe640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6fc14d690 0x7fc6fc13e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc700afd640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ec004d00 0x7fc6fc0ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 -- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ec004d00 msgr2=0x7fc6fc0ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ec004d00 0x7fc6fc0ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 -- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6fc14d690 msgr2=0x7fc6fc13e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6fc14d690 0x7fc6fc13e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.519+0000 7fc6fbfff640 1 -- 172.21.15.37:0/1031800357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc0ad010 con 0x7fc6fc14d210 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.520+0000 7fc6fbfff640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6fc14d210 0x7fc6fc13e460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800e4d0 tx=0x7fc6e800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.520+0000 7fc6f97fa640 1 -- 172.21.15.37:0/1031800357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80053a0 con 0x7fc6fc14d210 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.520+0000 7fc6f97fa640 1 -- 172.21.15.37:0/1031800357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e80035f0 con 0x7fc6fc14d210 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.520+0000 7fc6f97fa640 1 -- 172.21.15.37:0/1031800357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8003980 con 0x7fc6fc14d210 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.520+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc0ad2f0 con 0x7fc6fc14d210 2023-11-24T06:14:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.520+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc0adaf0 con 0x7fc6fc14d210 2023-11-24T06:14:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.521+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6fc0add10 con 0x7fc6fc14d210 2023-11-24T06:14:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.522+0000 7fc6f97fa640 1 -- 172.21.15.37:0/1031800357 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6e8003ae0 con 0x7fc6fc14d210 2023-11-24T06:14:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.524+0000 7fc6f97fa640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc6e006ae90 0x7fc6e006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.524+0000 7fc6f97fa640 1 -- 172.21.15.37:0/1031800357 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6e80893e0 con 0x7fc6fc14d210 2023-11-24T06:14:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.524+0000 7fc700afd640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc6e006ae90 0x7fc6e006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.524+0000 7fc700afd640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc6e006ae90 0x7fc6e006d350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009a10 tx=0x7fc6f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.528+0000 7fc6f97fa640 1 -- 172.21.15.37:0/1031800357 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6e8054470 con 0x7fc6fc14d210 2023-11-24T06:14:56.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.728+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6fc067470 con 0x7fc6fc14d210 2023-11-24T06:14:56.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.731+0000 7fc6f97fa640 1 -- 172.21.15.37:0/1031800357 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fc6e8057a90 con 0x7fc6fc14d210 2023-11-24T06:14:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:56.734 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:56.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc6e006ae90 msgr2=0x7fc6e006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc6e006ae90 0x7fc6e006d350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009a10 tx=0x7fc6f0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:56.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6fc14d210 msgr2=0x7fc6fc13e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6fc14d210 0x7fc6fc13e460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800e4d0 tx=0x7fc6e800e990 comp rx=0 tx=0).stop 2023-11-24T06:14:56.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 shutdown_connections 2023-11-24T06:14:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc6e006ae90 0x7fc6e006d350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6fc14d690 0x7fc6fc13e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6fc14d210 0x7fc6fc13e460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 --2- 172.21.15.37:0/1031800357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ec004d00 0x7fc6fc0ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 >> 172.21.15.37:0/1031800357 conn(0x7fc6fc06a920 msgr2=0x7fc6fc070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 shutdown_connections 2023-11-24T06:14:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.734+0000 7fc702d61640 1 -- 172.21.15.37:0/1031800357 wait complete. 2023-11-24T06:14:56.758 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T06:14:56.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.981+0000 7f1e7ffff640 1 Processor -- start 2023-11-24T06:14:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.981+0000 7f1e7ffff640 1 -- start start 2023-11-24T06:14:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.983+0000 7f1e7ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1e8014b100 0x7f1e80162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.983+0000 7f1e7ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e800cd160 0x7f1e800cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.983+0000 7f1e7ffff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e80162eb0 con 0x7f1e800703f0 2023-11-24T06:14:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.983+0000 7f1e7ffff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800cdb10 con 0x7f1e800cd160 2023-11-24T06:14:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.983+0000 7f1e7ffff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e801654a0 con 0x7f1e8014b100 2023-11-24T06:14:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.983+0000 7f1e77fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1e800703f0 0x7f1e80165c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47464/0 (socket says 172.21.15.37:47464) 2023-11-24T06:14:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e77fff640 1 -- 172.21.15.37:0/28417857 learned_addr learned my addr 172.21.15.37:0/28417857 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7f7fe640 1 --2- 172.21.15.37:0/28417857 >> v2:172.21.15.37:3300/0 conn(0x7f1e800cd160 0x7f1e800cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7effd640 1 --2- 172.21.15.37:0/28417857 >> v2:172.21.15.188:3300/0 conn(0x7f1e8014b100 0x7f1e80162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/28417857 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424268130 0 0) 0x7f1e68001110 con 0x7f1e800703f0 2023-11-24T06:14:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/28417857 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e6c003520 con 0x7f1e800703f0 2023-11-24T06:14:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7f7fe640 1 -- 172.21.15.37:0/28417857 >> v2:172.21.15.188:3300/0 conn(0x7f1e8014b100 msgr2=0x7f1e80162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7f7fe640 1 --2- 172.21.15.37:0/28417857 >> v2:172.21.15.188:3300/0 conn(0x7f1e8014b100 0x7f1e80162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7f7fe640 1 -- 172.21.15.37:0/28417857 >> v1:172.21.15.37:6789/0 conn(0x7f1e800703f0 legacy=0x7f1e80165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/28417857 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910529740 0 0) 0x7f1e6c003520 con 0x7f1e800703f0 2023-11-24T06:14:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.984+0000 7f1e7f7fe640 1 -- 172.21.15.37:0/28417857 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800ccf00 con 0x7f1e800cd160 2023-11-24T06:14:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.986+0000 7f1e7f7fe640 1 --2- 172.21.15.37:0/28417857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e800cd5d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e8006e420 tx=0x7f1e7802bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a71b815b6349e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.986+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/28417857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68001800 con 0x7f1e800cd160 2023-11-24T06:14:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.986+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/28417857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7802c830 con 0x7f1e800cd160 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.986+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/28417857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7802cbc0 con 0x7f1e800cd160 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.986+0000 7f1e7ffff640 1 -- 172.21.15.37:0/28417857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 msgr2=0x7f1e800cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.986+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/28417857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e800cd5d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e8006e420 tx=0x7f1e7802bd00 comp rx=0 tx=0).stop 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.987+0000 7f1e7ffff640 1 -- 172.21.15.37:0/28417857 shutdown_connections 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.987+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/28417857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e800cd5d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.987+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/28417857 >> v2:172.21.15.188:3300/0 conn(0x7f1e8014b100 0x7f1e80162970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.987+0000 7f1e7ffff640 1 -- 172.21.15.37:0/28417857 >> 172.21.15.37:0/28417857 conn(0x7f1e800cb830 msgr2=0x7f1e800cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.987+0000 7f1e7ffff640 1 -- 172.21.15.37:0/28417857 shutdown_connections 2023-11-24T06:14:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.987+0000 7f1e7ffff640 1 -- 172.21.15.37:0/28417857 wait complete. 2023-11-24T06:14:56.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.988+0000 7f1e7ffff640 1 Processor -- start 2023-11-24T06:14:56.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.989+0000 7f1e7ffff640 1 -- start start 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e800703f0 0x7f1e800ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e8006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e8014b100 0x7f1e8006caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e801fa8d0 con 0x7f1e800cd160 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7ffff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800ad730 con 0x7f1e8014b100 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7ffff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8013c120 con 0x7f1e800703f0 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e8006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e8006c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44486/0 (socket says 172.21.15.37:44486) 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 -- 172.21.15.37:0/368740536 learned_addr learned my addr 172.21.15.37:0/368740536 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7effd640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e800703f0 0x7f1e800ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7f7fe640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e8014b100 0x7f1e8006caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 -- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e800703f0 msgr2=0x7f1e800ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e800703f0 0x7f1e800ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 -- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e8014b100 msgr2=0x7f1e8006caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e8014b100 0x7f1e8006caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e77fff640 1 -- 172.21.15.37:0/368740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009a70 con 0x7f1e800cd160 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.990+0000 7f1e7f7fe640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e8014b100 0x7f1e8006caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.991+0000 7f1e77fff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e8006c5b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800c730 tx=0x7f1e6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.991+0000 7f1e777fe640 1 -- 172.21.15.37:0/368740536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68005ad0 con 0x7f1e800cd160 2023-11-24T06:14:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.991+0000 7f1e777fe640 1 -- 172.21.15.37:0/368740536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e68005c30 con 0x7f1e800cd160 2023-11-24T06:14:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.991+0000 7f1e777fe640 1 -- 172.21.15.37:0/368740536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68007070 con 0x7f1e800cd160 2023-11-24T06:14:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.991+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e801fab20 con 0x7f1e800cd160 2023-11-24T06:14:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.991+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e801fb0e0 con 0x7f1e800cd160 2023-11-24T06:14:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.992+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8004e840 con 0x7f1e800cd160 2023-11-24T06:14:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.993+0000 7f1e777fe640 1 -- 172.21.15.37:0/368740536 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e680071d0 con 0x7f1e800cd160 2023-11-24T06:14:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.994+0000 7f1e777fe640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e6006ae40 0x7f1e6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.994+0000 7f1e777fe640 1 -- 172.21.15.37:0/368740536 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e68089250 con 0x7f1e800cd160 2023-11-24T06:14:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.994+0000 7f1e7effd640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e6006ae40 0x7f1e6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.995+0000 7f1e7effd640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e6006ae40 0x7f1e6006d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009970 tx=0x7f1e70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:56.998+0000 7f1e777fe640 1 -- 172.21.15.37:0/368740536 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e68054300 con 0x7f1e800cd160 2023-11-24T06:14:57.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.193+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e80162eb0 con 0x7f1e800cd160 2023-11-24T06:14:57.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.196+0000 7f1e777fe640 1 -- 172.21.15.37:0/368740536 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f1e80162eb0 con 0x7f1e800cd160 2023-11-24T06:14:57.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:14:57.199 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:57.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.198+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e6006ae40 msgr2=0x7f1e6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.198+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e6006ae40 0x7f1e6006d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009970 tx=0x7f1e70008040 comp rx=0 tx=0).stop 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.198+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 msgr2=0x7f1e8006c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.198+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e8006c5b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800c730 tx=0x7f1e6800cbf0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 shutdown_connections 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e6006ae40 0x7f1e6006d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e8014b100 0x7f1e8006caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800cd160 0x7f1e8006c5b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 --2- 172.21.15.37:0/368740536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e800703f0 0x7f1e800ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 >> 172.21.15.37:0/368740536 conn(0x7f1e800cb830 msgr2=0x7f1e80165c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 shutdown_connections 2023-11-24T06:14:57.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.199+0000 7f1e7ffff640 1 -- 172.21.15.37:0/368740536 wait complete. 2023-11-24T06:14:57.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T06:14:57.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T06:14:57.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T06:14:57.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T06:14:57.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T06:14:57.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T06:14:57.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T06:14:57.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T06:14:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.539+0000 7f0c12e09640 1 Processor -- start 2023-11-24T06:14:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.539+0000 7f8f22eda640 1 Processor -- start 2023-11-24T06:14:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.539+0000 7f8f22eda640 1 -- start start 2023-11-24T06:14:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.539+0000 7f0c12e09640 1 -- start start 2023-11-24T06:14:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.541+0000 7f0c12e09640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0709a0 0x7f0c0c0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.541+0000 7f0c12e09640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0c0c0cf510 0x7f0c0c0b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.541+0000 7f8f22eda640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8f1c161810 0x7f8f1c0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.541+0000 7f8f22eda640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c0ce480 0x7f8f1c0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.541+0000 7f0c12e09640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c15aa20 con 0x7f0c0c0b12d0 2023-11-24T06:14:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.541+0000 7f0c12e09640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c0cf940 con 0x7f0c0c0709a0 2023-11-24T06:14:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.541+0000 7f0c12e09640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c15a080 con 0x7f0c0c0cf510 2023-11-24T06:14:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.542+0000 7f8f216d7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c0ce480 0x7f8f1c0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.542+0000 7f8f21ed8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8f1c161810 0x7f8f1c0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f8f216d7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c0ce480 0x7f8f1c0c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49268/0 (socket says 172.21.15.37:49268) 2023-11-24T06:14:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f8f216d7640 1 -- 172.21.15.37:0/3788645777 learned_addr learned my addr 172.21.15.37:0/3788645777 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f8f22eda640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c0cec30 con 0x7f8f1c0cd8a0 2023-11-24T06:14:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f8f22eda640 1 -- 172.21.15.37:0/3788645777 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c0ce950 con 0x7f8f1c161810 2023-11-24T06:14:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f8f22eda640 1 -- 172.21.15.37:0/3788645777 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0ccdc0 con 0x7f8f1c0ce480 2023-11-24T06:14:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452120729 0 0) 0x7f8f1c0cec30 con 0x7f8f1c0cd8a0 2023-11-24T06:14:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f08003520 con 0x7f8f1c0cd8a0 2023-11-24T06:14:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 31469772 0 0) 0x7f8f08003520 con 0x7f8f1c0cd8a0 2023-11-24T06:14:57.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c0ce480 msgr2=0x7f8f1c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c0ce480 0x7f8f1c0c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 >> v2:172.21.15.188:3300/0 conn(0x7f8f1c161810 msgr2=0x7f8f1c0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 --2- 172.21.15.37:0/3788645777 >> v2:172.21.15.188:3300/0 conn(0x7f8f1c161810 0x7f8f1c0cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0cd0a0 con 0x7f8f1c0cd8a0 2023-11-24T06:14:57.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f8f140019f0 con 0x7f8f1c0cd8a0 2023-11-24T06:14:57.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 >> v1:172.21.15.37:6789/0 conn(0x7f8f1c0cd8a0 legacy=0x7f8f1c0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f08003970 0x7f8f08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f080047c0 0x7f8f08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f08005180 0x7f8f0800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0ce950 con 0x7f8f08005180 2023-11-24T06:14:57.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0ccdc0 con 0x7f8f08003970 2023-11-24T06:14:57.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.545+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0800bfa0 con 0x7f8f080047c0 2023-11-24T06:14:57.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f0c113a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0c0c0cf510 0x7f0c0c0b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f0c113a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0c0c0cf510 0x7f0c0c0b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:52872/0 (socket says 172.21.15.37:52872) 2023-11-24T06:14:57.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f0c113a6640 1 -- 172.21.15.37:0/427439884 learned_addr learned my addr 172.21.15.37:0/427439884 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f0c03fff640 1 --2- 172.21.15.37:0/427439884 >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0709a0 0x7f0c0c0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.543+0000 7f0c113a6640 1 -- 172.21.15.37:0/427439884 >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0709a0 msgr2=0x7f0c0c0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f0c113a6640 1 --2- 172.21.15.37:0/427439884 >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0709a0 0x7f0c0c0cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f0c113a6640 1 -- 172.21.15.37:0/427439884 >> v1:172.21.15.188:6789/0 conn(0x7f0c0c0b12d0 legacy=0x7f0c0c153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.544+0000 7f0c113a6640 1 -- 172.21.15.37:0/427439884 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c15a360 con 0x7f0c0c0cf510 2023-11-24T06:14:57.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.546+0000 7f8f226d9640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f08005180 0x7f8f0800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.546+0000 7f0c03fff640 1 --2- 172.21.15.37:0/427439884 >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0709a0 0x7f0c0c0cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:57.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.547+0000 7f0c113a6640 1 --2- 172.21.15.37:0/427439884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 0x7f0c0c0b29d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c157620 tx=0x7f0c0402ba80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f53a2bbfa8c4ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.546+0000 7f8f21ed8640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f08003970 0x7f8f08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.546+0000 7f8f216d7640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f080047c0 0x7f8f08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.547+0000 7f8f226d9640 1 -- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f080047c0 msgr2=0x7f8f08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.547+0000 7f8f226d9640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f080047c0 0x7f8f08004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.547+0000 7f8f226d9640 1 -- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f08003970 msgr2=0x7f8f08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.547+0000 7f8f226d9640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f08003970 0x7f8f08003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.547+0000 7f8f226d9640 1 -- 172.21.15.37:0/3788645777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0cd0a0 con 0x7f8f08005180 2023-11-24T06:14:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.547+0000 7f2442a9b640 1 Processor -- start 2023-11-24T06:14:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.548+0000 7f2442a9b640 1 -- start start 2023-11-24T06:14:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.548+0000 7f0c0bfff640 1 -- 172.21.15.37:0/427439884 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0402d840 con 0x7f0c0c0cf510 2023-11-24T06:14:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.548+0000 7f0c0bfff640 1 -- 172.21.15.37:0/427439884 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0402d9a0 con 0x7f0c0c0cf510 2023-11-24T06:14:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.548+0000 7f0c0bfff640 1 -- 172.21.15.37:0/427439884 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0402dd70 con 0x7f0c0c0cf510 2023-11-24T06:14:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.549+0000 7f0593e51640 1 Processor -- start 2023-11-24T06:14:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.549+0000 7f8f226d9640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f08005180 0x7f8f0800b980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c510 tx=0x7f8f080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d7c46bade42075 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.549+0000 7f2442a9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f2434052c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f2442a9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f243404ff40 0x7f2434037b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f2442a9b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24340e3670 con 0x7f2434053150 2023-11-24T06:14:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f2442a9b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2434053660 con 0x7f243404ff40 2023-11-24T06:14:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f2442a9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2434053940 con 0x7f24340e3290 2023-11-24T06:14:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1402cda0 con 0x7f8f08005180 2023-11-24T06:14:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14034440 con 0x7f8f08005180 2023-11-24T06:14:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f8f20ed6640 1 -- 172.21.15.37:0/3788645777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14034830 con 0x7f8f08005180 2023-11-24T06:14:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f0593e51640 1 -- start start 2023-11-24T06:14:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f0c12e09640 1 -- 172.21.15.37:0/427439884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 msgr2=0x7f0c0c0b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f0c12e09640 1 --2- 172.21.15.37:0/427439884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 0x7f0c0c0b29d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c157620 tx=0x7f0c0402ba80 comp rx=0 tx=0).stop 2023-11-24T06:14:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f0c12e09640 1 -- 172.21.15.37:0/427439884 shutdown_connections 2023-11-24T06:14:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f0c12e09640 1 --2- 172.21.15.37:0/427439884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 0x7f0c0c0b29d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f0c12e09640 1 --2- 172.21.15.37:0/427439884 >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0709a0 0x7f0c0c0cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.550+0000 7f0c12e09640 1 -- 172.21.15.37:0/427439884 >> 172.21.15.37:0/427439884 conn(0x7f0c0c06ae10 msgr2=0x7f0c0c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f0c12e09640 1 -- 172.21.15.37:0/427439884 shutdown_connections 2023-11-24T06:14:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f243bfff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f2434053150 0x7f243404f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50390/0 (socket says 172.21.15.37:50390) 2023-11-24T06:14:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f243bfff640 1 -- 172.21.15.37:0/4159145525 learned_addr learned my addr 172.21.15.37:0/4159145525 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f2440837640 1 --2- 172.21.15.37:0/4159145525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f2434052c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f90fc54c640 1 Processor -- start 2023-11-24T06:14:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f8f22eda640 1 -- 172.21.15.37:0/3788645777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f08005180 msgr2=0x7f8f0800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f8f22eda640 1 --2- 172.21.15.37:0/3788645777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f08005180 0x7f8f0800b980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c510 tx=0x7f8f080057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f90fc54c640 1 -- start start 2023-11-24T06:14:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f8f226d9640 1 -- 172.21.15.37:0/3788645777 reap_dead start 2023-11-24T06:14:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f2441038640 1 --2- 172.21.15.37:0/4159145525 >> v2:172.21.15.188:3300/0 conn(0x7f243404ff40 0x7f2434037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f8f22eda640 1 -- 172.21.15.37:0/3788645777 shutdown_connections 2023-11-24T06:14:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f8f22eda640 1 -- 172.21.15.37:0/3788645777 >> 172.21.15.37:0/3788645777 conn(0x7f8f1c0cbb40 msgr2=0x7f8f1c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f243b7fe640 1 -- 172.21.15.37:0/4159145525 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554950937 0 0) 0x7f24340e3670 con 0x7f2434053150 2023-11-24T06:14:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f243b7fe640 1 -- 172.21.15.37:0/4159145525 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f242c003520 con 0x7f2434053150 2023-11-24T06:14:57.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f8f22eda640 1 -- 172.21.15.37:0/3788645777 shutdown_connections 2023-11-24T06:14:57.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f8f22eda640 1 -- 172.21.15.37:0/3788645777 wait complete. 2023-11-24T06:14:57.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.551+0000 7f0c12e09640 1 -- 172.21.15.37:0/427439884 wait complete. 2023-11-24T06:14:57.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f2440837640 1 -- 172.21.15.37:0/4159145525 >> v2:172.21.15.188:3300/0 conn(0x7f243404ff40 msgr2=0x7f2434037b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f2440837640 1 --2- 172.21.15.37:0/4159145525 >> v2:172.21.15.188:3300/0 conn(0x7f243404ff40 0x7f2434037b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f2440837640 1 -- 172.21.15.37:0/4159145525 >> v1:172.21.15.188:6789/0 conn(0x7f2434053150 legacy=0x7f243404f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f2440837640 1 -- 172.21.15.37:0/4159145525 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434053c20 con 0x7f24340e3290 2023-11-24T06:14:57.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f90fc54c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f415a0f0 0x7f90f40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f90fc54c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90f40cc500 0x7f90f40c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f90fc54c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f40cd590 con 0x7f90f40cd110 2023-11-24T06:14:57.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f90fc54c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40cd870 con 0x7f90f40cc500 2023-11-24T06:14:57.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f90fc54c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40cdb50 con 0x7f90f415a0f0 2023-11-24T06:14:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f0593e51640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c161260 0x7f058c1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f0593e51640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f058c0ceb10 0x7f058c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f0593e51640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c161ce0 con 0x7f058c15d270 2023-11-24T06:14:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f0593e51640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0cf4e0 con 0x7f058c0ceb10 2023-11-24T06:14:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.552+0000 7f0593e51640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c161fc0 con 0x7f058c161260 2023-11-24T06:14:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f05913ec640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c161260 0x7f058c1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f0591bed640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f058c15d270 0x7f058c15d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47478/0 (socket says 172.21.15.37:47478) 2023-11-24T06:14:57.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f0591bed640 1 -- 172.21.15.37:0/1148001682 learned_addr learned my addr 172.21.15.37:0/1148001682 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:57.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.554+0000 7f2440837640 1 --2- 172.21.15.37:0/4159145525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f2434052c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24280097a0 tx=0x7f242802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0f996e02075be9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.554+0000 7f90faae9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90f40cc500 0x7f90f40c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.554+0000 7f90f9ae7640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f90f40cd110 0x7f90f40cbdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50396/0 (socket says 172.21.15.37:50396) 2023-11-24T06:14:57.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.554+0000 7f90f9ae7640 1 -- 172.21.15.37:0/754192021 learned_addr learned my addr 172.21.15.37:0/754192021 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:57.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.554+0000 7f0c12e09640 1 Processor -- start 2023-11-24T06:14:57.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.554+0000 7f0590beb640 1 -- 172.21.15.37:0/1148001682 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348041919 0 0) 0x7f058c161ce0 con 0x7f058c15d270 2023-11-24T06:14:57.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.554+0000 7f0590beb640 1 -- 172.21.15.37:0/1148001682 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0578003520 con 0x7f058c15d270 2023-11-24T06:14:57.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.553+0000 7f05923ee640 1 --2- 172.21.15.37:0/1148001682 >> v2:172.21.15.37:3300/0 conn(0x7f058c0ceb10 0x7f058c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f90fa2e8640 1 --2- 172.21.15.37:0/754192021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f415a0f0 0x7f90f40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f8f22eda640 1 Processor -- start 2023-11-24T06:14:57.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f0c12e09640 1 -- start start 2023-11-24T06:14:57.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f8f22eda640 1 -- start start 2023-11-24T06:14:57.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f90faae9640 1 -- 172.21.15.37:0/754192021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f415a0f0 msgr2=0x7f90f40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f90faae9640 1 --2- 172.21.15.37:0/754192021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f415a0f0 0x7f90f40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f90faae9640 1 -- 172.21.15.37:0/754192021 >> v1:172.21.15.188:6789/0 conn(0x7f90f40cd110 legacy=0x7f90f40cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f90faae9640 1 -- 172.21.15.37:0/754192021 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40cde30 con 0x7f90f40cc500 2023-11-24T06:14:57.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f243b7fe640 1 -- 172.21.15.37:0/4159145525 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428030610 con 0x7f24340e3290 2023-11-24T06:14:57.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.556+0000 7f243b7fe640 1 -- 172.21.15.37:0/4159145525 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2428030770 con 0x7f24340e3290 2023-11-24T06:14:57.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f05923ee640 1 -- 172.21.15.37:0/1148001682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c161260 msgr2=0x7f058c1616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f05923ee640 1 --2- 172.21.15.37:0/1148001682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c161260 0x7f058c1616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.555+0000 7f05923ee640 1 -- 172.21.15.37:0/1148001682 >> v1:172.21.15.37:6789/0 conn(0x7f058c15d270 legacy=0x7f058c15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.556+0000 7f05923ee640 1 -- 172.21.15.37:0/1148001682 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0ce310 con 0x7f058c0ceb10 2023-11-24T06:14:57.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c12e09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0709a0 0x7f0c0c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c12e09640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c0c0b12d0 0x7f0c0c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c12e09640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 0x7f0c0c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c12e09640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0af7f0 con 0x7f0c0c0709a0 2023-11-24T06:14:57.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c12e09640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c141700 con 0x7f0c0c0cf510 2023-11-24T06:14:57.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c12e09640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c140050 con 0x7f0c0c0b12d0 2023-11-24T06:14:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.556+0000 7f243b7fe640 1 -- 172.21.15.37:0/4159145525 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428030b20 con 0x7f24340e3290 2023-11-24T06:14:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c10ba5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0709a0 0x7f0c0c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f8f22eda640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f08005180 0x7f8f1c150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f8f22eda640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c159740 0x7f8f1c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c10ba5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0709a0 0x7f0c0c140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44546/0 (socket says 172.21.15.37:44546) 2023-11-24T06:14:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f0c10ba5640 1 -- 172.21.15.37:0/2646739211 learned_addr learned my addr 172.21.15.37:0/2646739211 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.557+0000 7f8f22eda640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1c159ba0 0x7f8f1c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f0c113a6640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 0x7f0c0c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f05923ee640 1 --2- 172.21.15.37:0/1148001682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f058c0ceb10 0x7f058c0cefa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0584009d90 tx=0x7f058402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdff139972c70d8b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f8f22eda640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c14ef80 con 0x7f8f1c159ba0 2023-11-24T06:14:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f0c03fff640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c0c0b12d0 0x7f0c0c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f2442a9b640 1 -- 172.21.15.37:0/4159145525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 msgr2=0x7f2434052c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f2442a9b640 1 --2- 172.21.15.37:0/4159145525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f2434052c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24280097a0 tx=0x7f242802b960 comp rx=0 tx=0).stop 2023-11-24T06:14:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f90faae9640 1 --2- 172.21.15.37:0/754192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f40cc500 0x7f90f40c3ec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009d90 tx=0x7f90ec02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aeca42e206d0747 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f8f216d7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c159740 0x7f8f1c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f8f21ed8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f08005180 0x7f8f1c150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f8f216d7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c159740 0x7f8f1c14e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:52910/0 (socket says 172.21.15.37:52910) 2023-11-24T06:14:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f8f216d7640 1 -- 172.21.15.37:0/1602282746 learned_addr learned my addr 172.21.15.37:0/1602282746 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0c10ba5640 1 -- 172.21.15.37:0/2646739211 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c0c0b12d0 msgr2=0x7f0c0c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0c10ba5640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c0c0b12d0 0x7f0c0c0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0c10ba5640 1 -- 172.21.15.37:0/2646739211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 msgr2=0x7f0c0c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0c10ba5640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c0c0cf510 0x7f0c0c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0c10ba5640 1 -- 172.21.15.37:0/2646739211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040094d0 con 0x7f0c0c0709a0 2023-11-24T06:14:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f2442a9b640 1 -- 172.21.15.37:0/4159145525 shutdown_connections 2023-11-24T06:14:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f2442a9b640 1 --2- 172.21.15.37:0/4159145525 >> v2:172.21.15.188:3300/0 conn(0x7f243404ff40 0x7f2434037b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f2442a9b640 1 --2- 172.21.15.37:0/4159145525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f2434052c10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f2442a9b640 1 -- 172.21.15.37:0/4159145525 >> 172.21.15.37:0/4159145525 conn(0x7f2434009f70 msgr2=0x7f243400a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c150120 con 0x7f8f1c159740 2023-11-24T06:14:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.558+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c14f510 con 0x7f8f08005180 2023-11-24T06:14:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f8f226d9640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1c159ba0 0x7f8f1c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f90f92e6640 1 -- 172.21.15.37:0/754192021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec02cbc0 con 0x7f90f40cc500 2023-11-24T06:14:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f90f92e6640 1 -- 172.21.15.37:0/754192021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec02cd20 con 0x7f90f40cc500 2023-11-24T06:14:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f90f92e6640 1 -- 172.21.15.37:0/754192021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec034660 con 0x7f90f40cc500 2023-11-24T06:14:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0590beb640 1 -- 172.21.15.37:0/1148001682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058402cc70 con 0x7f058c0ceb10 2023-11-24T06:14:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0590beb640 1 -- 172.21.15.37:0/1148001682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058402cdd0 con 0x7f058c0ceb10 2023-11-24T06:14:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0590beb640 1 -- 172.21.15.37:0/1148001682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584034640 con 0x7f058c0ceb10 2023-11-24T06:14:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f0c10ba5640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0709a0 0x7f0c0c140b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00c870 tx=0x7f0bfc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f2442a9b640 1 -- 172.21.15.37:0/4159145525 shutdown_connections 2023-11-24T06:14:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f8f21ed8640 1 -- 172.21.15.37:0/1602282746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c159740 msgr2=0x7f8f1c14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f8f21ed8640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c159740 0x7f8f1c14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f8f21ed8640 1 -- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1c159ba0 msgr2=0x7f8f1c14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7ffac9a97640 1 Processor -- start 2023-11-24T06:14:57.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f90fc54c640 1 -- 172.21.15.37:0/754192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f40cc500 msgr2=0x7f90f40c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f90fc54c640 1 --2- 172.21.15.37:0/754192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f40cc500 0x7f90f40c3ec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009d90 tx=0x7f90ec02be10 comp rx=0 tx=0).stop 2023-11-24T06:14:57.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f8f21ed8640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1c159ba0 0x7f8f1c14ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f8f21ed8640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c14f7f0 con 0x7f8f08005180 2023-11-24T06:14:57.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f76b06cf640 1 Processor -- start 2023-11-24T06:14:57.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7ffac9a97640 1 -- start start 2023-11-24T06:14:57.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f8f21ed8640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f08005180 0x7f8f1c150e50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800f4e0 tx=0x7f8f1800f9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f76b06cf640 1 -- start start 2023-11-24T06:14:57.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f0593e51640 1 -- 172.21.15.37:0/1148001682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f058c0ceb10 msgr2=0x7f058c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f90fc54c640 1 -- 172.21.15.37:0/754192021 shutdown_connections 2023-11-24T06:14:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f90fc54c640 1 --2- 172.21.15.37:0/754192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f40cc500 0x7f90f40c3ec0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f90fc54c640 1 --2- 172.21.15.37:0/754192021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f415a0f0 0x7f90f40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f90fc54c640 1 -- 172.21.15.37:0/754192021 >> 172.21.15.37:0/754192021 conn(0x7f90f40b0c50 msgr2=0x7f90f40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18019070 con 0x7f8f08005180 2023-11-24T06:14:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f18004240 con 0x7f8f08005180 2023-11-24T06:14:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18003610 con 0x7f8f08005180 2023-11-24T06:14:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f0593e51640 1 --2- 172.21.15.37:0/1148001682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f058c0ceb10 0x7f058c0cefa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0584009d90 tx=0x7f058402bec0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f0593e51640 1 -- 172.21.15.37:0/1148001682 shutdown_connections 2023-11-24T06:14:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f0593e51640 1 --2- 172.21.15.37:0/1148001682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f058c0ceb10 0x7f058c0cefa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f0593e51640 1 --2- 172.21.15.37:0/1148001682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c161260 0x7f058c1616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f0593e51640 1 -- 172.21.15.37:0/1148001682 >> 172.21.15.37:0/1148001682 conn(0x7f058c08af60 msgr2=0x7f058c09c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7f0593e51640 1 -- 172.21.15.37:0/1148001682 shutdown_connections 2023-11-24T06:14:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.559+0000 7f2442a9b640 1 -- 172.21.15.37:0/4159145525 wait complete. 2023-11-24T06:14:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7f0593e51640 1 -- 172.21.15.37:0/1148001682 wait complete. 2023-11-24T06:14:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc003b70 con 0x7f0c0c0709a0 2023-11-24T06:14:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc003cf0 con 0x7f0c0c0709a0 2023-11-24T06:14:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc00aa90 con 0x7f0c0c0709a0 2023-11-24T06:14:57.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.560+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c13f300 con 0x7f0c0c0709a0 2023-11-24T06:14:57.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c1405d0 con 0x7f0c0c0709a0 2023-11-24T06:14:57.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c0c153e50 con 0x7f0c0c0709a0 2023-11-24T06:14:57.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f90fc54c640 1 -- 172.21.15.37:0/754192021 shutdown_connections 2023-11-24T06:14:57.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.561+0000 7f90fc54c640 1 -- 172.21.15.37:0/754192021 wait complete. 2023-11-24T06:14:57.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c14fad0 con 0x7f8f08005180 2023-11-24T06:14:57.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c14f130 con 0x7f8f08005180 2023-11-24T06:14:57.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7ffac9a97640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac40b1740 0x7ffac4159350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7ffac9a97640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffac4159890 0x7ffac40cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7ffac9a97640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac40705c0 con 0x7ffac40c3ec0 2023-11-24T06:14:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f2442a9b640 1 Processor -- start 2023-11-24T06:14:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7ffac9a97640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac4071140 con 0x7ffac4159890 2023-11-24T06:14:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.562+0000 7ffac9a97640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4070af0 con 0x7ffac40b1740 2023-11-24T06:14:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f2442a9b640 1 -- start start 2023-11-24T06:14:57.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76b06cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76a81660b0 0x7f76a8162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76b06cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f76a8162540 0x7f76a80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76b06cf640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a8166510 con 0x7f76a80ccbd0 2023-11-24T06:14:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76b06cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a81655f0 con 0x7f76a81660b0 2023-11-24T06:14:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76b06cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a80cc380 con 0x7f76a8162540 2023-11-24T06:14:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76adc6a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76a81660b0 0x7f76a8162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76adc6a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76a81660b0 0x7f76a8162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44562/0 (socket says 172.21.15.37:44562) 2023-11-24T06:14:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.563+0000 7f76adc6a640 1 -- 172.21.15.37:0/3077016257 learned_addr learned my addr 172.21.15.37:0/3077016257 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f76adc6a640 1 -- 172.21.15.37:0/3077016257 >> v2:172.21.15.188:3300/0 conn(0x7f76a8162540 msgr2=0x7f76a80c9650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:14:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f76adc6a640 1 --2- 172.21.15.37:0/3077016257 >> v2:172.21.15.188:3300/0 conn(0x7f76a8162540 0x7f76a80c9650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f76adc6a640 1 -- 172.21.15.37:0/3077016257 >> v1:172.21.15.37:6789/0 conn(0x7f76a80ccbd0 legacy=0x7f76a80ccfb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:14:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f76adc6a640 1 -- 172.21.15.37:0/3077016257 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8162b30 con 0x7f76a81660b0 2023-11-24T06:14:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f0593e51640 1 Processor -- start 2023-11-24T06:14:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8f04000fc0 con 0x7f8f08005180 2023-11-24T06:14:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.564+0000 7f0593e51640 1 -- start start 2023-11-24T06:14:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.565+0000 7ffac37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac40b1740 0x7ffac4159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.565+0000 7ffac37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac40b1740 0x7ffac4159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49354/0 (socket says 172.21.15.37:49354) 2023-11-24T06:14:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.565+0000 7ffac37fe640 1 -- 172.21.15.37:0/1564624411 learned_addr learned my addr 172.21.15.37:0/1564624411 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.565+0000 7f76adc6a640 1 --2- 172.21.15.37:0/3077016257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a81660b0 0x7f76a8162000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76a80ae430 tx=0x7f769c02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3c6952d35cac14 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7ffac2ffd640 1 --2- 172.21.15.37:0/1564624411 >> v2:172.21.15.37:3300/0 conn(0x7ffac4159890 0x7ffac40cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7ffac37fe640 1 -- 172.21.15.37:0/1564624411 >> v2:172.21.15.37:3300/0 conn(0x7ffac4159890 msgr2=0x7ffac40cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7ffac37fe640 1 --2- 172.21.15.37:0/1564624411 >> v2:172.21.15.37:3300/0 conn(0x7ffac4159890 0x7ffac40cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7ffac37fe640 1 -- 172.21.15.37:0/1564624411 >> v1:172.21.15.37:6789/0 conn(0x7ffac40c3ec0 legacy=0x7ffac40cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7ffac37fe640 1 -- 172.21.15.37:0/1564624411 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4070dd0 con 0x7ffac40b1740 2023-11-24T06:14:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7f76ad469640 1 -- 172.21.15.37:0/3077016257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c02caa0 con 0x7f76a81660b0 2023-11-24T06:14:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7f2442a9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243404ff40 0x7f24340d5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7f76ad469640 1 -- 172.21.15.37:0/3077016257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c02cc00 con 0x7f76a81660b0 2023-11-24T06:14:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.566+0000 7f76ad469640 1 -- 172.21.15.37:0/3077016257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c0343f0 con 0x7f76a81660b0 2023-11-24T06:14:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2442a9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2434053150 0x7f243404e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2442a9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f243404cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2442a9b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243404c970 con 0x7f243404ff40 2023-11-24T06:14:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2442a9b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340d64e0 con 0x7f2434053150 2023-11-24T06:14:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2442a9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243404bcf0 con 0x7f24340e3290 2023-11-24T06:14:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2440837640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243404ff40 0x7f24340d5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2440837640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243404ff40 0x7f24340d5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44576/0 (socket says 172.21.15.37:44576) 2023-11-24T06:14:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f90fc54c640 1 Processor -- start 2023-11-24T06:14:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f0593e51640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c0ceb10 0x7f058c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f0593e51640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f058c15d270 0x7f058c0b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f0593e51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f058c161260 0x7f058c0b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f76b06cf640 1 -- 172.21.15.37:0/3077016257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a81660b0 msgr2=0x7f76a8162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f76b06cf640 1 --2- 172.21.15.37:0/3077016257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a81660b0 0x7f76a8162000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f76a80ae430 tx=0x7f769c02bf00 comp rx=0 tx=0).stop 2023-11-24T06:14:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7ffac37fe640 1 --2- 172.21.15.37:0/1564624411 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac40b1740 0x7ffac4159350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a8a3c45e8cfa84c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.567+0000 7f2440837640 1 -- 172.21.15.37:0/3020203309 learned_addr learned my addr 172.21.15.37:0/3020203309 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f76b06cf640 1 -- 172.21.15.37:0/3077016257 shutdown_connections 2023-11-24T06:14:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f76b06cf640 1 --2- 172.21.15.37:0/3077016257 >> v2:172.21.15.188:3300/0 conn(0x7f76a8162540 0x7f76a80c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f76b06cf640 1 --2- 172.21.15.37:0/3077016257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a81660b0 0x7f76a8162000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f0593e51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c1f6640 con 0x7f058c161260 2023-11-24T06:14:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f18003770 con 0x7f8f08005180 2023-11-24T06:14:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f3adbd53640 1 Processor -- start 2023-11-24T06:14:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f3adbd53640 1 -- start start 2023-11-24T06:14:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f76b06cf640 1 -- 172.21.15.37:0/3077016257 >> 172.21.15.37:0/3077016257 conn(0x7f76a80b0c50 msgr2=0x7f76a80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f2441038640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f243404cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f0591bed640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c0ceb10 0x7f058c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f0593e51640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c1f6890 con 0x7f058c15d270 2023-11-24T06:14:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f0593e51640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c1f6b70 con 0x7f058c0ceb10 2023-11-24T06:14:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bfc00abf0 con 0x7f0c0c0709a0 2023-11-24T06:14:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f0591bed640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c0ceb10 0x7f058c159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49370/0 (socket says 172.21.15.37:49370) 2023-11-24T06:14:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f0591bed640 1 -- 172.21.15.37:0/1017843362 learned_addr learned my addr 172.21.15.37:0/1017843362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f05913ec640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f058c15d270 0x7f058c0b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f76b06cf640 1 -- 172.21.15.37:0/3077016257 shutdown_connections 2023-11-24T06:14:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f76b06cf640 1 -- 172.21.15.37:0/3077016257 wait complete. 2023-11-24T06:14:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7ffac27fc640 1 -- 172.21.15.37:0/1564624411 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc02ca80 con 0x7ffac40b1740 2023-11-24T06:14:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7ffac27fc640 1 -- 172.21.15.37:0/1564624411 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc02cbe0 con 0x7ffac40b1740 2023-11-24T06:14:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7ffac27fc640 1 -- 172.21.15.37:0/1564624411 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0343f0 con 0x7ffac40b1740 2023-11-24T06:14:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f243bfff640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2434053150 0x7f243404e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f2440837640 1 -- 172.21.15.37:0/3020203309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 msgr2=0x7f243404cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f2440837640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24340e3290 0x7f243404cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f2440837640 1 -- 172.21.15.37:0/3020203309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2434053150 msgr2=0x7f243404e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f2440837640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2434053150 0x7f243404e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f2440837640 1 -- 172.21.15.37:0/3020203309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428009400 con 0x7f243404ff40 2023-11-24T06:14:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f0591bed640 1 -- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f058c15d270 msgr2=0x7f058c0b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7ffac9a97640 1 -- 172.21.15.37:0/1564624411 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac40b1740 msgr2=0x7ffac4159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7ffac9a97640 1 --2- 172.21.15.37:0/1564624411 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac40b1740 0x7ffac4159350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc02bee0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f3adbd53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3ad4159650 0x7f3ad415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f3adbd53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40c4390 0x7f3ad40c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f8f127fc640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8f0006ae90 0x7f8f0006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f18089d60 con 0x7f8f08005180 2023-11-24T06:14:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f8f127fc640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7f8f000730b0 0x7f8f000754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f00075b80 con 0x7f8f000730b0 2023-11-24T06:14:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f1808a0d0 con 0x7f8f08005180 2023-11-24T06:14:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f2440837640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243404ff40 0x7f24340d5fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24280098c0 tx=0x7f24280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.568+0000 7f90fc54c640 1 -- start start 2023-11-24T06:14:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7ffac9a97640 1 -- 172.21.15.37:0/1564624411 shutdown_connections 2023-11-24T06:14:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f0c09ffb640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0bec06aec0 0x7f0bec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bfc089d20 con 0x7f0c0c0709a0 2023-11-24T06:14:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f0c09ffb640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f0bec0730e0 0x7f0bec075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 --> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bec075bb0 con 0x7f0bec0730e0 2023-11-24T06:14:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f3adbd53640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad406d5a0 con 0x7f3ad40ccc40 2023-11-24T06:14:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bfc08a1c0 con 0x7f0c0c0709a0 2023-11-24T06:14:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f3adbd53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad415aa40 con 0x7f3ad4159650 2023-11-24T06:14:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.570+0000 7f3adbd53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad40c4d60 con 0x7f3ad40c4390 2023-11-24T06:14:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f3ad9aef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3ad4159650 0x7f3ad415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242803f070 con 0x7f243404ff40 2023-11-24T06:14:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24280044c0 con 0x7f243404ff40 2023-11-24T06:14:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428030ea0 con 0x7f243404ff40 2023-11-24T06:14:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f3ad9aef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3ad4159650 0x7f3ad415d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:52920/0 (socket says 172.21.15.37:52920) 2023-11-24T06:14:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f3ad9aef640 1 -- 172.21.15.37:0/2401455000 learned_addr learned my addr 172.21.15.37:0/2401455000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f3ada2f0640 1 --2- 172.21.15.37:0/2401455000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40c4390 0x7f3ad40c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f0591bed640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f058c15d270 0x7f058c0b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f0591bed640 1 -- 172.21.15.37:0/1017843362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f058c161260 msgr2=0x7f058c0b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f0591bed640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f058c161260 0x7f058c0b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.569+0000 7f0591bed640 1 -- 172.21.15.37:0/1017843362 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584009a70 con 0x7f058c0ceb10 2023-11-24T06:14:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f8f226d9640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7f8f000730b0 0x7f8f000754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f0c113a6640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f0bec0730e0 0x7f0bec075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f0591bed640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c0ceb10 0x7f058c159a40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f058800c430 tx=0x7f058800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243404bfd0 con 0x7f243404ff40 2023-11-24T06:14:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243404c590 con 0x7f243404ff40 2023-11-24T06:14:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f8f216d7640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8f0006ae90 0x7f8f0006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f0c03fff640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0bec06aec0 0x7f0bec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.571+0000 7f76b06cf640 1 Processor -- start 2023-11-24T06:14:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f8f226d9640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7f8f000730b0 0x7f8f000754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f8f216d7640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8f0006ae90 0x7f8f0006d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c151e00 tx=0x7f8f0c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2434054700 con 0x7f243404ff40 2023-11-24T06:14:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f90fc54c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90f40cc500 0x7f90f40c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f90fc54c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f40cd110 0x7f90f409b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7ffac9a97640 1 --2- 172.21.15.37:0/1564624411 >> v2:172.21.15.37:3300/0 conn(0x7ffac4159890 0x7ffac40cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7ffac9a97640 1 --2- 172.21.15.37:0/1564624411 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac40b1740 0x7ffac4159350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7ffac9a97640 1 -- 172.21.15.37:0/1564624411 >> 172.21.15.37:0/1564624411 conn(0x7ffac40b0c50 msgr2=0x7ffac40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f3ada2f0640 1 -- 172.21.15.37:0/2401455000 >> v2:172.21.15.188:3300/0 conn(0x7f3ad4159650 msgr2=0x7f3ad415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f0c03fff640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0bec06aec0 0x7f0bec06d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c1430b0 tx=0x7f0bf4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f3ada2f0640 1 --2- 172.21.15.37:0/2401455000 >> v2:172.21.15.188:3300/0 conn(0x7f3ad4159650 0x7f3ad415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90fc54c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f415a0f0 0x7f90f40c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f3ada2f0640 1 -- 172.21.15.37:0/2401455000 >> v1:172.21.15.37:6789/0 conn(0x7f3ad40ccc40 legacy=0x7f3ad406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f3ada2f0640 1 -- 172.21.15.37:0/2401455000 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad415d990 con 0x7f3ad40c4390 2023-11-24T06:14:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f3ad9aef640 1 --2- 172.21.15.37:0/2401455000 >> v2:172.21.15.188:3300/0 conn(0x7f3ad4159650 0x7f3ad415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588005ce0 con 0x7f058c0ceb10 2023-11-24T06:14:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588005e40 con 0x7f058c0ceb10 2023-11-24T06:14:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90fc54c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f414cbb0 con 0x7f90f415a0f0 2023-11-24T06:14:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90fc54c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f409bed0 con 0x7f90f40cc500 2023-11-24T06:14:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90fc54c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c60d0 con 0x7f90f40cd110 2023-11-24T06:14:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.572+0000 7f76b06cf640 1 -- start start 2023-11-24T06:14:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7ffac9a97640 1 -- 172.21.15.37:0/1564624411 shutdown_connections 2023-11-24T06:14:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90fa2e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90f40cc500 0x7f90f40c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c1f6e50 con 0x7f058c0ceb10 2023-11-24T06:14:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== osd.0 v2:172.21.15.37:6814/1821926241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8f00075b80 con 0x7f8f000730b0 2023-11-24T06:14:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c1f7410 con 0x7f058c0ceb10 2023-11-24T06:14:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05880072f0 con 0x7f058c0ceb10 2023-11-24T06:14:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f76b06cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80ccbd0 0x7f76a8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f76b06cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76a8162540 0x7f76a8072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f76b06cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76a81660b0 0x7f76a80c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f0c113a6640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f0bec0730e0 0x7f0bec075500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f76b06cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80c60d0 con 0x7f76a80ccbd0 2023-11-24T06:14:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f76b06cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80714d0 con 0x7f76a8162540 2023-11-24T06:14:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.573+0000 7f76b06cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8070950 con 0x7f76a81660b0 2023-11-24T06:14:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f76ae46b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80ccbd0 0x7f76a8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f058c0d11e0 con 0x7f058c0ceb10 2023-11-24T06:14:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7ffac9a97640 1 -- 172.21.15.37:0/1564624411 wait complete. 2023-11-24T06:14:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90fa2e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90f40cc500 0x7f90f40c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:52934/0 (socket says 172.21.15.37:52934) 2023-11-24T06:14:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90fa2e8640 1 -- 172.21.15.37:0/1054406610 learned_addr learned my addr 172.21.15.37:0/1054406610 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90f9ae7640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f40cd110 0x7f90f409b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.574+0000 7f90faae9640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f415a0f0 0x7f90f40c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f90fa2e8640 1 -- 172.21.15.37:0/1054406610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f40cd110 msgr2=0x7f90f409b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f90fa2e8640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90f40cd110 0x7f90f409b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f90fa2e8640 1 -- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f415a0f0 msgr2=0x7f90f40c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f90fa2e8640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f415a0f0 0x7f90f40c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f90fa2e8640 1 -- 172.21.15.37:0/1054406610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009a70 con 0x7f90f40cc500 2023-11-24T06:14:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f90faae9640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f415a0f0 0x7f90f40c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.575+0000 7f76ae46b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80ccbd0 0x7f76a8158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44602/0 (socket says 172.21.15.37:44602) 2023-11-24T06:14:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.576+0000 7f76adc6a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76a8162540 0x7f76a8072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.576+0000 7f76ae46b640 1 -- 172.21.15.37:0/4205163024 learned_addr learned my addr 172.21.15.37:0/4205163024 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.576+0000 7f76aec6c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76a81660b0 0x7f76a80c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.576+0000 7f3ada2f0640 1 --2- 172.21.15.37:0/2401455000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40c4390 0x7f3ad40c4820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097a0 tx=0x7f3acc02da50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a556ad3f289b17 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.576+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== osd.1 v2:172.21.15.37:6808/2348647226 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0bec075bb0 con 0x7f0bec0730e0 2023-11-24T06:14:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.576+0000 7f90fa2e8640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90f40cc500 0x7f90f40c8ad0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90e400be90 tx=0x7f90e400dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.576+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2428003830 con 0x7f243404ff40 2023-11-24T06:14:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f76aec6c640 1 -- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76a8162540 msgr2=0x7f76a8072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f76aec6c640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f76a8162540 0x7f76a8072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f76aec6c640 1 -- 172.21.15.37:0/4205163024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80ccbd0 msgr2=0x7f76a8158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f76aec6c640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80ccbd0 0x7f76a8158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f76aec6c640 1 -- 172.21.15.37:0/4205163024 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c009b30 con 0x7f76a81660b0 2023-11-24T06:14:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4007a90 con 0x7f90f40cc500 2023-11-24T06:14:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4007bf0 con 0x7f90f40cc500 2023-11-24T06:14:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f409c100 con 0x7f90f40cc500 2023-11-24T06:14:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.577+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f40c6600 con 0x7f90f40cc500 2023-11-24T06:14:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7f24397fa640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f242006ae90 0x7f242006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7ffac9a97640 1 Processor -- start 2023-11-24T06:14:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0588007450 con 0x7f058c0ceb10 2023-11-24T06:14:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24280ab1a0 con 0x7f243404ff40 2023-11-24T06:14:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7f3ad8aed640 1 -- 172.21.15.37:0/2401455000 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc031870 con 0x7f3ad40c4390 2023-11-24T06:14:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7f24397fa640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f24200730b0 0x7f24200754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 --> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2420075b80 con 0x7f24200730b0 2023-11-24T06:14:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.578+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24280ad8b0 con 0x7f243404ff40 2023-11-24T06:14:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f76aec6c640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76a81660b0 0x7f76a80c5420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76a000b410 tx=0x7f76a000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4021480 con 0x7f90f40cc500 2023-11-24T06:14:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f3ad8aed640 1 -- 172.21.15.37:0/2401455000 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc0319d0 con 0x7f3ad40c4390 2023-11-24T06:14:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f3ad8aed640 1 -- 172.21.15.37:0/2401455000 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc031d60 con 0x7f3ad40c4390 2023-11-24T06:14:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0011830 con 0x7f76a81660b0 2023-11-24T06:14:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a00119b0 con 0x7f76a81660b0 2023-11-24T06:14:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0011d60 con 0x7f76a81660b0 2023-11-24T06:14:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a8070c30 con 0x7f76a81660b0 2023-11-24T06:14:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90dc000fc0 con 0x7f90f40cc500 2023-11-24T06:14:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f3adbd53640 1 -- 172.21.15.37:0/2401455000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40c4390 msgr2=0x7f3ad40c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.579+0000 7f3adbd53640 1 --2- 172.21.15.37:0/2401455000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40c4390 0x7f3ad40c4820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097a0 tx=0x7f3acc02da50 comp rx=0 tx=0).stop 2023-11-24T06:14:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a80711f0 con 0x7f76a81660b0 2023-11-24T06:14:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f3adbd53640 1 -- 172.21.15.37:0/2401455000 shutdown_connections 2023-11-24T06:14:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f3adbd53640 1 --2- 172.21.15.37:0/2401455000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40c4390 0x7f3ad40c4820 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f3adbd53640 1 --2- 172.21.15.37:0/2401455000 >> v2:172.21.15.188:3300/0 conn(0x7f3ad4159650 0x7f3ad415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f3adbd53640 1 -- 172.21.15.37:0/2401455000 >> 172.21.15.37:0/2401455000 conn(0x7f3ad40b0c50 msgr2=0x7f3ad40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7ffac9a97640 1 -- start start 2023-11-24T06:14:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f05827fc640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f057006af10 0x7f057006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0588089280 con 0x7f058c0ceb10 2023-11-24T06:14:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f05827fc640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f0570073130 0x7f0570075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.581+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 --> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0570075c00 con 0x7f0570073130 2023-11-24T06:14:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.581+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0588089630 con 0x7f058c0ceb10 2023-11-24T06:14:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f243bfff640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f242006ae90 0x7f242006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.580+0000 7f2441038640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f24200730b0 0x7f24200754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.581+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76a8165b90 con 0x7f76a81660b0 2023-11-24T06:14:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.581+0000 7ffac9a97640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac40b1740 0x7ffac4144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.581+0000 7ffac9a97640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffac40c3ec0 0x7ffac40b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.581+0000 7f05923ee640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f0570073130 0x7f0570075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f90e40215e0 con 0x7f90f40cc500 2023-11-24T06:14:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7f243bfff640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f242006ae90 0x7f242006d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f243404fd80 tx=0x7f2430009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7f2441038640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f24200730b0 0x7f24200754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7f05913ec640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f057006af10 0x7f057006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.584+0000 7f3adbd53640 1 -- 172.21.15.37:0/2401455000 shutdown_connections 2023-11-24T06:14:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.581+0000 7ffac9a97640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac4159890 0x7ffac40b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac9a97640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4149060 con 0x7ffac40b1740 2023-11-24T06:14:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac9a97640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4144680 con 0x7ffac40c3ec0 2023-11-24T06:14:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac9a97640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4148aa0 con 0x7ffac4159890 2023-11-24T06:14:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac40b1740 0x7ffac4144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac40b1740 0x7ffac4144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44608/0 (socket says 172.21.15.37:44608) 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac37fe640 1 -- 172.21.15.37:0/1356814251 learned_addr learned my addr 172.21.15.37:0/1356814251 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac2ffd640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffac40c3ec0 0x7ffac40b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac3fff640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac4159890 0x7ffac40b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac37fe640 1 -- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac4159890 msgr2=0x7ffac40b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.582+0000 7ffac37fe640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffac4159890 0x7ffac40b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffac37fe640 1 -- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffac40c3ec0 msgr2=0x7ffac40b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffac37fe640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffac40c3ec0 0x7ffac40b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffac37fe640 1 -- 172.21.15.37:0/1356814251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009b30 con 0x7ffac40b1740 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffac2ffd640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffac40c3ec0 0x7ffac40b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffac37fe640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac40b1740 0x7ffac4144140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc03e450 con 0x7ffac40b1740 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc03e5d0 con 0x7ffac40b1740 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc03e980 con 0x7ffac40b1740 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac4148d80 con 0x7ffac40b1740 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.583+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac40b20e0 con 0x7ffac40b1740 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.585+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffac40cc330 con 0x7ffac40b1740 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.585+0000 7f05913ec640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f057006af10 0x7f057006d3d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f058c0cce50 tx=0x7f057c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.585+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== osd.2 v2:172.21.15.37:6800/276316987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2420075b80 con 0x7f24200730b0 2023-11-24T06:14:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.586+0000 7f05923ee640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f0570073130 0x7f0570075550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.586+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffabc02cd50 con 0x7ffac40b1740 2023-11-24T06:14:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.584+0000 7f3adbd53640 1 -- 172.21.15.37:0/2401455000 wait complete. 2023-11-24T06:14:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.586+0000 7f3adbd53640 1 Processor -- start 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.587+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76a001a400 con 0x7f76a81660b0 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.587+0000 7f3adbd53640 1 -- start start 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.589+0000 7f76a6ffd640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f769406ae40 0x7f769406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.588+0000 7ffaabfff640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffab006ae40 0x7ffab006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.588+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffabc0ac720 con 0x7ffac40b1740 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.588+0000 7ffaabfff640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7ffab0072fe0 0x7ffab0075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.588+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 --> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffab0075ab0 con 0x7ffab0072fe0 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.588+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffabc0acb70 con 0x7ffac40b1740 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.588+0000 7ffac2ffd640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffab006ae40 0x7ffab006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.589+0000 7ffac3fff640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7ffab0072fe0 0x7ffab0075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.589+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76a0089da0 con 0x7f76a81660b0 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.589+0000 7f76a6ffd640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f7694072fe0 0x7f7694075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.589+0000 7f76ae46b640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f769406ae40 0x7f769406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.589+0000 7ffac2ffd640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffab006ae40 0x7ffab006d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffab4006fd0 tx=0x7ffab4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.590+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== osd.4 v2:172.21.15.188:6824/146983005 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0570075c00 con 0x7f0570073130 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.586+0000 7f90eaffd640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f90d806ae40 0x7f90d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.586+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90e409a940 con 0x7f90f40cc500 2023-11-24T06:14:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.587+0000 7f90f9ae7640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f90d806ae40 0x7f90d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.587+0000 7f90eaffd640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7f90d8072fe0 0x7f90d8075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.587+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 --> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90d8075ab0 con 0x7f90d8072fe0 2023-11-24T06:14:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.587+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90e409f2a0 con 0x7f90f40cc500 2023-11-24T06:14:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.587+0000 7f90f9ae7640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f90d806ae40 0x7f90d806d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90f0007c90 tx=0x7f90f0007be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.589+0000 7f90faae9640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7f90d8072fe0 0x7f90d8075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.590+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 --> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7694075ab0 con 0x7f7694072fe0 2023-11-24T06:14:57.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.590+0000 7f3adbd53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad40c4390 0x7f3ad4203d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.590+0000 7f3adbd53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40ccc40 0x7f3ad40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.590+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76a008a150 con 0x7f76a81660b0 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.590+0000 7f3adbd53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad4159650 0x7f3ad41ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3ad9aef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad40c4390 0x7f3ad4203d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3ada2f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad4159650 0x7f3ad41ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3ada2f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad4159650 0x7f3ad41ffd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44612/0 (socket says 172.21.15.37:44612) 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3ada2f0640 1 -- 172.21.15.37:0/1503700212 learned_addr learned my addr 172.21.15.37:0/1503700212 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f76adc6a640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f7694072fe0 0x7f7694075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad42042d0 con 0x7f3ad4159650 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4203340 con 0x7f3ad40c4390 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3ad92ee640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40ccc40 0x7f3ad40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f76ae46b640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f769406ae40 0x7f769406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7698009a30 tx=0x7f7698009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.591+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad42008a0 con 0x7f3ad40ccc40 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.592+0000 7f90faae9640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7f90d8072fe0 0x7f90d8075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.592+0000 7f76adc6a640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f7694072fe0 0x7f7694075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.593+0000 7f3ad9aef640 1 -- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40ccc40 msgr2=0x7f3ad40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.593+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== osd.3 v2:172.21.15.37:6812/1198045157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f90d8075ab0 con 0x7f90d8072fe0 2023-11-24T06:14:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.593+0000 7f3ad9aef640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ad40ccc40 0x7f3ad40c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.593+0000 7f3ad9aef640 1 -- 172.21.15.37:0/1503700212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad4159650 msgr2=0x7f3ad41ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.593+0000 7f3ad9aef640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad4159650 0x7f3ad41ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.593+0000 7f3ad9aef640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8009d60 con 0x7f3ad40c4390 2023-11-24T06:14:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.593+0000 7ffac3fff640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7ffab0072fe0 0x7ffab0075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.594+0000 7f3ad9aef640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad40c4390 0x7f3ad4203d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800f950 tx=0x7f3ac800fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.594+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800c070 con 0x7f3ad40c4390 2023-11-24T06:14:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.595+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== osd.5 v2:172.21.15.188:6800/3786933785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7694075ab0 con 0x7f7694072fe0 2023-11-24T06:14:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.595+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac800dd10 con 0x7f3ad40c4390 2023-11-24T06:14:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.595+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8004270 con 0x7f3ad40c4390 2023-11-24T06:14:57.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.595+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc009400 con 0x7f3ad40c4390 2023-11-24T06:14:57.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.595+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad4203590 con 0x7f3ad40c4390 2023-11-24T06:14:57.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.596+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== osd.6 v2:172.21.15.188:6811/2333602039 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffab0075ab0 con 0x7ffab0072fe0 2023-11-24T06:14:57.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.596+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ad406c970 con 0x7f3ad40c4390 2023-11-24T06:14:57.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.600+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ac80043d0 con 0x7f3ad40c4390 2023-11-24T06:14:57.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.601+0000 7f3ad27fc640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3ac006ae40 0x7f3ac006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.601+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ac8089960 con 0x7f3ad40c4390 2023-11-24T06:14:57.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.601+0000 7f3ad27fc640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f3ac0073060 0x7f3ac0075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.602+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ac0075b30 con 0x7f3ac0073060 2023-11-24T06:14:57.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.602+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ac8089d10 con 0x7f3ad40c4390 2023-11-24T06:14:57.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.605+0000 7f3ada2f0640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f3ac0073060 0x7f3ac0075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.606+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 --> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c0c141840 con 0x7f0bec0730e0 2023-11-24T06:14:57.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.607+0000 7f3ad92ee640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3ac006ae40 0x7f3ac006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.608+0000 7f3ad92ee640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3ac006ae40 0x7f3ac006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4158980 tx=0x7f3ac4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.608+0000 7f0c09ffb640 1 -- 172.21.15.37:0/2646739211 <== osd.1 v2:172.21.15.37:6808/2348647226 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c0402d7a0 con 0x7f0bec0730e0 2023-11-24T06:14:57.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.608+0000 7f3ada2f0640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f3ac0073060 0x7f3ac0075480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.609+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f0bec0730e0 msgr2=0x7f0bec075500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.609+0000 7f0c12e09640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f0bec0730e0 0x7f0bec075500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.609+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0bec06aec0 msgr2=0x7f0bec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.609+0000 7f0c12e09640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0bec06aec0 0x7f0bec06d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c1430b0 tx=0x7f0bf4008040 comp rx=0 tx=0).stop 2023-11-24T06:14:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.609+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0709a0 msgr2=0x7f0c0c140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.609+0000 7f0c12e09640 1 --2- 172.21.15.37:0/2646739211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0709a0 0x7f0c0c140b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00c870 tx=0x7f0bfc00cd30 comp rx=0 tx=0).stop 2023-11-24T06:14:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.609+0000 7f0c113a6640 1 -- 172.21.15.37:0/2646739211 reap_dead start 2023-11-24T06:14:57.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.610+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 --> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f04002cb0 con 0x7f8f000730b0 2023-11-24T06:14:57.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.610+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 shutdown_connections 2023-11-24T06:14:57.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.610+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 >> 172.21.15.37:0/2646739211 conn(0x7f0c0c06ae10 msgr2=0x7f0c0c071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.610+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 shutdown_connections 2023-11-24T06:14:57.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.610+0000 7f0c12e09640 1 -- 172.21.15.37:0/2646739211 wait complete. 2023-11-24T06:14:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.611+0000 7f8f127fc640 1 -- 172.21.15.37:0/1602282746 <== osd.0 v2:172.21.15.37:6814/1821926241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f04002cb0 con 0x7f8f000730b0 2023-11-24T06:14:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7f8f000730b0 msgr2=0x7f8f000754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7f8f000730b0 0x7f8f000754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== osd.7 v2:172.21.15.188:6808/89402988 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3ac0075b30 con 0x7f3ac0073060 2023-11-24T06:14:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8f0006ae90 msgr2=0x7f8f0006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8f0006ae90 0x7f8f0006d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c151e00 tx=0x7f8f0c009240 comp rx=0 tx=0).stop 2023-11-24T06:14:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f08005180 msgr2=0x7f8f1c150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 --2- 172.21.15.37:0/1602282746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f08005180 0x7f8f1c150e50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800f4e0 tx=0x7f8f1800f9a0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f226d9640 1 -- 172.21.15.37:0/1602282746 reap_dead start 2023-11-24T06:14:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 shutdown_connections 2023-11-24T06:14:57.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.612+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 >> 172.21.15.37:0/1602282746 conn(0x7f8f1c0cbb40 msgr2=0x7f8f1c0cee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.614+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 shutdown_connections 2023-11-24T06:14:57.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.614+0000 7f8f22eda640 1 -- 172.21.15.37:0/1602282746 wait complete. 2023-11-24T06:14:57.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.615+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 --> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f058c0ce000 con 0x7f0570073130 2023-11-24T06:14:57.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.617+0000 7f05827fc640 1 -- 172.21.15.37:0/1017843362 <== osd.4 v2:172.21.15.188:6824/146983005 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0584003990 con 0x7f0570073130 2023-11-24T06:14:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.617+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f0570073130 msgr2=0x7f0570075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.617+0000 7f0593e51640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f0570073130 0x7f0570075550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f057006af10 msgr2=0x7f057006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f0593e51640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f057006af10 0x7f057006d3d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f058c0cce50 tx=0x7f057c009190 comp rx=0 tx=0).stop 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c0ceb10 msgr2=0x7f058c159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f0593e51640 1 --2- 172.21.15.37:0/1017843362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f058c0ceb10 0x7f058c159a40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f058800c430 tx=0x7f058800c8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f05923ee640 1 -- 172.21.15.37:0/1017843362 reap_dead start 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 shutdown_connections 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 >> 172.21.15.37:0/1017843362 conn(0x7f058c08af60 msgr2=0x7f058c0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.618+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 shutdown_connections 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.619+0000 7f0593e51640 1 -- 172.21.15.37:0/1017843362 wait complete. 2023-11-24T06:14:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.621+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 --> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffac404e8b0 con 0x7ffab0072fe0 2023-11-24T06:14:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.622+0000 7ffaabfff640 1 -- 172.21.15.37:0/1356814251 <== osd.6 v2:172.21.15.188:6811/2333602039 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffac404e8b0 con 0x7ffab0072fe0 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.623+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7ffab0072fe0 msgr2=0x7ffab0075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.623+0000 7ffac9a97640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7ffab0072fe0 0x7ffab0075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.624+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffab006ae40 msgr2=0x7ffab006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.624+0000 7ffac9a97640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffab006ae40 0x7ffab006d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffab4006fd0 tx=0x7ffab4008040 comp rx=0 tx=0).stop 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.624+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac40b1740 msgr2=0x7ffac4144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.624+0000 7ffac9a97640 1 --2- 172.21.15.37:0/1356814251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac40b1740 0x7ffac4144140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.625+0000 7ffac3fff640 1 -- 172.21.15.37:0/1356814251 reap_dead start 2023-11-24T06:14:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.625+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 shutdown_connections 2023-11-24T06:14:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.625+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 >> 172.21.15.37:0/1356814251 conn(0x7ffac40b0c50 msgr2=0x7ffac40c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.626+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 shutdown_connections 2023-11-24T06:14:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.629+0000 7ffac9a97640 1 -- 172.21.15.37:0/1356814251 wait complete. 2023-11-24T06:14:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.628+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 --> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24340541e0 con 0x7f24200730b0 2023-11-24T06:14:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.629+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 --> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90dc002cb0 con 0x7f90d8072fe0 2023-11-24T06:14:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.630+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 --> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76a81658b0 con 0x7f7694072fe0 2023-11-24T06:14:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.630+0000 7f24397fa640 1 -- 172.21.15.37:0/3020203309 <== osd.2 v2:172.21.15.37:6800/276316987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f243c04e840 con 0x7f24200730b0 2023-11-24T06:14:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.631+0000 7f76a6ffd640 1 -- 172.21.15.37:0/4205163024 <== osd.5 v2:172.21.15.188:6800/3786933785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f769c03f410 con 0x7f7694072fe0 2023-11-24T06:14:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.631+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f24200730b0 msgr2=0x7f24200754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.631+0000 7f2442a9b640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f24200730b0 0x7f24200754d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.632+0000 7f90eaffd640 1 -- 172.21.15.37:0/1054406610 <== osd.3 v2:172.21.15.37:6812/1198045157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90dc002cb0 con 0x7f90d8072fe0 2023-11-24T06:14:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.632+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f242006ae90 msgr2=0x7f242006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.632+0000 7f2442a9b640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f242006ae90 0x7f242006d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f243404fd80 tx=0x7f2430009040 comp rx=0 tx=0).stop 2023-11-24T06:14:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.632+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243404ff40 msgr2=0x7f24340d5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.632+0000 7f2442a9b640 1 --2- 172.21.15.37:0/3020203309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243404ff40 0x7f24340d5fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24280098c0 tx=0x7f24280046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.632+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f7694072fe0 msgr2=0x7f7694075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.632+0000 7f76b06cf640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f7694072fe0 0x7f7694075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.633+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7f90d8072fe0 msgr2=0x7f90d8075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.676 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:14:57.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T06:14:57.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.633+0000 7f2441038640 1 -- 172.21.15.37:0/3020203309 reap_dead start 2023-11-24T06:14:57.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.633+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 shutdown_connections 2023-11-24T06:14:57.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.633+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 >> 172.21.15.37:0/3020203309 conn(0x7f2434009f70 msgr2=0x7f2434035bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.633+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 shutdown_connections 2023-11-24T06:14:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.633+0000 7f2442a9b640 1 -- 172.21.15.37:0/3020203309 wait complete. 2023-11-24T06:14:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.633+0000 7f90fc54c640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7f90d8072fe0 0x7f90d8075400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f769406ae40 msgr2=0x7f769406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f76b06cf640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f769406ae40 0x7f769406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7698009a30 tx=0x7f7698009190 comp rx=0 tx=0).stop 2023-11-24T06:14:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76a81660b0 msgr2=0x7f76a80c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f90d806ae40 msgr2=0x7f90d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f90d806ae40 0x7f90d806d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90f0007c90 tx=0x7f90f0007be0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f76b06cf640 1 --2- 172.21.15.37:0/4205163024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76a81660b0 0x7f76a80c5420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76a000b410 tx=0x7f76a000b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f76aec6c640 1 -- 172.21.15.37:0/4205163024 reap_dead start 2023-11-24T06:14:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90f40cc500 msgr2=0x7f90f40c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 --2- 172.21.15.37:0/1054406610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90f40cc500 0x7f90f40c8ad0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90e400be90 tx=0x7f90e400dd90 comp rx=0 tx=0).stop 2023-11-24T06:14:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90faae9640 1 -- 172.21.15.37:0/1054406610 reap_dead start 2023-11-24T06:14:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 shutdown_connections 2023-11-24T06:14:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 >> 172.21.15.37:0/1054406610 conn(0x7f90f40b0c50 msgr2=0x7f90f40704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 shutdown_connections 2023-11-24T06:14:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f90fc54c640 1 -- 172.21.15.37:0/1054406610 wait complete. 2023-11-24T06:14:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 shutdown_connections 2023-11-24T06:14:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.634+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 >> 172.21.15.37:0/4205163024 conn(0x7f76a80b0c50 msgr2=0x7f76a80ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.635+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 shutdown_connections 2023-11-24T06:14:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.635+0000 7f76b06cf640 1 -- 172.21.15.37:0/4205163024 wait complete. 2023-11-24T06:14:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.638+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 --> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ad406c690 con 0x7f3ac0073060 2023-11-24T06:14:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.640+0000 7f3ad27fc640 1 -- 172.21.15.37:0/1503700212 <== osd.7 v2:172.21.15.188:6808/89402988 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3acc0317b0 con 0x7f3ac0073060 2023-11-24T06:14:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.640+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f3ac0073060 msgr2=0x7f3ac0075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.641+0000 7f3adbd53640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f3ac0073060 0x7f3ac0075480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.641+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3ac006ae40 msgr2=0x7f3ac006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.641+0000 7f3adbd53640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3ac006ae40 0x7f3ac006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4158980 tx=0x7f3ac4009040 comp rx=0 tx=0).stop 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.641+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad40c4390 msgr2=0x7f3ad4203d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.641+0000 7f3adbd53640 1 --2- 172.21.15.37:0/1503700212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ad40c4390 0x7f3ad4203d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800f950 tx=0x7f3ac800fe10 comp rx=0 tx=0).stop 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.641+0000 7f3ada2f0640 1 -- 172.21.15.37:0/1503700212 reap_dead start 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.642+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 shutdown_connections 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.642+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 >> 172.21.15.37:0/1503700212 conn(0x7f3ad40b0c50 msgr2=0x7f3ad40af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.642+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 shutdown_connections 2023-11-24T06:14:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:57.642+0000 7f3adbd53640 1 -- 172.21.15.37:0/1503700212 wait complete. 2023-11-24T06:14:57.684 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:14:57.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:14:57.685 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-11-24T06:14:57.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T06:14:57.686 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:14:57.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:14:57.687 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-11-24T06:14:57.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T06:14:57.688 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-11-24T06:14:57.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T06:14:57.689 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-11-24T06:14:57.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T06:14:57.690 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-11-24T06:14:57.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:14:58.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.020+0000 7f7db3fff640 1 Processor -- start 2023-11-24T06:14:58.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.020+0000 7f7db3fff640 1 -- start start 2023-11-24T06:14:58.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.022+0000 7f7db3fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db40cd3a0 0x7f7db40cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.023+0000 7f7db3fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db416ec30 con 0x7f7db40cea40 2023-11-24T06:14:58.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.023+0000 7f7db3fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db408a210 con 0x7f7db416e7d0 2023-11-24T06:14:58.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.023+0000 7f7db37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db40cd3a0 0x7f7db40cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.024+0000 7f7db37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db40cd3a0 0x7f7db40cd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49454/0 (socket says 172.21.15.37:49454) 2023-11-24T06:14:58.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.024+0000 7f7db37fe640 1 -- 172.21.15.37:0/1704604018 learned_addr learned my addr 172.21.15.37:0/1704604018 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.024+0000 7f7db3fff640 1 -- 172.21.15.37:0/1704604018 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40c97b0 con 0x7f7db40cd3a0 2023-11-24T06:14:58.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.025+0000 7f7db37fe640 1 -- 172.21.15.37:0/1704604018 >> v1:172.21.15.188:6789/0 conn(0x7f7db416e7d0 legacy=0x7f7db40ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.025+0000 7f7db37fe640 1 -- 172.21.15.37:0/1704604018 >> v1:172.21.15.37:6789/0 conn(0x7f7db40cea40 legacy=0x7f7db40cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.025+0000 7f7db37fe640 1 -- 172.21.15.37:0/1704604018 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db40c9a90 con 0x7f7db40cd3a0 2023-11-24T06:14:58.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.027+0000 7f7db37fe640 1 --2- 172.21.15.37:0/1704604018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db40cd3a0 0x7f7db40cd830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7da800aa40 tx=0x7f7da802ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b4d845fcf2623e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.028+0000 7f7db1ffb640 1 -- 172.21.15.37:0/1704604018 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da802dc80 con 0x7f7db40cd3a0 2023-11-24T06:14:58.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.028+0000 7f7db1ffb640 1 -- 172.21.15.37:0/1704604018 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da802dde0 con 0x7f7db40cd3a0 2023-11-24T06:14:58.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.028+0000 7f7db1ffb640 1 -- 172.21.15.37:0/1704604018 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8035660 con 0x7f7db40cd3a0 2023-11-24T06:14:58.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.029+0000 7f7db3fff640 1 -- 172.21.15.37:0/1704604018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db40cd3a0 msgr2=0x7f7db40cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.029+0000 7f7db3fff640 1 --2- 172.21.15.37:0/1704604018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db40cd3a0 0x7f7db40cd830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7da800aa40 tx=0x7f7da802ced0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.030+0000 7f7db3fff640 1 -- 172.21.15.37:0/1704604018 shutdown_connections 2023-11-24T06:14:58.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.030+0000 7f7db3fff640 1 --2- 172.21.15.37:0/1704604018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db40cd3a0 0x7f7db40cd830 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.030+0000 7f7db3fff640 1 -- 172.21.15.37:0/1704604018 >> 172.21.15.37:0/1704604018 conn(0x7f7db40cbb40 msgr2=0x7f7db40cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.030+0000 7f7db3fff640 1 -- 172.21.15.37:0/1704604018 shutdown_connections 2023-11-24T06:14:58.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.030+0000 7f7db3fff640 1 -- 172.21.15.37:0/1704604018 wait complete. 2023-11-24T06:14:58.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.033+0000 7f7db3fff640 1 Processor -- start 2023-11-24T06:14:58.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.033+0000 7fcf06851640 1 Processor -- start 2023-11-24T06:14:58.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.034+0000 7fcf06851640 1 -- start start 2023-11-24T06:14:58.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.034+0000 7f7db3fff640 1 -- start start 2023-11-24T06:14:58.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.035+0000 7f7db3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7db40cd3a0 0x7f7db40b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.035+0000 7f7db3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40cea40 0x7f7db40b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.035+0000 7f7db3fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db416e7d0 0x7f7db40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.035+0000 7f7db3fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db416ae50 con 0x7f7db40cea40 2023-11-24T06:14:58.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.035+0000 7f7db3fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db416a240 con 0x7f7db40cd3a0 2023-11-24T06:14:58.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.035+0000 7f7db3fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db416a520 con 0x7f7db416e7d0 2023-11-24T06:14:58.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.036+0000 7f7db27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40cea40 0x7f7db40b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.036+0000 7f7db27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40cea40 0x7f7db40b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44618/0 (socket says 172.21.15.37:44618) 2023-11-24T06:14:58.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.036+0000 7f7db27fc640 1 -- 172.21.15.37:0/4083995037 learned_addr learned my addr 172.21.15.37:0/4083995037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.036+0000 7fcf06851640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcef80501a0 0x7fcef8038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7f7db27fc640 1 -- 172.21.15.37:0/4083995037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db416e7d0 msgr2=0x7f7db40b2200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7f7db27fc640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db416e7d0 0x7f7db40b2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7f7db27fc640 1 -- 172.21.15.37:0/4083995037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7db40cd3a0 msgr2=0x7f7db40b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7f7db27fc640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7db40cd3a0 0x7f7db40b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7f7db27fc640 1 -- 172.21.15.37:0/4083995037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da800a670 con 0x7f7db40cea40 2023-11-24T06:14:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7f7db27fc640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40cea40 0x7f7db40b1cc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c400 tx=0x7f7da400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.036+0000 7fcf06851640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcef8053c70 0x7fcef8006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7fcefffff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fcef80df220 0x7fcef804fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50414/0 (socket says 172.21.15.37:50414) 2023-11-24T06:14:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.037+0000 7fcefffff640 1 -- 172.21.15.37:0/737421113 learned_addr learned my addr 172.21.15.37:0/737421113 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7fcf04dee640 1 --2- 172.21.15.37:0/737421113 >> v2:172.21.15.37:3300/0 conn(0x7fcef8053c70 0x7fcef8006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7fceff7fe640 1 --2- 172.21.15.37:0/737421113 >> v2:172.21.15.188:3300/0 conn(0x7fcef80501a0 0x7fcef8038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7f2e51fb0640 1 Processor -- start 2023-11-24T06:14:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80544c0 con 0x7fcef80df220 2023-11-24T06:14:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80541e0 con 0x7fcef8053c70 2023-11-24T06:14:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7f2e51fb0640 1 -- start start 2023-11-24T06:14:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7f7d9b7fe640 1 -- 172.21.15.37:0/4083995037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da40052d0 con 0x7f7db40cea40 2023-11-24T06:14:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7f7d9b7fe640 1 -- 172.21.15.37:0/4083995037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4005430 con 0x7f7db40cea40 2023-11-24T06:14:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7f7d9b7fe640 1 -- 172.21.15.37:0/4083995037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4007240 con 0x7f7db40cea40 2023-11-24T06:14:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.038+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef8005f30 con 0x7fcef80501a0 2023-11-24T06:14:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.039+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546531197 0 0) 0x7fcef80544c0 con 0x7fcef80df220 2023-11-24T06:14:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.039+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef0003520 con 0x7fcef80df220 2023-11-24T06:14:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.039+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db416a800 con 0x7f7db40cea40 2023-11-24T06:14:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db40b4f20 con 0x7f7db40cea40 2023-11-24T06:14:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2889125533 0 0) 0x7fcef0003520 con 0x7fcef80df220 2023-11-24T06:14:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 >> v2:172.21.15.188:3300/0 conn(0x7fcef80501a0 msgr2=0x7fcef8038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 --2- 172.21.15.37:0/737421113 >> v2:172.21.15.188:3300/0 conn(0x7fcef80501a0 0x7fcef8038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 >> v2:172.21.15.37:3300/0 conn(0x7fcef8053c70 msgr2=0x7fcef8006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 --2- 172.21.15.37:0/737421113 >> v2:172.21.15.37:3300/0 conn(0x7fcef8053c70 0x7fcef8006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8006210 con 0x7fcef80df220 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fcef4001670 con 0x7fcef80df220 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 >> v1:172.21.15.188:6789/0 conn(0x7fcef80df220 legacy=0x7fcef804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef0003970 0x7fcef0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef00047c0 0x7fcef0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef0005180 0x7fcef000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80541e0 con 0x7fcef0003970 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8005f30 con 0x7fcef0005180 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00148b0 con 0x7fcef00047c0 2023-11-24T06:14:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.041+0000 7fcf04dee640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef0005180 0x7fcef000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7f2e51fb0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e4c0d31a0 0x7f2e4c0d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7f2e51fb0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e4c0ce010 0x7f2e4c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7f2e51fb0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0d1070 con 0x7f2e4c1609e0 2023-11-24T06:14:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7f2e51fb0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0d3b50 con 0x7f2e4c0ce010 2023-11-24T06:14:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.040+0000 7f2e51fb0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0cedc0 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.041+0000 7f2e4bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e4c0ce010 0x7f2e4c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.041+0000 7efc822ff640 1 Processor -- start 2023-11-24T06:14:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.041+0000 7efc822ff640 1 -- start start 2023-11-24T06:14:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.042+0000 7f2e4b7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f2e4c1609e0 0x7f2e4c06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50418/0 (socket says 172.21.15.37:50418) 2023-11-24T06:14:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.042+0000 7f2e4b7fe640 1 -- 172.21.15.37:0/2547414680 learned_addr learned my addr 172.21.15.37:0/2547414680 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.042+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db404e840 con 0x7f7db40cea40 2023-11-24T06:14:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.042+0000 7f2e4bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e4c0ce010 0x7f2e4c0ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44632/0 (socket says 172.21.15.37:44632) 2023-11-24T06:14:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.042+0000 7fcefffff640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef0003970 0x7fcef0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.042+0000 7fceff7fe640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef00047c0 0x7fcef0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7fcf04dee640 1 -- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef00047c0 msgr2=0x7fcef0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7fcf04dee640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef00047c0 0x7fcef0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7fcf04dee640 1 -- 172.21.15.37:0/737421113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef0003970 msgr2=0x7fcef0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7fcf04dee640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef0003970 0x7fcef0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7fcf04dee640 1 -- 172.21.15.37:0/737421113 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8006210 con 0x7fcef0005180 2023-11-24T06:14:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7fcefffff640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef0003970 0x7fcef0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7f2e4bfff640 1 -- 172.21.15.37:0/2547414680 >> v2:172.21.15.188:3300/0 conn(0x7f2e4c0d31a0 msgr2=0x7f2e4c0d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7f2e4affd640 1 --2- 172.21.15.37:0/2547414680 >> v2:172.21.15.188:3300/0 conn(0x7f2e4c0d31a0 0x7f2e4c0d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7f2e4bfff640 1 --2- 172.21.15.37:0/2547414680 >> v2:172.21.15.188:3300/0 conn(0x7f2e4c0d31a0 0x7f2e4c0d3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7f2e4bfff640 1 -- 172.21.15.37:0/2547414680 >> v1:172.21.15.188:6789/0 conn(0x7f2e4c1609e0 legacy=0x7f2e4c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7f2e4bfff640 1 -- 172.21.15.37:0/2547414680 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0cf0a0 con 0x7f2e4c0ce010 2023-11-24T06:14:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7f2e4affd640 1 --2- 172.21.15.37:0/2547414680 >> v2:172.21.15.188:3300/0 conn(0x7f2e4c0d31a0 0x7f2e4c0d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.044+0000 7fcf04dee640 1 -- 172.21.15.37:0/737421113 reap_dead start 2023-11-24T06:14:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.043+0000 7efc822ff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efc74033960 0x7efc74054390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.044+0000 7efc822ff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740069a0 con 0x7efc74038320 2023-11-24T06:14:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.044+0000 7efc822ff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc74053dd0 con 0x7efc74007160 2023-11-24T06:14:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.044+0000 7efc822ff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740540b0 con 0x7efc74033960 2023-11-24T06:14:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.044+0000 7efc81afe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc74038320 0x7efc74052c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47516/0 (socket says 172.21.15.37:47516) 2023-11-24T06:14:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.044+0000 7efc81afe640 1 -- 172.21.15.37:0/2755881602 learned_addr learned my addr 172.21.15.37:0/2755881602 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.044+0000 7efc812fd640 1 --2- 172.21.15.37:0/2755881602 >> v2:172.21.15.188:3300/0 conn(0x7efc74033960 0x7efc74054390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.045+0000 7f2e4bfff640 1 --2- 172.21.15.37:0/2547414680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c0ce010 0x7f2e4c0ce430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0d43c0 tx=0x7f2e3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f2ebd9b2eb2ebb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.045+0000 7efc812fd640 1 -- 172.21.15.37:0/2755881602 >> v1:172.21.15.188:6789/0 conn(0x7efc74007160 legacy=0x7efc74037c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.045+0000 7efc812fd640 1 -- 172.21.15.37:0/2755881602 >> v1:172.21.15.37:6789/0 conn(0x7efc74038320 legacy=0x7efc74052c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.045+0000 7efc812fd640 1 -- 172.21.15.37:0/2755881602 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74006c40 con 0x7efc74033960 2023-11-24T06:14:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.046+0000 7fcf42da5640 1 Processor -- start 2023-11-24T06:14:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.046+0000 7fcf04dee640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef0005180 0x7fcef000b980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf00064180 tx=0x7fcef00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f37a1d015e27f2d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.046+0000 7fcf42da5640 1 -- start start 2023-11-24T06:14:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.047+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000b0420 con 0x7fcef0005180 2023-11-24T06:14:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.047+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf000a9070 con 0x7fcef0005180 2023-11-24T06:14:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.047+0000 7f7d9b7fe640 1 -- 172.21.15.37:0/4083995037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7da40073a0 con 0x7f7db40cea40 2023-11-24T06:14:58.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.047+0000 7fcefeffd640 1 -- 172.21.15.37:0/737421113 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000b0780 con 0x7fcef0005180 2023-11-24T06:14:58.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.047+0000 7efc812fd640 1 --2- 172.21.15.37:0/2755881602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74033960 0x7efc74054390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc780097a0 tx=0x7efc7802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9fed15088c874ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf42da5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf3c1609e0 0x7fcf3c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf42da5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcf3c0d31a0 0x7fcf3c0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf42da5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c06c1f0 con 0x7fcf3c0ce010 2023-11-24T06:14:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef0005180 msgr2=0x7fcef000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf06851640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef0005180 0x7fcef000b980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf00064180 tx=0x7fcef00057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7efc73fff640 1 -- 172.21.15.37:0/2755881602 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78031830 con 0x7efc74033960 2023-11-24T06:14:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7efc73fff640 1 -- 172.21.15.37:0/2755881602 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc78031990 con 0x7efc74033960 2023-11-24T06:14:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7efc73fff640 1 -- 172.21.15.37:0/2755881602 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78031d20 con 0x7efc74033960 2023-11-24T06:14:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf42da5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0ceb40 con 0x7fcf3c1609e0 2023-11-24T06:14:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf42da5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0d1070 con 0x7fcf3c0d31a0 2023-11-24T06:14:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 shutdown_connections 2023-11-24T06:14:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf06851640 1 --2- 172.21.15.37:0/737421113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef0005180 0x7fcef000b980 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.048+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 >> 172.21.15.37:0/737421113 conn(0x7fcef8009fb0 msgr2=0x7fcef800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7fcf41342640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcf3c0ce010 0x7fcf3c0ce430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47528/0 (socket says 172.21.15.37:47528) 2023-11-24T06:14:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 shutdown_connections 2023-11-24T06:14:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7fcf06851640 1 -- 172.21.15.37:0/737421113 wait complete. 2023-11-24T06:14:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7efc822ff640 1 -- 172.21.15.37:0/2755881602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74033960 msgr2=0x7efc74054390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7efc822ff640 1 --2- 172.21.15.37:0/2755881602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74033960 0x7efc74054390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc780097a0 tx=0x7efc7802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7f7d9b7fe640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da006af10 0x7f7da006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7f7db2ffd640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da006af10 0x7f7da006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7f7d9b7fe640 1 -- 172.21.15.37:0/4083995037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7da4088f40 con 0x7f7db40cea40 2023-11-24T06:14:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7fcf41342640 1 -- 172.21.15.37:0/12670190 learned_addr learned my addr 172.21.15.37:0/12670190 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7efc822ff640 1 -- 172.21.15.37:0/2755881602 shutdown_connections 2023-11-24T06:14:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7efc822ff640 1 --2- 172.21.15.37:0/2755881602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74033960 0x7efc74054390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7efc822ff640 1 -- 172.21.15.37:0/2755881602 >> 172.21.15.37:0/2755881602 conn(0x7efc74009f80 msgr2=0x7efc7400a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.049+0000 7efc822ff640 1 -- 172.21.15.37:0/2755881602 shutdown_connections 2023-11-24T06:14:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.050+0000 7fcf40b41640 1 --2- 172.21.15.37:0/12670190 >> v2:172.21.15.37:3300/0 conn(0x7fcf3c1609e0 0x7fcf3c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.050+0000 7efc822ff640 1 -- 172.21.15.37:0/2755881602 wait complete. 2023-11-24T06:14:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.050+0000 7fcf33fff640 1 --2- 172.21.15.37:0/12670190 >> v2:172.21.15.188:3300/0 conn(0x7fcf3c0d31a0 0x7fcf3c0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.051+0000 7fcf40b41640 1 -- 172.21.15.37:0/12670190 >> v2:172.21.15.188:3300/0 conn(0x7fcf3c0d31a0 msgr2=0x7fcf3c0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.051+0000 7fcf40b41640 1 --2- 172.21.15.37:0/12670190 >> v2:172.21.15.188:3300/0 conn(0x7fcf3c0d31a0 0x7fcf3c0d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.051+0000 7fcf40b41640 1 -- 172.21.15.37:0/12670190 >> v1:172.21.15.37:6789/0 conn(0x7fcf3c0ce010 legacy=0x7fcf3c0ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.051+0000 7fcf40b41640 1 -- 172.21.15.37:0/12670190 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0d3b70 con 0x7fcf3c1609e0 2023-11-24T06:14:58.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.051+0000 7f7db2ffd640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da006af10 0x7f7da006d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0012e0 tx=0x7f7dac007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.052+0000 7fcf06851640 1 Processor -- start 2023-11-24T06:14:58.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.052+0000 7fcf06851640 1 -- start start 2023-11-24T06:14:58.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7f2e4a7fc640 1 -- 172.21.15.37:0/2547414680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34031640 con 0x7f2e4c0ce010 2023-11-24T06:14:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7f2e4a7fc640 1 -- 172.21.15.37:0/2547414680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e340317a0 con 0x7f2e4c0ce010 2023-11-24T06:14:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7f2e4a7fc640 1 -- 172.21.15.37:0/2547414680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34031b70 con 0x7f2e4c0ce010 2023-11-24T06:14:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7efc822ff640 1 Processor -- start 2023-11-24T06:14:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7fcf40b41640 1 --2- 172.21.15.37:0/12670190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c06bcb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0d43c0 tx=0x7fcf2c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c3d4dc348bdb76 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7f7d9b7fe640 1 -- 172.21.15.37:0/4083995037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7da4054060 con 0x7f7db40cea40 2023-11-24T06:14:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7fcf3bfff640 1 -- 172.21.15.37:0/12670190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c02cc70 con 0x7fcf3c1609e0 2023-11-24T06:14:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7fcf3bfff640 1 -- 172.21.15.37:0/12670190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c02cdd0 con 0x7fcf3c1609e0 2023-11-24T06:14:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7fcf3bfff640 1 -- 172.21.15.37:0/12670190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c034660 con 0x7fcf3c1609e0 2023-11-24T06:14:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7f2e51fb0640 1 -- 172.21.15.37:0/2547414680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c0ce010 msgr2=0x7f2e4c0ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/2547414680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c0ce010 0x7f2e4c0ce430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0d43c0 tx=0x7f2e3402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7fcf06851640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef0005180 0x7fcef80331f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7fcf06851640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef80d8c70 0x7fcef804bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.053+0000 7fcf06851640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef80e1dc0 0x7fcef80e2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7fcf06851640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef804d080 con 0x7fcef80e1dc0 2023-11-24T06:14:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7fcf06851640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80e2780 con 0x7fcef80d8c70 2023-11-24T06:14:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7fcf06851640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef804d4a0 con 0x7fcef0005180 2023-11-24T06:14:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7efc822ff640 1 -- start start 2023-11-24T06:14:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7f2e51fb0640 1 -- 172.21.15.37:0/2547414680 shutdown_connections 2023-11-24T06:14:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/2547414680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c0ce010 0x7f2e4c0ce430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/2547414680 >> v2:172.21.15.188:3300/0 conn(0x7f2e4c0d31a0 0x7f2e4c0d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.054+0000 7f2e51fb0640 1 -- 172.21.15.37:0/2547414680 >> 172.21.15.37:0/2547414680 conn(0x7f2e4c08af60 msgr2=0x7f2e4c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcf42da5640 1 -- 172.21.15.37:0/12670190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c1609e0 msgr2=0x7fcf3c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcf42da5640 1 --2- 172.21.15.37:0/12670190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c06bcb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0d43c0 tx=0x7fcf2c02bec0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7f2e51fb0640 1 -- 172.21.15.37:0/2547414680 shutdown_connections 2023-11-24T06:14:58.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcefffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef0005180 0x7fcef80331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcefffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef0005180 0x7fcef80331f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49486/0 (socket says 172.21.15.37:49486) 2023-11-24T06:14:58.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcefffff640 1 -- 172.21.15.37:0/221857599 learned_addr learned my addr 172.21.15.37:0/221857599 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcf04dee640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef80e1dc0 0x7fcef80e2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fceff7fe640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef80d8c70 0x7fcef804bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcf42da5640 1 -- 172.21.15.37:0/12670190 shutdown_connections 2023-11-24T06:14:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcf42da5640 1 --2- 172.21.15.37:0/12670190 >> v2:172.21.15.188:3300/0 conn(0x7fcf3c0d31a0 0x7fcf3c0d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcf42da5640 1 --2- 172.21.15.37:0/12670190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c06bcb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7fcf42da5640 1 -- 172.21.15.37:0/12670190 >> 172.21.15.37:0/12670190 conn(0x7fcf3c08af60 msgr2=0x7fcf3c09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7efc822ff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74007160 0x7efc74049920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7fcf04dee640 1 -- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef0005180 msgr2=0x7fcef80331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7efc822ff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc74033960 0x7efc740eddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7efc822ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc74038320 0x7efc74036150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7fcf04dee640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef0005180 0x7fcef80331f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7fcf04dee640 1 -- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef80d8c70 msgr2=0x7fcef804bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7fcf04dee640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef80d8c70 0x7fcef804bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7fcf04dee640 1 -- 172.21.15.37:0/221857599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef804c400 con 0x7fcef80e1dc0 2023-11-24T06:14:58.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.056+0000 7fceff7fe640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef80d8c70 0x7fcef804bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc812fd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74007160 0x7efc74049920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc812fd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74007160 0x7efc74049920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:53020/0 (socket says 172.21.15.37:53020) 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc81afe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc74038320 0x7efc74036150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc81afe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc74038320 0x7efc74036150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44674/0 (socket says 172.21.15.37:44674) 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc812fd640 1 -- 172.21.15.37:0/546579921 learned_addr learned my addr 172.21.15.37:0/546579921 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc80afc640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc74033960 0x7efc740eddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740ee760 con 0x7efc74038320 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740f04c0 con 0x7efc74007160 2023-11-24T06:14:58.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7404a410 con 0x7efc74033960 2023-11-24T06:14:58.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.057+0000 7fcf04dee640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef80e1dc0 0x7fcef80e2240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf000681f0 tx=0x7fcf0006a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.055+0000 7f2e51fb0640 1 -- 172.21.15.37:0/2547414680 wait complete. 2023-11-24T06:14:58.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7f2e51fb0640 1 Processor -- start 2023-11-24T06:14:58.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7fcf42da5640 1 -- 172.21.15.37:0/12670190 shutdown_connections 2023-11-24T06:14:58.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7fcefcff9640 1 -- 172.21.15.37:0/221857599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000b9400 con 0x7fcef80e1dc0 2023-11-24T06:14:58.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7fcf42da5640 1 -- 172.21.15.37:0/12670190 wait complete. 2023-11-24T06:14:58.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7fcefcff9640 1 -- 172.21.15.37:0/221857599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf000b9560 con 0x7fcef80e1dc0 2023-11-24T06:14:58.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7fcefcff9640 1 -- 172.21.15.37:0/221857599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000b98d0 con 0x7fcef80e1dc0 2023-11-24T06:14:58.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef804c6e0 con 0x7fcef80e1dc0 2023-11-24T06:14:58.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.058+0000 7efc812fd640 1 -- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc74033960 msgr2=0x7efc740eddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.059+0000 7efc812fd640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc74033960 0x7efc740eddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.059+0000 7efc812fd640 1 -- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc74038320 msgr2=0x7efc74036150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.059+0000 7efc812fd640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc74038320 0x7efc74036150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.059+0000 7efc812fd640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc78009400 con 0x7efc74007160 2023-11-24T06:14:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.059+0000 7efc81afe640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc74038320 0x7efc74036150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.060+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef804cca0 con 0x7fcef80e1dc0 2023-11-24T06:14:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.060+0000 7efc812fd640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74007160 0x7efc74049920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc780098c0 tx=0x7efc780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.061+0000 7efc71ffb640 1 -- 172.21.15.37:0/546579921 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7803bbf0 con 0x7efc74007160 2023-11-24T06:14:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.061+0000 7efc71ffb640 1 -- 172.21.15.37:0/546579921 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7803bd50 con 0x7efc74007160 2023-11-24T06:14:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.061+0000 7efc71ffb640 1 -- 172.21.15.37:0/546579921 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78045630 con 0x7efc74007160 2023-11-24T06:14:58.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.060+0000 7f2e51fb0640 1 -- start start 2023-11-24T06:14:58.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.061+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc740f06d0 con 0x7efc74007160 2023-11-24T06:14:58.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.061+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc740f0c90 con 0x7efc74007160 2023-11-24T06:14:58.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.062+0000 7fcefcff9640 1 -- 172.21.15.37:0/221857599 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf000e0060 con 0x7fcef80e1dc0 2023-11-24T06:14:58.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.063+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc740ee8a0 con 0x7efc74007160 2023-11-24T06:14:58.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.063+0000 7fcf42da5640 1 Processor -- start 2023-11-24T06:14:58.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.063+0000 7fcf42da5640 1 -- start start 2023-11-24T06:14:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.064+0000 7f2e51fb0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e4c0ce010 0x7f2e4c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.064+0000 7f2e51fb0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e4c0d31a0 0x7f2e4c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.064+0000 7f2e51fb0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c1609e0 0x7f2e4c0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e51fb0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15df50 con 0x7f2e4c1609e0 2023-11-24T06:14:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e4b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e4c0ce010 0x7f2e4c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c1609e0 0x7f2e4c0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef804d1c0 con 0x7fcef80e1dc0 2023-11-24T06:14:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c1609e0 0x7f2e4c0b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44688/0 (socket says 172.21.15.37:44688) 2023-11-24T06:14:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e4bfff640 1 -- 172.21.15.37:0/3772098442 learned_addr learned my addr 172.21.15.37:0/3772098442 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7fcf42da5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf3c0ce010 0x7fcf3c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0c7340 con 0x7f2e4c0ce010 2023-11-24T06:14:58.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0b4370 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7f2e4affd640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e4c0d31a0 0x7f2e4c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7fcf42da5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c0d31a0 0x7fcf3c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.066+0000 7fcf40b41640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf3c0ce010 0x7fcf3c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.066+0000 7fcf40b41640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf3c0ce010 0x7fcf3c15a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49520/0 (socket says 172.21.15.37:49520) 2023-11-24T06:14:58.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.066+0000 7fcf40b41640 1 -- 172.21.15.37:0/947403365 learned_addr learned my addr 172.21.15.37:0/947403365 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.065+0000 7efc71ffb640 1 -- 172.21.15.37:0/546579921 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc78065d50 con 0x7efc74007160 2023-11-24T06:14:58.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.066+0000 7efc71ffb640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc6006af10 0x7efc6006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.067+0000 7fcf42da5640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c0b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.067+0000 7efc71ffb640 1 -- 172.21.15.37:0/546579921 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc780ab760 con 0x7efc74007160 2023-11-24T06:14:58.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.067+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c15acb0 con 0x7fcf3c0d31a0 2023-11-24T06:14:58.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.067+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b69b0 con 0x7fcf3c1609e0 2023-11-24T06:14:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.066+0000 7fcefcff9640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcee406ae90 0x7fcee406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.066+0000 7fcefcff9640 1 -- 172.21.15.37:0/221857599 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf000de070 con 0x7fcef80e1dc0 2023-11-24T06:14:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.067+0000 7fcefffff640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcee406ae90 0x7fcee406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b6c90 con 0x7fcf3c0ce010 2023-11-24T06:14:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.067+0000 7efc80afc640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc6006af10 0x7efc6006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7f2e4affd640 1 -- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e4c0ce010 msgr2=0x7f2e4c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7f2e4affd640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e4c0ce010 0x7f2e4c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7f2e4affd640 1 -- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c1609e0 msgr2=0x7f2e4c0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7fcf41342640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c0b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7fcefffff640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcee406ae90 0x7fcee406d350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcef4007690 tx=0x7fcef4001930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7fcf33fff640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c0d31a0 0x7fcf3c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.068+0000 7efc80afc640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc6006af10 0x7efc6006d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc740546f0 tx=0x7efc6c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7f2e4affd640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c1609e0 0x7f2e4c0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7f2e4affd640 1 -- 172.21.15.37:0/3772098442 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34009400 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7f2e4bfff640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c1609e0 0x7f2e4c0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7fcf40b41640 1 -- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf3c1609e0 msgr2=0x7fcf3c0b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7fcf40b41640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c0b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7fcf40b41640 1 -- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c0d31a0 msgr2=0x7fcf3c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7fcf40b41640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c0d31a0 0x7fcf3c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7fcf40b41640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c009a70 con 0x7fcf3c0ce010 2023-11-24T06:14:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7f9d57fff640 1 Processor -- start 2023-11-24T06:14:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7fcf41342640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c0b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.069+0000 7f9d57fff640 1 -- start start 2023-11-24T06:14:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7f2e4affd640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e4c0d31a0 0x7f2e4c0b7830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400c7f0 tx=0x7f2e4400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7fcf40b41640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf3c0ce010 0x7fcf3c15a770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009e80 tx=0x7fcf2c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7f5df0b89640 1 Processor -- start 2023-11-24T06:14:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7f5df0b89640 1 -- start start 2023-11-24T06:14:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7f2e43fff640 1 -- 172.21.15.37:0/3772098442 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44004220 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7fcf39ffb640 1 -- 172.21.15.37:0/947403365 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c03e610 con 0x7fcf3c0ce010 2023-11-24T06:14:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7fcf39ffb640 1 -- 172.21.15.37:0/947403365 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c03e790 con 0x7fcf3c0ce010 2023-11-24T06:14:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.071+0000 7fcf39ffb640 1 -- 172.21.15.37:0/947403365 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c03eb40 con 0x7fcf3c0ce010 2023-11-24T06:14:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.071+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c0b4650 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.071+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c0ca140 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.071+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c0b6f70 con 0x7fcf3c0ce010 2023-11-24T06:14:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.071+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c0b7530 con 0x7fcf3c0ce010 2023-11-24T06:14:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.070+0000 7f2e43fff640 1 -- 172.21.15.37:0/3772098442 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44004380 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.071+0000 7f2e43fff640 1 -- 172.21.15.37:0/3772098442 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44007820 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7fc4425b0640 1 Processor -- start 2023-11-24T06:14:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7f9d57fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d580d08b0 0x7f9d580b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7f9d57fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9d580d1610 0x7f9d580b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7f9d57fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580d1d80 con 0x7f9d5815d5c0 2023-11-24T06:14:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7f9d57fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d580d2060 con 0x7f9d580d1610 2023-11-24T06:14:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7f9d57fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580d2340 con 0x7f9d580d08b0 2023-11-24T06:14:58.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0b4b70 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f5df0b89640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec1609e0 0x7f5dec06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f5df0b89640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5dec0d31a0 0x7f5dec0d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f5df0b89640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec0ceb90 con 0x7f5dec0ce010 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f5df0b89640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec06c1f0 con 0x7f5dec0d31a0 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f5df0b89640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0d1070 con 0x7f5dec1609e0 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f9d567fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d580d08b0 0x7f9d580b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f9d567fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d580d08b0 0x7f9d580b8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49524/0 (socket says 172.21.15.37:49524) 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f9d567fc640 1 -- 172.21.15.37:0/2035451623 learned_addr learned my addr 172.21.15.37:0/2035451623 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7f9d577fe640 1 --2- 172.21.15.37:0/2035451623 >> v2:172.21.15.188:3300/0 conn(0x7f9d580d1610 0x7f9d580b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.073+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c067470 con 0x7fcf3c0ce010 2023-11-24T06:14:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7fcefcff9640 1 -- 172.21.15.37:0/221857599 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcef804d1c0 con 0x7fcef80e1dc0 2023-11-24T06:14:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7f5dead9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f5dec0ce010 0x7f5dec0ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50436/0 (socket says 172.21.15.37:50436) 2023-11-24T06:14:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7f5dead9d640 1 -- 172.21.15.37:0/3650166120 learned_addr learned my addr 172.21.15.37:0/3650166120 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7f5de9d9b640 1 --2- 172.21.15.37:0/3650166120 >> v2:172.21.15.188:3300/0 conn(0x7f5dec0d31a0 0x7f5dec0d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7f9d567fc640 1 -- 172.21.15.37:0/2035451623 >> v2:172.21.15.188:3300/0 conn(0x7f9d580d1610 msgr2=0x7f9d580b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7f9d567fc640 1 --2- 172.21.15.37:0/2035451623 >> v2:172.21.15.188:3300/0 conn(0x7f9d580d1610 0x7f9d580b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7f9d567fc640 1 -- 172.21.15.37:0/2035451623 >> v1:172.21.15.188:6789/0 conn(0x7f9d5815d5c0 legacy=0x7f9d580d01a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7f9d567fc640 1 -- 172.21.15.37:0/2035451623 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580d2620 con 0x7f9d580d08b0 2023-11-24T06:14:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.072+0000 7fc4425b0640 1 -- start start 2023-11-24T06:14:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7fc4425b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc43c0cfb60 0x7fc43c0abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7fc4425b0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 0x7fc43c0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7fc4425b0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0ce270 con 0x7fc43c0cc470 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7fc4425b0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c06c560 con 0x7fc43c0cfb60 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.074+0000 7fc4425b0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c06d0a0 con 0x7fc43c0ce640 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7fc43b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc43c0cfb60 0x7fc43c0abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7fc43b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc43c0cfb60 0x7fc43c0abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44702/0 (socket says 172.21.15.37:44702) 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7fc43b7fe640 1 -- 172.21.15.37:0/60894539 learned_addr learned my addr 172.21.15.37:0/60894539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7f5dea59c640 1 --2- 172.21.15.37:0/3650166120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec1609e0 0x7f5dec06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7fc43b7fe640 1 -- 172.21.15.37:0/60894539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 msgr2=0x7fc43c0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.076+0000 7fcf39ffb640 1 -- 172.21.15.37:0/947403365 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf2c03b050 con 0x7fcf3c0ce010 2023-11-24T06:14:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7fc43b7fe640 1 --2- 172.21.15.37:0/60894539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 0x7fc43c0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7fc43b7fe640 1 -- 172.21.15.37:0/60894539 >> v1:172.21.15.188:6789/0 conn(0x7fc43c0cc470 legacy=0x7fc43c0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.075+0000 7fc43b7fe640 1 -- 172.21.15.37:0/60894539 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0b4200 con 0x7fc43c0cfb60 2023-11-24T06:14:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.076+0000 7f5dea59c640 1 -- 172.21.15.37:0/3650166120 >> v2:172.21.15.188:3300/0 conn(0x7f5dec0d31a0 msgr2=0x7f5dec0d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.076+0000 7f5dea59c640 1 --2- 172.21.15.37:0/3650166120 >> v2:172.21.15.188:3300/0 conn(0x7f5dec0d31a0 0x7f5dec0d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.076+0000 7f5dea59c640 1 -- 172.21.15.37:0/3650166120 >> v1:172.21.15.188:6789/0 conn(0x7f5dec0ce010 legacy=0x7f5dec0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.076+0000 7f5dea59c640 1 -- 172.21.15.37:0/3650166120 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0d3b40 con 0x7f5dec1609e0 2023-11-24T06:14:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.076+0000 7f9d567fc640 1 --2- 172.21.15.37:0/2035451623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d580d08b0 0x7f9d580b8dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009870 tx=0x7f9d4c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c047f9c66c7fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.076+0000 7f2e43fff640 1 -- 172.21.15.37:0/3772098442 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e44007c10 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.077+0000 7fc43b7fe640 1 --2- 172.21.15.37:0/60894539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cfb60 0x7fc43c0abfc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc430009870 tx=0x7fc43002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8af6336627b0002 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.077+0000 7f5dea59c640 1 --2- 172.21.15.37:0/3650166120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec1609e0 0x7f5dec06bcb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0097a0 tx=0x7f5ddc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43e8eec35384199f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.077+0000 7fc43affd640 1 -- 172.21.15.37:0/60894539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430030840 con 0x7fc43c0cfb60 2023-11-24T06:14:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.077+0000 7fc43affd640 1 -- 172.21.15.37:0/60894539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4300309a0 con 0x7fc43c0cfb60 2023-11-24T06:14:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.077+0000 7fc43affd640 1 -- 172.21.15.37:0/60894539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430030d30 con 0x7fc43c0cfb60 2023-11-24T06:14:58.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7f2e43fff640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e2c06af40 0x7f2e2c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7f2e43fff640 1 -- 172.21.15.37:0/3772098442 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e44089900 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7fc4425b0640 1 -- 172.21.15.37:0/60894539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cfb60 msgr2=0x7fc43c0abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7fc4425b0640 1 --2- 172.21.15.37:0/60894539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cfb60 0x7fc43c0abfc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc430009870 tx=0x7fc43002b980 comp rx=0 tx=0).stop 2023-11-24T06:14:58.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7fcf39ffb640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcf1c06ae40 0x7fcf1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7fcf39ffb640 1 -- 172.21.15.37:0/947403365 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf2c0ab810 con 0x7fcf3c0ce010 2023-11-24T06:14:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7fcf33fff640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcf1c06ae40 0x7fcf1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.078+0000 7f2e4b7fe640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e2c06af40 0x7f2e2c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.079+0000 7fc4425b0640 1 -- 172.21.15.37:0/60894539 shutdown_connections 2023-11-24T06:14:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.079+0000 7fc4425b0640 1 --2- 172.21.15.37:0/60894539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cfb60 0x7fc43c0abfc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.079+0000 7fc4425b0640 1 --2- 172.21.15.37:0/60894539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 0x7fc43c0b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.079+0000 7fc4425b0640 1 -- 172.21.15.37:0/60894539 >> 172.21.15.37:0/60894539 conn(0x7fc43c06a920 msgr2=0x7fc43c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.079+0000 7fc4425b0640 1 -- 172.21.15.37:0/60894539 shutdown_connections 2023-11-24T06:14:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.079+0000 7fc4425b0640 1 -- 172.21.15.37:0/60894539 wait complete. 2023-11-24T06:14:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.079+0000 7f2e4b7fe640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e2c06af40 0x7f2e2c06d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c005c00 tx=0x7f2e3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.080+0000 7fcf33fff640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcf1c06ae40 0x7fcf1c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c15e340 tx=0x7fcf24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.082+0000 7fc4425b0640 1 Processor -- start 2023-11-24T06:14:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.082+0000 7efc71ffb640 1 -- 172.21.15.37:0/546579921 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc78076930 con 0x7efc74007160 2023-11-24T06:14:58.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.082+0000 7fc4425b0640 1 -- start start 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc4425b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cc470 0x7fc43c162a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc4425b0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 0x7fc43c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc4425b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc43c0cfb60 0x7fc43c071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc4425b0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c151e20 con 0x7fc43c0cc470 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc4425b0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c164fa0 con 0x7fc43c0cfb60 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc4425b0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c145100 con 0x7fc43c0ce640 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc43bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cc470 0x7fc43c162a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc43bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cc470 0x7fc43c162a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44704/0 (socket says 172.21.15.37:44704) 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.084+0000 7fc43bfff640 1 -- 172.21.15.37:0/536446519 learned_addr learned my addr 172.21.15.37:0/536446519 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc43b7fe640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 0x7fc43c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc440b4d640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc43c0cfb60 0x7fc43c071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc43bfff640 1 -- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 msgr2=0x7fc43c071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc43bfff640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 0x7fc43c071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc43bfff640 1 -- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc43c0cfb60 msgr2=0x7fc43c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc43bfff640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc43c0cfb60 0x7fc43c071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc43bfff640 1 -- 172.21.15.37:0/536446519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300094d0 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc440b4d640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc43c0cfb60 0x7fc43c071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.085+0000 7fc43bfff640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cc470 0x7fc43c162a90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c450 tx=0x7fc42c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.086+0000 7fc438ff9640 1 -- 172.21.15.37:0/536446519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0052d0 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.086+0000 7fc438ff9640 1 -- 172.21.15.37:0/536446519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c005430 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.086+0000 7fc438ff9640 1 -- 172.21.15.37:0/536446519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c012870 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.086+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c071c20 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.086+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c152070 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.088+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c067470 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.089+0000 7fc438ff9640 1 -- 172.21.15.37:0/536446519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc42c0129d0 con 0x7fc43c0cc470 2023-11-24T06:14:58.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.090+0000 7fc438ff9640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc42806ae90 0x7fc42806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.090+0000 7fc438ff9640 1 -- 172.21.15.37:0/536446519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc42c0891b0 con 0x7fc43c0cc470 2023-11-24T06:14:58.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.090+0000 7fc43b7fe640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc42806ae90 0x7fc42806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.092+0000 7fc43b7fe640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc42806ae90 0x7fc42806d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc430036000 tx=0x7fc43003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.092+0000 7f2e43fff640 1 -- 172.21.15.37:0/3772098442 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e44054900 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.099+0000 7fc438ff9640 1 -- 172.21.15.37:0/536446519 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc42c054240 con 0x7fc43c0cc470 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.105+0000 7f5de959a640 1 -- 172.21.15.37:0/3650166120 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc031830 con 0x7f5dec1609e0 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.105+0000 7f5de959a640 1 -- 172.21.15.37:0/3650166120 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc031990 con 0x7f5dec1609e0 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.105+0000 7f5de959a640 1 -- 172.21.15.37:0/3650166120 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc031d60 con 0x7f5dec1609e0 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f5df0b89640 1 -- 172.21.15.37:0/3650166120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec1609e0 msgr2=0x7f5dec06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.105+0000 7f9d55ffb640 1 -- 172.21.15.37:0/2035451623 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0317c0 con 0x7f9d580d08b0 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.105+0000 7f9d55ffb640 1 -- 172.21.15.37:0/2035451623 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c031920 con 0x7f9d580d08b0 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.105+0000 7f9d55ffb640 1 -- 172.21.15.37:0/2035451623 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c031cb0 con 0x7f9d580d08b0 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f9d57fff640 1 -- 172.21.15.37:0/2035451623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d580d08b0 msgr2=0x7f9d580b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f9d57fff640 1 --2- 172.21.15.37:0/2035451623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d580d08b0 0x7f9d580b8dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009870 tx=0x7f9d4c02b860 comp rx=0 tx=0).stop 2023-11-24T06:14:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7fcf39ffb640 1 -- 172.21.15.37:0/947403365 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf2c0768d0 con 0x7fcf3c0ce010 2023-11-24T06:14:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3650166120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec1609e0 0x7f5dec06bcb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0097a0 tx=0x7f5ddc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f9d57fff640 1 -- 172.21.15.37:0/2035451623 shutdown_connections 2023-11-24T06:14:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f9d57fff640 1 --2- 172.21.15.37:0/2035451623 >> v2:172.21.15.188:3300/0 conn(0x7f9d580d1610 0x7f9d580b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f9d57fff640 1 --2- 172.21.15.37:0/2035451623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d580d08b0 0x7f9d580b8dd0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009870 tx=0x7f9d4c02b860 comp rx=0 tx=0).stop 2023-11-24T06:14:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f9d57fff640 1 -- 172.21.15.37:0/2035451623 >> 172.21.15.37:0/2035451623 conn(0x7f9d58061310 msgr2=0x7f9d58061720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f5df0b89640 1 -- 172.21.15.37:0/3650166120 shutdown_connections 2023-11-24T06:14:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3650166120 >> v2:172.21.15.188:3300/0 conn(0x7f5dec0d31a0 0x7f5dec0d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3650166120 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec1609e0 0x7f5dec06bcb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.106+0000 7f5df0b89640 1 -- 172.21.15.37:0/3650166120 >> 172.21.15.37:0/3650166120 conn(0x7f5dec08af60 msgr2=0x7f5dec09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.107+0000 7f5df0b89640 1 -- 172.21.15.37:0/3650166120 shutdown_connections 2023-11-24T06:14:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.107+0000 7f9d57fff640 1 -- 172.21.15.37:0/2035451623 shutdown_connections 2023-11-24T06:14:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.108+0000 7f9d57fff640 1 -- 172.21.15.37:0/2035451623 wait complete. 2023-11-24T06:14:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.107+0000 7f5df0b89640 1 -- 172.21.15.37:0/3650166120 wait complete. 2023-11-24T06:14:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.110+0000 7f5df0b89640 1 Processor -- start 2023-11-24T06:14:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.110+0000 7f9d57fff640 1 Processor -- start 2023-11-24T06:14:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.110+0000 7f5df0b89640 1 -- start start 2023-11-24T06:14:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.110+0000 7f9d57fff640 1 -- start start 2023-11-24T06:14:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.112+0000 7f9d57fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d580d1610 0x7f9d580b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.112+0000 7f9d57fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5815d5c0 0x7f9d580b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.112+0000 7f9d57fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d5815dae0 0x7f9d580c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.112+0000 7f9d57fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58147b10 con 0x7f9d5815d5c0 2023-11-24T06:14:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.112+0000 7f9d57fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58147f40 con 0x7f9d580d1610 2023-11-24T06:14:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.112+0000 7f9d57fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c83f0 con 0x7f9d5815dae0 2023-11-24T06:14:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d5815dae0 0x7f9d580c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d5815dae0 0x7f9d580c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49580/0 (socket says 172.21.15.37:49580) 2023-11-24T06:14:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d577fe640 1 -- 172.21.15.37:0/3503172238 learned_addr learned my addr 172.21.15.37:0/3503172238 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f5df0b89640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec0ce010 0x7f5dec0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d56ffd640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d580d1610 0x7f9d580b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d567fc640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5815d5c0 0x7f9d580b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f5df0b89640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dec0d31a0 0x7f5dec1f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d577fe640 1 -- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d580d1610 msgr2=0x7f9d580b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d577fe640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d580d1610 0x7f9d580b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.113+0000 7f9d577fe640 1 -- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5815d5c0 msgr2=0x7f9d580b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.114+0000 7f5df0b89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec1609e0 0x7f5dec1f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.114+0000 7f5dea59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec0ce010 0x7f5dec0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.114+0000 7f5de9d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dec0d31a0 0x7f5dec1f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.114+0000 7f9d577fe640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5815d5c0 0x7f9d580b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.114+0000 7f9d577fe640 1 -- 172.21.15.37:0/3503172238 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0094d0 con 0x7f9d5815dae0 2023-11-24T06:14:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.114+0000 7f9d567fc640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5815d5c0 0x7f9d580b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.114+0000 7f5de9d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dec0d31a0 0x7f5dec1f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:53068/0 (socket says 172.21.15.37:53068) 2023-11-24T06:14:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.115+0000 7f5dea59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec0ce010 0x7f5dec0b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49590/0 (socket says 172.21.15.37:49590) 2023-11-24T06:14:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.115+0000 7f9d577fe640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d5815dae0 0x7f9d580c7790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009d30 tx=0x7f9d5000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.115+0000 7f5dead9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec1609e0 0x7f5dec1f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.115+0000 7f5de9d9b640 1 -- 172.21.15.37:0/3686859239 learned_addr learned my addr 172.21.15.37:0/3686859239 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.115+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1f3b40 con 0x7f5dec1609e0 2023-11-24T06:14:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.115+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0b3510 con 0x7f5dec0d31a0 2023-11-24T06:14:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.115+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0b37f0 con 0x7f5dec0ce010 2023-11-24T06:14:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f9d3ffff640 1 -- 172.21.15.37:0/3503172238 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50009ba0 con 0x7f9d5815dae0 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f9d3ffff640 1 -- 172.21.15.37:0/3503172238 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5000f040 con 0x7f9d5815dae0 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d581471e0 con 0x7f9d5815dae0 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f9d3ffff640 1 -- 172.21.15.37:0/3503172238 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500146c0 con 0x7f9d5815dae0 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f5dead9d640 1 -- 172.21.15.37:0/3686859239 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec0ce010 msgr2=0x7f5dec0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f5dead9d640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec0ce010 0x7f5dec0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f5dead9d640 1 -- 172.21.15.37:0/3686859239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dec0d31a0 msgr2=0x7f5dec1f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.116+0000 7f5dead9d640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dec0d31a0 0x7f5dec1f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.117+0000 7f5dead9d640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc009400 con 0x7f5dec1609e0 2023-11-24T06:14:58.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.117+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d581477a0 con 0x7f9d5815dae0 2023-11-24T06:14:58.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.118+0000 7f5dead9d640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec1609e0 0x7f5dec1f4c30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5de400cdf0 tx=0x7f5de400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.119+0000 7f5ddaffd640 1 -- 172.21.15.37:0/3686859239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400ad40 con 0x7f5dec1609e0 2023-11-24T06:14:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.119+0000 7f5ddaffd640 1 -- 172.21.15.37:0/3686859239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40020a0 con 0x7f5dec1609e0 2023-11-24T06:14:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.119+0000 7f5ddaffd640 1 -- 172.21.15.37:0/3686859239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400aea0 con 0x7f5dec1609e0 2023-11-24T06:14:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.119+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec0b3ad0 con 0x7f5dec1609e0 2023-11-24T06:14:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.120+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec0b4090 con 0x7f5dec1609e0 2023-11-24T06:14:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.119+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5804e840 con 0x7f9d5815dae0 2023-11-24T06:14:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.123+0000 7f5ddaffd640 1 -- 172.21.15.37:0/3686859239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5de4007070 con 0x7f5dec1609e0 2023-11-24T06:14:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.122+0000 7f9d3ffff640 1 -- 172.21.15.37:0/3503172238 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d50014820 con 0x7f9d5815dae0 2023-11-24T06:14:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.124+0000 7f9d3ffff640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9d4406af40 0x7f9d4406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.124+0000 7f9d3ffff640 1 -- 172.21.15.37:0/3503172238 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d5008a1d0 con 0x7f9d5815dae0 2023-11-24T06:14:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.125+0000 7f5ddaffd640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5dcc06af10 0x7f5dcc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.125+0000 7f9d56ffd640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9d4406af40 0x7f9d4406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.125+0000 7f5ddaffd640 1 -- 172.21.15.37:0/3686859239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5de40893f0 con 0x7f5dec1609e0 2023-11-24T06:14:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.126+0000 7f5dea59c640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5dcc06af10 0x7f5dcc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.126+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec160dc0 con 0x7f5dec1609e0 2023-11-24T06:14:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.127+0000 7f5dea59c640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5dcc06af10 0x7f5dcc06d3d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc036000 tx=0x7f5ddc03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.133+0000 7f9d56ffd640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9d4406af40 0x7f9d4406d400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800a7d0 tx=0x7f9d48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.134+0000 7f9d3ffff640 1 -- 172.21.15.37:0/3503172238 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d500552f0 con 0x7f9d5815dae0 2023-11-24T06:14:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.138+0000 7f5ddaffd640 1 -- 172.21.15.37:0/3686859239 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5de4017080 con 0x7f5dec1609e0 2023-11-24T06:14:58.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.461+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7db408a9d0 con 0x7f7db40cea40 2023-11-24T06:14:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.462+0000 7f7d9b7fe640 1 -- 172.21.15.37:0/4083995037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7da4057680 con 0x7f7db40cea40 2023-11-24T06:14:58.465 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-11-24T06:14:58.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.464+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcef804d1c0 con 0x7fcef80e1dc0 2023-11-24T06:14:58.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.465+0000 7fcefcff9640 1 -- 172.21.15.37:0/221857599 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf000c0020 con 0x7fcef80e1dc0 2023-11-24T06:14:58.467 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-11-24T06:14:58.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.465+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da006af10 msgr2=0x7f7da006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.465+0000 7f7db3fff640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da006af10 0x7f7da006d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0012e0 tx=0x7f7dac007d30 comp rx=0 tx=0).stop 2023-11-24T06:14:58.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.466+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40cea40 msgr2=0x7f7db40b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.466+0000 7f7db3fff640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40cea40 0x7f7db40b1cc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c400 tx=0x7f7da400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.466+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 shutdown_connections 2023-11-24T06:14:58.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.467+0000 7f7db3fff640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da006af10 0x7f7da006d3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.467+0000 7f7db3fff640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7db416e7d0 0x7f7db40b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.467+0000 7f7db3fff640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40cea40 0x7f7db40b1cc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.467+0000 7f7db3fff640 1 --2- 172.21.15.37:0/4083995037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7db40cd3a0 0x7f7db40b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.467+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 >> 172.21.15.37:0/4083995037 conn(0x7f7db40cbb40 msgr2=0x7f7db40cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.467+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 shutdown_connections 2023-11-24T06:14:58.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.468+0000 7f7db3fff640 1 -- 172.21.15.37:0/4083995037 wait complete. 2023-11-24T06:14:58.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.468+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcee406ae90 msgr2=0x7fcee406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.468+0000 7fcf06851640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcee406ae90 0x7fcee406d350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcef4007690 tx=0x7fcef4001930 comp rx=0 tx=0).stop 2023-11-24T06:14:58.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.469+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef80e1dc0 msgr2=0x7fcef80e2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.469+0000 7fcf06851640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef80e1dc0 0x7fcef80e2240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf000681f0 tx=0x7fcf0006a3b0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 shutdown_connections 2023-11-24T06:14:58.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcee406ae90 0x7fcee406d350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcef80d8c70 0x7fcef804bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef80e1dc0 0x7fcef80e2240 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 --2- 172.21.15.37:0/221857599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcef0005180 0x7fcef80331f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 >> 172.21.15.37:0/221857599 conn(0x7fcef8009fb0 msgr2=0x7fcef80358e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 shutdown_connections 2023-11-24T06:14:58.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.470+0000 7fcf06851640 1 -- 172.21.15.37:0/221857599 wait complete. 2023-11-24T06:14:58.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.496+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e4c0b4b70 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-11-24T06:14:58.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-11-24T06:14:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.497+0000 7f2e43fff640 1 -- 172.21.15.37:0/3772098442 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e4c0b4b70 con 0x7f2e4c0d31a0 2023-11-24T06:14:58.501 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:14:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.500+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e2c06af40 msgr2=0x7f2e2c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.500+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e2c06af40 0x7f2e2c06d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c005c00 tx=0x7f2e3c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.500+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e4c0d31a0 msgr2=0x7f2e4c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.500+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e4c0d31a0 0x7f2e4c0b7830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400c7f0 tx=0x7f2e4400ccb0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 shutdown_connections 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e2c06af40 0x7f2e2c06d400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e4c1609e0 0x7f2e4c0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e4c0d31a0 0x7f2e4c0b7830 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 --2- 172.21.15.37:0/3772098442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e4c0ce010 0x7f2e4c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 >> 172.21.15.37:0/3772098442 conn(0x7f2e4c08af60 msgr2=0x7f2e4c0d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 shutdown_connections 2023-11-24T06:14:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.501+0000 7f2e51fb0640 1 -- 172.21.15.37:0/3772098442 wait complete. 2023-11-24T06:14:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.509+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc740089a0 con 0x7efc74007160 2023-11-24T06:14:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.509+0000 7efc71ffb640 1 -- 172.21.15.37:0/546579921 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc78079f50 con 0x7efc74007160 2023-11-24T06:14:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:14:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc6006af10 msgr2=0x7efc6006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc6006af10 0x7efc6006d3d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc740546f0 tx=0x7efc6c009060 comp rx=0 tx=0).stop 2023-11-24T06:14:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74007160 msgr2=0x7efc74049920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74007160 0x7efc74049920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc780098c0 tx=0x7efc780046c0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 shutdown_connections 2023-11-24T06:14:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc6006af10 0x7efc6006d3d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc74038320 0x7efc74036150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc74033960 0x7efc740eddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 --2- 172.21.15.37:0/546579921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc74007160 0x7efc74049920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.513+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 >> 172.21.15.37:0/546579921 conn(0x7efc74009f80 msgr2=0x7efc7404c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.514+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 shutdown_connections 2023-11-24T06:14:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.514+0000 7efc822ff640 1 -- 172.21.15.37:0/546579921 wait complete. 2023-11-24T06:14:58.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.525+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcf3c06b750 con 0x7fcf3c0ce010 2023-11-24T06:14:58.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.525+0000 7fcf39ffb640 1 -- 172.21.15.37:0/947403365 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf2c079ef0 con 0x7fcf3c0ce010 2023-11-24T06:14:58.528 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-11-24T06:14:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.526+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5dec067470 con 0x7f5dec1609e0 2023-11-24T06:14:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.526+0000 7f5ddaffd640 1 -- 172.21.15.37:0/3686859239 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5de40545c0 con 0x7f5dec1609e0 2023-11-24T06:14:58.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-11-24T06:14:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-11-24T06:14:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.528+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcf1c06ae40 msgr2=0x7fcf1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.528+0000 7fcf42da5640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcf1c06ae40 0x7fcf1c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c15e340 tx=0x7fcf24008040 comp rx=0 tx=0).stop 2023-11-24T06:14:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.528+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf3c0ce010 msgr2=0x7fcf3c15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.528+0000 7fcf42da5640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf3c0ce010 0x7fcf3c15a770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009e80 tx=0x7fcf2c004a40 comp rx=0 tx=0).stop 2023-11-24T06:14:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc43c0cd910 con 0x7fc43c0cc470 2023-11-24T06:14:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5dcc06af10 msgr2=0x7f5dcc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5dcc06af10 0x7f5dcc06d3d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc036000 tx=0x7f5ddc03c040 comp rx=0 tx=0).stop 2023-11-24T06:14:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec1609e0 msgr2=0x7f5dec1f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec1609e0 0x7f5dec1f4c30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5de400cdf0 tx=0x7f5de400a430 comp rx=0 tx=0).stop 2023-11-24T06:14:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 shutdown_connections 2023-11-24T06:14:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7fcf42da5640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcf1c06ae40 0x7fcf1c06d300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7fcf42da5640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf3c1609e0 0x7fcf3c0b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7fcf42da5640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf3c0d31a0 0x7fcf3c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7fcf42da5640 1 --2- 172.21.15.37:0/947403365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf3c0ce010 0x7fcf3c15a770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.529+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 >> 172.21.15.37:0/947403365 conn(0x7fcf3c08af60 msgr2=0x7fcf3c0b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7fc438ff9640 1 -- 172.21.15.37:0/536446519 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc42c057860 con 0x7fc43c0cc470 2023-11-24T06:14:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 shutdown_connections 2023-11-24T06:14:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 shutdown_connections 2023-11-24T06:14:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5dcc06af10 0x7f5dcc06d3d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dec0d31a0 0x7f5dec1f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec1609e0 0x7f5dec1f4c30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 --2- 172.21.15.37:0/3686859239 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dec0ce010 0x7f5dec0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 >> 172.21.15.37:0/3686859239 conn(0x7f5dec08af60 msgr2=0x7f5dec0ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.537 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:14:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 shutdown_connections 2023-11-24T06:14:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7fcf42da5640 1 -- 172.21.15.37:0/947403365 wait complete. 2023-11-24T06:14:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.530+0000 7f5df0b89640 1 -- 172.21.15.37:0/3686859239 wait complete. 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.533+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc42806ae90 msgr2=0x7fc42806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.533+0000 7fc4425b0640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc42806ae90 0x7fc42806d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc430036000 tx=0x7fc43003b040 comp rx=0 tx=0).stop 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.533+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cc470 msgr2=0x7fc43c162a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.533+0000 7fc4425b0640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cc470 0x7fc43c162a90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c450 tx=0x7fc42c00c910 comp rx=0 tx=0).stop 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.534+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 shutdown_connections 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.534+0000 7fc4425b0640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc42806ae90 0x7fc42806d350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.534+0000 7fc4425b0640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc43c0cfb60 0x7fc43c071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.534+0000 7fc4425b0640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc43c0ce640 0x7fc43c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.534+0000 7fc4425b0640 1 --2- 172.21.15.37:0/536446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c0cc470 0x7fc43c162a90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.534+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 >> 172.21.15.37:0/536446519 conn(0x7fc43c06a920 msgr2=0x7fc43c154470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.534+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9d580b2d30 con 0x7f9d5815dae0 2023-11-24T06:14:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.535+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 shutdown_connections 2023-11-24T06:14:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.535+0000 7fc4425b0640 1 -- 172.21.15.37:0/536446519 wait complete. 2023-11-24T06:14:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.535+0000 7f9d3ffff640 1 -- 172.21.15.37:0/3503172238 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d50018020 con 0x7f9d5815dae0 2023-11-24T06:14:58.541 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-11-24T06:14:58.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-11-24T06:14:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.537+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9d4406af40 msgr2=0x7f9d4406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.537+0000 7f9d57fff640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9d4406af40 0x7f9d4406d400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800a7d0 tx=0x7f9d48008040 comp rx=0 tx=0).stop 2023-11-24T06:14:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.537+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d5815dae0 msgr2=0x7f9d580c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.537+0000 7f9d57fff640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d5815dae0 0x7f9d580c7790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009d30 tx=0x7f9d5000c490 comp rx=0 tx=0).stop 2023-11-24T06:14:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 shutdown_connections 2023-11-24T06:14:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9d4406af40 0x7f9d4406d400 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d5815dae0 0x7f9d580c7790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5815d5c0 0x7f9d580b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 --2- 172.21.15.37:0/3503172238 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d580d1610 0x7f9d580b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 >> 172.21.15.37:0/3503172238 conn(0x7f9d58061310 msgr2=0x7f9d58152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 shutdown_connections 2023-11-24T06:14:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:58.538+0000 7f9d57fff640 1 -- 172.21.15.37:0/3503172238 wait complete. 2023-11-24T06:14:58.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-11-24T06:14:58.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-11-24T06:14:58.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-24T06:14:58.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-11-24T06:14:59.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:14:59.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T06:14:59.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T06:14:59.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T06:14:59.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T06:14:59.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:14:59.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T06:14:59.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.761+0000 7f7dc82bb640 1 Processor -- start 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.761+0000 7f7dc82bb640 1 -- start start 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.763+0000 7f7dc82bb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7dc00af710 0x7f7dc00aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.763+0000 7f7dc82bb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.763+0000 7f7dc82bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7dc00ae510 0x7f7dc0169db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.763+0000 7f7dc82bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00af090 con 0x7f7dc00ae510 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.763+0000 7f7dc82bb640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00b2520 con 0x7f7dc00af710 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.763+0000 7f7dc82bb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00ac160 con 0x7f7dc0098780 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.764+0000 7f7dc6858640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7dc00ae510 0x7f7dc0169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.764+0000 7f7dc6858640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7dc00ae510 0x7f7dc0169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44738/0 (socket says 172.21.15.37:44738) 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.764+0000 7f7dc6858640 1 -- 172.21.15.37:0/1690383846 learned_addr learned my addr 172.21.15.37:0/1690383846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7fa475188640 1 Processor -- start 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc6057640 1 --2- 172.21.15.37:0/1690383846 >> v2:172.21.15.188:3300/0 conn(0x7f7dc00af710 0x7f7dc00aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc6858640 1 -- 172.21.15.37:0/1690383846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 msgr2=0x7f7dc00b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7fa475188640 1 -- start start 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc5856640 1 --2- 172.21.15.37:0/1690383846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc6858640 1 --2- 172.21.15.37:0/1690383846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc6858640 1 -- 172.21.15.37:0/1690383846 >> v2:172.21.15.188:3300/0 conn(0x7f7dc00af710 msgr2=0x7f7dc00aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc6858640 1 --2- 172.21.15.37:0/1690383846 >> v2:172.21.15.188:3300/0 conn(0x7f7dc00af710 0x7f7dc00aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc6858640 1 -- 172.21.15.37:0/1690383846 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00ac440 con 0x7f7dc00ae510 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.765+0000 7f7dc6057640 1 --2- 172.21.15.37:0/1690383846 >> v2:172.21.15.188:3300/0 conn(0x7f7dc00af710 0x7f7dc00aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.767+0000 7f7dc6858640 1 --2- 172.21.15.37:0/1690383846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00ae510 0x7f7dc0169db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7dc006ff20 tx=0x7f7db002b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c9bca187d7832f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.768+0000 7f7dc5055640 1 -- 172.21.15.37:0/1690383846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0031760 con 0x7f7dc00ae510 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.768+0000 7f7dc5055640 1 -- 172.21.15.37:0/1690383846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00318c0 con 0x7f7dc00ae510 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.768+0000 7f7dc5055640 1 -- 172.21.15.37:0/1690383846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0031c50 con 0x7f7dc00ae510 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.768+0000 7fa475188640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa46803e810 0x7fa468053bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.768+0000 7fa475188640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa468054100 0x7fa4680068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.769+0000 7fa475188640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa468058540 con 0x7fa4680e3090 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.769+0000 7f7dc82bb640 1 -- 172.21.15.37:0/1690383846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00ae510 msgr2=0x7f7dc0169db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.769+0000 7fa46ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa4680e3090 0x7fa468057d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47532/0 (socket says 172.21.15.37:47532) 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.770+0000 7fa475188640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa468006170 con 0x7fa46803e810 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.770+0000 7fa46ffff640 1 -- 172.21.15.37:0/1586486444 learned_addr learned my addr 172.21.15.37:0/1586486444 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.770+0000 7fa475188640 1 -- 172.21.15.37:0/1586486444 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa468054570 con 0x7fa468054100 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.769+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/1690383846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00ae510 0x7f7dc0169db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7dc006ff20 tx=0x7f7db002b800 comp rx=0 tx=0).stop 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.770+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/1586486444 >> v2:172.21.15.37:3300/0 conn(0x7fa46803e810 0x7fa468053bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7f7dc82bb640 1 -- 172.21.15.37:0/1690383846 shutdown_connections 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/1690383846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00ae510 0x7f7dc0169db0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/1690383846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7fa46effd640 1 -- 172.21.15.37:0/1586486444 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714936864 0 0) 0x7fa468058540 con 0x7fa4680e3090 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.772+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/1690383846 >> v2:172.21.15.188:3300/0 conn(0x7f7dc00af710 0x7f7dc00aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.772+0000 7f7dc82bb640 1 -- 172.21.15.37:0/1690383846 >> 172.21.15.37:0/1690383846 conn(0x7f7dc00b4500 msgr2=0x7f7dc00b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7fa46f7fe640 1 -- 172.21.15.37:0/1586486444 >> v2:172.21.15.188:3300/0 conn(0x7fa468054100 msgr2=0x7fa4680068a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/1586486444 >> v2:172.21.15.188:3300/0 conn(0x7fa468054100 0x7fa4680068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7fa46f7fe640 1 -- 172.21.15.37:0/1586486444 >> v1:172.21.15.37:6789/0 conn(0x7fa4680e3090 legacy=0x7fa468057d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.771+0000 7fa46f7fe640 1 -- 172.21.15.37:0/1586486444 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468058820 con 0x7fa46803e810 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.774+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/1586486444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa46803e810 0x7fa468053bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4680e7ca0 tx=0x7fa45c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7664e5a05aad4395 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.774+0000 7fa46effd640 1 -- 172.21.15.37:0/1586486444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c030860 con 0x7fa46803e810 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.774+0000 7fa46effd640 1 -- 172.21.15.37:0/1586486444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c0309c0 con 0x7fa46803e810 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.774+0000 7fa46effd640 1 -- 172.21.15.37:0/1586486444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c030d50 con 0x7fa46803e810 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.775+0000 7fa475188640 1 -- 172.21.15.37:0/1586486444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa46803e810 msgr2=0x7fa468053bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.775+0000 7fa475188640 1 --2- 172.21.15.37:0/1586486444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa46803e810 0x7fa468053bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4680e7ca0 tx=0x7fa45c02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.773+0000 7f7dc82bb640 1 -- 172.21.15.37:0/1690383846 shutdown_connections 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.773+0000 7f7dc82bb640 1 -- 172.21.15.37:0/1690383846 wait complete. 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.776+0000 7fa475188640 1 -- 172.21.15.37:0/1586486444 shutdown_connections 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.776+0000 7fa475188640 1 --2- 172.21.15.37:0/1586486444 >> v2:172.21.15.188:3300/0 conn(0x7fa468054100 0x7fa4680068a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.776+0000 7fa475188640 1 --2- 172.21.15.37:0/1586486444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa46803e810 0x7fa468053bc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.776+0000 7fa475188640 1 -- 172.21.15.37:0/1586486444 >> 172.21.15.37:0/1586486444 conn(0x7fa4680559b0 msgr2=0x7fa468055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.777+0000 7fa475188640 1 -- 172.21.15.37:0/1586486444 shutdown_connections 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.777+0000 7fa475188640 1 -- 172.21.15.37:0/1586486444 wait complete. 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.778+0000 7f7dc82bb640 1 Processor -- start 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.778+0000 7f7dc82bb640 1 -- start start 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.780+0000 7f7dc82bb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.780+0000 7fa475188640 1 Processor -- start 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.781+0000 7f7dc82bb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc00ae510 0x7f7dc0209bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.781+0000 7fa475188640 1 -- start start 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.781+0000 7f7dc82bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00af710 0x7f7dc016bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.781+0000 7f7dc5856640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc00ae510 0x7f7dc0209bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc6858640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00af710 0x7f7dc016bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc6057640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc5856640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc00ae510 0x7f7dc0209bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:53092/0 (socket says 172.21.15.37:53092) 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc6057640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49604/0 (socket says 172.21.15.37:49604) 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc5856640 1 -- 172.21.15.37:0/2268768161 learned_addr learned my addr 172.21.15.37:0/2268768161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00cc2a0 con 0x7f7dc00af710 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc020a4f0 con 0x7f7dc00ae510 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.782+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc020a7d0 con 0x7f7dc0098780 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.783+0000 7f7dc6057640 1 -- 172.21.15.37:0/2268768161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc00ae510 msgr2=0x7f7dc0209bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.783+0000 7f7dc6057640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc00ae510 0x7f7dc0209bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.783+0000 7f7dc6057640 1 -- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00af710 msgr2=0x7f7dc016bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.783+0000 7fa475188640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa46803e810 0x7fa4680d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.783+0000 7fa475188640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa468054100 0x7fa4680e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.783+0000 7fa475188640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4680e3090 0x7fa46804ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.783+0000 7f7dc6057640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00af710 0x7f7dc016bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa475188640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680e47a0 con 0x7fa4680e3090 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa475188640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa468051360 con 0x7fa46803e810 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7f7dc6057640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00094d0 con 0x7f7dc0098780 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa475188640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680504b0 con 0x7fa468054100 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa474987640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4680e3090 0x7fa46804ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa474987640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4680e3090 0x7fa46804ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44764/0 (socket says 172.21.15.37:44764) 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa474987640 1 -- 172.21.15.37:0/307177363 learned_addr learned my addr 172.21.15.37:0/307177363 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa468054100 0x7fa4680e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa474987640 1 -- 172.21.15.37:0/307177363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa468054100 msgr2=0x7fa4680e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa474987640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa468054100 0x7fa4680e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa474987640 1 -- 172.21.15.37:0/307177363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa46803e810 msgr2=0x7fa4680d5040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7fa474987640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa46803e810 0x7fa4680d5040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.785+0000 7fa474987640 1 -- 172.21.15.37:0/307177363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c009400 con 0x7fa4680e3090 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.784+0000 7f7dc6858640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00af710 0x7f7dc016bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.785+0000 7fa474987640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4680e3090 0x7fa46804ff70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa4700620a0 tx=0x7fa470067f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.786+0000 7fa46cff9640 1 -- 172.21.15.37:0/307177363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700721c0 con 0x7fa4680e3090 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.786+0000 7f7dc6057640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00cbd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00c610 tx=0x7f7dbc00cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.786+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa468050750 con 0x7fa4680e3090 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.786+0000 7fa46cff9640 1 -- 172.21.15.37:0/307177363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa470072320 con 0x7fa4680e3090 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.786+0000 7fa46cff9640 1 -- 172.21.15.37:0/307177363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700721c0 con 0x7fa4680e3090 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.786+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa468050d10 con 0x7fa4680e3090 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.787+0000 7f7db6ffd640 1 -- 172.21.15.37:0/2268768161 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc011800 con 0x7f7dc0098780 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.787+0000 7f7db6ffd640 1 -- 172.21.15.37:0/2268768161 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc011960 con 0x7f7dc0098780 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.787+0000 7f7db6ffd640 1 -- 172.21.15.37:0/2268768161 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc011cf0 con 0x7f7dc0098780 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.790+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4680057b0 con 0x7fa4680e3090 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.788+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc020aab0 con 0x7f7dc0098780 2023-11-24T06:14:59.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.788+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc020b070 con 0x7f7dc0098780 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.792+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc020b290 con 0x7f7dc0098780 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.791+0000 7fa46cff9640 1 -- 172.21.15.37:0/307177363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa470074940 con 0x7fa4680e3090 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.795+0000 7fa46cff9640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa45406aea0 0x7fa45406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.795+0000 7fa46cff9640 1 -- 172.21.15.37:0/307177363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4701034a0 con 0x7fa4680e3090 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.796+0000 7fa46ffff640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa45406aea0 0x7fa45406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.798+0000 7fa46ffff640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa45406aea0 0x7fa45406d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa464007890 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.797+0000 7f7db6ffd640 1 -- 172.21.15.37:0/2268768161 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dbc01a450 con 0x7f7dc0098780 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.798+0000 7f7db6ffd640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da406af10 0x7f7da406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.798+0000 7f7db6ffd640 1 -- 172.21.15.37:0/2268768161 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dbc089750 con 0x7f7dc0098780 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.803+0000 7f7dc5856640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da406af10 0x7f7da406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.804+0000 7fa46cff9640 1 -- 172.21.15.37:0/307177363 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4700ce4b0 con 0x7fa4680e3090 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.804+0000 7f7dc5856640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da406af10 0x7f7da406d3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7dc016d240 tx=0x7f7db8007620 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.808+0000 7f7db6ffd640 1 -- 172.21.15.37:0/2268768161 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7dbc054920 con 0x7f7dc0098780 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.839+0000 7f0811f5c640 1 Processor -- start 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.839+0000 7f0811f5c640 1 -- start start 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.841+0000 7f0811f5c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c15d5c0 0x7f080c0b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.841+0000 7f0811f5c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f080c0d08b0 0x7f080c0b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.841+0000 7f0811f5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c0d1d80 con 0x7f080c0d1610 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.841+0000 7f0811f5c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080c0d2060 con 0x7f080c0d08b0 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.842+0000 7f0811f5c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0d2340 con 0x7f080c15d5c0 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.842+0000 7f080bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f080c0d1610 0x7f080c0d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47536/0 (socket says 172.21.15.37:47536) 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.842+0000 7f080bfff640 1 -- 172.21.15.37:0/2980034436 learned_addr learned my addr 172.21.15.37:0/2980034436 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.842+0000 7f081175b640 1 --2- 172.21.15.37:0/2980034436 >> v2:172.21.15.188:3300/0 conn(0x7f080c0d08b0 0x7f080c0b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.843+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146486580 0 0) 0x7f080c0d1d80 con 0x7f080c0d1610 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.843+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07fc003520 con 0x7f080c0d1610 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.844+0000 7f0810f5a640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c15d5c0 0x7f080c0b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.844+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013460097 0 0) 0x7f07fc003520 con 0x7f080c0d1610 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.844+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c15d5c0 msgr2=0x7f080c0b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.844+0000 7f080b7fe640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c15d5c0 0x7f080c0b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.844+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 >> v2:172.21.15.188:3300/0 conn(0x7f080c0d08b0 msgr2=0x7f080c0b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.844+0000 7f080b7fe640 1 --2- 172.21.15.37:0/2980034436 >> v2:172.21.15.188:3300/0 conn(0x7f080c0d08b0 0x7f080c0b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.844+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c0d2620 con 0x7f080c0d1610 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f0800001650 con 0x7f080c0d1610 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 >> v1:172.21.15.37:6789/0 conn(0x7f080c0d1610 legacy=0x7f080c0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07fc0039f0 0x7f07fc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07fc0047c0 0x7f07fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07fc005180 0x7f07fc01c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0d2060 con 0x7f07fc005180 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0d2340 con 0x7f07fc0039f0 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.845+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc01d060 con 0x7f07fc0047c0 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.846+0000 7f081175b640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07fc005180 0x7f07fc01c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f080bfff640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07fc0047c0 0x7f07fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f0810f5a640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07fc0039f0 0x7f07fc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f081175b640 1 -- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07fc0047c0 msgr2=0x7f07fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f081175b640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07fc0047c0 0x7f07fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f081175b640 1 -- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07fc0039f0 msgr2=0x7f07fc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f081175b640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07fc0039f0 0x7f07fc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f081175b640 1 -- 172.21.15.37:0/2980034436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc003520 con 0x7f07fc005180 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.847+0000 7f0810f5a640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07fc0039f0 0x7f07fc003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.849+0000 7f081175b640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07fc005180 0x7f07fc01c990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f080c06bb30 tx=0x7f07fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e0578d69a8171d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.850+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080402cbd0 con 0x7f07fc005180 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.850+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400f040 con 0x7f07fc005180 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.850+0000 7f080b7fe640 1 -- 172.21.15.37:0/2980034436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804034440 con 0x7f07fc005180 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.850+0000 7f3e569e3640 1 Processor -- start 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.851+0000 7f0811f5c640 1 -- 172.21.15.37:0/2980034436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07fc005180 msgr2=0x7f07fc01c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.851+0000 7f0811f5c640 1 --2- 172.21.15.37:0/2980034436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07fc005180 0x7f07fc01c990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f080c06bb30 tx=0x7f07fc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.851+0000 7f681a22b640 1 Processor -- start 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.850+0000 7f3e569e3640 1 -- start start 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.851+0000 7f081175b640 1 -- 172.21.15.37:0/2980034436 reap_dead start 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.851+0000 7f0811f5c640 1 -- 172.21.15.37:0/2980034436 shutdown_connections 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.852+0000 7f0811f5c640 1 -- 172.21.15.37:0/2980034436 >> 172.21.15.37:0/2980034436 conn(0x7f080c061310 msgr2=0x7f080c061720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.852+0000 7f0811f5c640 1 -- 172.21.15.37:0/2980034436 shutdown_connections 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.852+0000 7f681a22b640 1 -- start start 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.852+0000 7f0811f5c640 1 -- 172.21.15.37:0/2980034436 wait complete. 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.854+0000 7f3e569e3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3e500ce450 0x7f3e500ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.854+0000 7f3e569e3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e5006c560 0x7f3e5015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.854+0000 7f3e569e3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500cff70 con 0x7f3e5006da40 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.854+0000 7f3e4ffff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f3e5006da40 0x7f3e5006de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50454/0 (socket says 172.21.15.37:50454) 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.855+0000 7f3e4ffff640 1 -- 172.21.15.37:0/221232929 learned_addr learned my addr 172.21.15.37:0/221232929 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.855+0000 7f3e4f7fe640 1 --2- 172.21.15.37:0/221232929 >> v2:172.21.15.188:3300/0 conn(0x7f3e500ce450 0x7f3e500ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.855+0000 7f3e54f80640 1 --2- 172.21.15.37:0/221232929 >> v2:172.21.15.37:3300/0 conn(0x7f3e5006c560 0x7f3e5015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.855+0000 7f3e569e3640 1 -- 172.21.15.37:0/221232929 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500b3970 con 0x7f3e5006c560 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.855+0000 7f3e569e3640 1 -- 172.21.15.37:0/221232929 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500b3c50 con 0x7f3e500ce450 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.855+0000 7f681a22b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f680c053c30 0x7f680c038040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f681a22b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c054480 con 0x7f680c050160 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f681a22b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0541a0 con 0x7f680c0df1e0 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f681a22b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c005ef0 con 0x7f680c053c30 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f0811f5c640 1 Processor -- start 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f68137fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f680c0df1e0 0x7f680c04fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50456/0 (socket says 172.21.15.37:50456) 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f6812ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f680c050160 0x7f680c0069d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47552/0 (socket says 172.21.15.37:47552) 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f68137fe640 1 -- 172.21.15.37:0/4114381462 learned_addr learned my addr 172.21.15.37:0/4114381462 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101723146 0 0) 0x7f3e500cff70 con 0x7f3e5006da40 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f0811f5c640 1 -- start start 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.856+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c003520 con 0x7f3e5006da40 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967913729 0 0) 0x7f3e3c003520 con 0x7f3e5006da40 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 >> v2:172.21.15.188:3300/0 conn(0x7f3e500ce450 msgr2=0x7f3e500ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 --2- 172.21.15.37:0/221232929 >> v2:172.21.15.188:3300/0 conn(0x7f3e500ce450 0x7f3e500ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 >> v2:172.21.15.37:3300/0 conn(0x7f3e5006c560 msgr2=0x7f3e5015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 --2- 172.21.15.37:0/221232929 >> v2:172.21.15.37:3300/0 conn(0x7f3e5006c560 0x7f3e5015a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500b3f30 con 0x7f3e5006da40 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f3e38000ed0 con 0x7f3e5006da40 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 >> v1:172.21.15.188:6789/0 conn(0x7f3e5006da40 legacy=0x7f3e5006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e3c003970 0x7f3e3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e3c005180 0x7f3e3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b3970 con 0x7f3e3c0047c0 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b3c50 con 0x7f3e3c005180 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c00bf10 con 0x7f3e3c003970 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.857+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656677828 0 0) 0x7f680c0541a0 con 0x7f680c0df1e0 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.858+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67fc003520 con 0x7f680c0df1e0 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.858+0000 7f3e4f7fe640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.858+0000 7f3e4ffff640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e3c003970 0x7f3e3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f3e54f80640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e3c005180 0x7f3e3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.858+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279736214 0 0) 0x7f680c054480 con 0x7f680c050160 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f680c0541a0 con 0x7f680c050160 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f3e4f7fe640 1 -- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e3c003970 msgr2=0x7f3e3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f3e4f7fe640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e3c003970 0x7f3e3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f3e4f7fe640 1 -- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e3c005180 msgr2=0x7f3e3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f3e4f7fe640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e3c005180 0x7f3e3c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f3e4f7fe640 1 -- 172.21.15.37:0/221232929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500b3f30 con 0x7f3e3c0047c0 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1974404966 0 0) 0x7f67fc003520 con 0x7f680c0df1e0 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 >> v2:172.21.15.188:3300/0 conn(0x7f680c053c30 msgr2=0x7f680c038040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f68127fc640 1 --2- 172.21.15.37:0/4114381462 >> v2:172.21.15.188:3300/0 conn(0x7f680c053c30 0x7f680c038040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 >> v1:172.21.15.37:6789/0 conn(0x7f680c050160 legacy=0x7f680c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.859+0000 7f0811f5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080c155ee0 0x7f080c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f3e54f80640 1 -- 172.21.15.37:0/221232929 reap_dead start 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0061d0 con 0x7f680c0df1e0 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f0811f5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080c156d30 0x7f080c1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f6804001670 con 0x7f680c0df1e0 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 >> v1:172.21.15.188:6789/0 conn(0x7f680c0df1e0 legacy=0x7f680c04fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67fc003b00 0x7f67fc003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67fc0047c0 0x7f67fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f67fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c005ef0 con 0x7f67fc0047c0 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc00c210 con 0x7f67fc005380 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.860+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc00c3d0 con 0x7f67fc003b00 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.861+0000 7f0811f5c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c0cbc90 0x7f080c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.861+0000 7f6813fff640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f67fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.861+0000 7f0810f5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080c155ee0 0x7f080c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f68137fe640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67fc003b00 0x7f67fc003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f080bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080c156d30 0x7f080c1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f080bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080c156d30 0x7f080c1586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:53156/0 (socket says 172.21.15.37:53156) 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f080bfff640 1 -- 172.21.15.37:0/1310009925 learned_addr learned my addr 172.21.15.37:0/1310009925 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f0811f5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0cc9d0 con 0x7f080c155ee0 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f081175b640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c0cbc90 0x7f080c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0b28a0 con 0x7f080c156d30 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f3e4f7fe640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e3c004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3e40006070 tx=0x7f3e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff235e92d9d8833 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f6813fff640 1 -- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67fc003b00 msgr2=0x7f67fc003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f6813fff640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67fc003b00 0x7f67fc003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f6813fff640 1 -- 172.21.15.37:0/4114381462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67fc0047c0 msgr2=0x7f67fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f6813fff640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67fc0047c0 0x7f67fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f6813fff640 1 -- 172.21.15.37:0/4114381462 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc003520 con 0x7f67fc005380 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0cc130 con 0x7f080c0cbc90 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.862+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40033600 con 0x7f3e3c0047c0 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.863+0000 7f6813fff640 1 -- 172.21.15.37:0/4114381462 reap_dead start 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.863+0000 7f3e4effd640 1 -- 172.21.15.37:0/221232929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4002f050 con 0x7f3e3c0047c0 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f3e569e3640 1 -- 172.21.15.37:0/221232929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 msgr2=0x7f3e3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f3e569e3640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e3c004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3e40006070 tx=0x7f3e3c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f3e569e3640 1 -- 172.21.15.37:0/221232929 shutdown_connections 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f0810f5a640 1 -- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c0cbc90 msgr2=0x7f080c0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f6813fff640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f67fc00b980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68140733c0 tx=0x7f67fc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bdbcfc808dfd33a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f3e569e3640 1 --2- 172.21.15.37:0/221232929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e3c004c40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f3e569e3640 1 -- 172.21.15.37:0/221232929 >> 172.21.15.37:0/221232929 conn(0x7f3e5006a920 msgr2=0x7f3e5006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f0810f5a640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c0cbc90 0x7f080c0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f0810f5a640 1 -- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080c156d30 msgr2=0x7f080c1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f0810f5a640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080c156d30 0x7f080c1586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f0810f5a640 1 -- 172.21.15.37:0/1310009925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c0cc410 con 0x7f080c155ee0 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.864+0000 7f080bfff640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080c156d30 0x7f080c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.865+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68140b0410 con 0x7f67fc005380 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.865+0000 7f0810f5a640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080c155ee0 0x7f080c1581a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f080c0d4340 tx=0x7f07f800f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.866+0000 7f08097fa640 1 -- 172.21.15.37:0/1310009925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8019070 con 0x7f080c155ee0 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.866+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c0cc6f0 con 0x7f080c155ee0 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.866+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c1564a0 con 0x7f080c155ee0 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.866+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68140b0570 con 0x7f67fc005380 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.866+0000 7f68127fc640 1 -- 172.21.15.37:0/4114381462 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68140b08e0 con 0x7f67fc005380 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.867+0000 7f681a22b640 1 -- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 msgr2=0x7f67fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.867+0000 7f681a22b640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f67fc00b980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68140733c0 tx=0x7f67fc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.867+0000 7f681a22b640 1 -- 172.21.15.37:0/4114381462 shutdown_connections 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.867+0000 7f681a22b640 1 --2- 172.21.15.37:0/4114381462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f67fc00b980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.867+0000 7f681a22b640 1 -- 172.21.15.37:0/4114381462 >> 172.21.15.37:0/4114381462 conn(0x7f680c009f70 msgr2=0x7f680c00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.867+0000 7f681a22b640 1 -- 172.21.15.37:0/4114381462 shutdown_connections 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.865+0000 7f3e569e3640 1 -- 172.21.15.37:0/221232929 shutdown_connections 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.865+0000 7f3e569e3640 1 -- 172.21.15.37:0/221232929 wait complete. 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.868+0000 7f3e569e3640 1 Processor -- start 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.868+0000 7f3e569e3640 1 -- start start 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.867+0000 7f681a22b640 1 -- 172.21.15.37:0/4114381462 wait complete. 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.870+0000 7f681a22b640 1 Processor -- start 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.871+0000 7f681a22b640 1 -- start start 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.871+0000 7f3e569e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e500b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.871+0000 7f3e569e3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e5013f750 0x7f3e50098ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.871+0000 7f3e569e3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e50152500 0x7f3e5014e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.872+0000 7f3e569e3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500ad5b0 con 0x7f3e3c0047c0 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.872+0000 7f3e4f7fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e5013f750 0x7f3e50098ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.872+0000 7f3e4f7fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e5013f750 0x7f3e50098ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49672/0 (socket says 172.21.15.37:49672) 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.872+0000 7f3e4f7fe640 1 -- 172.21.15.37:0/2235836903 learned_addr learned my addr 172.21.15.37:0/2235836903 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.872+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50151810 con 0x7f3e50152500 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.872+0000 7f3e54f80640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e50152500 0x7f3e5014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.872+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500ad7c0 con 0x7f3e5013f750 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.869+0000 7f08097fa640 1 -- 172.21.15.37:0/1310009925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f8004240 con 0x7f080c155ee0 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.869+0000 7f08097fa640 1 -- 172.21.15.37:0/1310009925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8003610 con 0x7f080c155ee0 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.873+0000 7f3e4ffff640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e500b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.873+0000 7f681a22b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f680c04c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.873+0000 7f3e54f80640 1 -- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e5013f750 msgr2=0x7f3e50098ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.874+0000 7f3e54f80640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e5013f750 0x7f3e50098ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.873+0000 7f08097fa640 1 -- 172.21.15.37:0/1310009925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07f8003770 con 0x7f080c155ee0 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.874+0000 7f3e54f80640 1 -- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 msgr2=0x7f3e500b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.874+0000 7f3e54f80640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e500b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.874+0000 7f681a22b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f680c0d0820 0x7f680c0d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.874+0000 7f3e54f80640 1 -- 172.21.15.37:0/2235836903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50151a20 con 0x7f3e50152500 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.874+0000 7f3e4ffff640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e500b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.874+0000 7f681a22b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680c0e1490 0x7f680c0e1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.875+0000 7f68137fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f680c04c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.875+0000 7f3e54f80640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e50152500 0x7f3e5014e930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e500cda50 tx=0x7f3e48014590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.875+0000 7f08097fa640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07f006ae70 0x7f07f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.875+0000 7f6813fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680c0e1490 0x7f680c0e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.875+0000 7f6813fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680c0e1490 0x7f680c0e1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44832/0 (socket says 172.21.15.37:44832) 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.875+0000 7f6813fff640 1 -- 172.21.15.37:0/1919210487 learned_addr learned my addr 172.21.15.37:0/1919210487 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f6812ffd640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f680c0d0820 0x7f680c0d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f3e4cff9640 1 -- 172.21.15.37:0/2235836903 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48012050 con 0x7f3e50152500 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.875+0000 7f08097fa640 1 -- 172.21.15.37:0/1310009925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07f8089250 con 0x7f080c155ee0 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec005250 con 0x7f080c155ee0 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f681a22b640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0daf50 con 0x7f680c0e1490 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f681a22b640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0e1000 con 0x7f67fc005380 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f3e4cff9640 1 -- 172.21.15.37:0/2235836903 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48013040 con 0x7f3e50152500 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f3e4cff9640 1 -- 172.21.15.37:0/2235836903 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48003df0 con 0x7f3e50152500 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f681a22b640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0d11c0 con 0x7f680c0d0820 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.876+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e50151d00 con 0x7f3e50152500 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.877+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e50152980 con 0x7f3e50152500 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.877+0000 7f080bfff640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07f006ae70 0x7f07f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.877+0000 7f6813fff640 1 -- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f680c0d0820 msgr2=0x7f680c0d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.877+0000 7f6813fff640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f680c0d0820 0x7f680c0d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.877+0000 7f6813fff640 1 -- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 msgr2=0x7f680c04c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.877+0000 7f6813fff640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f680c04c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.877+0000 7f6813fff640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0e06d0 con 0x7f680c0e1490 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.878+0000 7f6813fff640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680c0e1490 0x7f680c0e1910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6814069300 tx=0x7f6814069170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.878+0000 7f6812ffd640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f680c0d0820 0x7f680c0d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.878+0000 7f67fbfff640 1 -- 172.21.15.37:0/1919210487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68140af440 con 0x7f680c0e1490 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.879+0000 7f681a22b640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c0e09b0 con 0x7f680c0e1490 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.881+0000 7f080bfff640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07f006ae70 0x7f07f006d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0800008fd0 tx=0x7f0800001c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.879+0000 7f681a22b640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c0d54b0 con 0x7f680c0e1490 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.881+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c005350 con 0x7f680c0e1490 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.881+0000 7f3e4cff9640 1 -- 172.21.15.37:0/2235836903 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e48004030 con 0x7f3e50152500 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.883+0000 7f3e4cff9640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3e3006ae40 0x7f3e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.883+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e50152220 con 0x7f3e50152500 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.884+0000 7f3e4cff9640 1 -- 172.21.15.37:0/2235836903 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e4808e160 con 0x7f3e50152500 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.884+0000 7f3e4ffff640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3e3006ae40 0x7f3e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.885+0000 7f3e4ffff640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3e3006ae40 0x7f3e3006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e380049f0 tx=0x7f3e38004f00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.889+0000 7f67fbfff640 1 -- 172.21.15.37:0/1919210487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68140af5a0 con 0x7f680c0e1490 2023-11-24T06:14:59.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.891+0000 7f67fbfff640 1 -- 172.21.15.37:0/1919210487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68140af910 con 0x7f680c0e1490 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.891+0000 7f08097fa640 1 -- 172.21.15.37:0/1310009925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07f8054280 con 0x7f080c155ee0 2023-11-24T06:14:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.894+0000 7f67fbfff640 1 -- 172.21.15.37:0/1919210487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6814074940 con 0x7f680c0e1490 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.895+0000 7f67fbfff640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f680006aea0 0x7f680006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.896+0000 7f67fbfff640 1 -- 172.21.15.37:0/1919210487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f681404f730 con 0x7f680c0e1490 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.897+0000 7f68137fe640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f680006aea0 0x7f680006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.898+0000 7f68137fe640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f680006aea0 0x7f680006d360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f680c003e40 tx=0x7f6804000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.900+0000 7f3e4cff9640 1 -- 172.21.15.37:0/2235836903 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e50152220 con 0x7f3e50152500 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.901+0000 7f67fbfff640 1 -- 172.21.15.37:0/1919210487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68140f9a40 con 0x7f680c0e1490 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.914+0000 7f776952c640 1 Processor -- start 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.914+0000 7f776952c640 1 -- start start 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.916+0000 7f776952c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640b0ce0 0x7f77640cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.916+0000 7f776952c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f77640ce120 0x7f7764159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.917+0000 7f776952c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77640cc3b0 con 0x7f77640b0380 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.917+0000 7f776952c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77640cc970 con 0x7f77640ce120 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.917+0000 7f776952c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77640cc690 con 0x7f77640b0ce0 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.917+0000 7f77637fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f77640b0380 0x7f77640aeab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:50470/0 (socket says 172.21.15.37:50470) 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.917+0000 7f77637fe640 1 -- 172.21.15.37:0/3813506072 learned_addr learned my addr 172.21.15.37:0/3813506072 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.918+0000 7f7762ffd640 1 --2- 172.21.15.37:0/3813506072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640b0ce0 0x7f77640cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.918+0000 7f77627fc640 1 --2- 172.21.15.37:0/3813506072 >> v2:172.21.15.188:3300/0 conn(0x7f77640ce120 0x7f7764159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.919+0000 7f7762ffd640 1 -- 172.21.15.37:0/3813506072 >> v2:172.21.15.188:3300/0 conn(0x7f77640ce120 msgr2=0x7f7764159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.919+0000 7f7762ffd640 1 --2- 172.21.15.37:0/3813506072 >> v2:172.21.15.188:3300/0 conn(0x7f77640ce120 0x7f7764159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.919+0000 7f7762ffd640 1 -- 172.21.15.37:0/3813506072 >> v1:172.21.15.188:6789/0 conn(0x7f77640b0380 legacy=0x7f77640aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.919+0000 7f7762ffd640 1 -- 172.21.15.37:0/3813506072 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640b2180 con 0x7f77640b0ce0 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.920+0000 7f7762ffd640 1 --2- 172.21.15.37:0/3813506072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640b0ce0 0x7f77640cbd20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f775c0097a0 tx=0x7f775c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1571da61f5a99dfa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.921+0000 7f7761ffb640 1 -- 172.21.15.37:0/3813506072 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c02d040 con 0x7f77640b0ce0 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.921+0000 7f7761ffb640 1 -- 172.21.15.37:0/3813506072 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c031810 con 0x7f77640b0ce0 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.921+0000 7f7761ffb640 1 -- 172.21.15.37:0/3813506072 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c031ba0 con 0x7f77640b0ce0 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.922+0000 7f776952c640 1 -- 172.21.15.37:0/3813506072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640b0ce0 msgr2=0x7f77640cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.922+0000 7f776952c640 1 --2- 172.21.15.37:0/3813506072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640b0ce0 0x7f77640cbd20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f775c0097a0 tx=0x7f775c02b8b0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.922+0000 7f776952c640 1 -- 172.21.15.37:0/3813506072 shutdown_connections 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.922+0000 7f776952c640 1 --2- 172.21.15.37:0/3813506072 >> v2:172.21.15.188:3300/0 conn(0x7f77640ce120 0x7f7764159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.922+0000 7f776952c640 1 --2- 172.21.15.37:0/3813506072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640b0ce0 0x7f77640cbd20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.922+0000 7f776952c640 1 -- 172.21.15.37:0/3813506072 >> 172.21.15.37:0/3813506072 conn(0x7f77640b4500 msgr2=0x7f77640b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.923+0000 7f776952c640 1 -- 172.21.15.37:0/3813506072 shutdown_connections 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.923+0000 7f776952c640 1 -- 172.21.15.37:0/3813506072 wait complete. 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.926+0000 7f776952c640 1 Processor -- start 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.926+0000 7f776952c640 1 -- start start 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.928+0000 7f776952c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77640b0380 0x7f7764156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7f776952c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77640b0ce0 0x7f7764152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7fca4331a640 1 Processor -- start 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7f77627fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77640b0ce0 0x7f7764152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7f77627fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77640b0ce0 0x7f7764152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44842/0 (socket says 172.21.15.37:44842) 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77640b0380 0x7f7764156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7f7762ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77640b0380 0x7f7764156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:53200/0 (socket says 172.21.15.37:53200) 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7f77627fc640 1 -- 172.21.15.37:0/4063459431 learned_addr learned my addr 172.21.15.37:0/4063459431 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7fca4331a640 1 -- start start 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.929+0000 7f776952c640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640ce120 0x7f77640ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.930+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77641f6330 con 0x7f77640b0ce0 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.930+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7764156840 con 0x7f77640b0380 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.930+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77641f6750 con 0x7f77640ce120 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7f77627fc640 1 -- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640ce120 msgr2=0x7f77640ad140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7f77627fc640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640ce120 0x7f77640ad140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7f77627fc640 1 -- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77640b0380 msgr2=0x7f7764156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7f77627fc640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77640b0380 0x7f7764156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7f77627fc640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c009400 con 0x7f77640b0ce0 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7fca4331a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca3c15d5c0 0x7fca3c0b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7fca4331a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d1610 0x7fca3c0d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7f7762ffd640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77640b0380 0x7f7764156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.931+0000 7fca4331a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c0d1d80 con 0x7fca3c0d06e0 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7fca4331a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3c0d0b50 con 0x7fca3c15d5c0 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7fca4331a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0d2060 con 0x7fca3c0d1610 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7f77627fc640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77640b0ce0 0x7f7764152ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f775400e190 tx=0x7f775400e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7fca42318640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca3c15d5c0 0x7fca3c0b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7fca42318640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca3c15d5c0 0x7fca3c0b8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44856/0 (socket says 172.21.15.37:44856) 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7fca42318640 1 -- 172.21.15.37:0/600255907 learned_addr learned my addr 172.21.15.37:0/600255907 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7fca41b17640 1 --2- 172.21.15.37:0/600255907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d1610 0x7fca3c0d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7f775b7fe640 1 -- 172.21.15.37:0/4063459431 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754014620 con 0x7f77640b0ce0 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7f775b7fe640 1 -- 172.21.15.37:0/4063459431 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77540147a0 con 0x7f77640b0ce0 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7f775b7fe640 1 -- 172.21.15.37:0/4063459431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754014b50 con 0x7f77640b0ce0 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7fca42318640 1 -- 172.21.15.37:0/600255907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d1610 msgr2=0x7fca3c0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7fca42318640 1 --2- 172.21.15.37:0/600255907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d1610 0x7fca3c0d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7fca42318640 1 -- 172.21.15.37:0/600255907 >> v1:172.21.15.188:6789/0 conn(0x7fca3c0d06e0 legacy=0x7fca3c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7fca42318640 1 -- 172.21.15.37:0/600255907 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c0d2340 con 0x7fca3c15d5c0 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7f8cbd333640 1 Processor -- start 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.932+0000 7f8cbd333640 1 -- start start 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77641f56b0 con 0x7f77640b0ce0 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.933+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77641f5c70 con 0x7f77640b0ce0 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.934+0000 7f8cbd333640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb8098780 0x7f8cb80aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.935+0000 7f8cbd333640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8cb80b1380 0x7f8cb80b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.935+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb8098780 0x7f8cb80aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.935+0000 7f8cb67fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8cb80ae510 0x7f8cb80b0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47568/0 (socket says 172.21.15.37:47568) 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.935+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb8098780 0x7f8cb80aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49730/0 (socket says 172.21.15.37:49730) 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.935+0000 7f8cbd333640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb80b2520 con 0x7f8cb80ae510 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.935+0000 7f8cb67fc640 1 -- 172.21.15.37:0/3645527516 learned_addr learned my addr 172.21.15.37:0/3645527516 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cbd333640 1 -- 172.21.15.37:0/3645527516 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80af090 con 0x7f8cb80b1380 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cbd333640 1 -- 172.21.15.37:0/3645527516 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80ac160 con 0x7f8cb8098780 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7fca42318640 1 --2- 172.21.15.37:0/600255907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 0x7fca3c0b8dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8cfd9464870bb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cb77fe640 1 --2- 172.21.15.37:0/3645527516 >> v2:172.21.15.37:3300/0 conn(0x7f8cb80b1380 0x7f8cb80b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cb5ffb640 1 -- 172.21.15.37:0/3645527516 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674007091 0 0) 0x7f8cb80b2520 con 0x7f8cb80ae510 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cb6ffd640 1 -- 172.21.15.37:0/3645527516 >> v2:172.21.15.37:3300/0 conn(0x7f8cb80b1380 msgr2=0x7f8cb80b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cb6ffd640 1 --2- 172.21.15.37:0/3645527516 >> v2:172.21.15.37:3300/0 conn(0x7f8cb80b1380 0x7f8cb80b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cb6ffd640 1 -- 172.21.15.37:0/3645527516 >> v1:172.21.15.37:6789/0 conn(0x7f8cb80ae510 legacy=0x7f8cb80b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f8cb6ffd640 1 -- 172.21.15.37:0/3645527516 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80ac440 con 0x7f8cb8098780 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.937+0000 7fca41316640 1 -- 172.21.15.37:0/600255907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38031870 con 0x7fca3c15d5c0 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.937+0000 7fca41316640 1 -- 172.21.15.37:0/600255907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca380319d0 con 0x7fca3c15d5c0 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.936+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77641f6470 con 0x7f77640b0ce0 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.937+0000 7fca41316640 1 -- 172.21.15.37:0/600255907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38031da0 con 0x7fca3c15d5c0 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.938+0000 7fca4331a640 1 -- 172.21.15.37:0/600255907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 msgr2=0x7fca3c0b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.938+0000 7fca4331a640 1 --2- 172.21.15.37:0/600255907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 0x7fca3c0b8dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3802b910 comp rx=0 tx=0).stop 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.938+0000 7f775b7fe640 1 -- 172.21.15.37:0/4063459431 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7754014cb0 con 0x7f77640b0ce0 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.939+0000 7fca4331a640 1 -- 172.21.15.37:0/600255907 shutdown_connections 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.939+0000 7fca4331a640 1 --2- 172.21.15.37:0/600255907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d1610 0x7fca3c0d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.939+0000 7f8cb6ffd640 1 --2- 172.21.15.37:0/3645527516 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb8098780 0x7f8cb80aeb50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009d90 tx=0x7f8cb0030220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62eea28a3629479d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.939+0000 7fca4331a640 1 --2- 172.21.15.37:0/600255907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 0x7fca3c0b8dd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.939+0000 7fca4331a640 1 -- 172.21.15.37:0/600255907 >> 172.21.15.37:0/600255907 conn(0x7fca3c061310 msgr2=0x7fca3c061720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.940+0000 7f775b7fe640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f774406af10 0x7f774406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.940+0000 7fca4331a640 1 -- 172.21.15.37:0/600255907 shutdown_connections 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.940+0000 7fca4331a640 1 -- 172.21.15.37:0/600255907 wait complete. 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.940+0000 7f8cb5ffb640 1 -- 172.21.15.37:0/3645527516 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0038440 con 0x7f8cb8098780 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.940+0000 7f8cb5ffb640 1 -- 172.21.15.37:0/3645527516 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb00385a0 con 0x7f8cb8098780 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.940+0000 7f8cb5ffb640 1 -- 172.21.15.37:0/3645527516 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0038930 con 0x7f8cb8098780 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.940+0000 7f775b7fe640 1 -- 172.21.15.37:0/4063459431 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7754089f90 con 0x7f77640b0ce0 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.941+0000 7f7762ffd640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f774406af10 0x7f774406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.942+0000 7f7762ffd640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f774406af10 0x7f774406d3d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f775c036000 tx=0x7f775c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.941+0000 7f8cbd333640 1 -- 172.21.15.37:0/3645527516 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb8098780 msgr2=0x7f8cb80aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.941+0000 7f8cbd333640 1 --2- 172.21.15.37:0/3645527516 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb8098780 0x7f8cb80aeb50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009d90 tx=0x7f8cb0030220 comp rx=0 tx=0).stop 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.943+0000 7fca4331a640 1 Processor -- start 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.943+0000 7fca4331a640 1 -- start start 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.943+0000 7f8cbd333640 1 -- 172.21.15.37:0/3645527516 shutdown_connections 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.943+0000 7f8cbd333640 1 --2- 172.21.15.37:0/3645527516 >> v2:172.21.15.37:3300/0 conn(0x7f8cb80b1380 0x7f8cb80b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.943+0000 7f8cbd333640 1 --2- 172.21.15.37:0/3645527516 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb8098780 0x7f8cb80aeb50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.943+0000 7f8cbd333640 1 -- 172.21.15.37:0/3645527516 >> 172.21.15.37:0/3645527516 conn(0x7f8cb80b4500 msgr2=0x7f8cb80b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.944+0000 7f8cbd333640 1 -- 172.21.15.37:0/3645527516 shutdown_connections 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.944+0000 7f8cbd333640 1 -- 172.21.15.37:0/3645527516 wait complete. 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.945+0000 7fca4331a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d06e0 0x7fca3c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.945+0000 7fca4331a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca3c0d1610 0x7fca3c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.945+0000 7fca4331a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 0x7fca3c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.945+0000 7fca4331a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0cab30 con 0x7fca3c15d5c0 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.945+0000 7fca4331a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0cae10 con 0x7fca3c0d1610 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.945+0000 7fca4331a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0cb0f0 con 0x7fca3c0d06e0 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.946+0000 7fca42318640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d06e0 0x7fca3c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.946+0000 7fca42318640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d06e0 0x7fca3c0c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:49736/0 (socket says 172.21.15.37:49736) 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.946+0000 7fca42318640 1 -- 172.21.15.37:0/3166625640 learned_addr learned my addr 172.21.15.37:0/3166625640 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.946+0000 7fca41b17640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca3c0d1610 0x7fca3c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.947+0000 7fca41b17640 1 -- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d06e0 msgr2=0x7fca3c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.947+0000 7fca41b17640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d06e0 0x7fca3c0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.947+0000 7fca41b17640 1 -- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 msgr2=0x7fca3c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.947+0000 7f8cbd333640 1 Processor -- start 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.947+0000 7fca41b17640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 0x7fca3c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.947+0000 7fca41b17640 1 -- 172.21.15.37:0/3166625640 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380094d0 con 0x7fca3c0d1610 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.947+0000 7f8cbd333640 1 -- start start 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.948+0000 7fca41b17640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca3c0d1610 0x7fca3c1598d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca3400ebc0 tx=0x7fca3400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.948+0000 7f775b7fe640 1 -- 172.21.15.37:0/4063459431 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77641f6470 con 0x7f77640b0ce0 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.948+0000 7fca32ffd640 1 -- 172.21.15.37:0/3166625640 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400cda0 con 0x7fca3c0d1610 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7fca32ffd640 1 -- 172.21.15.37:0/3166625640 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400f040 con 0x7fca3c0d1610 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cbd333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb8098780 0x7f8cb809ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cbd333640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cb80ae510 0x7f8cb8203ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cbd333640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb80b1380 0x7f8cb80919b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cbd333640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb806d010 con 0x7f8cb8098780 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cbd333640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb809b350 con 0x7f8cb80ae510 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cbd333640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb809b630 con 0x7f8cb80b1380 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c0cb3d0 con 0x7fca3c0d1610 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c159e10 con 0x7fca3c0d1610 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb8098780 0x7f8cb809ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb8098780 0x7f8cb809ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44882/0 (socket says 172.21.15.37:44882) 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.949+0000 7f8cb6ffd640 1 -- 172.21.15.37:0/2739368499 learned_addr learned my addr 172.21.15.37:0/2739368499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7f8cb67fc640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cb80ae510 0x7f8cb8203ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7f8cb77fe640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb80b1380 0x7f8cb80919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c04e840 con 0x7fca3c0d1610 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7f8cb6ffd640 1 -- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb80b1380 msgr2=0x7f8cb80919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7f8cb6ffd640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb80b1380 0x7f8cb80919b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.951+0000 7fca32ffd640 1 -- 172.21.15.37:0/3166625640 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340146c0 con 0x7fca3c0d1610 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7f8cb6ffd640 1 -- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cb80ae510 msgr2=0x7f8cb8203ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7f8cb6ffd640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cb80ae510 0x7f8cb8203ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.950+0000 7f8cb6ffd640 1 -- 172.21.15.37:0/2739368499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0009a70 con 0x7f8cb8098780 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.951+0000 7f8cb6ffd640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb8098780 0x7f8cb809ad70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009d90 tx=0x7f8cb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.951+0000 7f8cb67fc640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cb80ae510 0x7f8cb8203ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.951+0000 7f8caf7fe640 1 -- 172.21.15.37:0/2739368499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0038440 con 0x7f8cb8098780 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.952+0000 7f8caf7fe640 1 -- 172.21.15.37:0/2739368499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0036b00 con 0x7f8cb8098780 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.952+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb809b910 con 0x7f8cb8098780 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.952+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb809bbf0 con 0x7f8cb8098780 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.953+0000 7f8caf7fe640 1 -- 172.21.15.37:0/2739368499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0038440 con 0x7f8cb8098780 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.954+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb8067470 con 0x7f8cb8098780 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.956+0000 7fca32ffd640 1 -- 172.21.15.37:0/3166625640 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca34014820 con 0x7fca3c0d1610 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.957+0000 7fca32ffd640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fca2006ae90 0x7fca2006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.957+0000 7fca32ffd640 1 -- 172.21.15.37:0/3166625640 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca3408a890 con 0x7fca3c0d1610 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.956+0000 7f8caf7fe640 1 -- 172.21.15.37:0/2739368499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cb003f050 con 0x7f8cb8098780 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.958+0000 7f8caf7fe640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ca006aed0 0x7f8ca006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.958+0000 7f8caf7fe640 1 -- 172.21.15.37:0/2739368499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cb00af970 con 0x7f8cb8098780 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.958+0000 7f8cb67fc640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ca006aed0 0x7f8ca006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.960+0000 7f8cb67fc640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ca006aed0 0x7f8ca006d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80cf120 tx=0x7f8ca4007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.960+0000 7fca42318640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fca2006ae90 0x7fca2006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.961+0000 7fca42318640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fca2006ae90 0x7fca2006d350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.967+0000 7fca32ffd640 1 -- 172.21.15.37:0/3166625640 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca340559b0 con 0x7fca3c0d1610 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:14:59.967+0000 7f8caf7fe640 1 -- 172.21.15.37:0/2739368499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cb007a9b0 con 0x7f8cb8098780 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.220+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa468005bd0 con 0x7fa4680e3090 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.221+0000 7fa46cff9640 1 -- 172.21.15.37:0/307177363 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4700d1ad0 con 0x7fa4680e3090 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.225+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa45406aea0 msgr2=0x7fa45406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.225+0000 7fa475188640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa45406aea0 0x7fa45406d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa464007890 comp rx=0 tx=0).stop 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.225+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7dc0067470 con 0x7f7dc0098780 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.225+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4680e3090 msgr2=0x7fa46804ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.225+0000 7fa475188640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4680e3090 0x7fa46804ff70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa4700620a0 tx=0x7fa470067f50 comp rx=0 tx=0).stop 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 shutdown_connections 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa45406aea0 0x7fa45406d360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4680e3090 0x7fa46804ff70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa468054100 0x7fa4680e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 --2- 172.21.15.37:0/307177363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa46803e810 0x7fa4680d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 >> 172.21.15.37:0/307177363 conn(0x7fa4680559b0 msgr2=0x7fa4680380b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7f7db6ffd640 1 -- 172.21.15.37:0/2268768161 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7dbc057f40 con 0x7f7dc0098780 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 shutdown_connections 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.226+0000 7fa475188640 1 -- 172.21.15.37:0/307177363 wait complete. 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.229+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da406af10 msgr2=0x7f7da406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.229+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da406af10 0x7f7da406d3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7dc016d240 tx=0x7f7db8007620 comp rx=0 tx=0).stop 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.229+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 msgr2=0x7f7dc00cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.229+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00cbd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00c610 tx=0x7f7dbc00cad0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.230+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 shutdown_connections 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.230+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7da406af10 0x7f7da406d3d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.230+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc00ae510 0x7f7dc0209bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.230+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00af710 0x7f7dc016bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.230+0000 7f7dc82bb640 1 --2- 172.21.15.37:0/2268768161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc0098780 0x7f7dc00cbd60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.230+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 >> 172.21.15.37:0/2268768161 conn(0x7f7dc00b4500 msgr2=0x7f7dc00b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.234+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 shutdown_connections 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.234+0000 7f7dc82bb640 1 -- 172.21.15.37:0/2268768161 wait complete. 2023-11-24T06:15:00.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-11-24T06:15:00.257 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-11-24T06:15:00.263 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.284+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f680c0e1140 con 0x7f680c0e1490 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.285+0000 7f67fbfff640 1 -- 172.21.15.37:0/1919210487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68140f9be0 con 0x7f680c0e1490 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f680006aea0 msgr2=0x7f680006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f680006aea0 0x7f680006d360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f680c003e40 tx=0x7f6804000ed0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680c0e1490 msgr2=0x7f680c0e1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680c0e1490 0x7f680c0e1910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6814069300 tx=0x7f6814069170 comp rx=0 tx=0).stop 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 shutdown_connections 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f680006aea0 0x7f680006d360 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f680c0e1490 0x7f680c0e1910 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f680c0d0820 0x7f680c0d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 --2- 172.21.15.37:0/1919210487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67fc005380 0x7f680c04c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 >> 172.21.15.37:0/1919210487 conn(0x7f680c009f70 msgr2=0x7f680c0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 shutdown_connections 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.287+0000 7f67f9ffb640 1 -- 172.21.15.37:0/1919210487 wait complete. 2023-11-24T06:15:00.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-11-24T06:15:00.306 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.312+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8cb8099420 con 0x7f8cb8098780 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.312+0000 7f8caf7fe640 1 -- 172.21.15.37:0/2739368499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8cb007dfd0 con 0x7f8cb8098780 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ca006aed0 msgr2=0x7f8ca006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ca006aed0 0x7f8ca006d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80cf120 tx=0x7f8ca4007c10 comp rx=0 tx=0).stop 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb8098780 msgr2=0x7f8cb809ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb8098780 0x7f8cb809ad70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009d90 tx=0x7f8cb0004a40 comp rx=0 tx=0).stop 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 shutdown_connections 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ca006aed0 0x7f8ca006d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8cb80ae510 0x7f8cb8203ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8cb80b1380 0x7f8cb80919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 --2- 172.21.15.37:0/2739368499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb8098780 0x7f8cb809ad70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.314+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 >> 172.21.15.37:0/2739368499 conn(0x7f8cb80b4500 msgr2=0x7f8cb8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.315+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 shutdown_connections 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.315+0000 7f8cbd333640 1 -- 172.21.15.37:0/2739368499 wait complete. 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.315+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e50152220 con 0x7f3e50152500 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.316+0000 7f3e4cff9640 1 -- 172.21.15.37:0/2235836903 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e50152220 con 0x7f3e50152500 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3e3006ae40 msgr2=0x7f3e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3e3006ae40 0x7f3e3006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e380049f0 tx=0x7f3e38004f00 comp rx=0 tx=0).stop 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e50152500 msgr2=0x7f3e5014e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e50152500 0x7f3e5014e930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e500cda50 tx=0x7f3e48014590 comp rx=0 tx=0).stop 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 shutdown_connections 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3e3006ae40 0x7f3e3006d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e50152500 0x7f3e5014e930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e5013f750 0x7f3e50098ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 --2- 172.21.15.37:0/2235836903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e3c0047c0 0x7f3e500b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 >> 172.21.15.37:0/2235836903 conn(0x7f3e5006a920 msgr2=0x7f3e5006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 shutdown_connections 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.319+0000 7f3e569e3640 1 -- 172.21.15.37:0/2235836903 wait complete. 2023-11-24T06:15:00.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.331+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07ec005500 con 0x7f080c155ee0 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.332+0000 7f08097fa640 1 -- 172.21.15.37:0/1310009925 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07f8054280 con 0x7f080c155ee0 2023-11-24T06:15:00.335 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07f006ae70 msgr2=0x7f07f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07f006ae70 0x7f07f006d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0800008fd0 tx=0x7f0800001c00 comp rx=0 tx=0).stop 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080c155ee0 msgr2=0x7f080c1581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080c155ee0 0x7f080c1581a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f080c0d4340 tx=0x7f07f800f920 comp rx=0 tx=0).stop 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 shutdown_connections 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07f006ae70 0x7f07f006d330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f080c156d30 0x7f080c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f080c0cbc90 0x7f080c0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 --2- 172.21.15.37:0/1310009925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080c155ee0 0x7f080c1581a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 >> 172.21.15.37:0/1310009925 conn(0x7f080c061310 msgr2=0x7f080c15f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 shutdown_connections 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.336+0000 7f0811f5c640 1 -- 172.21.15.37:0/1310009925 wait complete. 2023-11-24T06:15:00.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-11-24T06:15:00.345 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-11-24T06:15:00.361 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.360+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fca3c15dad0 con 0x7fca3c0d1610 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.361+0000 7fca32ffd640 1 -- 172.21.15.37:0/3166625640 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca34058fd0 con 0x7fca3c0d1610 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fca2006ae90 msgr2=0x7fca2006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fca2006ae90 0x7fca2006d350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3803c040 comp rx=0 tx=0).stop 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca3c0d1610 msgr2=0x7fca3c1598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca3c0d1610 0x7fca3c1598d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca3400ebc0 tx=0x7fca3400c490 comp rx=0 tx=0).stop 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 shutdown_connections 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fca2006ae90 0x7fca2006d350 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca3c0d1610 0x7fca3c1598d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca3c15d5c0 0x7fca3c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 --2- 172.21.15.37:0/3166625640 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca3c0d06e0 0x7fca3c0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 >> 172.21.15.37:0/3166625640 conn(0x7fca3c061310 msgr2=0x7fca3c15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 shutdown_connections 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.363+0000 7fca4331a640 1 -- 172.21.15.37:0/3166625640 wait complete. 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.367+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f77641f6470 con 0x7f77640b0ce0 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.368+0000 7f775b7fe640 1 -- 172.21.15.37:0/4063459431 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77641f6470 con 0x7f77640b0ce0 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f774406af10 msgr2=0x7f774406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f774406af10 0x7f774406d3d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f775c036000 tx=0x7f775c03c040 comp rx=0 tx=0).stop 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77640b0ce0 msgr2=0x7f7764152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77640b0ce0 0x7f7764152ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f775400e190 tx=0x7f775400e650 comp rx=0 tx=0).stop 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 shutdown_connections 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f774406af10 0x7f774406d3d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f77640ce120 0x7f77640ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77640b0ce0 0x7f7764152ee0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 --2- 172.21.15.37:0/4063459431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f77640b0380 0x7f7764156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 >> 172.21.15.37:0/4063459431 conn(0x7f77640b4500 msgr2=0x7f77640b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 shutdown_connections 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.370+0000 7f776952c640 1 -- 172.21.15.37:0/4063459431 wait complete. 2023-11-24T06:15:00.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-11-24T06:15:00.382 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-11-24T06:15:00.389 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:00.390 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:15:00.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.646+0000 7f2862533640 1 Processor -- start 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.646+0000 7f2862533640 1 -- start start 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.648+0000 7f2862533640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f285c0ce6c0 0x7f285c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.648+0000 7f2862533640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0cece0 con 0x7f285c15c7f0 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.648+0000 7f2862533640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c06d040 con 0x7f285c0cf450 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.648+0000 7f2862533640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0cfe40 con 0x7f285c0ce6c0 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.648+0000 7f285bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f285c15c7f0 0x7f285c06db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47584/0 (socket says 172.21.15.37:47584) 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.648+0000 7f285bfff640 1 -- 172.21.15.37:0/1296449368 learned_addr learned my addr 172.21.15.37:0/1296449368 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f2860ad0640 1 --2- 172.21.15.37:0/1296449368 >> v2:172.21.15.188:3300/0 conn(0x7f285c0ce6c0 0x7f285c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407199788 0 0) 0x7f285c0cece0 con 0x7f285c15c7f0 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2848003520 con 0x7f285c15c7f0 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2553812732 0 0) 0x7f2848003520 con 0x7f285c15c7f0 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 >> v2:172.21.15.188:3300/0 conn(0x7f285c0ce6c0 msgr2=0x7f285c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 --2- 172.21.15.37:0/1296449368 >> v2:172.21.15.188:3300/0 conn(0x7f285c0ce6c0 0x7f285c0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 >> v1:172.21.15.188:6789/0 conn(0x7f285c0cf450 legacy=0x7f285c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c06d320 con 0x7f285c15c7f0 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f284c001670 con 0x7f285c15c7f0 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 >> v1:172.21.15.37:6789/0 conn(0x7f285c15c7f0 legacy=0x7f285c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2848003970 0x7f2848003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28480047c0 0x7f2848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2848005180 0x7f284800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0cfe40 con 0x7f2848003970 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284800c020 con 0x7f28480047c0 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.649+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284800c1e0 con 0x7f2848005180 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f285bfff640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2848003970 0x7f2848003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f2853fff640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28480047c0 0x7f2848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f2860ad0640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2848005180 0x7f284800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f285bfff640 1 -- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2848005180 msgr2=0x7f284800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f285bfff640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2848005180 0x7f284800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f285bfff640 1 -- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28480047c0 msgr2=0x7f2848004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f285bfff640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28480047c0 0x7f2848004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f2860ad0640 1 -- 172.21.15.37:0/1296449368 reap_dead start 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.650+0000 7f285bfff640 1 -- 172.21.15.37:0/1296449368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848003520 con 0x7f2848003970 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.652+0000 7f285bfff640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2848003970 0x7f2848003d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c240 tx=0x7f28480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dd4bcee7c32ad0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.652+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c005ad0 con 0x7f2848003970 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.652+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c005c30 con 0x7f2848003970 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.652+0000 7f285b7fe640 1 -- 172.21.15.37:0/1296449368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c02ca70 con 0x7f2848003970 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.652+0000 7f2862533640 1 -- 172.21.15.37:0/1296449368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2848003970 msgr2=0x7f2848003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.652+0000 7f2862533640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2848003970 0x7f2848003d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c240 tx=0x7f28480057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.653+0000 7f2862533640 1 -- 172.21.15.37:0/1296449368 shutdown_connections 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.653+0000 7f2862533640 1 --2- 172.21.15.37:0/1296449368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2848003970 0x7f2848003d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.653+0000 7f2862533640 1 -- 172.21.15.37:0/1296449368 >> 172.21.15.37:0/1296449368 conn(0x7f285c06a920 msgr2=0x7f285c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.653+0000 7f2862533640 1 -- 172.21.15.37:0/1296449368 shutdown_connections 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.653+0000 7f2862533640 1 -- 172.21.15.37:0/1296449368 wait complete. 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.655+0000 7f2862533640 1 Processor -- start 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.655+0000 7f2862533640 1 -- start start 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2862533640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2848003970 0x7f285c148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2862533640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0abfc0 0x7f285c0ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2862533640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f285c157ea0 0x7f285c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2862533640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0ac960 con 0x7f285c0abfc0 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2862533640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c158860 con 0x7f2848003970 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2862533640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0ad770 con 0x7f285c157ea0 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0abfc0 0x7f285c0ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0abfc0 0x7f285c0ac420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44908/0 (socket says 172.21.15.37:44908) 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 -- 172.21.15.37:0/3231409020 learned_addr learned my addr 172.21.15.37:0/3231409020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2860ad0640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f285c157ea0 0x7f285c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 -- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f285c157ea0 msgr2=0x7f285c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f285bfff640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2848003970 0x7f285c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f285c157ea0 0x7f285c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 -- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2848003970 msgr2=0x7f285c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2848003970 0x7f285c148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.656+0000 7f2853fff640 1 -- 172.21.15.37:0/3231409020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c158d20 con 0x7f285c0abfc0 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.657+0000 7f2853fff640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0abfc0 0x7f285c0ac420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f284400f590 tx=0x7f284400fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.657+0000 7f28597fa640 1 -- 172.21.15.37:0/3231409020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440052e0 con 0x7f285c0abfc0 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.657+0000 7f28597fa640 1 -- 172.21.15.37:0/3231409020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844005440 con 0x7f285c0abfc0 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.657+0000 7f28597fa640 1 -- 172.21.15.37:0/3231409020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844003830 con 0x7f285c0abfc0 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.657+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c0acb60 con 0x7f285c0abfc0 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.657+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c0ad120 con 0x7f285c0abfc0 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.658+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c067470 con 0x7f285c0abfc0 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.659+0000 7f28597fa640 1 -- 172.21.15.37:0/3231409020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2844003990 con 0x7f285c0abfc0 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.660+0000 7f28597fa640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283c06ae70 0x7f283c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.660+0000 7f28597fa640 1 -- 172.21.15.37:0/3231409020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2844089560 con 0x7f285c0abfc0 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.660+0000 7f285bfff640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283c06ae70 0x7f283c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.661+0000 7f285bfff640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283c06ae70 0x7f283c06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f284c034000 tx=0x7f284c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.664+0000 7f28597fa640 1 -- 172.21.15.37:0/3231409020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2844054570 con 0x7f285c0abfc0 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.845+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f285c06ad00 con 0x7f283c06ae70 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.853+0000 7f28597fa640 1 -- 172.21.15.37:0/3231409020 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264411 (secure 0 0 0) 0x7f285c06ad00 con 0x7f283c06ae70 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.859+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283c06ae70 msgr2=0x7f283c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.859+0000 7f2862533640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283c06ae70 0x7f283c06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f284c034000 tx=0x7f284c009030 comp rx=0 tx=0).stop 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0abfc0 msgr2=0x7f285c0ac420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0abfc0 0x7f285c0ac420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f284400f590 tx=0x7f284400fa50 comp rx=0 tx=0).stop 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 shutdown_connections 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283c06ae70 0x7f283c06d330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f285c157ea0 0x7f285c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f285c0abfc0 0x7f285c0ac420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 --2- 172.21.15.37:0/3231409020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2848003970 0x7f285c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 >> 172.21.15.37:0/3231409020 conn(0x7f285c06a920 msgr2=0x7f285c0aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 shutdown_connections 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:00.860+0000 7f2862533640 1 -- 172.21.15.37:0/3231409020 wait complete. 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:15:00.816615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003527"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100558+0000","last_change":"2023-11-24T06:14:50.682748+0000","last_active":"2023-11-24T06:14:52.100558+0000","last_peered":"2023-11-24T06:14:52.100558+0000","last_clean":"2023-11-24T06:14:52.100558+0000","last_became_active":"2023-11-24T06:14:50.682229+0000","last_became_peered":"2023-11-24T06:14:50.682229+0000","last_unstale":"2023-11-24T06:14:52.100558+0000","last_undegraded":"2023-11-24T06:14:52.100558+0000","last_fullsized":"2023-11-24T06:14:52.100558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:31.904106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643746+0000","last_change":"2023-11-24T06:14:50.672740+0000","last_active":"2023-11-24T06:14:51.643746+0000","last_peered":"2023-11-24T06:14:51.643746+0000","last_clean":"2023-11-24T06:14:51.643746+0000","last_became_active":"2023-11-24T06:14:50.672321+0000","last_became_peered":"2023-11-24T06:14:50.672321+0000","last_unstale":"2023-11-24T06:14:51.643746+0000","last_undegraded":"2023-11-24T06:14:51.643746+0000","last_fullsized":"2023-11-24T06:14:51.643746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100183+0000","last_change":"2023-11-24T06:14:50.682497+0000","last_active":"2023-11-24T06:14:52.100183+0000","last_peered":"2023-11-24T06:14:52.100183+0000","last_clean":"2023-11-24T06:14:52.100183+0000","last_became_active":"2023-11-24T06:14:50.682193+0000","last_became_peered":"2023-11-24T06:14:50.682193+0000","last_unstale":"2023-11-24T06:14:52.100183+0000","last_undegraded":"2023-11-24T06:14:52.100183+0000","last_fullsized":"2023-11-24T06:14:52.100183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648766+0000","last_change":"2023-11-24T06:14:50.674687+0000","last_active":"2023-11-24T06:14:51.648766+0000","last_peered":"2023-11-24T06:14:51.648766+0000","last_clean":"2023-11-24T06:14:51.648766+0000","last_became_active":"2023-11-24T06:14:50.673159+0000","last_became_peered":"2023-11-24T06:14:50.673159+0000","last_unstale":"2023-11-24T06:14:51.648766+0000","last_undegraded":"2023-11-24T06:14:51.648766+0000","last_fullsized":"2023-11-24T06:14:51.648766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100007+0000","last_change":"2023-11-24T06:14:50.672761+0000","last_active":"2023-11-24T06:14:52.100007+0000","last_peered":"2023-11-24T06:14:52.100007+0000","last_clean":"2023-11-24T06:14:52.100007+0000","last_became_active":"2023-11-24T06:14:50.672175+0000","last_became_peered":"2023-11-24T06:14:50.672175+0000","last_unstale":"2023-11-24T06:14:52.100007+0000","last_undegraded":"2023-11-24T06:14:52.100007+0000","last_fullsized":"2023-11-24T06:14:52.100007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647948+0000","last_change":"2023-11-24T06:14:50.676313+0000","last_active":"2023-11-24T06:14:51.647948+0000","last_peered":"2023-11-24T06:14:51.647948+0000","last_clean":"2023-11-24T06:14:51.647948+0000","last_became_active":"2023-11-24T06:14:50.675981+0000","last_became_peered":"2023-11-24T06:14:50.675981+0000","last_unstale":"2023-11-24T06:14:51.647948+0000","last_undegraded":"2023-11-24T06:14:51.647948+0000","last_fullsized":"2023-11-24T06:14:51.647948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099417+0000","last_change":"2023-11-24T06:14:50.678743+0000","last_active":"2023-11-24T06:14:52.099417+0000","last_peered":"2023-11-24T06:14:52.099417+0000","last_clean":"2023-11-24T06:14:52.099417+0000","last_became_active":"2023-11-24T06:14:50.677585+0000","last_became_peered":"2023-11-24T06:14:50.677585+0000","last_unstale":"2023-11-24T06:14:52.099417+0000","last_undegraded":"2023-11-24T06:14:52.099417+0000","last_fullsized":"2023-11-24T06:14:52.099417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098443+0000","last_change":"2023-11-24T06:14:50.671307+0000","last_active":"2023-11-24T06:14:52.098443+0000","last_peered":"2023-11-24T06:14:52.098443+0000","last_clean":"2023-11-24T06:14:52.098443+0000","last_became_active":"2023-11-24T06:14:50.670760+0000","last_became_peered":"2023-11-24T06:14:50.670760+0000","last_unstale":"2023-11-24T06:14:52.098443+0000","last_undegraded":"2023-11-24T06:14:52.098443+0000","last_fullsized":"2023-11-24T06:14:52.098443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100556+0000","last_change":"2023-11-24T06:14:50.686106+0000","last_active":"2023-11-24T06:14:52.100556+0000","last_peered":"2023-11-24T06:14:52.100556+0000","last_clean":"2023-11-24T06:14:52.100556+0000","last_became_active":"2023-11-24T06:14:50.685766+0000","last_became_peered":"2023-11-24T06:14:50.685766+0000","last_unstale":"2023-11-24T06:14:52.100556+0000","last_undegraded":"2023-11-24T06:14:52.100556+0000","last_fullsized":"2023-11-24T06:14:52.100556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087249+0000","last_change":"2023-11-24T06:14:50.668109+0000","last_active":"2023-11-24T06:14:52.087249+0000","last_peered":"2023-11-24T06:14:52.087249+0000","last_clean":"2023-11-24T06:14:52.087249+0000","last_became_active":"2023-11-24T06:14:50.667876+0000","last_became_peered":"2023-11-24T06:14:50.667876+0000","last_unstale":"2023-11-24T06:14:52.087249+0000","last_undegraded":"2023-11-24T06:14:52.087249+0000","last_fullsized":"2023-11-24T06:14:52.087249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086961+0000","last_change":"2023-11-24T06:14:50.669500+0000","last_active":"2023-11-24T06:14:52.086961+0000","last_peered":"2023-11-24T06:14:52.086961+0000","last_clean":"2023-11-24T06:14:52.086961+0000","last_became_active":"2023-11-24T06:14:50.667834+0000","last_became_peered":"2023-11-24T06:14:50.667834+0000","last_unstale":"2023-11-24T06:14:52.086961+0000","last_undegraded":"2023-11-24T06:14:52.086961+0000","last_fullsized":"2023-11-24T06:14:52.086961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649114+0000","last_change":"2023-11-24T06:14:50.669357+0000","last_active":"2023-11-24T06:14:51.649114+0000","last_peered":"2023-11-24T06:14:51.649114+0000","last_clean":"2023-11-24T06:14:51.649114+0000","last_became_active":"2023-11-24T06:14:50.669083+0000","last_became_peered":"2023-11-24T06:14:50.669083+0000","last_unstale":"2023-11-24T06:14:51.649114+0000","last_undegraded":"2023-11-24T06:14:51.649114+0000","last_fullsized":"2023-11-24T06:14:51.649114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:27.615626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098696+0000","last_change":"2023-11-24T06:14:50.682270+0000","last_active":"2023-11-24T06:14:52.098696+0000","last_peered":"2023-11-24T06:14:52.098696+0000","last_clean":"2023-11-24T06:14:52.098696+0000","last_became_active":"2023-11-24T06:14:50.681919+0000","last_became_peered":"2023-11-24T06:14:50.681919+0000","last_unstale":"2023-11-24T06:14:52.098696+0000","last_undegraded":"2023-11-24T06:14:52.098696+0000","last_fullsized":"2023-11-24T06:14:52.098696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099796+0000","last_change":"2023-11-24T06:14:50.674645+0000","last_active":"2023-11-24T06:14:52.099796+0000","last_peered":"2023-11-24T06:14:52.099796+0000","last_clean":"2023-11-24T06:14:52.099796+0000","last_became_active":"2023-11-24T06:14:50.673843+0000","last_became_peered":"2023-11-24T06:14:50.673843+0000","last_unstale":"2023-11-24T06:14:52.099796+0000","last_undegraded":"2023-11-24T06:14:52.099796+0000","last_fullsized":"2023-11-24T06:14:52.099796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:43.740152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643448+0000","last_change":"2023-11-24T06:14:50.671555+0000","last_active":"2023-11-24T06:14:51.643448+0000","last_peered":"2023-11-24T06:14:51.643448+0000","last_clean":"2023-11-24T06:14:51.643448+0000","last_became_active":"2023-11-24T06:14:50.671247+0000","last_became_peered":"2023-11-24T06:14:50.671247+0000","last_unstale":"2023-11-24T06:14:51.643448+0000","last_undegraded":"2023-11-24T06:14:51.643448+0000","last_fullsized":"2023-11-24T06:14:51.643448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647469+0000","last_change":"2023-11-24T06:14:50.670462+0000","last_active":"2023-11-24T06:14:51.647469+0000","last_peered":"2023-11-24T06:14:51.647469+0000","last_clean":"2023-11-24T06:14:51.647469+0000","last_became_active":"2023-11-24T06:14:50.670143+0000","last_became_peered":"2023-11-24T06:14:50.670143+0000","last_unstale":"2023-11-24T06:14:51.647469+0000","last_undegraded":"2023-11-24T06:14:51.647469+0000","last_fullsized":"2023-11-24T06:14:51.647469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650874+0000","last_change":"2023-11-24T06:14:50.681286+0000","last_active":"2023-11-24T06:14:51.650874+0000","last_peered":"2023-11-24T06:14:51.650874+0000","last_clean":"2023-11-24T06:14:51.650874+0000","last_became_active":"2023-11-24T06:14:50.680323+0000","last_became_peered":"2023-11-24T06:14:50.680323+0000","last_unstale":"2023-11-24T06:14:51.650874+0000","last_undegraded":"2023-11-24T06:14:51.650874+0000","last_fullsized":"2023-11-24T06:14:51.650874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096934+0000","last_change":"2023-11-24T06:14:50.680143+0000","last_active":"2023-11-24T06:14:52.096934+0000","last_peered":"2023-11-24T06:14:52.096934+0000","last_clean":"2023-11-24T06:14:52.096934+0000","last_became_active":"2023-11-24T06:14:50.679818+0000","last_became_peered":"2023-11-24T06:14:50.679818+0000","last_unstale":"2023-11-24T06:14:52.096934+0000","last_undegraded":"2023-11-24T06:14:52.096934+0000","last_fullsized":"2023-11-24T06:14:52.096934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100469+0000","last_change":"2023-11-24T06:14:50.677609+0000","last_active":"2023-11-24T06:14:52.100469+0000","last_peered":"2023-11-24T06:14:52.100469+0000","last_clean":"2023-11-24T06:14:52.100469+0000","last_became_active":"2023-11-24T06:14:50.677066+0000","last_became_peered":"2023-11-24T06:14:50.677066+0000","last_unstale":"2023-11-24T06:14:52.100469+0000","last_undegraded":"2023-11-24T06:14:52.100469+0000","last_fullsized":"2023-11-24T06:14:52.100469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087142+0000","last_change":"2023-11-24T06:14:50.683104+0000","last_active":"2023-11-24T06:14:52.087142+0000","last_peered":"2023-11-24T06:14:52.087142+0000","last_clean":"2023-11-24T06:14:52.087142+0000","last_became_active":"2023-11-24T06:14:50.682658+0000","last_became_peered":"2023-11-24T06:14:50.682658+0000","last_unstale":"2023-11-24T06:14:52.087142+0000","last_undegraded":"2023-11-24T06:14:52.087142+0000","last_fullsized":"2023-11-24T06:14:52.087142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099758+0000","last_change":"2023-11-24T06:14:50.679645+0000","last_active":"2023-11-24T06:14:52.099758+0000","last_peered":"2023-11-24T06:14:52.099758+0000","last_clean":"2023-11-24T06:14:52.099758+0000","last_became_active":"2023-11-24T06:14:50.675742+0000","last_became_peered":"2023-11-24T06:14:50.675742+0000","last_unstale":"2023-11-24T06:14:52.099758+0000","last_undegraded":"2023-11-24T06:14:52.099758+0000","last_fullsized":"2023-11-24T06:14:52.099758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:09.290044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649295+0000","last_change":"2023-11-24T06:14:50.681368+0000","last_active":"2023-11-24T06:14:51.649295+0000","last_peered":"2023-11-24T06:14:51.649295+0000","last_clean":"2023-11-24T06:14:51.649295+0000","last_became_active":"2023-11-24T06:14:50.680084+0000","last_became_peered":"2023-11-24T06:14:50.680084+0000","last_unstale":"2023-11-24T06:14:51.649295+0000","last_undegraded":"2023-11-24T06:14:51.649295+0000","last_fullsized":"2023-11-24T06:14:51.649295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098619+0000","last_change":"2023-11-24T06:14:50.673670+0000","last_active":"2023-11-24T06:14:52.098619+0000","last_peered":"2023-11-24T06:14:52.098619+0000","last_clean":"2023-11-24T06:14:52.098619+0000","last_became_active":"2023-11-24T06:14:50.673403+0000","last_became_peered":"2023-11-24T06:14:50.673403+0000","last_unstale":"2023-11-24T06:14:52.098619+0000","last_undegraded":"2023-11-24T06:14:52.098619+0000","last_fullsized":"2023-11-24T06:14:52.098619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648773+0000","last_change":"2023-11-24T06:14:50.674073+0000","last_active":"2023-11-24T06:14:51.648773+0000","last_peered":"2023-11-24T06:14:51.648773+0000","last_clean":"2023-11-24T06:14:51.648773+0000","last_became_active":"2023-11-24T06:14:50.673664+0000","last_became_peered":"2023-11-24T06:14:50.673664+0000","last_unstale":"2023-11-24T06:14:51.648773+0000","last_undegraded":"2023-11-24T06:14:51.648773+0000","last_fullsized":"2023-11-24T06:14:51.648773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099308+0000","last_change":"2023-11-24T06:14:50.678205+0000","last_active":"2023-11-24T06:14:52.099308+0000","last_peered":"2023-11-24T06:14:52.099308+0000","last_clean":"2023-11-24T06:14:52.099308+0000","last_became_active":"2023-11-24T06:14:50.677191+0000","last_became_peered":"2023-11-24T06:14:50.677191+0000","last_unstale":"2023-11-24T06:14:52.099308+0000","last_undegraded":"2023-11-24T06:14:52.099308+0000","last_fullsized":"2023-11-24T06:14:52.099308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087355+0000","last_change":"2023-11-24T06:14:50.676733+0000","last_active":"2023-11-24T06:14:52.087355+0000","last_peered":"2023-11-24T06:14:52.087355+0000","last_clean":"2023-11-24T06:14:52.087355+0000","last_became_active":"2023-11-24T06:14:50.676449+0000","last_became_peered":"2023-11-24T06:14:50.676449+0000","last_unstale":"2023-11-24T06:14:52.087355+0000","last_undegraded":"2023-11-24T06:14:52.087355+0000","last_fullsized":"2023-11-24T06:14:52.087355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643784+0000","last_change":"2023-11-24T06:14:50.673695+0000","last_active":"2023-11-24T06:14:51.643784+0000","last_peered":"2023-11-24T06:14:51.643784+0000","last_clean":"2023-11-24T06:14:51.643784+0000","last_became_active":"2023-11-24T06:14:50.673352+0000","last_became_peered":"2023-11-24T06:14:50.673352+0000","last_unstale":"2023-11-24T06:14:51.643784+0000","last_undegraded":"2023-11-24T06:14:51.643784+0000","last_fullsized":"2023-11-24T06:14:51.643784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099455+0000","last_change":"2023-11-24T06:14:50.676349+0000","last_active":"2023-11-24T06:14:52.099455+0000","last_peered":"2023-11-24T06:14:52.099455+0000","last_clean":"2023-11-24T06:14:52.099455+0000","last_became_active":"2023-11-24T06:14:50.676071+0000","last_became_peered":"2023-11-24T06:14:50.676071+0000","last_unstale":"2023-11-24T06:14:52.099455+0000","last_undegraded":"2023-11-24T06:14:52.099455+0000","last_fullsized":"2023-11-24T06:14:52.099455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099881+0000","last_change":"2023-11-24T06:14:50.680531+0000","last_active":"2023-11-24T06:14:52.099881+0000","last_peered":"2023-11-24T06:14:52.099881+0000","last_clean":"2023-11-24T06:14:52.099881+0000","last_became_active":"2023-11-24T06:14:50.680165+0000","last_became_peered":"2023-11-24T06:14:50.680165+0000","last_unstale":"2023-11-24T06:14:52.099881+0000","last_undegraded":"2023-11-24T06:14:52.099881+0000","last_fullsized":"2023-11-24T06:14:52.099881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649625+0000","last_change":"2023-11-24T06:14:50.670339+0000","last_active":"2023-11-24T06:14:51.649625+0000","last_peered":"2023-11-24T06:14:51.649625+0000","last_clean":"2023-11-24T06:14:51.649625+0000","last_became_active":"2023-11-24T06:14:50.670090+0000","last_became_peered":"2023-11-24T06:14:50.670090+0000","last_unstale":"2023-11-24T06:14:51.649625+0000","last_undegraded":"2023-11-24T06:14:51.649625+0000","last_fullsized":"2023-11-24T06:14:51.649625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096750+0000","last_change":"2023-11-24T06:14:50.666860+0000","last_active":"2023-11-24T06:14:52.096750+0000","last_peered":"2023-11-24T06:14:52.096750+0000","last_clean":"2023-11-24T06:14:52.096750+0000","last_became_active":"2023-11-24T06:14:50.666581+0000","last_became_peered":"2023-11-24T06:14:50.666581+0000","last_unstale":"2023-11-24T06:14:52.096750+0000","last_undegraded":"2023-11-24T06:14:52.096750+0000","last_fullsized":"2023-11-24T06:14:52.096750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087368+0000","last_change":"2023-11-24T06:14:50.674598+0000","last_active":"2023-11-24T06:14:52.087368+0000","last_peered":"2023-11-24T06:14:52.087368+0000","last_clean":"2023-11-24T06:14:52.087368+0000","last_became_active":"2023-11-24T06:14:50.674093+0000","last_became_peered":"2023-11-24T06:14:50.674093+0000","last_unstale":"2023-11-24T06:14:52.087368+0000","last_undegraded":"2023-11-24T06:14:52.087368+0000","last_fullsized":"2023-11-24T06:14:52.087368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650044+0000","last_change":"2023-11-24T06:14:50.668892+0000","last_active":"2023-11-24T06:14:51.650044+0000","last_peered":"2023-11-24T06:14:51.650044+0000","last_clean":"2023-11-24T06:14:51.650044+0000","last_became_active":"2023-11-24T06:14:50.668376+0000","last_became_peered":"2023-11-24T06:14:50.668376+0000","last_unstale":"2023-11-24T06:14:51.650044+0000","last_undegraded":"2023-11-24T06:14:51.650044+0000","last_fullsized":"2023-11-24T06:14:51.650044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708546+0000","last_change":"2023-11-24T06:14:49.697821+0000","last_active":"2023-11-24T06:14:50.708546+0000","last_peered":"2023-11-24T06:14:50.708546+0000","last_clean":"2023-11-24T06:14:50.708546+0000","last_became_active":"2023-11-24T06:14:49.697563+0000","last_became_peered":"2023-11-24T06:14:49.697563+0000","last_unstale":"2023-11-24T06:14:50.708546+0000","last_undegraded":"2023-11-24T06:14:50.708546+0000","last_fullsized":"2023-11-24T06:14:50.708546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100036+0000","last_change":"2023-11-24T06:14:50.679328+0000","last_active":"2023-11-24T06:14:52.100036+0000","last_peered":"2023-11-24T06:14:52.100036+0000","last_clean":"2023-11-24T06:14:52.100036+0000","last_became_active":"2023-11-24T06:14:50.675211+0000","last_became_peered":"2023-11-24T06:14:50.675211+0000","last_unstale":"2023-11-24T06:14:52.100036+0000","last_undegraded":"2023-11-24T06:14:52.100036+0000","last_fullsized":"2023-11-24T06:14:52.100036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708071+0000","last_change":"2023-11-24T06:14:49.695142+0000","last_active":"2023-11-24T06:14:50.708071+0000","last_peered":"2023-11-24T06:14:50.708071+0000","last_clean":"2023-11-24T06:14:50.708071+0000","last_became_active":"2023-11-24T06:14:49.694825+0000","last_became_peered":"2023-11-24T06:14:49.694825+0000","last_unstale":"2023-11-24T06:14:50.708071+0000","last_undegraded":"2023-11-24T06:14:50.708071+0000","last_fullsized":"2023-11-24T06:14:50.708071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.664430+0000","last_change":"2023-11-24T06:14:49.706014+0000","last_active":"2023-11-24T06:14:50.664430+0000","last_peered":"2023-11-24T06:14:50.664430+0000","last_clean":"2023-11-24T06:14:50.664430+0000","last_became_active":"2023-11-24T06:14:49.705727+0000","last_became_peered":"2023-11-24T06:14:49.705727+0000","last_unstale":"2023-11-24T06:14:50.664430+0000","last_undegraded":"2023-11-24T06:14:50.664430+0000","last_fullsized":"2023-11-24T06:14:50.664430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098742+0000","last_change":"2023-11-24T06:14:50.679393+0000","last_active":"2023-11-24T06:14:52.098742+0000","last_peered":"2023-11-24T06:14:52.098742+0000","last_clean":"2023-11-24T06:14:52.098742+0000","last_became_active":"2023-11-24T06:14:50.679078+0000","last_became_peered":"2023-11-24T06:14:50.679078+0000","last_unstale":"2023-11-24T06:14:52.098742+0000","last_undegraded":"2023-11-24T06:14:52.098742+0000","last_fullsized":"2023-11-24T06:14:52.098742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655585+0000","last_change":"2023-11-24T06:14:49.702941+0000","last_active":"2023-11-24T06:14:50.655585+0000","last_peered":"2023-11-24T06:14:50.655585+0000","last_clean":"2023-11-24T06:14:50.655585+0000","last_became_active":"2023-11-24T06:14:49.701670+0000","last_became_peered":"2023-11-24T06:14:49.701670+0000","last_unstale":"2023-11-24T06:14:50.655585+0000","last_undegraded":"2023-11-24T06:14:50.655585+0000","last_fullsized":"2023-11-24T06:14:50.655585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643424+0000","last_change":"2023-11-24T06:14:50.675363+0000","last_active":"2023-11-24T06:14:51.643424+0000","last_peered":"2023-11-24T06:14:51.643424+0000","last_clean":"2023-11-24T06:14:51.643424+0000","last_became_active":"2023-11-24T06:14:50.675034+0000","last_became_peered":"2023-11-24T06:14:50.675034+0000","last_unstale":"2023-11-24T06:14:51.643424+0000","last_undegraded":"2023-11-24T06:14:51.643424+0000","last_fullsized":"2023-11-24T06:14:51.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.657217+0000","last_change":"2023-11-24T06:14:49.703756+0000","last_active":"2023-11-24T06:14:50.657217+0000","last_peered":"2023-11-24T06:14:50.657217+0000","last_clean":"2023-11-24T06:14:50.657217+0000","last_became_active":"2023-11-24T06:14:49.703456+0000","last_became_peered":"2023-11-24T06:14:49.703456+0000","last_unstale":"2023-11-24T06:14:50.657217+0000","last_undegraded":"2023-11-24T06:14:50.657217+0000","last_fullsized":"2023-11-24T06:14:50.657217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650542+0000","last_change":"2023-11-24T06:14:50.680598+0000","last_active":"2023-11-24T06:14:51.650542+0000","last_peered":"2023-11-24T06:14:51.650542+0000","last_clean":"2023-11-24T06:14:51.650542+0000","last_became_active":"2023-11-24T06:14:50.680267+0000","last_became_peered":"2023-11-24T06:14:50.680267+0000","last_unstale":"2023-11-24T06:14:51.650542+0000","last_undegraded":"2023-11-24T06:14:51.650542+0000","last_fullsized":"2023-11-24T06:14:51.650542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.659528+0000","last_change":"2023-11-24T06:14:49.705839+0000","last_active":"2023-11-24T06:14:50.659528+0000","last_peered":"2023-11-24T06:14:50.659528+0000","last_clean":"2023-11-24T06:14:50.659528+0000","last_became_active":"2023-11-24T06:14:49.705477+0000","last_became_peered":"2023-11-24T06:14:49.705477+0000","last_unstale":"2023-11-24T06:14:50.659528+0000","last_undegraded":"2023-11-24T06:14:50.659528+0000","last_fullsized":"2023-11-24T06:14:50.659528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:31.756581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100424+0000","last_change":"2023-11-24T06:14:50.673579+0000","last_active":"2023-11-24T06:14:52.100424+0000","last_peered":"2023-11-24T06:14:52.100424+0000","last_clean":"2023-11-24T06:14:52.100424+0000","last_became_active":"2023-11-24T06:14:50.673282+0000","last_became_peered":"2023-11-24T06:14:50.673282+0000","last_unstale":"2023-11-24T06:14:52.100424+0000","last_undegraded":"2023-11-24T06:14:52.100424+0000","last_fullsized":"2023-11-24T06:14:52.100424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712613+0000","last_change":"2023-11-24T06:14:49.701007+0000","last_active":"2023-11-24T06:14:50.712613+0000","last_peered":"2023-11-24T06:14:50.712613+0000","last_clean":"2023-11-24T06:14:50.712613+0000","last_became_active":"2023-11-24T06:14:49.700724+0000","last_became_peered":"2023-11-24T06:14:49.700724+0000","last_unstale":"2023-11-24T06:14:50.712613+0000","last_undegraded":"2023-11-24T06:14:50.712613+0000","last_fullsized":"2023-11-24T06:14:50.712613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649436+0000","last_change":"2023-11-24T06:14:50.673608+0000","last_active":"2023-11-24T06:14:51.649436+0000","last_peered":"2023-11-24T06:14:51.649436+0000","last_clean":"2023-11-24T06:14:51.649436+0000","last_became_active":"2023-11-24T06:14:50.673301+0000","last_became_peered":"2023-11-24T06:14:50.673301+0000","last_unstale":"2023-11-24T06:14:51.649436+0000","last_undegraded":"2023-11-24T06:14:51.649436+0000","last_fullsized":"2023-11-24T06:14:51.649436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.714522+0000","last_change":"2023-11-24T06:14:49.704014+0000","last_active":"2023-11-24T06:14:50.714522+0000","last_peered":"2023-11-24T06:14:50.714522+0000","last_clean":"2023-11-24T06:14:50.714522+0000","last_became_active":"2023-11-24T06:14:49.703708+0000","last_became_peered":"2023-11-24T06:14:49.703708+0000","last_unstale":"2023-11-24T06:14:50.714522+0000","last_undegraded":"2023-11-24T06:14:50.714522+0000","last_fullsized":"2023-11-24T06:14:50.714522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099830+0000","last_change":"2023-11-24T06:14:50.677436+0000","last_active":"2023-11-24T06:14:52.099830+0000","last_peered":"2023-11-24T06:14:52.099830+0000","last_clean":"2023-11-24T06:14:52.099830+0000","last_became_active":"2023-11-24T06:14:50.676715+0000","last_became_peered":"2023-11-24T06:14:50.676715+0000","last_unstale":"2023-11-24T06:14:52.099830+0000","last_undegraded":"2023-11-24T06:14:52.099830+0000","last_fullsized":"2023-11-24T06:14:52.099830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712757+0000","last_change":"2023-11-24T06:14:49.693145+0000","last_active":"2023-11-24T06:14:50.712757+0000","last_peered":"2023-11-24T06:14:50.712757+0000","last_clean":"2023-11-24T06:14:50.712757+0000","last_became_active":"2023-11-24T06:14:49.692740+0000","last_became_peered":"2023-11-24T06:14:49.692740+0000","last_unstale":"2023-11-24T06:14:50.712757+0000","last_undegraded":"2023-11-24T06:14:50.712757+0000","last_fullsized":"2023-11-24T06:14:50.712757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100100+0000","last_change":"2023-11-24T06:14:50.679348+0000","last_active":"2023-11-24T06:14:52.100100+0000","last_peered":"2023-11-24T06:14:52.100100+0000","last_clean":"2023-11-24T06:14:52.100100+0000","last_became_active":"2023-11-24T06:14:50.679013+0000","last_became_peered":"2023-11-24T06:14:50.679013+0000","last_unstale":"2023-11-24T06:14:52.100100+0000","last_undegraded":"2023-11-24T06:14:52.100100+0000","last_fullsized":"2023-11-24T06:14:52.100100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650013+0000","last_change":"2023-11-24T06:14:49.694677+0000","last_active":"2023-11-24T06:14:50.650013+0000","last_peered":"2023-11-24T06:14:50.650013+0000","last_clean":"2023-11-24T06:14:50.650013+0000","last_became_active":"2023-11-24T06:14:49.694383+0000","last_became_peered":"2023-11-24T06:14:49.694383+0000","last_unstale":"2023-11-24T06:14:50.650013+0000","last_undegraded":"2023-11-24T06:14:50.650013+0000","last_fullsized":"2023-11-24T06:14:50.650013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099792+0000","last_change":"2023-11-24T06:14:50.677961+0000","last_active":"2023-11-24T06:14:52.099792+0000","last_peered":"2023-11-24T06:14:52.099792+0000","last_clean":"2023-11-24T06:14:52.099792+0000","last_became_active":"2023-11-24T06:14:50.675864+0000","last_became_peered":"2023-11-24T06:14:50.675864+0000","last_unstale":"2023-11-24T06:14:52.099792+0000","last_undegraded":"2023-11-24T06:14:52.099792+0000","last_fullsized":"2023-11-24T06:14:52.099792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.654827+0000","last_change":"2023-11-24T06:14:49.698393+0000","last_active":"2023-11-24T06:14:50.654827+0000","last_peered":"2023-11-24T06:14:50.654827+0000","last_clean":"2023-11-24T06:14:50.654827+0000","last_became_active":"2023-11-24T06:14:49.698130+0000","last_became_peered":"2023-11-24T06:14:49.698130+0000","last_unstale":"2023-11-24T06:14:50.654827+0000","last_undegraded":"2023-11-24T06:14:50.654827+0000","last_fullsized":"2023-11-24T06:14:50.654827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087151+0000","last_change":"2023-11-24T06:14:50.674381+0000","last_active":"2023-11-24T06:14:52.087151+0000","last_peered":"2023-11-24T06:14:52.087151+0000","last_clean":"2023-11-24T06:14:52.087151+0000","last_became_active":"2023-11-24T06:14:50.673643+0000","last_became_peered":"2023-11-24T06:14:50.673643+0000","last_unstale":"2023-11-24T06:14:52.087151+0000","last_undegraded":"2023-11-24T06:14:52.087151+0000","last_fullsized":"2023-11-24T06:14:52.087151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.713585+0000","last_change":"2023-11-24T06:14:49.685131+0000","last_active":"2023-11-24T06:14:50.713585+0000","last_peered":"2023-11-24T06:14:50.713585+0000","last_clean":"2023-11-24T06:14:50.713585+0000","last_became_active":"2023-11-24T06:14:49.684509+0000","last_became_peered":"2023-11-24T06:14:49.684509+0000","last_unstale":"2023-11-24T06:14:50.713585+0000","last_undegraded":"2023-11-24T06:14:50.713585+0000","last_fullsized":"2023-11-24T06:14:50.713585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099960+0000","last_change":"2023-11-24T06:14:50.679197+0000","last_active":"2023-11-24T06:14:52.099960+0000","last_peered":"2023-11-24T06:14:52.099960+0000","last_clean":"2023-11-24T06:14:52.099960+0000","last_became_active":"2023-11-24T06:14:50.676823+0000","last_became_peered":"2023-11-24T06:14:50.676823+0000","last_unstale":"2023-11-24T06:14:52.099960+0000","last_undegraded":"2023-11-24T06:14:52.099960+0000","last_fullsized":"2023-11-24T06:14:52.099960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710348+0000","last_change":"2023-11-24T06:14:49.698361+0000","last_active":"2023-11-24T06:14:50.710348+0000","last_peered":"2023-11-24T06:14:50.710348+0000","last_clean":"2023-11-24T06:14:50.710348+0000","last_became_active":"2023-11-24T06:14:49.698063+0000","last_became_peered":"2023-11-24T06:14:49.698063+0000","last_unstale":"2023-11-24T06:14:50.710348+0000","last_undegraded":"2023-11-24T06:14:50.710348+0000","last_fullsized":"2023-11-24T06:14:50.710348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100144+0000","last_change":"2023-11-24T06:14:50.678280+0000","last_active":"2023-11-24T06:14:52.100144+0000","last_peered":"2023-11-24T06:14:52.100144+0000","last_clean":"2023-11-24T06:14:52.100144+0000","last_became_active":"2023-11-24T06:14:50.677222+0000","last_became_peered":"2023-11-24T06:14:50.677222+0000","last_unstale":"2023-11-24T06:14:52.100144+0000","last_undegraded":"2023-11-24T06:14:52.100144+0000","last_fullsized":"2023-11-24T06:14:52.100144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709589+0000","last_change":"2023-11-24T06:14:49.686043+0000","last_active":"2023-11-24T06:14:50.709589+0000","last_peered":"2023-11-24T06:14:50.709589+0000","last_clean":"2023-11-24T06:14:50.709589+0000","last_became_active":"2023-11-24T06:14:49.685728+0000","last_became_peered":"2023-11-24T06:14:49.685728+0000","last_unstale":"2023-11-24T06:14:50.709589+0000","last_undegraded":"2023-11-24T06:14:50.709589+0000","last_fullsized":"2023-11-24T06:14:50.709589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100809+0000","last_change":"2023-11-24T06:14:50.685979+0000","last_active":"2023-11-24T06:14:52.100809+0000","last_peered":"2023-11-24T06:14:52.100809+0000","last_clean":"2023-11-24T06:14:52.100809+0000","last_became_active":"2023-11-24T06:14:50.685166+0000","last_became_peered":"2023-11-24T06:14:50.685166+0000","last_unstale":"2023-11-24T06:14:52.100809+0000","last_undegraded":"2023-11-24T06:14:52.100809+0000","last_fullsized":"2023-11-24T06:14:52.100809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:41.237889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712701+0000","last_change":"2023-11-24T06:14:49.689763+0000","last_active":"2023-11-24T06:14:50.712701+0000","last_peered":"2023-11-24T06:14:50.712701+0000","last_clean":"2023-11-24T06:14:50.712701+0000","last_became_active":"2023-11-24T06:14:49.689550+0000","last_became_peered":"2023-11-24T06:14:49.689550+0000","last_unstale":"2023-11-24T06:14:50.712701+0000","last_undegraded":"2023-11-24T06:14:50.712701+0000","last_fullsized":"2023-11-24T06:14:50.712701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649468+0000","last_change":"2023-11-24T06:14:50.674890+0000","last_active":"2023-11-24T06:14:51.649468+0000","last_peered":"2023-11-24T06:14:51.649468+0000","last_clean":"2023-11-24T06:14:51.649468+0000","last_became_active":"2023-11-24T06:14:50.674553+0000","last_became_peered":"2023-11-24T06:14:50.674553+0000","last_unstale":"2023-11-24T06:14:51.649468+0000","last_undegraded":"2023-11-24T06:14:51.649468+0000","last_fullsized":"2023-11-24T06:14:51.649468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655833+0000","last_change":"2023-11-24T06:14:49.694356+0000","last_active":"2023-11-24T06:14:50.655833+0000","last_peered":"2023-11-24T06:14:50.655833+0000","last_clean":"2023-11-24T06:14:50.655833+0000","last_became_active":"2023-11-24T06:14:49.694071+0000","last_became_peered":"2023-11-24T06:14:49.694071+0000","last_unstale":"2023-11-24T06:14:50.655833+0000","last_undegraded":"2023-11-24T06:14:50.655833+0000","last_fullsized":"2023-11-24T06:14:50.655833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100208+0000","last_change":"2023-11-24T06:14:50.678368+0000","last_active":"2023-11-24T06:14:52.100208+0000","last_peered":"2023-11-24T06:14:52.100208+0000","last_clean":"2023-11-24T06:14:52.100208+0000","last_became_active":"2023-11-24T06:14:50.678080+0000","last_became_peered":"2023-11-24T06:14:50.678080+0000","last_unstale":"2023-11-24T06:14:52.100208+0000","last_undegraded":"2023-11-24T06:14:52.100208+0000","last_fullsized":"2023-11-24T06:14:52.100208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.662084+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:14:50.662084+0000","last_peered":"2023-11-24T06:14:50.662084+0000","last_clean":"2023-11-24T06:14:50.662084+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:14:50.662084+0000","last_undegraded":"2023-11-24T06:14:50.662084+0000","last_fullsized":"2023-11-24T06:14:50.662084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655544+0000","last_change":"2023-11-24T06:14:49.696906+0000","last_active":"2023-11-24T06:14:50.655544+0000","last_peered":"2023-11-24T06:14:50.655544+0000","last_clean":"2023-11-24T06:14:50.655544+0000","last_became_active":"2023-11-24T06:14:49.696642+0000","last_became_peered":"2023-11-24T06:14:49.696642+0000","last_unstale":"2023-11-24T06:14:50.655544+0000","last_undegraded":"2023-11-24T06:14:50.655544+0000","last_fullsized":"2023-11-24T06:14:50.655544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:22.648754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098494+0000","last_change":"2023-11-24T06:14:50.668661+0000","last_active":"2023-11-24T06:14:52.098494+0000","last_peered":"2023-11-24T06:14:52.098494+0000","last_clean":"2023-11-24T06:14:52.098494+0000","last_became_active":"2023-11-24T06:14:50.668333+0000","last_became_peered":"2023-11-24T06:14:50.668333+0000","last_unstale":"2023-11-24T06:14:52.098494+0000","last_undegraded":"2023-11-24T06:14:52.098494+0000","last_fullsized":"2023-11-24T06:14:52.098494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661983+0000","last_change":"2023-11-24T06:14:49.710092+0000","last_active":"2023-11-24T06:14:50.661983+0000","last_peered":"2023-11-24T06:14:50.661983+0000","last_clean":"2023-11-24T06:14:50.661983+0000","last_became_active":"2023-11-24T06:14:49.709784+0000","last_became_peered":"2023-11-24T06:14:49.709784+0000","last_unstale":"2023-11-24T06:14:50.661983+0000","last_undegraded":"2023-11-24T06:14:50.661983+0000","last_fullsized":"2023-11-24T06:14:50.661983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099297+0000","last_change":"2023-11-24T06:14:50.676764+0000","last_active":"2023-11-24T06:14:52.099297+0000","last_peered":"2023-11-24T06:14:52.099297+0000","last_clean":"2023-11-24T06:14:52.099297+0000","last_became_active":"2023-11-24T06:14:50.676031+0000","last_became_peered":"2023-11-24T06:14:50.676031+0000","last_unstale":"2023-11-24T06:14:52.099297+0000","last_undegraded":"2023-11-24T06:14:52.099297+0000","last_fullsized":"2023-11-24T06:14:52.099297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:59.786496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655216+0000","last_change":"2023-11-24T06:14:49.687348+0000","last_active":"2023-11-24T06:14:50.655216+0000","last_peered":"2023-11-24T06:14:50.655216+0000","last_clean":"2023-11-24T06:14:50.655216+0000","last_became_active":"2023-11-24T06:14:49.685807+0000","last_became_peered":"2023-11-24T06:14:49.685807+0000","last_unstale":"2023-11-24T06:14:50.655216+0000","last_undegraded":"2023-11-24T06:14:50.655216+0000","last_fullsized":"2023-11-24T06:14:50.655216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643489+0000","last_change":"2023-11-24T06:14:50.662346+0000","last_active":"2023-11-24T06:14:51.643489+0000","last_peered":"2023-11-24T06:14:51.643489+0000","last_clean":"2023-11-24T06:14:51.643489+0000","last_became_active":"2023-11-24T06:14:50.661969+0000","last_became_peered":"2023-11-24T06:14:50.661969+0000","last_unstale":"2023-11-24T06:14:51.643489+0000","last_undegraded":"2023-11-24T06:14:51.643489+0000","last_fullsized":"2023-11-24T06:14:51.643489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650302+0000","last_change":"2023-11-24T06:14:49.693881+0000","last_active":"2023-11-24T06:14:50.650302+0000","last_peered":"2023-11-24T06:14:50.650302+0000","last_clean":"2023-11-24T06:14:50.650302+0000","last_became_active":"2023-11-24T06:14:49.692876+0000","last_became_peered":"2023-11-24T06:14:49.692876+0000","last_unstale":"2023-11-24T06:14:50.650302+0000","last_undegraded":"2023-11-24T06:14:50.650302+0000","last_fullsized":"2023-11-24T06:14:50.650302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649095+0000","last_change":"2023-11-24T06:14:50.685296+0000","last_active":"2023-11-24T06:14:51.649095+0000","last_peered":"2023-11-24T06:14:51.649095+0000","last_clean":"2023-11-24T06:14:51.649095+0000","last_became_active":"2023-11-24T06:14:50.681627+0000","last_became_peered":"2023-11-24T06:14:50.681627+0000","last_unstale":"2023-11-24T06:14:51.649095+0000","last_undegraded":"2023-11-24T06:14:51.649095+0000","last_fullsized":"2023-11-24T06:14:51.649095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:02.302315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645831+0000","last_change":"2023-11-24T06:14:49.694973+0000","last_active":"2023-11-24T06:14:50.645831+0000","last_peered":"2023-11-24T06:14:50.645831+0000","last_clean":"2023-11-24T06:14:50.645831+0000","last_became_active":"2023-11-24T06:14:49.694351+0000","last_became_peered":"2023-11-24T06:14:49.694351+0000","last_unstale":"2023-11-24T06:14:50.645831+0000","last_undegraded":"2023-11-24T06:14:50.645831+0000","last_fullsized":"2023-11-24T06:14:50.645831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650479+0000","last_change":"2023-11-24T06:14:50.674491+0000","last_active":"2023-11-24T06:14:51.650479+0000","last_peered":"2023-11-24T06:14:51.650479+0000","last_clean":"2023-11-24T06:14:51.650479+0000","last_became_active":"2023-11-24T06:14:50.674140+0000","last_became_peered":"2023-11-24T06:14:50.674140+0000","last_unstale":"2023-11-24T06:14:51.650479+0000","last_undegraded":"2023-11-24T06:14:51.650479+0000","last_fullsized":"2023-11-24T06:14:51.650479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.665634+0000","last_change":"2023-11-24T06:14:49.710812+0000","last_active":"2023-11-24T06:14:50.665634+0000","last_peered":"2023-11-24T06:14:50.665634+0000","last_clean":"2023-11-24T06:14:50.665634+0000","last_became_active":"2023-11-24T06:14:49.710500+0000","last_became_peered":"2023-11-24T06:14:49.710500+0000","last_unstale":"2023-11-24T06:14:50.665634+0000","last_undegraded":"2023-11-24T06:14:50.665634+0000","last_fullsized":"2023-11-24T06:14:50.665634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:48.196535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643655+0000","last_change":"2023-11-24T06:14:50.669928+0000","last_active":"2023-11-24T06:14:51.643655+0000","last_peered":"2023-11-24T06:14:51.643655+0000","last_clean":"2023-11-24T06:14:51.643655+0000","last_became_active":"2023-11-24T06:14:50.666246+0000","last_became_peered":"2023-11-24T06:14:50.666246+0000","last_unstale":"2023-11-24T06:14:51.643655+0000","last_undegraded":"2023-11-24T06:14:51.643655+0000","last_fullsized":"2023-11-24T06:14:51.643655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643916+0000","last_change":"2023-11-24T06:14:49.703013+0000","last_active":"2023-11-24T06:14:51.643916+0000","last_peered":"2023-11-24T06:14:51.643916+0000","last_clean":"2023-11-24T06:14:51.643916+0000","last_became_active":"2023-11-24T06:14:49.702599+0000","last_became_peered":"2023-11-24T06:14:49.702599+0000","last_unstale":"2023-11-24T06:14:51.643916+0000","last_undegraded":"2023-11-24T06:14:51.643916+0000","last_fullsized":"2023-11-24T06:14:51.643916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099635+0000","last_change":"2023-11-24T06:14:50.677366+0000","last_active":"2023-11-24T06:14:52.099635+0000","last_peered":"2023-11-24T06:14:52.099635+0000","last_clean":"2023-11-24T06:14:52.099635+0000","last_became_active":"2023-11-24T06:14:50.677021+0000","last_became_peered":"2023-11-24T06:14:50.677021+0000","last_unstale":"2023-11-24T06:14:52.099635+0000","last_undegraded":"2023-11-24T06:14:52.099635+0000","last_fullsized":"2023-11-24T06:14:52.099635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708120+0000","last_change":"2023-11-24T06:14:49.705904+0000","last_active":"2023-11-24T06:14:50.708120+0000","last_peered":"2023-11-24T06:14:50.708120+0000","last_clean":"2023-11-24T06:14:50.708120+0000","last_became_active":"2023-11-24T06:14:49.705615+0000","last_became_peered":"2023-11-24T06:14:49.705615+0000","last_unstale":"2023-11-24T06:14:50.708120+0000","last_undegraded":"2023-11-24T06:14:50.708120+0000","last_fullsized":"2023-11-24T06:14:50.708120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100419+0000","last_change":"2023-11-24T06:14:50.670885+0000","last_active":"2023-11-24T06:14:52.100419+0000","last_peered":"2023-11-24T06:14:52.100419+0000","last_clean":"2023-11-24T06:14:52.100419+0000","last_became_active":"2023-11-24T06:14:50.670481+0000","last_became_peered":"2023-11-24T06:14:50.670481+0000","last_unstale":"2023-11-24T06:14:52.100419+0000","last_undegraded":"2023-11-24T06:14:52.100419+0000","last_fullsized":"2023-11-24T06:14:52.100419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661454+0000","last_change":"2023-11-24T06:14:49.710392+0000","last_active":"2023-11-24T06:14:50.661454+0000","last_peered":"2023-11-24T06:14:50.661454+0000","last_clean":"2023-11-24T06:14:50.661454+0000","last_became_active":"2023-11-24T06:14:49.710102+0000","last_became_peered":"2023-11-24T06:14:49.710102+0000","last_unstale":"2023-11-24T06:14:50.661454+0000","last_undegraded":"2023-11-24T06:14:50.661454+0000","last_fullsized":"2023-11-24T06:14:50.661454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648534+0000","last_change":"2023-11-24T06:14:50.667556+0000","last_active":"2023-11-24T06:14:51.648534+0000","last_peered":"2023-11-24T06:14:51.648534+0000","last_clean":"2023-11-24T06:14:51.648534+0000","last_became_active":"2023-11-24T06:14:50.667254+0000","last_became_peered":"2023-11-24T06:14:50.667254+0000","last_unstale":"2023-11-24T06:14:51.648534+0000","last_undegraded":"2023-11-24T06:14:51.648534+0000","last_fullsized":"2023-11-24T06:14:51.648534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:41.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645782+0000","last_change":"2023-11-24T06:14:49.700284+0000","last_active":"2023-11-24T06:14:50.645782+0000","last_peered":"2023-11-24T06:14:50.645782+0000","last_clean":"2023-11-24T06:14:50.645782+0000","last_became_active":"2023-11-24T06:14:49.699898+0000","last_became_peered":"2023-11-24T06:14:49.699898+0000","last_unstale":"2023-11-24T06:14:50.645782+0000","last_undegraded":"2023-11-24T06:14:50.645782+0000","last_fullsized":"2023-11-24T06:14:50.645782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098745+0000","last_change":"2023-11-24T06:14:50.671052+0000","last_active":"2023-11-24T06:14:52.098745+0000","last_peered":"2023-11-24T06:14:52.098745+0000","last_clean":"2023-11-24T06:14:52.098745+0000","last_became_active":"2023-11-24T06:14:50.670386+0000","last_became_peered":"2023-11-24T06:14:50.670386+0000","last_unstale":"2023-11-24T06:14:52.098745+0000","last_undegraded":"2023-11-24T06:14:52.098745+0000","last_fullsized":"2023-11-24T06:14:52.098745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.643772+0000","last_change":"2023-11-24T06:14:49.684530+0000","last_active":"2023-11-24T06:14:50.643772+0000","last_peered":"2023-11-24T06:14:50.643772+0000","last_clean":"2023-11-24T06:14:50.643772+0000","last_became_active":"2023-11-24T06:14:49.684174+0000","last_became_peered":"2023-11-24T06:14:49.684174+0000","last_unstale":"2023-11-24T06:14:50.643772+0000","last_undegraded":"2023-11-24T06:14:50.643772+0000","last_fullsized":"2023-11-24T06:14:50.643772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098771+0000","last_change":"2023-11-24T06:14:50.685541+0000","last_active":"2023-11-24T06:14:52.098771+0000","last_peered":"2023-11-24T06:14:52.098771+0000","last_clean":"2023-11-24T06:14:52.098771+0000","last_became_active":"2023-11-24T06:14:50.685197+0000","last_became_peered":"2023-11-24T06:14:50.685197+0000","last_unstale":"2023-11-24T06:14:52.098771+0000","last_undegraded":"2023-11-24T06:14:52.098771+0000","last_fullsized":"2023-11-24T06:14:52.098771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.706856+0000","last_change":"2023-11-24T06:14:49.708039+0000","last_active":"2023-11-24T06:14:50.706856+0000","last_peered":"2023-11-24T06:14:50.706856+0000","last_clean":"2023-11-24T06:14:50.706856+0000","last_became_active":"2023-11-24T06:14:49.707647+0000","last_became_peered":"2023-11-24T06:14:49.707647+0000","last_unstale":"2023-11-24T06:14:50.706856+0000","last_undegraded":"2023-11-24T06:14:50.706856+0000","last_fullsized":"2023-11-24T06:14:50.706856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086649+0000","last_change":"2023-11-24T06:14:50.677402+0000","last_active":"2023-11-24T06:14:52.086649+0000","last_peered":"2023-11-24T06:14:52.086649+0000","last_clean":"2023-11-24T06:14:52.086649+0000","last_became_active":"2023-11-24T06:14:50.677099+0000","last_became_peered":"2023-11-24T06:14:50.677099+0000","last_unstale":"2023-11-24T06:14:52.086649+0000","last_undegraded":"2023-11-24T06:14:52.086649+0000","last_fullsized":"2023-11-24T06:14:52.086649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650383+0000","last_change":"2023-11-24T06:14:50.675498+0000","last_active":"2023-11-24T06:14:51.650383+0000","last_peered":"2023-11-24T06:14:51.650383+0000","last_clean":"2023-11-24T06:14:51.650383+0000","last_became_active":"2023-11-24T06:14:50.675047+0000","last_became_peered":"2023-11-24T06:14:50.675047+0000","last_unstale":"2023-11-24T06:14:51.650383+0000","last_undegraded":"2023-11-24T06:14:51.650383+0000","last_fullsized":"2023-11-24T06:14:51.650383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708991+0000","last_change":"2023-11-24T06:14:49.712534+0000","last_active":"2023-11-24T06:14:50.708991+0000","last_peered":"2023-11-24T06:14:50.708991+0000","last_clean":"2023-11-24T06:14:50.708991+0000","last_became_active":"2023-11-24T06:14:49.712227+0000","last_became_peered":"2023-11-24T06:14:49.712227+0000","last_unstale":"2023-11-24T06:14:50.708991+0000","last_undegraded":"2023-11-24T06:14:50.708991+0000","last_fullsized":"2023-11-24T06:14:50.708991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649128+0000","last_change":"2023-11-24T06:14:50.679678+0000","last_active":"2023-11-24T06:14:51.649128+0000","last_peered":"2023-11-24T06:14:51.649128+0000","last_clean":"2023-11-24T06:14:51.649128+0000","last_became_active":"2023-11-24T06:14:50.679409+0000","last_became_peered":"2023-11-24T06:14:50.679409+0000","last_unstale":"2023-11-24T06:14:51.649128+0000","last_undegraded":"2023-11-24T06:14:51.649128+0000","last_fullsized":"2023-11-24T06:14:51.649128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709115+0000","last_change":"2023-11-24T06:14:49.712744+0000","last_active":"2023-11-24T06:14:50.709115+0000","last_peered":"2023-11-24T06:14:50.709115+0000","last_clean":"2023-11-24T06:14:50.709115+0000","last_became_active":"2023-11-24T06:14:49.712445+0000","last_became_peered":"2023-11-24T06:14:49.712445+0000","last_unstale":"2023-11-24T06:14:50.709115+0000","last_undegraded":"2023-11-24T06:14:50.709115+0000","last_fullsized":"2023-11-24T06:14:50.709115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100288+0000","last_change":"2023-11-24T06:14:50.673586+0000","last_active":"2023-11-24T06:14:52.100288+0000","last_peered":"2023-11-24T06:14:52.100288+0000","last_clean":"2023-11-24T06:14:52.100288+0000","last_became_active":"2023-11-24T06:14:50.672630+0000","last_became_peered":"2023-11-24T06:14:50.672630+0000","last_unstale":"2023-11-24T06:14:52.100288+0000","last_undegraded":"2023-11-24T06:14:52.100288+0000","last_fullsized":"2023-11-24T06:14:52.100288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710407+0000","last_change":"2023-11-24T06:14:49.695261+0000","last_active":"2023-11-24T06:14:50.710407+0000","last_peered":"2023-11-24T06:14:50.710407+0000","last_clean":"2023-11-24T06:14:50.710407+0000","last_became_active":"2023-11-24T06:14:49.692908+0000","last_became_peered":"2023-11-24T06:14:49.692908+0000","last_unstale":"2023-11-24T06:14:50.710407+0000","last_undegraded":"2023-11-24T06:14:50.710407+0000","last_fullsized":"2023-11-24T06:14:50.710407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099034+0000","last_change":"2023-11-24T06:14:50.682523+0000","last_active":"2023-11-24T06:14:52.099034+0000","last_peered":"2023-11-24T06:14:52.099034+0000","last_clean":"2023-11-24T06:14:52.099034+0000","last_became_active":"2023-11-24T06:14:50.682208+0000","last_became_peered":"2023-11-24T06:14:50.682208+0000","last_unstale":"2023-11-24T06:14:52.099034+0000","last_undegraded":"2023-11-24T06:14:52.099034+0000","last_fullsized":"2023-11-24T06:14:52.099034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710033+0000","last_change":"2023-11-24T06:14:49.701899+0000","last_active":"2023-11-24T06:14:50.710033+0000","last_peered":"2023-11-24T06:14:50.710033+0000","last_clean":"2023-11-24T06:14:50.710033+0000","last_became_active":"2023-11-24T06:14:49.701658+0000","last_became_peered":"2023-11-24T06:14:49.701658+0000","last_unstale":"2023-11-24T06:14:50.710033+0000","last_undegraded":"2023-11-24T06:14:50.710033+0000","last_fullsized":"2023-11-24T06:14:50.710033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:07.157268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.663}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7210000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2690000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0720000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9059999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:15:00.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.136+0000 7ff0a51cf640 1 Processor -- start 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.136+0000 7ff0a51cf640 1 -- start start 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.137+0000 7ff0a51cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.137+0000 7ff0a51cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0a00b1de0 0x7ff0a00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.137+0000 7ff0a51cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a015bf80 con 0x7ff0a015c410 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.137+0000 7ff0a51cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a00b27b0 con 0x7ff0a00b1de0 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.137+0000 7ff0a51cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00b1560 con 0x7ff0a0144b30 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff0a49ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0a00b1de0 0x7ff0a00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff0a49ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0a00b1de0 0x7ff0a00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33914/0 (socket says 172.21.15.37:33914) 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff0a49ce640 1 -- 172.21.15.37:0/764067022 learned_addr learned my addr 172.21.15.37:0/764067022 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff09ffff640 1 --2- 172.21.15.37:0/764067022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff0a49ce640 1 -- 172.21.15.37:0/764067022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 msgr2=0x7ff0a015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff0a49ce640 1 --2- 172.21.15.37:0/764067022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff0a49ce640 1 -- 172.21.15.37:0/764067022 >> v1:172.21.15.188:6789/0 conn(0x7ff0a015c410 legacy=0x7ff0a00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff0a49ce640 1 -- 172.21.15.37:0/764067022 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00b1280 con 0x7ff0a00b1de0 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.138+0000 7ff09ffff640 1 --2- 172.21.15.37:0/764067022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a015f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.139+0000 7ff0a49ce640 1 --2- 172.21.15.37:0/764067022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a00b1de0 0x7ff0a00b2270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff098009e50 tx=0x7ff09802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac51009142ca14e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff09effd640 1 -- 172.21.15.37:0/764067022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09802ca70 con 0x7ff0a00b1de0 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff09effd640 1 -- 172.21.15.37:0/764067022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09802cbd0 con 0x7ff0a00b1de0 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff09effd640 1 -- 172.21.15.37:0/764067022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980343f0 con 0x7ff0a00b1de0 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 -- 172.21.15.37:0/764067022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a00b1de0 msgr2=0x7ff0a00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/764067022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a00b1de0 0x7ff0a00b2270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff098009e50 tx=0x7ff09802bed0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 -- 172.21.15.37:0/764067022 shutdown_connections 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/764067022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a00b1de0 0x7ff0a00b2270 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/764067022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a015f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 -- 172.21.15.37:0/764067022 >> 172.21.15.37:0/764067022 conn(0x7ff0a00cb830 msgr2=0x7ff0a00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 -- 172.21.15.37:0/764067022 shutdown_connections 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.140+0000 7ff0a51cf640 1 -- 172.21.15.37:0/764067022 wait complete. 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.142+0000 7ff0a51cf640 1 Processor -- start 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.142+0000 7ff0a51cf640 1 -- start start 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.143+0000 7ff0a51cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0a00b1de0 0x7ff0a0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.143+0000 7ff0a51cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a00b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.143+0000 7ff0a51cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a015c410 0x7ff0a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.143+0000 7ff0a51cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a01f4040 con 0x7ff0a015c410 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.143+0000 7ff0a51cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0070ac0 con 0x7ff0a00b1de0 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.143+0000 7ff0a51cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a01f3d60 con 0x7ff0a0144b30 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a015c410 0x7ff0a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a015c410 0x7ff0a006c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33916/0 (socket says 172.21.15.37:33916) 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 -- 172.21.15.37:0/3347675611 learned_addr learned my addr 172.21.15.37:0/3347675611 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff09ffff640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0a00b1de0 0x7ff0a0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff09f7fe640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a00b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 -- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 msgr2=0x7ff0a00b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a00b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 -- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0a00b1de0 msgr2=0x7ff0a0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0a00b1de0 0x7ff0a0070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 -- 172.21.15.37:0/3347675611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009b30 con 0x7ff0a015c410 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff09ffff640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0a00b1de0 0x7ff0a0070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff09f7fe640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a00b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.144+0000 7ff0a49ce640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a015c410 0x7ff0a006c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff098009e50 tx=0x7ff098004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.145+0000 7ff09cff9640 1 -- 172.21.15.37:0/3347675611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09803e450 con 0x7ff0a015c410 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.145+0000 7ff09cff9640 1 -- 172.21.15.37:0/3347675611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09803e5d0 con 0x7ff0a015c410 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.145+0000 7ff09cff9640 1 -- 172.21.15.37:0/3347675611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09803e980 con 0x7ff0a015c410 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.145+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a0070470 con 0x7ff0a015c410 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.145+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a00b05f0 con 0x7ff0a015c410 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.146+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0070c50 con 0x7ff0a015c410 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.147+0000 7ff09cff9640 1 -- 172.21.15.37:0/3347675611 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff09803eae0 con 0x7ff0a015c410 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.148+0000 7ff09cff9640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff08c06ae40 0x7ff08c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.148+0000 7ff09cff9640 1 -- 172.21.15.37:0/3347675611 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0980ac500 con 0x7ff0a015c410 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.148+0000 7ff09ffff640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff08c06ae40 0x7ff08c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.149+0000 7ff09ffff640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff08c06ae40 0x7ff08c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0a006d4b0 tx=0x7ff090008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.152+0000 7ff09cff9640 1 -- 172.21.15.37:0/3347675611 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0980775b0 con 0x7ff0a015c410 2023-11-24T06:15:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.334+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0a00b22e0 con 0x7ff08c06ae40 2023-11-24T06:15:01.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.354+0000 7ff09cff9640 1 -- 172.21.15.37:0/3347675611 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264411 (secure 0 0 0) 0x7ff0a00b22e0 con 0x7ff08c06ae40 2023-11-24T06:15:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:01.363 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:15:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.360+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff08c06ae40 msgr2=0x7ff08c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.360+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff08c06ae40 0x7ff08c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0a006d4b0 tx=0x7ff090008040 comp rx=0 tx=0).stop 2023-11-24T06:15:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.360+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a015c410 msgr2=0x7ff0a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.360+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a015c410 0x7ff0a006c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff098009e50 tx=0x7ff098004a40 comp rx=0 tx=0).stop 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 shutdown_connections 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff08c06ae40 0x7ff08c06d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0a015c410 0x7ff0a006c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0a0144b30 0x7ff0a00b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 --2- 172.21.15.37:0/3347675611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0a00b1de0 0x7ff0a0070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 >> 172.21.15.37:0/3347675611 conn(0x7ff0a00cb830 msgr2=0x7ff0a00cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 shutdown_connections 2023-11-24T06:15:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.361+0000 7ff0a51cf640 1 -- 172.21.15.37:0/3347675611 wait complete. 2023-11-24T06:15:01.384 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:15:00.816615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003527"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100558+0000","last_change":"2023-11-24T06:14:50.682748+0000","last_active":"2023-11-24T06:14:52.100558+0000","last_peered":"2023-11-24T06:14:52.100558+0000","last_clean":"2023-11-24T06:14:52.100558+0000","last_became_active":"2023-11-24T06:14:50.682229+0000","last_became_peered":"2023-11-24T06:14:50.682229+0000","last_unstale":"2023-11-24T06:14:52.100558+0000","last_undegraded":"2023-11-24T06:14:52.100558+0000","last_fullsized":"2023-11-24T06:14:52.100558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:31.904106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643746+0000","last_change":"2023-11-24T06:14:50.672740+0000","last_active":"2023-11-24T06:14:51.643746+0000","last_peered":"2023-11-24T06:14:51.643746+0000","last_clean":"2023-11-24T06:14:51.643746+0000","last_became_active":"2023-11-24T06:14:50.672321+0000","last_became_peered":"2023-11-24T06:14:50.672321+0000","last_unstale":"2023-11-24T06:14:51.643746+0000","last_undegraded":"2023-11-24T06:14:51.643746+0000","last_fullsized":"2023-11-24T06:14:51.643746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100183+0000","last_change":"2023-11-24T06:14:50.682497+0000","last_active":"2023-11-24T06:14:52.100183+0000","last_peered":"2023-11-24T06:14:52.100183+0000","last_clean":"2023-11-24T06:14:52.100183+0000","last_became_active":"2023-11-24T06:14:50.682193+0000","last_became_peered":"2023-11-24T06:14:50.682193+0000","last_unstale":"2023-11-24T06:14:52.100183+0000","last_undegraded":"2023-11-24T06:14:52.100183+0000","last_fullsized":"2023-11-24T06:14:52.100183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648766+0000","last_change":"2023-11-24T06:14:50.674687+0000","last_active":"2023-11-24T06:14:51.648766+0000","last_peered":"2023-11-24T06:14:51.648766+0000","last_clean":"2023-11-24T06:14:51.648766+0000","last_became_active":"2023-11-24T06:14:50.673159+0000","last_became_peered":"2023-11-24T06:14:50.673159+0000","last_unstale":"2023-11-24T06:14:51.648766+0000","last_undegraded":"2023-11-24T06:14:51.648766+0000","last_fullsized":"2023-11-24T06:14:51.648766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100007+0000","last_change":"2023-11-24T06:14:50.672761+0000","last_active":"2023-11-24T06:14:52.100007+0000","last_peered":"2023-11-24T06:14:52.100007+0000","last_clean":"2023-11-24T06:14:52.100007+0000","last_became_active":"2023-11-24T06:14:50.672175+0000","last_became_peered":"2023-11-24T06:14:50.672175+0000","last_unstale":"2023-11-24T06:14:52.100007+0000","last_undegraded":"2023-11-24T06:14:52.100007+0000","last_fullsized":"2023-11-24T06:14:52.100007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647948+0000","last_change":"2023-11-24T06:14:50.676313+0000","last_active":"2023-11-24T06:14:51.647948+0000","last_peered":"2023-11-24T06:14:51.647948+0000","last_clean":"2023-11-24T06:14:51.647948+0000","last_became_active":"2023-11-24T06:14:50.675981+0000","last_became_peered":"2023-11-24T06:14:50.675981+0000","last_unstale":"2023-11-24T06:14:51.647948+0000","last_undegraded":"2023-11-24T06:14:51.647948+0000","last_fullsized":"2023-11-24T06:14:51.647948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099417+0000","last_change":"2023-11-24T06:14:50.678743+0000","last_active":"2023-11-24T06:14:52.099417+0000","last_peered":"2023-11-24T06:14:52.099417+0000","last_clean":"2023-11-24T06:14:52.099417+0000","last_became_active":"2023-11-24T06:14:50.677585+0000","last_became_peered":"2023-11-24T06:14:50.677585+0000","last_unstale":"2023-11-24T06:14:52.099417+0000","last_undegraded":"2023-11-24T06:14:52.099417+0000","last_fullsized":"2023-11-24T06:14:52.099417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098443+0000","last_change":"2023-11-24T06:14:50.671307+0000","last_active":"2023-11-24T06:14:52.098443+0000","last_peered":"2023-11-24T06:14:52.098443+0000","last_clean":"2023-11-24T06:14:52.098443+0000","last_became_active":"2023-11-24T06:14:50.670760+0000","last_became_peered":"2023-11-24T06:14:50.670760+0000","last_unstale":"2023-11-24T06:14:52.098443+0000","last_undegraded":"2023-11-24T06:14:52.098443+0000","last_fullsized":"2023-11-24T06:14:52.098443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100556+0000","last_change":"2023-11-24T06:14:50.686106+0000","last_active":"2023-11-24T06:14:52.100556+0000","last_peered":"2023-11-24T06:14:52.100556+0000","last_clean":"2023-11-24T06:14:52.100556+0000","last_became_active":"2023-11-24T06:14:50.685766+0000","last_became_peered":"2023-11-24T06:14:50.685766+0000","last_unstale":"2023-11-24T06:14:52.100556+0000","last_undegraded":"2023-11-24T06:14:52.100556+0000","last_fullsized":"2023-11-24T06:14:52.100556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087249+0000","last_change":"2023-11-24T06:14:50.668109+0000","last_active":"2023-11-24T06:14:52.087249+0000","last_peered":"2023-11-24T06:14:52.087249+0000","last_clean":"2023-11-24T06:14:52.087249+0000","last_became_active":"2023-11-24T06:14:50.667876+0000","last_became_peered":"2023-11-24T06:14:50.667876+0000","last_unstale":"2023-11-24T06:14:52.087249+0000","last_undegraded":"2023-11-24T06:14:52.087249+0000","last_fullsized":"2023-11-24T06:14:52.087249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086961+0000","last_change":"2023-11-24T06:14:50.669500+0000","last_active":"2023-11-24T06:14:52.086961+0000","last_peered":"2023-11-24T06:14:52.086961+0000","last_clean":"2023-11-24T06:14:52.086961+0000","last_became_active":"2023-11-24T06:14:50.667834+0000","last_became_peered":"2023-11-24T06:14:50.667834+0000","last_unstale":"2023-11-24T06:14:52.086961+0000","last_undegraded":"2023-11-24T06:14:52.086961+0000","last_fullsized":"2023-11-24T06:14:52.086961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649114+0000","last_change":"2023-11-24T06:14:50.669357+0000","last_active":"2023-11-24T06:14:51.649114+0000","last_peered":"2023-11-24T06:14:51.649114+0000","last_clean":"2023-11-24T06:14:51.649114+0000","last_became_active":"2023-11-24T06:14:50.669083+0000","last_became_peered":"2023-11-24T06:14:50.669083+0000","last_unstale":"2023-11-24T06:14:51.649114+0000","last_undegraded":"2023-11-24T06:14:51.649114+0000","last_fullsized":"2023-11-24T06:14:51.649114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:27.615626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098696+0000","last_change":"2023-11-24T06:14:50.682270+0000","last_active":"2023-11-24T06:14:52.098696+0000","last_peered":"2023-11-24T06:14:52.098696+0000","last_clean":"2023-11-24T06:14:52.098696+0000","last_became_active":"2023-11-24T06:14:50.681919+0000","last_became_peered":"2023-11-24T06:14:50.681919+0000","last_unstale":"2023-11-24T06:14:52.098696+0000","last_undegraded":"2023-11-24T06:14:52.098696+0000","last_fullsized":"2023-11-24T06:14:52.098696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099796+0000","last_change":"2023-11-24T06:14:50.674645+0000","last_active":"2023-11-24T06:14:52.099796+0000","last_peered":"2023-11-24T06:14:52.099796+0000","last_clean":"2023-11-24T06:14:52.099796+0000","last_became_active":"2023-11-24T06:14:50.673843+0000","last_became_peered":"2023-11-24T06:14:50.673843+0000","last_unstale":"2023-11-24T06:14:52.099796+0000","last_undegraded":"2023-11-24T06:14:52.099796+0000","last_fullsized":"2023-11-24T06:14:52.099796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:43.740152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643448+0000","last_change":"2023-11-24T06:14:50.671555+0000","last_active":"2023-11-24T06:14:51.643448+0000","last_peered":"2023-11-24T06:14:51.643448+0000","last_clean":"2023-11-24T06:14:51.643448+0000","last_became_active":"2023-11-24T06:14:50.671247+0000","last_became_peered":"2023-11-24T06:14:50.671247+0000","last_unstale":"2023-11-24T06:14:51.643448+0000","last_undegraded":"2023-11-24T06:14:51.643448+0000","last_fullsized":"2023-11-24T06:14:51.643448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.647469+0000","last_change":"2023-11-24T06:14:50.670462+0000","last_active":"2023-11-24T06:14:51.647469+0000","last_peered":"2023-11-24T06:14:51.647469+0000","last_clean":"2023-11-24T06:14:51.647469+0000","last_became_active":"2023-11-24T06:14:50.670143+0000","last_became_peered":"2023-11-24T06:14:50.670143+0000","last_unstale":"2023-11-24T06:14:51.647469+0000","last_undegraded":"2023-11-24T06:14:51.647469+0000","last_fullsized":"2023-11-24T06:14:51.647469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650874+0000","last_change":"2023-11-24T06:14:50.681286+0000","last_active":"2023-11-24T06:14:51.650874+0000","last_peered":"2023-11-24T06:14:51.650874+0000","last_clean":"2023-11-24T06:14:51.650874+0000","last_became_active":"2023-11-24T06:14:50.680323+0000","last_became_peered":"2023-11-24T06:14:50.680323+0000","last_unstale":"2023-11-24T06:14:51.650874+0000","last_undegraded":"2023-11-24T06:14:51.650874+0000","last_fullsized":"2023-11-24T06:14:51.650874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.242162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096934+0000","last_change":"2023-11-24T06:14:50.680143+0000","last_active":"2023-11-24T06:14:52.096934+0000","last_peered":"2023-11-24T06:14:52.096934+0000","last_clean":"2023-11-24T06:14:52.096934+0000","last_became_active":"2023-11-24T06:14:50.679818+0000","last_became_peered":"2023-11-24T06:14:50.679818+0000","last_unstale":"2023-11-24T06:14:52.096934+0000","last_undegraded":"2023-11-24T06:14:52.096934+0000","last_fullsized":"2023-11-24T06:14:52.096934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100469+0000","last_change":"2023-11-24T06:14:50.677609+0000","last_active":"2023-11-24T06:14:52.100469+0000","last_peered":"2023-11-24T06:14:52.100469+0000","last_clean":"2023-11-24T06:14:52.100469+0000","last_became_active":"2023-11-24T06:14:50.677066+0000","last_became_peered":"2023-11-24T06:14:50.677066+0000","last_unstale":"2023-11-24T06:14:52.100469+0000","last_undegraded":"2023-11-24T06:14:52.100469+0000","last_fullsized":"2023-11-24T06:14:52.100469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087142+0000","last_change":"2023-11-24T06:14:50.683104+0000","last_active":"2023-11-24T06:14:52.087142+0000","last_peered":"2023-11-24T06:14:52.087142+0000","last_clean":"2023-11-24T06:14:52.087142+0000","last_became_active":"2023-11-24T06:14:50.682658+0000","last_became_peered":"2023-11-24T06:14:50.682658+0000","last_unstale":"2023-11-24T06:14:52.087142+0000","last_undegraded":"2023-11-24T06:14:52.087142+0000","last_fullsized":"2023-11-24T06:14:52.087142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099758+0000","last_change":"2023-11-24T06:14:50.679645+0000","last_active":"2023-11-24T06:14:52.099758+0000","last_peered":"2023-11-24T06:14:52.099758+0000","last_clean":"2023-11-24T06:14:52.099758+0000","last_became_active":"2023-11-24T06:14:50.675742+0000","last_became_peered":"2023-11-24T06:14:50.675742+0000","last_unstale":"2023-11-24T06:14:52.099758+0000","last_undegraded":"2023-11-24T06:14:52.099758+0000","last_fullsized":"2023-11-24T06:14:52.099758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:09.290044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649295+0000","last_change":"2023-11-24T06:14:50.681368+0000","last_active":"2023-11-24T06:14:51.649295+0000","last_peered":"2023-11-24T06:14:51.649295+0000","last_clean":"2023-11-24T06:14:51.649295+0000","last_became_active":"2023-11-24T06:14:50.680084+0000","last_became_peered":"2023-11-24T06:14:50.680084+0000","last_unstale":"2023-11-24T06:14:51.649295+0000","last_undegraded":"2023-11-24T06:14:51.649295+0000","last_fullsized":"2023-11-24T06:14:51.649295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098619+0000","last_change":"2023-11-24T06:14:50.673670+0000","last_active":"2023-11-24T06:14:52.098619+0000","last_peered":"2023-11-24T06:14:52.098619+0000","last_clean":"2023-11-24T06:14:52.098619+0000","last_became_active":"2023-11-24T06:14:50.673403+0000","last_became_peered":"2023-11-24T06:14:50.673403+0000","last_unstale":"2023-11-24T06:14:52.098619+0000","last_undegraded":"2023-11-24T06:14:52.098619+0000","last_fullsized":"2023-11-24T06:14:52.098619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648773+0000","last_change":"2023-11-24T06:14:50.674073+0000","last_active":"2023-11-24T06:14:51.648773+0000","last_peered":"2023-11-24T06:14:51.648773+0000","last_clean":"2023-11-24T06:14:51.648773+0000","last_became_active":"2023-11-24T06:14:50.673664+0000","last_became_peered":"2023-11-24T06:14:50.673664+0000","last_unstale":"2023-11-24T06:14:51.648773+0000","last_undegraded":"2023-11-24T06:14:51.648773+0000","last_fullsized":"2023-11-24T06:14:51.648773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099308+0000","last_change":"2023-11-24T06:14:50.678205+0000","last_active":"2023-11-24T06:14:52.099308+0000","last_peered":"2023-11-24T06:14:52.099308+0000","last_clean":"2023-11-24T06:14:52.099308+0000","last_became_active":"2023-11-24T06:14:50.677191+0000","last_became_peered":"2023-11-24T06:14:50.677191+0000","last_unstale":"2023-11-24T06:14:52.099308+0000","last_undegraded":"2023-11-24T06:14:52.099308+0000","last_fullsized":"2023-11-24T06:14:52.099308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.165484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087355+0000","last_change":"2023-11-24T06:14:50.676733+0000","last_active":"2023-11-24T06:14:52.087355+0000","last_peered":"2023-11-24T06:14:52.087355+0000","last_clean":"2023-11-24T06:14:52.087355+0000","last_became_active":"2023-11-24T06:14:50.676449+0000","last_became_peered":"2023-11-24T06:14:50.676449+0000","last_unstale":"2023-11-24T06:14:52.087355+0000","last_undegraded":"2023-11-24T06:14:52.087355+0000","last_fullsized":"2023-11-24T06:14:52.087355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643784+0000","last_change":"2023-11-24T06:14:50.673695+0000","last_active":"2023-11-24T06:14:51.643784+0000","last_peered":"2023-11-24T06:14:51.643784+0000","last_clean":"2023-11-24T06:14:51.643784+0000","last_became_active":"2023-11-24T06:14:50.673352+0000","last_became_peered":"2023-11-24T06:14:50.673352+0000","last_unstale":"2023-11-24T06:14:51.643784+0000","last_undegraded":"2023-11-24T06:14:51.643784+0000","last_fullsized":"2023-11-24T06:14:51.643784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099455+0000","last_change":"2023-11-24T06:14:50.676349+0000","last_active":"2023-11-24T06:14:52.099455+0000","last_peered":"2023-11-24T06:14:52.099455+0000","last_clean":"2023-11-24T06:14:52.099455+0000","last_became_active":"2023-11-24T06:14:50.676071+0000","last_became_peered":"2023-11-24T06:14:50.676071+0000","last_unstale":"2023-11-24T06:14:52.099455+0000","last_undegraded":"2023-11-24T06:14:52.099455+0000","last_fullsized":"2023-11-24T06:14:52.099455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099881+0000","last_change":"2023-11-24T06:14:50.680531+0000","last_active":"2023-11-24T06:14:52.099881+0000","last_peered":"2023-11-24T06:14:52.099881+0000","last_clean":"2023-11-24T06:14:52.099881+0000","last_became_active":"2023-11-24T06:14:50.680165+0000","last_became_peered":"2023-11-24T06:14:50.680165+0000","last_unstale":"2023-11-24T06:14:52.099881+0000","last_undegraded":"2023-11-24T06:14:52.099881+0000","last_fullsized":"2023-11-24T06:14:52.099881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:23.653780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649625+0000","last_change":"2023-11-24T06:14:50.670339+0000","last_active":"2023-11-24T06:14:51.649625+0000","last_peered":"2023-11-24T06:14:51.649625+0000","last_clean":"2023-11-24T06:14:51.649625+0000","last_became_active":"2023-11-24T06:14:50.670090+0000","last_became_peered":"2023-11-24T06:14:50.670090+0000","last_unstale":"2023-11-24T06:14:51.649625+0000","last_undegraded":"2023-11-24T06:14:51.649625+0000","last_fullsized":"2023-11-24T06:14:51.649625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:29:33.047596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.096750+0000","last_change":"2023-11-24T06:14:50.666860+0000","last_active":"2023-11-24T06:14:52.096750+0000","last_peered":"2023-11-24T06:14:52.096750+0000","last_clean":"2023-11-24T06:14:52.096750+0000","last_became_active":"2023-11-24T06:14:50.666581+0000","last_became_peered":"2023-11-24T06:14:50.666581+0000","last_unstale":"2023-11-24T06:14:52.096750+0000","last_undegraded":"2023-11-24T06:14:52.096750+0000","last_fullsized":"2023-11-24T06:14:52.096750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087368+0000","last_change":"2023-11-24T06:14:50.674598+0000","last_active":"2023-11-24T06:14:52.087368+0000","last_peered":"2023-11-24T06:14:52.087368+0000","last_clean":"2023-11-24T06:14:52.087368+0000","last_became_active":"2023-11-24T06:14:50.674093+0000","last_became_peered":"2023-11-24T06:14:50.674093+0000","last_unstale":"2023-11-24T06:14:52.087368+0000","last_undegraded":"2023-11-24T06:14:52.087368+0000","last_fullsized":"2023-11-24T06:14:52.087368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650044+0000","last_change":"2023-11-24T06:14:50.668892+0000","last_active":"2023-11-24T06:14:51.650044+0000","last_peered":"2023-11-24T06:14:51.650044+0000","last_clean":"2023-11-24T06:14:51.650044+0000","last_became_active":"2023-11-24T06:14:50.668376+0000","last_became_peered":"2023-11-24T06:14:50.668376+0000","last_unstale":"2023-11-24T06:14:51.650044+0000","last_undegraded":"2023-11-24T06:14:51.650044+0000","last_fullsized":"2023-11-24T06:14:51.650044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:01.780755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708546+0000","last_change":"2023-11-24T06:14:49.697821+0000","last_active":"2023-11-24T06:14:50.708546+0000","last_peered":"2023-11-24T06:14:50.708546+0000","last_clean":"2023-11-24T06:14:50.708546+0000","last_became_active":"2023-11-24T06:14:49.697563+0000","last_became_peered":"2023-11-24T06:14:49.697563+0000","last_unstale":"2023-11-24T06:14:50.708546+0000","last_undegraded":"2023-11-24T06:14:50.708546+0000","last_fullsized":"2023-11-24T06:14:50.708546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100036+0000","last_change":"2023-11-24T06:14:50.679328+0000","last_active":"2023-11-24T06:14:52.100036+0000","last_peered":"2023-11-24T06:14:52.100036+0000","last_clean":"2023-11-24T06:14:52.100036+0000","last_became_active":"2023-11-24T06:14:50.675211+0000","last_became_peered":"2023-11-24T06:14:50.675211+0000","last_unstale":"2023-11-24T06:14:52.100036+0000","last_undegraded":"2023-11-24T06:14:52.100036+0000","last_fullsized":"2023-11-24T06:14:52.100036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708071+0000","last_change":"2023-11-24T06:14:49.695142+0000","last_active":"2023-11-24T06:14:50.708071+0000","last_peered":"2023-11-24T06:14:50.708071+0000","last_clean":"2023-11-24T06:14:50.708071+0000","last_became_active":"2023-11-24T06:14:49.694825+0000","last_became_peered":"2023-11-24T06:14:49.694825+0000","last_unstale":"2023-11-24T06:14:50.708071+0000","last_undegraded":"2023-11-24T06:14:50.708071+0000","last_fullsized":"2023-11-24T06:14:50.708071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.664430+0000","last_change":"2023-11-24T06:14:49.706014+0000","last_active":"2023-11-24T06:14:50.664430+0000","last_peered":"2023-11-24T06:14:50.664430+0000","last_clean":"2023-11-24T06:14:50.664430+0000","last_became_active":"2023-11-24T06:14:49.705727+0000","last_became_peered":"2023-11-24T06:14:49.705727+0000","last_unstale":"2023-11-24T06:14:50.664430+0000","last_undegraded":"2023-11-24T06:14:50.664430+0000","last_fullsized":"2023-11-24T06:14:50.664430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098742+0000","last_change":"2023-11-24T06:14:50.679393+0000","last_active":"2023-11-24T06:14:52.098742+0000","last_peered":"2023-11-24T06:14:52.098742+0000","last_clean":"2023-11-24T06:14:52.098742+0000","last_became_active":"2023-11-24T06:14:50.679078+0000","last_became_peered":"2023-11-24T06:14:50.679078+0000","last_unstale":"2023-11-24T06:14:52.098742+0000","last_undegraded":"2023-11-24T06:14:52.098742+0000","last_fullsized":"2023-11-24T06:14:52.098742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655585+0000","last_change":"2023-11-24T06:14:49.702941+0000","last_active":"2023-11-24T06:14:50.655585+0000","last_peered":"2023-11-24T06:14:50.655585+0000","last_clean":"2023-11-24T06:14:50.655585+0000","last_became_active":"2023-11-24T06:14:49.701670+0000","last_became_peered":"2023-11-24T06:14:49.701670+0000","last_unstale":"2023-11-24T06:14:50.655585+0000","last_undegraded":"2023-11-24T06:14:50.655585+0000","last_fullsized":"2023-11-24T06:14:50.655585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643424+0000","last_change":"2023-11-24T06:14:50.675363+0000","last_active":"2023-11-24T06:14:51.643424+0000","last_peered":"2023-11-24T06:14:51.643424+0000","last_clean":"2023-11-24T06:14:51.643424+0000","last_became_active":"2023-11-24T06:14:50.675034+0000","last_became_peered":"2023-11-24T06:14:50.675034+0000","last_unstale":"2023-11-24T06:14:51.643424+0000","last_undegraded":"2023-11-24T06:14:51.643424+0000","last_fullsized":"2023-11-24T06:14:51.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.657217+0000","last_change":"2023-11-24T06:14:49.703756+0000","last_active":"2023-11-24T06:14:50.657217+0000","last_peered":"2023-11-24T06:14:50.657217+0000","last_clean":"2023-11-24T06:14:50.657217+0000","last_became_active":"2023-11-24T06:14:49.703456+0000","last_became_peered":"2023-11-24T06:14:49.703456+0000","last_unstale":"2023-11-24T06:14:50.657217+0000","last_undegraded":"2023-11-24T06:14:50.657217+0000","last_fullsized":"2023-11-24T06:14:50.657217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650542+0000","last_change":"2023-11-24T06:14:50.680598+0000","last_active":"2023-11-24T06:14:51.650542+0000","last_peered":"2023-11-24T06:14:51.650542+0000","last_clean":"2023-11-24T06:14:51.650542+0000","last_became_active":"2023-11-24T06:14:50.680267+0000","last_became_peered":"2023-11-24T06:14:50.680267+0000","last_unstale":"2023-11-24T06:14:51.650542+0000","last_undegraded":"2023-11-24T06:14:51.650542+0000","last_fullsized":"2023-11-24T06:14:51.650542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:31.651357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.659528+0000","last_change":"2023-11-24T06:14:49.705839+0000","last_active":"2023-11-24T06:14:50.659528+0000","last_peered":"2023-11-24T06:14:50.659528+0000","last_clean":"2023-11-24T06:14:50.659528+0000","last_became_active":"2023-11-24T06:14:49.705477+0000","last_became_peered":"2023-11-24T06:14:49.705477+0000","last_unstale":"2023-11-24T06:14:50.659528+0000","last_undegraded":"2023-11-24T06:14:50.659528+0000","last_fullsized":"2023-11-24T06:14:50.659528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:31.756581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100424+0000","last_change":"2023-11-24T06:14:50.673579+0000","last_active":"2023-11-24T06:14:52.100424+0000","last_peered":"2023-11-24T06:14:52.100424+0000","last_clean":"2023-11-24T06:14:52.100424+0000","last_became_active":"2023-11-24T06:14:50.673282+0000","last_became_peered":"2023-11-24T06:14:50.673282+0000","last_unstale":"2023-11-24T06:14:52.100424+0000","last_undegraded":"2023-11-24T06:14:52.100424+0000","last_fullsized":"2023-11-24T06:14:52.100424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712613+0000","last_change":"2023-11-24T06:14:49.701007+0000","last_active":"2023-11-24T06:14:50.712613+0000","last_peered":"2023-11-24T06:14:50.712613+0000","last_clean":"2023-11-24T06:14:50.712613+0000","last_became_active":"2023-11-24T06:14:49.700724+0000","last_became_peered":"2023-11-24T06:14:49.700724+0000","last_unstale":"2023-11-24T06:14:50.712613+0000","last_undegraded":"2023-11-24T06:14:50.712613+0000","last_fullsized":"2023-11-24T06:14:50.712613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649436+0000","last_change":"2023-11-24T06:14:50.673608+0000","last_active":"2023-11-24T06:14:51.649436+0000","last_peered":"2023-11-24T06:14:51.649436+0000","last_clean":"2023-11-24T06:14:51.649436+0000","last_became_active":"2023-11-24T06:14:50.673301+0000","last_became_peered":"2023-11-24T06:14:50.673301+0000","last_unstale":"2023-11-24T06:14:51.649436+0000","last_undegraded":"2023-11-24T06:14:51.649436+0000","last_fullsized":"2023-11-24T06:14:51.649436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:48.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.714522+0000","last_change":"2023-11-24T06:14:49.704014+0000","last_active":"2023-11-24T06:14:50.714522+0000","last_peered":"2023-11-24T06:14:50.714522+0000","last_clean":"2023-11-24T06:14:50.714522+0000","last_became_active":"2023-11-24T06:14:49.703708+0000","last_became_peered":"2023-11-24T06:14:49.703708+0000","last_unstale":"2023-11-24T06:14:50.714522+0000","last_undegraded":"2023-11-24T06:14:50.714522+0000","last_fullsized":"2023-11-24T06:14:50.714522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099830+0000","last_change":"2023-11-24T06:14:50.677436+0000","last_active":"2023-11-24T06:14:52.099830+0000","last_peered":"2023-11-24T06:14:52.099830+0000","last_clean":"2023-11-24T06:14:52.099830+0000","last_became_active":"2023-11-24T06:14:50.676715+0000","last_became_peered":"2023-11-24T06:14:50.676715+0000","last_unstale":"2023-11-24T06:14:52.099830+0000","last_undegraded":"2023-11-24T06:14:52.099830+0000","last_fullsized":"2023-11-24T06:14:52.099830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712757+0000","last_change":"2023-11-24T06:14:49.693145+0000","last_active":"2023-11-24T06:14:50.712757+0000","last_peered":"2023-11-24T06:14:50.712757+0000","last_clean":"2023-11-24T06:14:50.712757+0000","last_became_active":"2023-11-24T06:14:49.692740+0000","last_became_peered":"2023-11-24T06:14:49.692740+0000","last_unstale":"2023-11-24T06:14:50.712757+0000","last_undegraded":"2023-11-24T06:14:50.712757+0000","last_fullsized":"2023-11-24T06:14:50.712757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:32.088174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100100+0000","last_change":"2023-11-24T06:14:50.679348+0000","last_active":"2023-11-24T06:14:52.100100+0000","last_peered":"2023-11-24T06:14:52.100100+0000","last_clean":"2023-11-24T06:14:52.100100+0000","last_became_active":"2023-11-24T06:14:50.679013+0000","last_became_peered":"2023-11-24T06:14:50.679013+0000","last_unstale":"2023-11-24T06:14:52.100100+0000","last_undegraded":"2023-11-24T06:14:52.100100+0000","last_fullsized":"2023-11-24T06:14:52.100100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:30.036496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650013+0000","last_change":"2023-11-24T06:14:49.694677+0000","last_active":"2023-11-24T06:14:50.650013+0000","last_peered":"2023-11-24T06:14:50.650013+0000","last_clean":"2023-11-24T06:14:50.650013+0000","last_became_active":"2023-11-24T06:14:49.694383+0000","last_became_peered":"2023-11-24T06:14:49.694383+0000","last_unstale":"2023-11-24T06:14:50.650013+0000","last_undegraded":"2023-11-24T06:14:50.650013+0000","last_fullsized":"2023-11-24T06:14:50.650013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099792+0000","last_change":"2023-11-24T06:14:50.677961+0000","last_active":"2023-11-24T06:14:52.099792+0000","last_peered":"2023-11-24T06:14:52.099792+0000","last_clean":"2023-11-24T06:14:52.099792+0000","last_became_active":"2023-11-24T06:14:50.675864+0000","last_became_peered":"2023-11-24T06:14:50.675864+0000","last_unstale":"2023-11-24T06:14:52.099792+0000","last_undegraded":"2023-11-24T06:14:52.099792+0000","last_fullsized":"2023-11-24T06:14:52.099792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.654827+0000","last_change":"2023-11-24T06:14:49.698393+0000","last_active":"2023-11-24T06:14:50.654827+0000","last_peered":"2023-11-24T06:14:50.654827+0000","last_clean":"2023-11-24T06:14:50.654827+0000","last_became_active":"2023-11-24T06:14:49.698130+0000","last_became_peered":"2023-11-24T06:14:49.698130+0000","last_unstale":"2023-11-24T06:14:50.654827+0000","last_undegraded":"2023-11-24T06:14:50.654827+0000","last_fullsized":"2023-11-24T06:14:50.654827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.087151+0000","last_change":"2023-11-24T06:14:50.674381+0000","last_active":"2023-11-24T06:14:52.087151+0000","last_peered":"2023-11-24T06:14:52.087151+0000","last_clean":"2023-11-24T06:14:52.087151+0000","last_became_active":"2023-11-24T06:14:50.673643+0000","last_became_peered":"2023-11-24T06:14:50.673643+0000","last_unstale":"2023-11-24T06:14:52.087151+0000","last_undegraded":"2023-11-24T06:14:52.087151+0000","last_fullsized":"2023-11-24T06:14:52.087151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.713585+0000","last_change":"2023-11-24T06:14:49.685131+0000","last_active":"2023-11-24T06:14:50.713585+0000","last_peered":"2023-11-24T06:14:50.713585+0000","last_clean":"2023-11-24T06:14:50.713585+0000","last_became_active":"2023-11-24T06:14:49.684509+0000","last_became_peered":"2023-11-24T06:14:49.684509+0000","last_unstale":"2023-11-24T06:14:50.713585+0000","last_undegraded":"2023-11-24T06:14:50.713585+0000","last_fullsized":"2023-11-24T06:14:50.713585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099960+0000","last_change":"2023-11-24T06:14:50.679197+0000","last_active":"2023-11-24T06:14:52.099960+0000","last_peered":"2023-11-24T06:14:52.099960+0000","last_clean":"2023-11-24T06:14:52.099960+0000","last_became_active":"2023-11-24T06:14:50.676823+0000","last_became_peered":"2023-11-24T06:14:50.676823+0000","last_unstale":"2023-11-24T06:14:52.099960+0000","last_undegraded":"2023-11-24T06:14:52.099960+0000","last_fullsized":"2023-11-24T06:14:52.099960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710348+0000","last_change":"2023-11-24T06:14:49.698361+0000","last_active":"2023-11-24T06:14:50.710348+0000","last_peered":"2023-11-24T06:14:50.710348+0000","last_clean":"2023-11-24T06:14:50.710348+0000","last_became_active":"2023-11-24T06:14:49.698063+0000","last_became_peered":"2023-11-24T06:14:49.698063+0000","last_unstale":"2023-11-24T06:14:50.710348+0000","last_undegraded":"2023-11-24T06:14:50.710348+0000","last_fullsized":"2023-11-24T06:14:50.710348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100144+0000","last_change":"2023-11-24T06:14:50.678280+0000","last_active":"2023-11-24T06:14:52.100144+0000","last_peered":"2023-11-24T06:14:52.100144+0000","last_clean":"2023-11-24T06:14:52.100144+0000","last_became_active":"2023-11-24T06:14:50.677222+0000","last_became_peered":"2023-11-24T06:14:50.677222+0000","last_unstale":"2023-11-24T06:14:52.100144+0000","last_undegraded":"2023-11-24T06:14:52.100144+0000","last_fullsized":"2023-11-24T06:14:52.100144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709589+0000","last_change":"2023-11-24T06:14:49.686043+0000","last_active":"2023-11-24T06:14:50.709589+0000","last_peered":"2023-11-24T06:14:50.709589+0000","last_clean":"2023-11-24T06:14:50.709589+0000","last_became_active":"2023-11-24T06:14:49.685728+0000","last_became_peered":"2023-11-24T06:14:49.685728+0000","last_unstale":"2023-11-24T06:14:50.709589+0000","last_undegraded":"2023-11-24T06:14:50.709589+0000","last_fullsized":"2023-11-24T06:14:50.709589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100809+0000","last_change":"2023-11-24T06:14:50.685979+0000","last_active":"2023-11-24T06:14:52.100809+0000","last_peered":"2023-11-24T06:14:52.100809+0000","last_clean":"2023-11-24T06:14:52.100809+0000","last_became_active":"2023-11-24T06:14:50.685166+0000","last_became_peered":"2023-11-24T06:14:50.685166+0000","last_unstale":"2023-11-24T06:14:52.100809+0000","last_undegraded":"2023-11-24T06:14:52.100809+0000","last_fullsized":"2023-11-24T06:14:52.100809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:41.237889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.712701+0000","last_change":"2023-11-24T06:14:49.689763+0000","last_active":"2023-11-24T06:14:50.712701+0000","last_peered":"2023-11-24T06:14:50.712701+0000","last_clean":"2023-11-24T06:14:50.712701+0000","last_became_active":"2023-11-24T06:14:49.689550+0000","last_became_peered":"2023-11-24T06:14:49.689550+0000","last_unstale":"2023-11-24T06:14:50.712701+0000","last_undegraded":"2023-11-24T06:14:50.712701+0000","last_fullsized":"2023-11-24T06:14:50.712701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649468+0000","last_change":"2023-11-24T06:14:50.674890+0000","last_active":"2023-11-24T06:14:51.649468+0000","last_peered":"2023-11-24T06:14:51.649468+0000","last_clean":"2023-11-24T06:14:51.649468+0000","last_became_active":"2023-11-24T06:14:50.674553+0000","last_became_peered":"2023-11-24T06:14:50.674553+0000","last_unstale":"2023-11-24T06:14:51.649468+0000","last_undegraded":"2023-11-24T06:14:51.649468+0000","last_fullsized":"2023-11-24T06:14:51.649468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:58.064287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655833+0000","last_change":"2023-11-24T06:14:49.694356+0000","last_active":"2023-11-24T06:14:50.655833+0000","last_peered":"2023-11-24T06:14:50.655833+0000","last_clean":"2023-11-24T06:14:50.655833+0000","last_became_active":"2023-11-24T06:14:49.694071+0000","last_became_peered":"2023-11-24T06:14:49.694071+0000","last_unstale":"2023-11-24T06:14:50.655833+0000","last_undegraded":"2023-11-24T06:14:50.655833+0000","last_fullsized":"2023-11-24T06:14:50.655833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100208+0000","last_change":"2023-11-24T06:14:50.678368+0000","last_active":"2023-11-24T06:14:52.100208+0000","last_peered":"2023-11-24T06:14:52.100208+0000","last_clean":"2023-11-24T06:14:52.100208+0000","last_became_active":"2023-11-24T06:14:50.678080+0000","last_became_peered":"2023-11-24T06:14:50.678080+0000","last_unstale":"2023-11-24T06:14:52.100208+0000","last_undegraded":"2023-11-24T06:14:52.100208+0000","last_fullsized":"2023-11-24T06:14:52.100208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.662084+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:14:50.662084+0000","last_peered":"2023-11-24T06:14:50.662084+0000","last_clean":"2023-11-24T06:14:50.662084+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:14:50.662084+0000","last_undegraded":"2023-11-24T06:14:50.662084+0000","last_fullsized":"2023-11-24T06:14:50.662084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655544+0000","last_change":"2023-11-24T06:14:49.696906+0000","last_active":"2023-11-24T06:14:50.655544+0000","last_peered":"2023-11-24T06:14:50.655544+0000","last_clean":"2023-11-24T06:14:50.655544+0000","last_became_active":"2023-11-24T06:14:49.696642+0000","last_became_peered":"2023-11-24T06:14:49.696642+0000","last_unstale":"2023-11-24T06:14:50.655544+0000","last_undegraded":"2023-11-24T06:14:50.655544+0000","last_fullsized":"2023-11-24T06:14:50.655544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:22.648754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098494+0000","last_change":"2023-11-24T06:14:50.668661+0000","last_active":"2023-11-24T06:14:52.098494+0000","last_peered":"2023-11-24T06:14:52.098494+0000","last_clean":"2023-11-24T06:14:52.098494+0000","last_became_active":"2023-11-24T06:14:50.668333+0000","last_became_peered":"2023-11-24T06:14:50.668333+0000","last_unstale":"2023-11-24T06:14:52.098494+0000","last_undegraded":"2023-11-24T06:14:52.098494+0000","last_fullsized":"2023-11-24T06:14:52.098494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661983+0000","last_change":"2023-11-24T06:14:49.710092+0000","last_active":"2023-11-24T06:14:50.661983+0000","last_peered":"2023-11-24T06:14:50.661983+0000","last_clean":"2023-11-24T06:14:50.661983+0000","last_became_active":"2023-11-24T06:14:49.709784+0000","last_became_peered":"2023-11-24T06:14:49.709784+0000","last_unstale":"2023-11-24T06:14:50.661983+0000","last_undegraded":"2023-11-24T06:14:50.661983+0000","last_fullsized":"2023-11-24T06:14:50.661983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:37:26.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099297+0000","last_change":"2023-11-24T06:14:50.676764+0000","last_active":"2023-11-24T06:14:52.099297+0000","last_peered":"2023-11-24T06:14:52.099297+0000","last_clean":"2023-11-24T06:14:52.099297+0000","last_became_active":"2023-11-24T06:14:50.676031+0000","last_became_peered":"2023-11-24T06:14:50.676031+0000","last_unstale":"2023-11-24T06:14:52.099297+0000","last_undegraded":"2023-11-24T06:14:52.099297+0000","last_fullsized":"2023-11-24T06:14:52.099297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:59.786496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.655216+0000","last_change":"2023-11-24T06:14:49.687348+0000","last_active":"2023-11-24T06:14:50.655216+0000","last_peered":"2023-11-24T06:14:50.655216+0000","last_clean":"2023-11-24T06:14:50.655216+0000","last_became_active":"2023-11-24T06:14:49.685807+0000","last_became_peered":"2023-11-24T06:14:49.685807+0000","last_unstale":"2023-11-24T06:14:50.655216+0000","last_undegraded":"2023-11-24T06:14:50.655216+0000","last_fullsized":"2023-11-24T06:14:50.655216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:18:40.882904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643489+0000","last_change":"2023-11-24T06:14:50.662346+0000","last_active":"2023-11-24T06:14:51.643489+0000","last_peered":"2023-11-24T06:14:51.643489+0000","last_clean":"2023-11-24T06:14:51.643489+0000","last_became_active":"2023-11-24T06:14:50.661969+0000","last_became_peered":"2023-11-24T06:14:50.661969+0000","last_unstale":"2023-11-24T06:14:51.643489+0000","last_undegraded":"2023-11-24T06:14:51.643489+0000","last_fullsized":"2023-11-24T06:14:51.643489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:49.201560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.650302+0000","last_change":"2023-11-24T06:14:49.693881+0000","last_active":"2023-11-24T06:14:50.650302+0000","last_peered":"2023-11-24T06:14:50.650302+0000","last_clean":"2023-11-24T06:14:50.650302+0000","last_became_active":"2023-11-24T06:14:49.692876+0000","last_became_peered":"2023-11-24T06:14:49.692876+0000","last_unstale":"2023-11-24T06:14:50.650302+0000","last_undegraded":"2023-11-24T06:14:50.650302+0000","last_fullsized":"2023-11-24T06:14:50.650302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:55:00.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649095+0000","last_change":"2023-11-24T06:14:50.685296+0000","last_active":"2023-11-24T06:14:51.649095+0000","last_peered":"2023-11-24T06:14:51.649095+0000","last_clean":"2023-11-24T06:14:51.649095+0000","last_became_active":"2023-11-24T06:14:50.681627+0000","last_became_peered":"2023-11-24T06:14:50.681627+0000","last_unstale":"2023-11-24T06:14:51.649095+0000","last_undegraded":"2023-11-24T06:14:51.649095+0000","last_fullsized":"2023-11-24T06:14:51.649095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:02.302315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645831+0000","last_change":"2023-11-24T06:14:49.694973+0000","last_active":"2023-11-24T06:14:50.645831+0000","last_peered":"2023-11-24T06:14:50.645831+0000","last_clean":"2023-11-24T06:14:50.645831+0000","last_became_active":"2023-11-24T06:14:49.694351+0000","last_became_peered":"2023-11-24T06:14:49.694351+0000","last_unstale":"2023-11-24T06:14:50.645831+0000","last_undegraded":"2023-11-24T06:14:50.645831+0000","last_fullsized":"2023-11-24T06:14:50.645831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:11:08.285018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650479+0000","last_change":"2023-11-24T06:14:50.674491+0000","last_active":"2023-11-24T06:14:51.650479+0000","last_peered":"2023-11-24T06:14:51.650479+0000","last_clean":"2023-11-24T06:14:51.650479+0000","last_became_active":"2023-11-24T06:14:50.674140+0000","last_became_peered":"2023-11-24T06:14:50.674140+0000","last_unstale":"2023-11-24T06:14:51.650479+0000","last_undegraded":"2023-11-24T06:14:51.650479+0000","last_fullsized":"2023-11-24T06:14:51.650479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:38.473941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.665634+0000","last_change":"2023-11-24T06:14:49.710812+0000","last_active":"2023-11-24T06:14:50.665634+0000","last_peered":"2023-11-24T06:14:50.665634+0000","last_clean":"2023-11-24T06:14:50.665634+0000","last_became_active":"2023-11-24T06:14:49.710500+0000","last_became_peered":"2023-11-24T06:14:49.710500+0000","last_unstale":"2023-11-24T06:14:50.665634+0000","last_undegraded":"2023-11-24T06:14:50.665634+0000","last_fullsized":"2023-11-24T06:14:50.665634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:48.196535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643655+0000","last_change":"2023-11-24T06:14:50.669928+0000","last_active":"2023-11-24T06:14:51.643655+0000","last_peered":"2023-11-24T06:14:51.643655+0000","last_clean":"2023-11-24T06:14:51.643655+0000","last_became_active":"2023-11-24T06:14:50.666246+0000","last_became_peered":"2023-11-24T06:14:50.666246+0000","last_unstale":"2023-11-24T06:14:51.643655+0000","last_undegraded":"2023-11-24T06:14:51.643655+0000","last_fullsized":"2023-11-24T06:14:51.643655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.643916+0000","last_change":"2023-11-24T06:14:49.703013+0000","last_active":"2023-11-24T06:14:51.643916+0000","last_peered":"2023-11-24T06:14:51.643916+0000","last_clean":"2023-11-24T06:14:51.643916+0000","last_became_active":"2023-11-24T06:14:49.702599+0000","last_became_peered":"2023-11-24T06:14:49.702599+0000","last_unstale":"2023-11-24T06:14:51.643916+0000","last_undegraded":"2023-11-24T06:14:51.643916+0000","last_fullsized":"2023-11-24T06:14:51.643916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:42.735127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099635+0000","last_change":"2023-11-24T06:14:50.677366+0000","last_active":"2023-11-24T06:14:52.099635+0000","last_peered":"2023-11-24T06:14:52.099635+0000","last_clean":"2023-11-24T06:14:52.099635+0000","last_became_active":"2023-11-24T06:14:50.677021+0000","last_became_peered":"2023-11-24T06:14:50.677021+0000","last_unstale":"2023-11-24T06:14:52.099635+0000","last_undegraded":"2023-11-24T06:14:52.099635+0000","last_fullsized":"2023-11-24T06:14:52.099635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:38.651165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708120+0000","last_change":"2023-11-24T06:14:49.705904+0000","last_active":"2023-11-24T06:14:50.708120+0000","last_peered":"2023-11-24T06:14:50.708120+0000","last_clean":"2023-11-24T06:14:50.708120+0000","last_became_active":"2023-11-24T06:14:49.705615+0000","last_became_peered":"2023-11-24T06:14:49.705615+0000","last_unstale":"2023-11-24T06:14:50.708120+0000","last_undegraded":"2023-11-24T06:14:50.708120+0000","last_fullsized":"2023-11-24T06:14:50.708120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:28:47.948573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100419+0000","last_change":"2023-11-24T06:14:50.670885+0000","last_active":"2023-11-24T06:14:52.100419+0000","last_peered":"2023-11-24T06:14:52.100419+0000","last_clean":"2023-11-24T06:14:52.100419+0000","last_became_active":"2023-11-24T06:14:50.670481+0000","last_became_peered":"2023-11-24T06:14:50.670481+0000","last_unstale":"2023-11-24T06:14:52.100419+0000","last_undegraded":"2023-11-24T06:14:52.100419+0000","last_fullsized":"2023-11-24T06:14:52.100419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:55.708174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.661454+0000","last_change":"2023-11-24T06:14:49.710392+0000","last_active":"2023-11-24T06:14:50.661454+0000","last_peered":"2023-11-24T06:14:50.661454+0000","last_clean":"2023-11-24T06:14:50.661454+0000","last_became_active":"2023-11-24T06:14:49.710102+0000","last_became_peered":"2023-11-24T06:14:49.710102+0000","last_unstale":"2023-11-24T06:14:50.661454+0000","last_undegraded":"2023-11-24T06:14:50.661454+0000","last_fullsized":"2023-11-24T06:14:50.661454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.648534+0000","last_change":"2023-11-24T06:14:50.667556+0000","last_active":"2023-11-24T06:14:51.648534+0000","last_peered":"2023-11-24T06:14:51.648534+0000","last_clean":"2023-11-24T06:14:51.648534+0000","last_became_active":"2023-11-24T06:14:50.667254+0000","last_became_peered":"2023-11-24T06:14:50.667254+0000","last_unstale":"2023-11-24T06:14:51.648534+0000","last_undegraded":"2023-11-24T06:14:51.648534+0000","last_fullsized":"2023-11-24T06:14:51.648534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:41.591891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.645782+0000","last_change":"2023-11-24T06:14:49.700284+0000","last_active":"2023-11-24T06:14:50.645782+0000","last_peered":"2023-11-24T06:14:50.645782+0000","last_clean":"2023-11-24T06:14:50.645782+0000","last_became_active":"2023-11-24T06:14:49.699898+0000","last_became_peered":"2023-11-24T06:14:49.699898+0000","last_unstale":"2023-11-24T06:14:50.645782+0000","last_undegraded":"2023-11-24T06:14:50.645782+0000","last_fullsized":"2023-11-24T06:14:50.645782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098745+0000","last_change":"2023-11-24T06:14:50.671052+0000","last_active":"2023-11-24T06:14:52.098745+0000","last_peered":"2023-11-24T06:14:52.098745+0000","last_clean":"2023-11-24T06:14:52.098745+0000","last_became_active":"2023-11-24T06:14:50.670386+0000","last_became_peered":"2023-11-24T06:14:50.670386+0000","last_unstale":"2023-11-24T06:14:52.098745+0000","last_undegraded":"2023-11-24T06:14:52.098745+0000","last_fullsized":"2023-11-24T06:14:52.098745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.643772+0000","last_change":"2023-11-24T06:14:49.684530+0000","last_active":"2023-11-24T06:14:50.643772+0000","last_peered":"2023-11-24T06:14:50.643772+0000","last_clean":"2023-11-24T06:14:50.643772+0000","last_became_active":"2023-11-24T06:14:49.684174+0000","last_became_peered":"2023-11-24T06:14:49.684174+0000","last_unstale":"2023-11-24T06:14:50.643772+0000","last_undegraded":"2023-11-24T06:14:50.643772+0000","last_fullsized":"2023-11-24T06:14:50.643772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:40.586866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.098771+0000","last_change":"2023-11-24T06:14:50.685541+0000","last_active":"2023-11-24T06:14:52.098771+0000","last_peered":"2023-11-24T06:14:52.098771+0000","last_clean":"2023-11-24T06:14:52.098771+0000","last_became_active":"2023-11-24T06:14:50.685197+0000","last_became_peered":"2023-11-24T06:14:50.685197+0000","last_unstale":"2023-11-24T06:14:52.098771+0000","last_undegraded":"2023-11-24T06:14:52.098771+0000","last_fullsized":"2023-11-24T06:14:52.098771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:14:40.490125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.706856+0000","last_change":"2023-11-24T06:14:49.708039+0000","last_active":"2023-11-24T06:14:50.706856+0000","last_peered":"2023-11-24T06:14:50.706856+0000","last_clean":"2023-11-24T06:14:50.706856+0000","last_became_active":"2023-11-24T06:14:49.707647+0000","last_became_peered":"2023-11-24T06:14:49.707647+0000","last_unstale":"2023-11-24T06:14:50.706856+0000","last_undegraded":"2023-11-24T06:14:50.706856+0000","last_fullsized":"2023-11-24T06:14:50.706856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.086649+0000","last_change":"2023-11-24T06:14:50.677402+0000","last_active":"2023-11-24T06:14:52.086649+0000","last_peered":"2023-11-24T06:14:52.086649+0000","last_clean":"2023-11-24T06:14:52.086649+0000","last_became_active":"2023-11-24T06:14:50.677099+0000","last_became_peered":"2023-11-24T06:14:50.677099+0000","last_unstale":"2023-11-24T06:14:52.086649+0000","last_undegraded":"2023-11-24T06:14:52.086649+0000","last_fullsized":"2023-11-24T06:14:52.086649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.987202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.650383+0000","last_change":"2023-11-24T06:14:50.675498+0000","last_active":"2023-11-24T06:14:51.650383+0000","last_peered":"2023-11-24T06:14:51.650383+0000","last_clean":"2023-11-24T06:14:51.650383+0000","last_became_active":"2023-11-24T06:14:50.675047+0000","last_became_peered":"2023-11-24T06:14:50.675047+0000","last_unstale":"2023-11-24T06:14:51.650383+0000","last_undegraded":"2023-11-24T06:14:51.650383+0000","last_fullsized":"2023-11-24T06:14:51.650383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:40:47.169979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.708991+0000","last_change":"2023-11-24T06:14:49.712534+0000","last_active":"2023-11-24T06:14:50.708991+0000","last_peered":"2023-11-24T06:14:50.708991+0000","last_clean":"2023-11-24T06:14:50.708991+0000","last_became_active":"2023-11-24T06:14:49.712227+0000","last_became_peered":"2023-11-24T06:14:49.712227+0000","last_unstale":"2023-11-24T06:14:50.708991+0000","last_undegraded":"2023-11-24T06:14:50.708991+0000","last_fullsized":"2023-11-24T06:14:50.708991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:49:01.297290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:51.649128+0000","last_change":"2023-11-24T06:14:50.679678+0000","last_active":"2023-11-24T06:14:51.649128+0000","last_peered":"2023-11-24T06:14:51.649128+0000","last_clean":"2023-11-24T06:14:51.649128+0000","last_became_active":"2023-11-24T06:14:50.679409+0000","last_became_peered":"2023-11-24T06:14:50.679409+0000","last_unstale":"2023-11-24T06:14:51.649128+0000","last_undegraded":"2023-11-24T06:14:51.649128+0000","last_fullsized":"2023-11-24T06:14:51.649128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:58.046148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.709115+0000","last_change":"2023-11-24T06:14:49.712744+0000","last_active":"2023-11-24T06:14:50.709115+0000","last_peered":"2023-11-24T06:14:50.709115+0000","last_clean":"2023-11-24T06:14:50.709115+0000","last_became_active":"2023-11-24T06:14:49.712445+0000","last_became_peered":"2023-11-24T06:14:49.712445+0000","last_unstale":"2023-11-24T06:14:50.709115+0000","last_undegraded":"2023-11-24T06:14:50.709115+0000","last_fullsized":"2023-11-24T06:14:50.709115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.982177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.100288+0000","last_change":"2023-11-24T06:14:50.673586+0000","last_active":"2023-11-24T06:14:52.100288+0000","last_peered":"2023-11-24T06:14:52.100288+0000","last_clean":"2023-11-24T06:14:52.100288+0000","last_became_active":"2023-11-24T06:14:50.672630+0000","last_became_peered":"2023-11-24T06:14:50.672630+0000","last_unstale":"2023-11-24T06:14:52.100288+0000","last_undegraded":"2023-11-24T06:14:52.100288+0000","last_fullsized":"2023-11-24T06:14:52.100288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:32.761606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710407+0000","last_change":"2023-11-24T06:14:49.695261+0000","last_active":"2023-11-24T06:14:50.710407+0000","last_peered":"2023-11-24T06:14:50.710407+0000","last_clean":"2023-11-24T06:14:50.710407+0000","last_became_active":"2023-11-24T06:14:49.692908+0000","last_became_peered":"2023-11-24T06:14:49.692908+0000","last_unstale":"2023-11-24T06:14:50.710407+0000","last_undegraded":"2023-11-24T06:14:50.710407+0000","last_fullsized":"2023-11-24T06:14:50.710407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:58.781471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:14:52.099034+0000","last_change":"2023-11-24T06:14:50.682523+0000","last_active":"2023-11-24T06:14:52.099034+0000","last_peered":"2023-11-24T06:14:52.099034+0000","last_clean":"2023-11-24T06:14:52.099034+0000","last_became_active":"2023-11-24T06:14:50.682208+0000","last_became_peered":"2023-11-24T06:14:50.682208+0000","last_unstale":"2023-11-24T06:14:52.099034+0000","last_undegraded":"2023-11-24T06:14:52.099034+0000","last_fullsized":"2023-11-24T06:14:52.099034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:49.652498+0000","last_clean_scrub_stamp":"2023-11-24T06:14:49.652498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:29:41.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:14:50.710033+0000","last_change":"2023-11-24T06:14:49.701899+0000","last_active":"2023-11-24T06:14:50.710033+0000","last_peered":"2023-11-24T06:14:50.710033+0000","last_clean":"2023-11-24T06:14:50.710033+0000","last_became_active":"2023-11-24T06:14:49.701658+0000","last_became_peered":"2023-11-24T06:14:49.701658+0000","last_unstale":"2023-11-24T06:14:50.710033+0000","last_undegraded":"2023-11-24T06:14:50.710033+0000","last_fullsized":"2023-11-24T06:14:50.710033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:48.647472+0000","last_clean_scrub_stamp":"2023-11-24T06:14:48.647472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:56:07.157268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.663}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7210000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2690000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0720000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9059999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:15:01.388 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:15:01.388 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T06:15:01.388 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T06:15:01.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.647+0000 7f0383815640 1 Processor -- start 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.647+0000 7f0383815640 1 -- start start 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0383815640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f037c0cfb60 0x7f037c161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0383815640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f037c15dc80 0x7f037c15e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0383815640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0ce0b0 con 0x7f037c157c70 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0383815640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c161960 con 0x7f037c0cfb60 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0383815640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c15e670 con 0x7f037c15dc80 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0380db0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f037c0cfb60 0x7f037c161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0380db0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f037c0cfb60 0x7f037c161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33928/0 (socket says 172.21.15.37:33928) 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.649+0000 7f0380db0640 1 -- 172.21.15.37:0/688695034 learned_addr learned my addr 172.21.15.37:0/688695034 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.650+0000 7f0381db2640 1 --2- 172.21.15.37:0/688695034 >> v2:172.21.15.188:3300/0 conn(0x7f037c15dc80 0x7f037c15e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.650+0000 7f0380db0640 1 -- 172.21.15.37:0/688695034 >> v2:172.21.15.188:3300/0 conn(0x7f037c15dc80 msgr2=0x7f037c15e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.650+0000 7f0380db0640 1 --2- 172.21.15.37:0/688695034 >> v2:172.21.15.188:3300/0 conn(0x7f037c15dc80 0x7f037c15e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.650+0000 7f0380db0640 1 -- 172.21.15.37:0/688695034 >> v1:172.21.15.188:6789/0 conn(0x7f037c157c70 legacy=0x7f037c0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.650+0000 7f0380db0640 1 -- 172.21.15.37:0/688695034 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c15e8d0 con 0x7f037c0cfb60 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.650+0000 7f0381db2640 1 --2- 172.21.15.37:0/688695034 >> v2:172.21.15.188:3300/0 conn(0x7f037c15dc80 0x7f037c15e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.651+0000 7f0380db0640 1 --2- 172.21.15.37:0/688695034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c0cfb60 0x7f037c161df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f037c0d0130 tx=0x7f036c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919478d10ec20be server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.651+0000 7f0373fff640 1 -- 172.21.15.37:0/688695034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0317e0 con 0x7f037c0cfb60 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.651+0000 7f0373fff640 1 -- 172.21.15.37:0/688695034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c031940 con 0x7f037c0cfb60 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.651+0000 7f0373fff640 1 -- 172.21.15.37:0/688695034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c031cd0 con 0x7f037c0cfb60 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 -- 172.21.15.37:0/688695034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c0cfb60 msgr2=0x7f037c161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 --2- 172.21.15.37:0/688695034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c0cfb60 0x7f037c161df0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f037c0d0130 tx=0x7f036c02b880 comp rx=0 tx=0).stop 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 -- 172.21.15.37:0/688695034 shutdown_connections 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 --2- 172.21.15.37:0/688695034 >> v2:172.21.15.188:3300/0 conn(0x7f037c15dc80 0x7f037c15e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 --2- 172.21.15.37:0/688695034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c0cfb60 0x7f037c161df0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 -- 172.21.15.37:0/688695034 >> 172.21.15.37:0/688695034 conn(0x7f037c06a920 msgr2=0x7f037c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 -- 172.21.15.37:0/688695034 shutdown_connections 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.652+0000 7f0383815640 1 -- 172.21.15.37:0/688695034 wait complete. 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.654+0000 7f0383815640 1 Processor -- start 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.654+0000 7f0383815640 1 -- start start 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0383815640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0cfb60 0x7f037c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0383815640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c157c70 0x7f037c156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0383815640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15dc80 0x7f037c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0383815640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c160f60 con 0x7f037c157c70 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0383815640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c099ef0 con 0x7f037c0cfb60 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0383815640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0992e0 con 0x7f037c15dc80 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0380db0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c157c70 0x7f037c156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0380db0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c157c70 0x7f037c156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33932/0 (socket says 172.21.15.37:33932) 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.655+0000 7f0380db0640 1 -- 172.21.15.37:0/2704200456 learned_addr learned my addr 172.21.15.37:0/2704200456 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0380db0640 1 -- 172.21.15.37:0/2704200456 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15dc80 msgr2=0x7f037c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0380db0640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15dc80 0x7f037c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f03815b1640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0cfb60 0x7f037c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0380db0640 1 -- 172.21.15.37:0/2704200456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0cfb60 msgr2=0x7f037c0cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0380db0640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0cfb60 0x7f037c0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0380db0640 1 -- 172.21.15.37:0/2704200456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0094d0 con 0x7f037c157c70 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0380db0640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c157c70 0x7f037c156130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f036c000c00 tx=0x7f036c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0371ffb640 1 -- 172.21.15.37:0/2704200456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c032980 con 0x7f037c157c70 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0371ffb640 1 -- 172.21.15.37:0/2704200456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c032ae0 con 0x7f037c157c70 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0371ffb640 1 -- 172.21.15.37:0/2704200456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c032e90 con 0x7f037c157c70 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c0995c0 con 0x7f037c157c70 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.656+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c099b80 con 0x7f037c157c70 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.658+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c09a060 con 0x7f037c157c70 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.658+0000 7f0371ffb640 1 -- 172.21.15.37:0/2704200456 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f036c04d3f0 con 0x7f037c157c70 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.659+0000 7f0371ffb640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f036006ae40 0x7f036006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.659+0000 7f0371ffb640 1 -- 172.21.15.37:0/2704200456 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f036c0ab590 con 0x7f037c157c70 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.660+0000 7f03815b1640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f036006ae40 0x7f036006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.660+0000 7f03815b1640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f036006ae40 0x7f036006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f037c157bc0 tx=0x7f03780072e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.663+0000 7f0371ffb640 1 -- 172.21.15.37:0/2704200456 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f036c076780 con 0x7f037c157c70 2023-11-24T06:15:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.889+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f037c067470 con 0x7f037c157c70 2023-11-24T06:15:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.890+0000 7f0371ffb640 1 -- 172.21.15.37:0/2704200456 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f036c079da0 con 0x7f037c157c70 2023-11-24T06:15:01.893 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:01.893 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T06:15:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f036006ae40 msgr2=0x7f036006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f036006ae40 0x7f036006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f037c157bc0 tx=0x7f03780072e0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c157c70 msgr2=0x7f037c156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c157c70 0x7f037c156130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f036c000c00 tx=0x7f036c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 shutdown_connections 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f036006ae40 0x7f036006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15dc80 0x7f037c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037c157c70 0x7f037c156130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 --2- 172.21.15.37:0/2704200456 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0cfb60 0x7f037c0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 >> 172.21.15.37:0/2704200456 conn(0x7f037c06a920 msgr2=0x7f037c0b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 shutdown_connections 2023-11-24T06:15:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:01.892+0000 7f0383815640 1 -- 172.21.15.37:0/2704200456 wait complete. 2023-11-24T06:15:01.914 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T06:15:01.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.115+0000 7fa4d0d41640 1 Processor -- start 2023-11-24T06:15:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.116+0000 7fa4d0d41640 1 -- start start 2023-11-24T06:15:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.117+0000 7fa4d0d41640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.117+0000 7fa4d0d41640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa4cc0d22b0 0x7fa4cc0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.117+0000 7fa4d0d41640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc0b2d90 con 0x7fa4cc0ce710 2023-11-24T06:15:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.117+0000 7fa4d0d41640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc0ceb80 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.117+0000 7fa4d0d41640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0d1540 con 0x7fa4cc0d1ed0 2023-11-24T06:15:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.118+0000 7fa4c9d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa4cc0d22b0 0x7fa4cc0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.118+0000 7fa4ca59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.118+0000 7fa4c9d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa4cc0d22b0 0x7fa4cc0ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:43400/0 (socket says 172.21.15.37:43400) 2023-11-24T06:15:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.118+0000 7fa4c9d9b640 1 -- 172.21.15.37:0/4018852835 learned_addr learned my addr 172.21.15.37:0/4018852835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.119+0000 7fa4c959a640 1 -- 172.21.15.37:0/4018852835 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102916820 0 0) 0x7fa4cc0b2d90 con 0x7fa4cc0ce710 2023-11-24T06:15:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.119+0000 7fa4c959a640 1 -- 172.21.15.37:0/4018852835 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b8003520 con 0x7fa4cc0ce710 2023-11-24T06:15:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.119+0000 7fa4c9d9b640 1 -- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 msgr2=0x7fa4cc0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.119+0000 7fa4c9d9b640 1 --2- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc0d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.119+0000 7fa4c9d9b640 1 -- 172.21.15.37:0/4018852835 >> v1:172.21.15.188:6789/0 conn(0x7fa4cc0ce710 legacy=0x7fa4cc0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.119+0000 7fa4c9d9b640 1 -- 172.21.15.37:0/4018852835 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0b45f0 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.119+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc0d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:15:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.120+0000 7fa4c9d9b640 1 --2- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0ce1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009870 tx=0x7fa4b402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cb7af324bc1e865 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.121+0000 7fa4c959a640 1 -- 172.21.15.37:0/4018852835 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4031640 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.121+0000 7fa4c959a640 1 -- 172.21.15.37:0/4018852835 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b40317a0 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.121+0000 7fa4c959a640 1 -- 172.21.15.37:0/4018852835 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4031b30 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 -- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0d22b0 msgr2=0x7fa4cc0ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0ce1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009870 tx=0x7fa4b402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 -- 172.21.15.37:0/4018852835 shutdown_connections 2023-11-24T06:15:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0ce1d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/4018852835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc0d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 -- 172.21.15.37:0/4018852835 >> 172.21.15.37:0/4018852835 conn(0x7fa4cc08af60 msgr2=0x7fa4cc0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 -- 172.21.15.37:0/4018852835 shutdown_connections 2023-11-24T06:15:02.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.122+0000 7fa4d0d41640 1 -- 172.21.15.37:0/4018852835 wait complete. 2023-11-24T06:15:02.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.124+0000 7fa4d0d41640 1 Processor -- start 2023-11-24T06:15:02.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.124+0000 7fa4d0d41640 1 -- start start 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.125+0000 7fa4d0d41640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0ce710 0x7fa4cc0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.125+0000 7fa4d0d41640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc1e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.125+0000 7fa4d0d41640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.125+0000 7fa4d0d41640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c8fc0 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.125+0000 7fa4d0d41640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c80a0 con 0x7fa4cc0ce710 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.125+0000 7fa4d0d41640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0c8340 con 0x7fa4cc0d1ed0 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33940/0 (socket says 172.21.15.37:33940) 2023-11-24T06:15:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 -- 172.21.15.37:0/477120237 learned_addr learned my addr 172.21.15.37:0/477120237 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0ce710 0x7fa4cc0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4c9d9b640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc1e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 -- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 msgr2=0x7fa4cc1e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc1e38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 -- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0ce710 msgr2=0x7fa4cc0b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0ce710 0x7fa4cc0b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.126+0000 7fa4cad9d640 1 -- 172.21.15.37:0/477120237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009a70 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.127+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0caf10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c400 tx=0x7fa4c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.127+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/477120237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40052d0 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.127+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/477120237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4005430 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.127+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b40094d0 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.127+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/477120237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40037f0 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.127+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc0c8900 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.128+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc0c9100 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.129+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/477120237 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4c4003950 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.130+0000 7fa4c2ffd640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4ac06ae40 0x7fa4ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.130+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/477120237 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4c4088b70 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.131+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4ac06ae40 0x7fa4ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.131+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4ac06ae40 0x7fa4ac06d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc007600 tx=0x7fa4bc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.135+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/477120237 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4cc0c9100 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.327+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4cc0c9100 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.329+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/477120237 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fa4cc0c9100 con 0x7fa4cc0d22b0 2023-11-24T06:15:02.332 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:02.332 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.331+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4ac06ae40 msgr2=0x7fa4ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.331+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4ac06ae40 0x7fa4ac06d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc007600 tx=0x7fa4bc00b040 comp rx=0 tx=0).stop 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.331+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc0d22b0 msgr2=0x7fa4cc0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.331+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0caf10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c400 tx=0x7fa4c400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 shutdown_connections 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4ac06ae40 0x7fa4ac06d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc0d22b0 0x7fa4cc0caf10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d1ed0 0x7fa4cc1e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 --2- 172.21.15.37:0/477120237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4cc0ce710 0x7fa4cc0b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 >> 172.21.15.37:0/477120237 conn(0x7fa4cc08af60 msgr2=0x7fa4cc1e4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 shutdown_connections 2023-11-24T06:15:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.332+0000 7fa4d0d41640 1 -- 172.21.15.37:0/477120237 wait complete. 2023-11-24T06:15:02.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:02.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.579+0000 7f2f6759e640 1 Processor -- start 2023-11-24T06:15:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.579+0000 7f2f6759e640 1 -- start start 2023-11-24T06:15:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f6759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 0x7f2f680d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f6759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2f680d0e40 0x7f2f680d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f6759e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f680d15e0 con 0x7f2f6815d7d0 2023-11-24T06:15:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f6759e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f680d0280 con 0x7f2f680d0e40 2023-11-24T06:15:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f6759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680d1300 con 0x7f2f6815d3f0 2023-11-24T06:15:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f65d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2f6815d7d0 0x7f2f680afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57208/0 (socket says 172.21.15.37:57208) 2023-11-24T06:15:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f65d9b640 1 -- 172.21.15.37:0/3291751858 learned_addr learned my addr 172.21.15.37:0/3291751858 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f6659c640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 0x7f2f680d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f66d9d640 1 --2- 172.21.15.37:0/3291751858 >> v2:172.21.15.188:3300/0 conn(0x7f2f680d0e40 0x7f2f680d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.581+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525636348 0 0) 0x7f2f680d15e0 con 0x7f2f6815d7d0 2023-11-24T06:15:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f54003520 con 0x7f2f6815d7d0 2023-11-24T06:15:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586416287 0 0) 0x7f2f54003520 con 0x7f2f6815d7d0 2023-11-24T06:15:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 msgr2=0x7f2f680d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 0x7f2f680d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 >> v2:172.21.15.188:3300/0 conn(0x7f2f680d0e40 msgr2=0x7f2f680d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 --2- 172.21.15.37:0/3291751858 >> v2:172.21.15.188:3300/0 conn(0x7f2f680d0e40 0x7f2f680d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680cfc30 con 0x7f2f6815d7d0 2023-11-24T06:15:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f2f50001670 con 0x7f2f6815d7d0 2023-11-24T06:15:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 >> v1:172.21.15.37:6789/0 conn(0x7f2f6815d7d0 legacy=0x7f2f680afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 0x7f2f54003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f54004d00 0x7f2f54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680d0280 con 0x7f2f54003f40 2023-11-24T06:15:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680d1300 con 0x7f2f54004d00 2023-11-24T06:15:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5400b980 con 0x7f2f6815d3f0 2023-11-24T06:15:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.582+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.583+0000 7f2f66d9d640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f54004d00 0x7f2f54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.583+0000 7f2f6659c640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 0x7f2f54003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.583+0000 7f2f65d9b640 1 -- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 msgr2=0x7f2f54003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.583+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f6815d3f0 0x7f2f54003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.583+0000 7f2f65d9b640 1 -- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f54004d00 msgr2=0x7f2f54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.583+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f54004d00 0x7f2f54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.583+0000 7f2f65d9b640 1 -- 172.21.15.37:0/3291751858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54003520 con 0x7f2f54003f40 2023-11-24T06:15:02.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.584+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f540047c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c160 tx=0x7f2f540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eeb582e9e284e6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.584+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50005ad0 con 0x7f2f54003f40 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.584+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50005c30 con 0x7f2f54003f40 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.584+0000 7f2f6559a640 1 -- 172.21.15.37:0/3291751858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5002c7d0 con 0x7f2f54003f40 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.585+0000 7f2f6759e640 1 -- 172.21.15.37:0/3291751858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 msgr2=0x7f2f540047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.585+0000 7f2f6759e640 1 --2- 172.21.15.37:0/3291751858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f540047c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c160 tx=0x7f2f540057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.585+0000 7f2f66d9d640 1 -- 172.21.15.37:0/3291751858 reap_dead start 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.585+0000 7f2f6759e640 1 -- 172.21.15.37:0/3291751858 shutdown_connections 2023-11-24T06:15:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.585+0000 7f2f6759e640 1 -- 172.21.15.37:0/3291751858 >> 172.21.15.37:0/3291751858 conn(0x7f2f6809c5b0 msgr2=0x7f2f680d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.585+0000 7f2f6759e640 1 -- 172.21.15.37:0/3291751858 shutdown_connections 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.585+0000 7f2f6759e640 1 -- 172.21.15.37:0/3291751858 wait complete. 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.587+0000 7f2f6759e640 1 Processor -- start 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.587+0000 7f2f6759e640 1 -- start start 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.588+0000 7f2f6759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f68152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.588+0000 7f2f6759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f680c7440 0x7f2f680c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.588+0000 7f2f6759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f680c7e00 0x7f2f680b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.588+0000 7f2f6759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680cc510 con 0x7f2f54003f40 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.588+0000 7f2f6759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680cc760 con 0x7f2f680c7440 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.588+0000 7f2f6759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680cca40 con 0x7f2f680c7e00 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f68152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f68152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33962/0 (socket says 172.21.15.37:33962) 2023-11-24T06:15:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 -- 172.21.15.37:0/4211112378 learned_addr learned my addr 172.21.15.37:0/4211112378 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f680c7440 0x7f2f680c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 -- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f680c7e00 msgr2=0x7f2f680b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f680c7e00 0x7f2f680b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 -- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f680c7440 msgr2=0x7f2f680c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f680c7440 0x7f2f680c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 -- 172.21.15.37:0/4211112378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680ccd20 con 0x7f2f54003f40 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f680c7440 0x7f2f680c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f6659c640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f68152700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007f30 tx=0x7f2f58011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.589+0000 7f2f5effd640 1 -- 172.21.15.37:0/4211112378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800e030 con 0x7f2f54003f40 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.590+0000 7f2f5effd640 1 -- 172.21.15.37:0/4211112378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f58016470 con 0x7f2f54003f40 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.590+0000 7f2f5effd640 1 -- 172.21.15.37:0/4211112378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58016820 con 0x7f2f54003f40 2023-11-24T06:15:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.590+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f680cd000 con 0x7f2f54003f40 2023-11-24T06:15:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.590+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f68152c40 con 0x7f2f54003f40 2023-11-24T06:15:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.591+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f68067990 con 0x7f2f54003f40 2023-11-24T06:15:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.592+0000 7f2f5effd640 1 -- 172.21.15.37:0/4211112378 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f58016980 con 0x7f2f54003f40 2023-11-24T06:15:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.593+0000 7f2f5effd640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f4806ae40 0x7f2f4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.593+0000 7f2f5effd640 1 -- 172.21.15.37:0/4211112378 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f5800f070 con 0x7f2f54003f40 2023-11-24T06:15:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.594+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f4806ae40 0x7f2f4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.594+0000 7f2f65d9b640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f4806ae40 0x7f2f4806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f6815dbb0 tx=0x7f2f50007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.598+0000 7f2f5effd640 1 -- 172.21.15.37:0/4211112378 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f58055560 con 0x7f2f54003f40 2023-11-24T06:15:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.794+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f68072120 con 0x7f2f54003f40 2023-11-24T06:15:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.795+0000 7f2f5effd640 1 -- 172.21.15.37:0/4211112378 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f58058b80 con 0x7f2f54003f40 2023-11-24T06:15:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.797+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f4806ae40 msgr2=0x7f2f4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.797+0000 7f2f6759e640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f4806ae40 0x7f2f4806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f6815dbb0 tx=0x7f2f50007000 comp rx=0 tx=0).stop 2023-11-24T06:15:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.797+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 msgr2=0x7f2f68152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.797+0000 7f2f6759e640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f68152700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007f30 tx=0x7f2f58011660 comp rx=0 tx=0).stop 2023-11-24T06:15:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 shutdown_connections 2023-11-24T06:15:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f4806ae40 0x7f2f4806d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f680c7440 0x7f2f680c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f680c7e00 0x7f2f680b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 --2- 172.21.15.37:0/4211112378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f54003f40 0x7f2f68152700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 >> 172.21.15.37:0/4211112378 conn(0x7f2f6809c5b0 msgr2=0x7f2f680b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:02.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 shutdown_connections 2023-11-24T06:15:02.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:02.798+0000 7f2f6759e640 1 -- 172.21.15.37:0/4211112378 wait complete. 2023-11-24T06:15:02.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:03.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.046+0000 7fd3365fa640 1 Processor -- start 2023-11-24T06:15:03.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.046+0000 7fd3365fa640 1 -- start start 2023-11-24T06:15:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.047+0000 7fd3365fa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd33015d3f0 0x7fd3300d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.047+0000 7fd3365fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3300d15e0 con 0x7fd33015d7d0 2023-11-24T06:15:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.048+0000 7fd3365fa640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3300d0280 con 0x7fd3300d0e40 2023-11-24T06:15:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.048+0000 7fd3365fa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300d1300 con 0x7fd33015d3f0 2023-11-24T06:15:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.048+0000 7fd334df7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd33015d7d0 0x7fd3300afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57218/0 (socket says 172.21.15.37:57218) 2023-11-24T06:15:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.048+0000 7fd334df7640 1 -- 172.21.15.37:0/1691741395 learned_addr learned my addr 172.21.15.37:0/1691741395 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.048+0000 7fd3355f8640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd33015d3f0 0x7fd3300d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.048+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933850842 0 0) 0x7fd3300d15e0 con 0x7fd33015d7d0 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.048+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd31c003520 con 0x7fd33015d7d0 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141902727 0 0) 0x7fd31c003520 con 0x7fd33015d7d0 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd33015d3f0 msgr2=0x7fd3300d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd33015d3f0 0x7fd3300d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 >> v1:172.21.15.188:6789/0 conn(0x7fd3300d0e40 legacy=0x7fd3300b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300cfc30 con 0x7fd33015d7d0 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd320001670 con 0x7fd33015d7d0 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 >> v1:172.21.15.37:6789/0 conn(0x7fd33015d7d0 legacy=0x7fd3300afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd31c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c0047c0 0x7fd31c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd31c005180 0x7fd31c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300d1300 con 0x7fd31c0039a0 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c00c020 con 0x7fd31c0047c0 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c00c1e0 con 0x7fd31c005180 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd3355f8640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd33015d3f0 0x7fd3300d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.049+0000 7fd3355f8640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd31c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.050+0000 7fd334df7640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c0047c0 0x7fd31c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.050+0000 7fd3355f8640 1 -- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd31c005180 msgr2=0x7fd31c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.050+0000 7fd3355f8640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd31c005180 0x7fd31c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.050+0000 7fd3355f8640 1 -- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c0047c0 msgr2=0x7fd31c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.050+0000 7fd3355f8640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c0047c0 0x7fd31c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.050+0000 7fd3355f8640 1 -- 172.21.15.37:0/1691741395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c003520 con 0x7fd31c0039a0 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.050+0000 7fd334df7640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd31c0047c0 0x7fd31c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.051+0000 7fd3355f8640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd31c003dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006fd0 tx=0x7fd31c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aea7fd9c735e047 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.051+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c033600 con 0x7fd31c0039a0 2023-11-24T06:15:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.051+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c02f050 con 0x7fd31c0039a0 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.051+0000 7fd327fff640 1 -- 172.21.15.37:0/1691741395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c033980 con 0x7fd31c0039a0 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.052+0000 7fd3365fa640 1 -- 172.21.15.37:0/1691741395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 msgr2=0x7fd31c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.052+0000 7fd3365fa640 1 --2- 172.21.15.37:0/1691741395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd31c003dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006fd0 tx=0x7fd31c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.052+0000 7fd335df9640 1 -- 172.21.15.37:0/1691741395 reap_dead start 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.052+0000 7fd3365fa640 1 -- 172.21.15.37:0/1691741395 shutdown_connections 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.052+0000 7fd3365fa640 1 -- 172.21.15.37:0/1691741395 >> 172.21.15.37:0/1691741395 conn(0x7fd33009c5b0 msgr2=0x7fd3300d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.052+0000 7fd3365fa640 1 -- 172.21.15.37:0/1691741395 shutdown_connections 2023-11-24T06:15:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.052+0000 7fd3365fa640 1 -- 172.21.15.37:0/1691741395 wait complete. 2023-11-24T06:15:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.054+0000 7fd3365fa640 1 Processor -- start 2023-11-24T06:15:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.054+0000 7fd3365fa640 1 -- start start 2023-11-24T06:15:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3365fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd3300b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3365fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3301506e0 0x7fd33006c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3365fa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3300c8f70 0x7fd3300c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3365fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300c9930 con 0x7fd31c0039a0 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3365fa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300ca340 con 0x7fd3301506e0 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3365fa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33006c6e0 con 0x7fd3300c8f70 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3355f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd3300b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3355f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd3300b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33970/0 (socket says 172.21.15.37:33970) 2023-11-24T06:15:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3355f8640 1 -- 172.21.15.37:0/501128042 learned_addr learned my addr 172.21.15.37:0/501128042 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:03.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd335df9640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3300c8f70 0x7fd3300c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3355f8640 1 -- 172.21.15.37:0/501128042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3300c8f70 msgr2=0x7fd3300c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.055+0000 7fd3355f8640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3300c8f70 0x7fd3300c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd3355f8640 1 -- 172.21.15.37:0/501128042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3301506e0 msgr2=0x7fd33006c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd3355f8640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3301506e0 0x7fd33006c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd3355f8640 1 -- 172.21.15.37:0/501128042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300b2f50 con 0x7fd31c0039a0 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd3355f8640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd3300b2970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd33008d4b0 tx=0x7fd32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd325ffb640 1 -- 172.21.15.37:0/501128042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c03d710 con 0x7fd31c0039a0 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd325ffb640 1 -- 172.21.15.37:0/501128042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c03d870 con 0x7fd31c0039a0 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd325ffb640 1 -- 172.21.15.37:0/501128042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c03dc00 con 0x7fd31c0039a0 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3300b3230 con 0x7fd31c0039a0 2023-11-24T06:15:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.056+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3300b37f0 con 0x7fd31c0039a0 2023-11-24T06:15:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.057+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33004e840 con 0x7fd31c0039a0 2023-11-24T06:15:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.058+0000 7fd325ffb640 1 -- 172.21.15.37:0/501128042 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd32c032420 con 0x7fd31c0039a0 2023-11-24T06:15:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.059+0000 7fd325ffb640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd31406aec0 0x7fd31406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.059+0000 7fd325ffb640 1 -- 172.21.15.37:0/501128042 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd32c0ab080 con 0x7fd31c0039a0 2023-11-24T06:15:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.060+0000 7fd334df7640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd31406aec0 0x7fd31406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.060+0000 7fd334df7640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd31406aec0 0x7fd31406d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd320001eb0 tx=0x7fd320009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.064+0000 7fd325ffb640 1 -- 172.21.15.37:0/501128042 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd32c0dde90 con 0x7fd31c0039a0 2023-11-24T06:15:03.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.259+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd33006c960 con 0x7fd31c0039a0 2023-11-24T06:15:03.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.260+0000 7fd325ffb640 1 -- 172.21.15.37:0/501128042 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd32c076110 con 0x7fd31c0039a0 2023-11-24T06:15:03.263 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.262+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd31406aec0 msgr2=0x7fd31406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.262+0000 7fd3365fa640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd31406aec0 0x7fd31406d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd320001eb0 tx=0x7fd320009040 comp rx=0 tx=0).stop 2023-11-24T06:15:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.262+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 msgr2=0x7fd3300b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.262+0000 7fd3365fa640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd3300b2970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd33008d4b0 tx=0x7fd32c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 shutdown_connections 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd31406aec0 0x7fd31406d380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3301506e0 0x7fd33006c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3300c8f70 0x7fd3300c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 --2- 172.21.15.37:0/501128042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31c0039a0 0x7fd3300b2970 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 >> 172.21.15.37:0/501128042 conn(0x7fd33009c5b0 msgr2=0x7fd3300cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 shutdown_connections 2023-11-24T06:15:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.263+0000 7fd3365fa640 1 -- 172.21.15.37:0/501128042 wait complete. 2023-11-24T06:15:03.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.518+0000 7f21f2d4e640 1 Processor -- start 2023-11-24T06:15:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.518+0000 7f21f2d4e640 1 -- start start 2023-11-24T06:15:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.520+0000 7f21f2d4e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec0cb580 0x7f21ec0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.520+0000 7f21f2d4e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f21ec0c25d0 0x7f21ec0b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.520+0000 7f21f2d4e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ec0cb960 con 0x7f21ec0ca940 2023-11-24T06:15:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.520+0000 7f21f2d4e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec0c2a40 con 0x7f21ec0c25d0 2023-11-24T06:15:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.520+0000 7f21f2d4e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec161e40 con 0x7f21ec0cb580 2023-11-24T06:15:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.520+0000 7f21f154b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21ec0ca940 0x7f21ec0b0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57220/0 (socket says 172.21.15.37:57220) 2023-11-24T06:15:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.520+0000 7f21f154b640 1 -- 172.21.15.37:0/2050701643 learned_addr learned my addr 172.21.15.37:0/2050701643 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181626787 0 0) 0x7f21ec0cb960 con 0x7f21ec0ca940 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d8003520 con 0x7f21ec0ca940 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2247143772 0 0) 0x7f21d8003520 con 0x7f21ec0ca940 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec0cb580 msgr2=0x7f21ec0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec0cb580 0x7f21ec0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 >> v2:172.21.15.188:3300/0 conn(0x7f21ec0c25d0 msgr2=0x7f21ec0b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 --2- 172.21.15.37:0/2050701643 >> v2:172.21.15.188:3300/0 conn(0x7f21ec0c25d0 0x7f21ec0b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec162120 con 0x7f21ec0ca940 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f21dc001670 con 0x7f21ec0ca940 2023-11-24T06:15:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 >> v1:172.21.15.37:6789/0 conn(0x7f21ec0ca940 legacy=0x7f21ec0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8003970 0x7f21d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec0cb580 0x7f21d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21d8004d50 0x7f21d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec0c2a40 con 0x7f21d8003970 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec161e40 con 0x7f21d8004d50 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d800bbe0 con 0x7f21ec0cb580 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.521+0000 7f21f1d4c640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8003970 0x7f21d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.522+0000 7f21f1d4c640 1 -- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec0cb580 msgr2=0x7f21d80047c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.522+0000 7f21f1d4c640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec0cb580 0x7f21d80047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.522+0000 7f21f1d4c640 1 -- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21d8004d50 msgr2=0x7f21d80051d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.522+0000 7f21f1d4c640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21d8004d50 0x7f21d80051d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.522+0000 7f21f1d4c640 1 -- 172.21.15.37:0/2050701643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8003520 con 0x7f21d8003970 2023-11-24T06:15:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.523+0000 7f21f1d4c640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8003970 0x7f21d8003d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009860 tx=0x7f21d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e5e50e50aaf5b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.523+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8032600 con 0x7f21d8003970 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.523+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e802e050 con 0x7f21d8003970 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.523+0000 7f21f0d4a640 1 -- 172.21.15.37:0/2050701643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8032a00 con 0x7f21d8003970 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.524+0000 7f21f2d4e640 1 -- 172.21.15.37:0/2050701643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8003970 msgr2=0x7f21d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.524+0000 7f21f2d4e640 1 --2- 172.21.15.37:0/2050701643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8003970 0x7f21d8003d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009860 tx=0x7f21d80057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.524+0000 7f21f254d640 1 -- 172.21.15.37:0/2050701643 reap_dead start 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.524+0000 7f21f2d4e640 1 -- 172.21.15.37:0/2050701643 shutdown_connections 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.524+0000 7f21f2d4e640 1 -- 172.21.15.37:0/2050701643 >> 172.21.15.37:0/2050701643 conn(0x7f21ec0cbb40 msgr2=0x7f21ec0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.524+0000 7f21f2d4e640 1 -- 172.21.15.37:0/2050701643 shutdown_connections 2023-11-24T06:15:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.524+0000 7f21f2d4e640 1 -- 172.21.15.37:0/2050701643 wait complete. 2023-11-24T06:15:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.526+0000 7f21f2d4e640 1 Processor -- start 2023-11-24T06:15:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.526+0000 7f21f2d4e640 1 -- start start 2023-11-24T06:15:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f2d4e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21d8003970 0x7f21ec1ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f2d4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ec0c5550 0x7f21ec15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f2d4e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec15a9d0 0x7f21ec158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f2d4e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec15ae50 con 0x7f21ec0c5550 2023-11-24T06:15:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f2d4e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec1eca00 con 0x7f21d8003970 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f2d4e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec1ebb50 con 0x7f21ec15a9d0 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f154b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ec0c5550 0x7f21ec15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f154b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ec0c5550 0x7f21ec15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33994/0 (socket says 172.21.15.37:33994) 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.527+0000 7f21f154b640 1 -- 172.21.15.37:0/228058322 learned_addr learned my addr 172.21.15.37:0/228058322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f254d640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec15a9d0 0x7f21ec158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f154b640 1 -- 172.21.15.37:0/228058322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec15a9d0 msgr2=0x7f21ec158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f154b640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec15a9d0 0x7f21ec158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f154b640 1 -- 172.21.15.37:0/228058322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21d8003970 msgr2=0x7f21ec1ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f154b640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21d8003970 0x7f21ec1ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f154b640 1 -- 172.21.15.37:0/228058322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec1ebdf0 con 0x7f21ec0c5550 2023-11-24T06:15:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f154b640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ec0c5550 0x7f21ec15a490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00c770 tx=0x7f21dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21e27fc640 1 -- 172.21.15.37:0/228058322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0074e0 con 0x7f21ec0c5550 2023-11-24T06:15:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21e27fc640 1 -- 172.21.15.37:0/228058322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc007660 con 0x7f21ec0c5550 2023-11-24T06:15:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec1ec0d0 con 0x7f21ec0c5550 2023-11-24T06:15:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21e27fc640 1 -- 172.21.15.37:0/228058322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc004a20 con 0x7f21ec0c5550 2023-11-24T06:15:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.528+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec1ec690 con 0x7f21ec0c5550 2023-11-24T06:15:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.529+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec0b0e90 con 0x7f21ec0c5550 2023-11-24T06:15:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.531+0000 7f21e27fc640 1 -- 172.21.15.37:0/228058322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21dc004b80 con 0x7f21ec0c5550 2023-11-24T06:15:03.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.532+0000 7f21e27fc640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21d006aec0 0x7f21d006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.532+0000 7f21e27fc640 1 -- 172.21.15.37:0/228058322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21dc088f10 con 0x7f21ec0c5550 2023-11-24T06:15:03.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.532+0000 7f21f1d4c640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21d006aec0 0x7f21d006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.533+0000 7f21f1d4c640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21d006aec0 0x7f21d006d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21e8034000 tx=0x7f21e802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.536+0000 7f21e27fc640 1 -- 172.21.15.37:0/228058322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21dc053fa0 con 0x7f21ec0c5550 2023-11-24T06:15:03.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.732+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21ec04e840 con 0x7f21ec0c5550 2023-11-24T06:15:03.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.733+0000 7f21e27fc640 1 -- 172.21.15.37:0/228058322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21dc018070 con 0x7f21ec0c5550 2023-11-24T06:15:03.735 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21d006aec0 msgr2=0x7f21d006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21d006aec0 0x7f21d006d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21e8034000 tx=0x7f21e802f000 comp rx=0 tx=0).stop 2023-11-24T06:15:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ec0c5550 msgr2=0x7f21ec15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ec0c5550 0x7f21ec15a490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00c770 tx=0x7f21dc00cc30 comp rx=0 tx=0).stop 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 shutdown_connections 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21d006aec0 0x7f21d006d380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21ec15a9d0 0x7f21ec158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ec0c5550 0x7f21ec15a490 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 --2- 172.21.15.37:0/228058322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21d8003970 0x7f21ec1ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.735+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 >> 172.21.15.37:0/228058322 conn(0x7f21ec0cbb40 msgr2=0x7f21ec164860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.736+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 shutdown_connections 2023-11-24T06:15:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.736+0000 7f21f2d4e640 1 -- 172.21.15.37:0/228058322 wait complete. 2023-11-24T06:15:03.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.981+0000 7f182e189640 1 Processor -- start 2023-11-24T06:15:03.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.981+0000 7f182e189640 1 -- start start 2023-11-24T06:15:03.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.983+0000 7f182e189640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18280c3910 0x7f18280ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.983+0000 7f182e189640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f18281665a0 0x7f18280cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.983+0000 7f182e189640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280b04a0 con 0x7f18280af600 2023-11-24T06:15:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.983+0000 7f182e189640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18281622a0 con 0x7f18281665a0 2023-11-24T06:15:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.983+0000 7f182e189640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280afee0 con 0x7f18280c3910 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f1827fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f18281665a0 0x7f18280cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f181effd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18280c3910 0x7f18280ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f1827fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f18281665a0 0x7f18280cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:43502/0 (socket says 172.21.15.37:43502) 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f1827fff640 1 -- 172.21.15.37:0/1482908283 learned_addr learned my addr 172.21.15.37:0/1482908283 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f1827fff640 1 -- 172.21.15.37:0/1482908283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18280c3910 msgr2=0x7f18280ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f1827fff640 1 --2- 172.21.15.37:0/1482908283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18280c3910 0x7f18280ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f1827fff640 1 -- 172.21.15.37:0/1482908283 >> v1:172.21.15.188:6789/0 conn(0x7f18280af600 legacy=0x7f18280c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.984+0000 7f1827fff640 1 -- 172.21.15.37:0/1482908283 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280b01c0 con 0x7f18281665a0 2023-11-24T06:15:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.986+0000 7f1827fff640 1 --2- 172.21.15.37:0/1482908283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18281665a0 0x7f18280cedd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1820009870 tx=0x7f182002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26dcb52e2c839475 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.986+0000 7f1826ffd640 1 -- 172.21.15.37:0/1482908283 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820031640 con 0x7f18281665a0 2023-11-24T06:15:03.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.986+0000 7f1826ffd640 1 -- 172.21.15.37:0/1482908283 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18200317a0 con 0x7f18281665a0 2023-11-24T06:15:03.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.986+0000 7f1826ffd640 1 -- 172.21.15.37:0/1482908283 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820031b30 con 0x7f18281665a0 2023-11-24T06:15:03.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 -- 172.21.15.37:0/1482908283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18281665a0 msgr2=0x7f18280cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 --2- 172.21.15.37:0/1482908283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18281665a0 0x7f18280cedd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1820009870 tx=0x7f182002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 -- 172.21.15.37:0/1482908283 shutdown_connections 2023-11-24T06:15:03.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 --2- 172.21.15.37:0/1482908283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18281665a0 0x7f18280cedd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 --2- 172.21.15.37:0/1482908283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18280c3910 0x7f18280ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 -- 172.21.15.37:0/1482908283 >> 172.21.15.37:0/1482908283 conn(0x7f18280999d0 msgr2=0x7f18280b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 -- 172.21.15.37:0/1482908283 shutdown_connections 2023-11-24T06:15:03.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.987+0000 7f182e189640 1 -- 172.21.15.37:0/1482908283 wait complete. 2023-11-24T06:15:03.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.988+0000 7f182e189640 1 Processor -- start 2023-11-24T06:15:03.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.989+0000 7f182e189640 1 -- start start 2023-11-24T06:15:03.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f182e189640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18280af600 0x7f18280c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f182e189640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280c3910 0x7f1828159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f182e189640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18281665a0 0x7f18280c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f182e189640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815d610 con 0x7f18280c3910 2023-11-24T06:15:03.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f182e189640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280c8580 con 0x7f18280af600 2023-11-24T06:15:03.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f182e189640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280c8860 con 0x7f18281665a0 2023-11-24T06:15:03.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280c3910 0x7f1828159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280c3910 0x7f1828159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34004/0 (socket says 172.21.15.37:34004) 2023-11-24T06:15:03.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 -- 172.21.15.37:0/2446046852 learned_addr learned my addr 172.21.15.37:0/2446046852 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:03.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f18277fe640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18280af600 0x7f18280c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f1827fff640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18281665a0 0x7f18280c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 -- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18281665a0 msgr2=0x7f18280c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18281665a0 0x7f18280c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 -- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18280af600 msgr2=0x7f18280c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18280af600 0x7f18280c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.990+0000 7f181effd640 1 -- 172.21.15.37:0/2446046852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200094d0 con 0x7f18280c3910 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.991+0000 7f18277fe640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18280af600 0x7f18280c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.991+0000 7f181effd640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280c3910 0x7f1828159ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f181000e9b0 tx=0x7f181000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.991+0000 7f1824ff9640 1 -- 172.21.15.37:0/2446046852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810009670 con 0x7f18280c3910 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.991+0000 7f1824ff9640 1 -- 172.21.15.37:0/2446046852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000c9a0 con 0x7f18280c3910 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.991+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18280c8b40 con 0x7f18280c3910 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.991+0000 7f1824ff9640 1 -- 172.21.15.37:0/2446046852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000cd50 con 0x7f18280c3910 2023-11-24T06:15:03.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.991+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18280b2c50 con 0x7f18280c3910 2023-11-24T06:15:03.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.992+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18280743b0 con 0x7f18280c3910 2023-11-24T06:15:03.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.993+0000 7f1824ff9640 1 -- 172.21.15.37:0/2446046852 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1810013470 con 0x7f18280c3910 2023-11-24T06:15:03.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.995+0000 7f1824ff9640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f180806ae40 0x7f180806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.995+0000 7f1824ff9640 1 -- 172.21.15.37:0/2446046852 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1810089960 con 0x7f18280c3910 2023-11-24T06:15:03.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.995+0000 7f18277fe640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f180806ae40 0x7f180806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.996+0000 7f18277fe640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f180806ae40 0x7f180806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18180012e0 tx=0x7f1818009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:03.999+0000 7f1824ff9640 1 -- 172.21.15.37:0/2446046852 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1810054970 con 0x7f18280c3910 2023-11-24T06:15:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.232+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18280b5b00 con 0x7f18280c3910 2023-11-24T06:15:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.233+0000 7f1824ff9640 1 -- 172.21.15.37:0/2446046852 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f1810017090 con 0x7f18280c3910 2023-11-24T06:15:04.236 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:15:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:15:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.235+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f180806ae40 msgr2=0x7f180806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.235+0000 7f182e189640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f180806ae40 0x7f180806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18180012e0 tx=0x7f1818009040 comp rx=0 tx=0).stop 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.235+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280c3910 msgr2=0x7f1828159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.235+0000 7f182e189640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280c3910 0x7f1828159ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f181000e9b0 tx=0x7f181000ee70 comp rx=0 tx=0).stop 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 shutdown_connections 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f180806ae40 0x7f180806d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18281665a0 0x7f18280c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280c3910 0x7f1828159ec0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 --2- 172.21.15.37:0/2446046852 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18280af600 0x7f18280c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 >> 172.21.15.37:0/2446046852 conn(0x7f18280999d0 msgr2=0x7f182806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 shutdown_connections 2023-11-24T06:15:04.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.236+0000 7f182e189640 1 -- 172.21.15.37:0/2446046852 wait complete. 2023-11-24T06:15:04.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.479+0000 7f9ed359e640 1 Processor -- start 2023-11-24T06:15:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.479+0000 7f9ed359e640 1 -- start start 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed359e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9ed4144b30 0x7f9ed415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ed40b1de0 0x7f9ed40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed415bf80 con 0x7f9ed415c410 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed359e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40b27b0 con 0x7f9ed40b1de0 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed359e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40b1560 con 0x7f9ed4144b30 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed2d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ed40b1de0 0x7f9ed40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed2d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ed40b1de0 0x7f9ed40b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34010/0 (socket says 172.21.15.37:34010) 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/3161218237 learned_addr learned my addr 172.21.15.37:0/3161218237 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed1d9b640 1 --1- 172.21.15.37:0/3161218237 >> v1:172.21.15.37:6789/0 conn(0x7f9ed415c410 0x7f9ed40b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57222/0 (socket says 172.21.15.37:57222) 2023-11-24T06:15:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.481+0000 7f9ed259c640 1 --2- 172.21.15.37:0/3161218237 >> v2:172.21.15.188:3300/0 conn(0x7f9ed4144b30 0x7f9ed415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.482+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/3161218237 >> v2:172.21.15.188:3300/0 conn(0x7f9ed4144b30 msgr2=0x7f9ed415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.482+0000 7f9ed2d9d640 1 --2- 172.21.15.37:0/3161218237 >> v2:172.21.15.188:3300/0 conn(0x7f9ed4144b30 0x7f9ed415f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.482+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/3161218237 >> v1:172.21.15.37:6789/0 conn(0x7f9ed415c410 legacy=0x7f9ed40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.482+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/3161218237 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40b1280 con 0x7f9ed40b1de0 2023-11-24T06:15:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.483+0000 7f9ed2d9d640 1 --2- 172.21.15.37:0/3161218237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed40b1de0 0x7f9ed40b2270 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406f690 tx=0x7f9ecc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31960e691ec09b83 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.483+0000 7f9ed159a640 1 -- 172.21.15.37:0/3161218237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc030860 con 0x7f9ed40b1de0 2023-11-24T06:15:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.483+0000 7f9ed159a640 1 -- 172.21.15.37:0/3161218237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0309c0 con 0x7f9ed40b1de0 2023-11-24T06:15:04.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.483+0000 7f9ed159a640 1 -- 172.21.15.37:0/3161218237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc030d50 con 0x7f9ed40b1de0 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 -- 172.21.15.37:0/3161218237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed40b1de0 msgr2=0x7f9ed40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 --2- 172.21.15.37:0/3161218237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed40b1de0 0x7f9ed40b2270 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406f690 tx=0x7f9ecc02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 -- 172.21.15.37:0/3161218237 shutdown_connections 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 --2- 172.21.15.37:0/3161218237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed40b1de0 0x7f9ed40b2270 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 --2- 172.21.15.37:0/3161218237 >> v2:172.21.15.188:3300/0 conn(0x7f9ed4144b30 0x7f9ed415f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 -- 172.21.15.37:0/3161218237 >> 172.21.15.37:0/3161218237 conn(0x7f9ed40cb830 msgr2=0x7f9ed40cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 -- 172.21.15.37:0/3161218237 shutdown_connections 2023-11-24T06:15:04.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.484+0000 7f9ed359e640 1 -- 172.21.15.37:0/3161218237 wait complete. 2023-11-24T06:15:04.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.486+0000 7f9ed359e640 1 Processor -- start 2023-11-24T06:15:04.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.486+0000 7f9ed359e640 1 -- start start 2023-11-24T06:15:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40b1de0 0x7f9ed4130280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed4144b30 0x7f9ed413f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed415c410 0x7f9ed413f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4131610 con 0x7f9ed415c410 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed413f030 con 0x7f9ed40b1de0 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4133b70 con 0x7f9ed4144b30 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed415c410 0x7f9ed413f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed415c410 0x7f9ed413f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34026/0 (socket says 172.21.15.37:34026) 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.487+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/4264879484 learned_addr learned my addr 172.21.15.37:0/4264879484 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed259c640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40b1de0 0x7f9ed4130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed1d9b640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed4144b30 0x7f9ed413f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed4144b30 msgr2=0x7f9ed413f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed2d9d640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed4144b30 0x7f9ed413f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40b1de0 msgr2=0x7f9ed4130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed2d9d640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40b1de0 0x7f9ed4130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed2d9d640 1 -- 172.21.15.37:0/4264879484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0094d0 con 0x7f9ed415c410 2023-11-24T06:15:04.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed259c640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40b1de0 0x7f9ed4130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:04.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed2d9d640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed415c410 0x7f9ed413f7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc02b9e0 tx=0x7f9ecc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ecaffd640 1 -- 172.21.15.37:0/4264879484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc039d50 con 0x7f9ed415c410 2023-11-24T06:15:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ecaffd640 1 -- 172.21.15.37:0/4264879484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc043400 con 0x7f9ed415c410 2023-11-24T06:15:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed4130c70 con 0x7f9ed415c410 2023-11-24T06:15:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.488+0000 7f9ecaffd640 1 -- 172.21.15.37:0/4264879484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0437b0 con 0x7f9ed415c410 2023-11-24T06:15:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.489+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed4131230 con 0x7f9ed415c410 2023-11-24T06:15:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.490+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed4131750 con 0x7f9ed415c410 2023-11-24T06:15:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.491+0000 7f9ecaffd640 1 -- 172.21.15.37:0/4264879484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ecc043910 con 0x7f9ed415c410 2023-11-24T06:15:04.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.492+0000 7f9ecaffd640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb406ae40 0x7f9eb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.492+0000 7f9ecaffd640 1 -- 172.21.15.37:0/4264879484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ecc03e070 con 0x7f9ed415c410 2023-11-24T06:15:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.492+0000 7f9ed259c640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb406ae40 0x7f9eb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.493+0000 7f9ed259c640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb406ae40 0x7f9eb406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40a9800 tx=0x7f9ec400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.496+0000 7f9ecaffd640 1 -- 172.21.15.37:0/4264879484 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ed4131750 con 0x7f9ed415c410 2023-11-24T06:15:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.693+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ed4131750 con 0x7f9ed415c410 2023-11-24T06:15:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.695+0000 7f9ecaffd640 1 -- 172.21.15.37:0/4264879484 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f9ed4131750 con 0x7f9ed415c410 2023-11-24T06:15:04.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:04.698 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb406ae40 msgr2=0x7f9eb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb406ae40 0x7f9eb406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40a9800 tx=0x7f9ec400b040 comp rx=0 tx=0).stop 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed415c410 msgr2=0x7f9ed413f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed415c410 0x7f9ed413f7f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc02b9e0 tx=0x7f9ecc004730 comp rx=0 tx=0).stop 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 shutdown_connections 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb406ae40 0x7f9eb406d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed415c410 0x7f9ed413f7f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed4144b30 0x7f9ed413f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 --2- 172.21.15.37:0/4264879484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40b1de0 0x7f9ed4130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 >> 172.21.15.37:0/4264879484 conn(0x7f9ed40cb830 msgr2=0x7f9ed415ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 shutdown_connections 2023-11-24T06:15:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.698+0000 7f9ed359e640 1 -- 172.21.15.37:0/4264879484 wait complete. 2023-11-24T06:15:04.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:04.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.949+0000 7f06ce00e640 1 Processor -- start 2023-11-24T06:15:04.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.949+0000 7f06ce00e640 1 -- start start 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.950+0000 7f06ce00e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c815b440 0x7f06c80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.950+0000 7f06ce00e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06c80c59b0 0x7f06c806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06ce00e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80cc3a0 con 0x7f06c80cbf20 2023-11-24T06:15:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06ce00e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c815b820 con 0x7f06c80c59b0 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06ce00e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c815eea0 con 0x7f06c815b440 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06c80c59b0 0x7f06c806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c6ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06c80cbf20 0x7f06c80c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57230/0 (socket says 172.21.15.37:57230) 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06c80c59b0 0x7f06c806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34032/0 (socket says 172.21.15.37:34032) 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c6ffd640 1 -- 172.21.15.37:0/4252451844 learned_addr learned my addr 172.21.15.37:0/4252451844 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c77fe640 1 --2- 172.21.15.37:0/4252451844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c815b440 0x7f06c80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c7fff640 1 -- 172.21.15.37:0/4252451844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c815b440 msgr2=0x7f06c80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c7fff640 1 --2- 172.21.15.37:0/4252451844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c815b440 0x7f06c80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c7fff640 1 -- 172.21.15.37:0/4252451844 >> v1:172.21.15.37:6789/0 conn(0x7f06c80cbf20 legacy=0x7f06c80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.951+0000 7f06c7fff640 1 -- 172.21.15.37:0/4252451844 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80abf30 con 0x7f06c80c59b0 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.953+0000 7f06c7fff640 1 --2- 172.21.15.37:0/4252451844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c806c5f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06c00097a0 tx=0x7f06c002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9df521b8195a0e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.953+0000 7f06c67fc640 1 -- 172.21.15.37:0/4252451844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0031780 con 0x7f06c80c59b0 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.953+0000 7f06c67fc640 1 -- 172.21.15.37:0/4252451844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c00318e0 con 0x7f06c80c59b0 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.953+0000 7f06c67fc640 1 -- 172.21.15.37:0/4252451844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0031c70 con 0x7f06c80c59b0 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 -- 172.21.15.37:0/4252451844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 msgr2=0x7f06c806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4252451844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c806c5f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06c00097a0 tx=0x7f06c002b820 comp rx=0 tx=0).stop 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 -- 172.21.15.37:0/4252451844 shutdown_connections 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4252451844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c806c5f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4252451844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c815b440 0x7f06c80cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 -- 172.21.15.37:0/4252451844 >> 172.21.15.37:0/4252451844 conn(0x7f06c80b0c50 msgr2=0x7f06c80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 -- 172.21.15.37:0/4252451844 shutdown_connections 2023-11-24T06:15:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.954+0000 7f06ce00e640 1 -- 172.21.15.37:0/4252451844 wait complete. 2023-11-24T06:15:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.956+0000 7f06ce00e640 1 Processor -- start 2023-11-24T06:15:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.957+0000 7f06ce00e640 1 -- start start 2023-11-24T06:15:04.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06ce00e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c81554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06ce00e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c80cbf20 0x7f06c8159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06ce00e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06c815b440 0x7f06c80adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06ce00e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81f72b0 con 0x7f06c80c59b0 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06ce00e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81f66a0 con 0x7f06c815b440 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06ce00e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81f6980 con 0x7f06c80cbf20 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c81554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c81554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34034/0 (socket says 172.21.15.37:34034) 2023-11-24T06:15:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.958+0000 7f06c77fe640 1 -- 172.21.15.37:0/4067391791 learned_addr learned my addr 172.21.15.37:0/4067391791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c7fff640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06c815b440 0x7f06c80adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c6ffd640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c80cbf20 0x7f06c8159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c77fe640 1 -- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c80cbf20 msgr2=0x7f06c8159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c77fe640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c80cbf20 0x7f06c8159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c77fe640 1 -- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06c815b440 msgr2=0x7f06c80adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c77fe640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06c815b440 0x7f06c80adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c77fe640 1 -- 172.21.15.37:0/4067391791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009400 con 0x7f06c80c59b0 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c7fff640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06c815b440 0x7f06c80adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c6ffd640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c80cbf20 0x7f06c8159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06c77fe640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c81554b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06b8007e40 tx=0x7f06b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06bffff640 1 -- 172.21.15.37:0/4067391791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8014620 con 0x7f06c80c59b0 2023-11-24T06:15:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06bffff640 1 -- 172.21.15.37:0/4067391791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b800ee90 con 0x7f06c80c59b0 2023-11-24T06:15:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.959+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c81f6c60 con 0x7f06c80c59b0 2023-11-24T06:15:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.960+0000 7f06bffff640 1 -- 172.21.15.37:0/4067391791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80149c0 con 0x7f06c80c59b0 2023-11-24T06:15:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.960+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c815a230 con 0x7f06c80c59b0 2023-11-24T06:15:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.961+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c804e8b0 con 0x7f06c80c59b0 2023-11-24T06:15:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.962+0000 7f06bffff640 1 -- 172.21.15.37:0/4067391791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06b8014b20 con 0x7f06c80c59b0 2023-11-24T06:15:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.963+0000 7f06bffff640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06a806ae70 0x7f06a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.963+0000 7f06bffff640 1 -- 172.21.15.37:0/4067391791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06b8089fe0 con 0x7f06c80c59b0 2023-11-24T06:15:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.963+0000 7f06c6ffd640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06a806ae70 0x7f06a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.964+0000 7f06c6ffd640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06a806ae70 0x7f06a806d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06c80cccd0 tx=0x7f06b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:04.967+0000 7f06bffff640 1 -- 172.21.15.37:0/4067391791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06b8054ff0 con 0x7f06c80c59b0 2023-11-24T06:15:05.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.162+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06c806dc80 con 0x7f06c80c59b0 2023-11-24T06:15:05.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.162+0000 7f06bffff640 1 -- 172.21.15.37:0/4067391791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06b8058610 con 0x7f06c80c59b0 2023-11-24T06:15:05.165 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.165+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06a806ae70 msgr2=0x7f06a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.165+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06a806ae70 0x7f06a806d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06c80cccd0 tx=0x7f06b0009040 comp rx=0 tx=0).stop 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.165+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 msgr2=0x7f06c81554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.165+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c81554b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06b8007e40 tx=0x7f06b800e4b0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 shutdown_connections 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06a806ae70 0x7f06a806d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06c815b440 0x7f06c80adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06c80cbf20 0x7f06c8159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 --2- 172.21.15.37:0/4067391791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06c80c59b0 0x7f06c81554b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 >> 172.21.15.37:0/4067391791 conn(0x7f06c80b0c50 msgr2=0x7f06c80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 shutdown_connections 2023-11-24T06:15:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.166+0000 7f06ce00e640 1 -- 172.21.15.37:0/4067391791 wait complete. 2023-11-24T06:15:05.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.414+0000 7f7ac26f1640 1 Processor -- start 2023-11-24T06:15:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.415+0000 7f7ac26f1640 1 -- start start 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac26f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7abc15d3f0 0x7f7abc0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac26f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7abc15d7d0 0x7f7abc0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac26f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac26f1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0d15e0 con 0x7f7abc15d3f0 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac26f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0d0280 con 0x7f7abc15d7d0 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac26f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0d1300 con 0x7f7abc0d0e40 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac16ef640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7abc15d3f0 0x7f7abc0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac16ef640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7abc15d3f0 0x7f7abc0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34036/0 (socket says 172.21.15.37:34036) 2023-11-24T06:15:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.416+0000 7f7ac16ef640 1 -- 172.21.15.37:0/472533851 learned_addr learned my addr 172.21.15.37:0/472533851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac0eee640 1 --2- 172.21.15.37:0/472533851 >> v2:172.21.15.188:3300/0 conn(0x7f7abc15d7d0 0x7f7abc0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac1ef0640 1 --2- 172.21.15.37:0/472533851 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac16ef640 1 -- 172.21.15.37:0/472533851 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 msgr2=0x7f7abc0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac16ef640 1 --2- 172.21.15.37:0/472533851 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac16ef640 1 -- 172.21.15.37:0/472533851 >> v2:172.21.15.188:3300/0 conn(0x7f7abc15d7d0 msgr2=0x7f7abc0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac16ef640 1 --2- 172.21.15.37:0/472533851 >> v2:172.21.15.188:3300/0 conn(0x7f7abc15d7d0 0x7f7abc0d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac16ef640 1 -- 172.21.15.37:0/472533851 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0cfc30 con 0x7f7abc15d3f0 2023-11-24T06:15:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.417+0000 7f7ac1ef0640 1 --2- 172.21.15.37:0/472533851 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.418+0000 7f7ac16ef640 1 --2- 172.21.15.37:0/472533851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0d1830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7abc067bd0 tx=0x7f7aac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a11002c1c34267 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.418+0000 7f7abbfff640 1 -- 172.21.15.37:0/472533851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac02ca70 con 0x7f7abc15d3f0 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.418+0000 7f7abbfff640 1 -- 172.21.15.37:0/472533851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac02cbd0 con 0x7f7abc15d3f0 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.418+0000 7f7abbfff640 1 -- 172.21.15.37:0/472533851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0343f0 con 0x7f7abc15d3f0 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 -- 172.21.15.37:0/472533851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d3f0 msgr2=0x7f7abc0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/472533851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0d1830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7abc067bd0 tx=0x7f7aac02bed0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 -- 172.21.15.37:0/472533851 shutdown_connections 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/472533851 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/472533851 >> v2:172.21.15.188:3300/0 conn(0x7f7abc15d7d0 0x7f7abc0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/472533851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0d1830 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 -- 172.21.15.37:0/472533851 >> 172.21.15.37:0/472533851 conn(0x7f7abc09c5b0 msgr2=0x7f7abc0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 -- 172.21.15.37:0/472533851 shutdown_connections 2023-11-24T06:15:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.419+0000 7f7ac26f1640 1 -- 172.21.15.37:0/472533851 wait complete. 2023-11-24T06:15:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.421+0000 7f7ac26f1640 1 Processor -- start 2023-11-24T06:15:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.421+0000 7f7ac26f1640 1 -- start start 2023-11-24T06:15:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac26f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac26f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac26f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d7d0 0x7f7abc0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac26f1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b61e0 con 0x7f7abc15d7d0 2023-11-24T06:15:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac26f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b5e90 con 0x7f7abc15d3f0 2023-11-24T06:15:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac26f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0caea0 con 0x7f7abc0d0e40 2023-11-24T06:15:05.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac1ef0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d7d0 0x7f7abc0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac1ef0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d7d0 0x7f7abc0ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34042/0 (socket says 172.21.15.37:34042) 2023-11-24T06:15:05.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.422+0000 7f7ac1ef0640 1 -- 172.21.15.37:0/2479141708 learned_addr learned my addr 172.21.15.37:0/2479141708 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac16ef640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac0eee640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac1ef0640 1 -- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 msgr2=0x7f7abc0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac1ef0640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac1ef0640 1 -- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7abc15d3f0 msgr2=0x7f7abc0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac1ef0640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac1ef0640 1 -- 172.21.15.37:0/2479141708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac009b30 con 0x7f7abc15d7d0 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac0eee640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ac1ef0640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d7d0 0x7f7abc0ca960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c820 tx=0x7f7ab400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.423+0000 7f7ab9ffb640 1 -- 172.21.15.37:0/2479141708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4004220 con 0x7f7abc15d7d0 2023-11-24T06:15:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.424+0000 7f7ab9ffb640 1 -- 172.21.15.37:0/2479141708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab40043a0 con 0x7f7abc15d7d0 2023-11-24T06:15:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.424+0000 7f7ab9ffb640 1 -- 172.21.15.37:0/2479141708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4007a70 con 0x7f7abc15d7d0 2023-11-24T06:15:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.424+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc0cb150 con 0x7f7abc15d7d0 2023-11-24T06:15:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.424+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc0cb710 con 0x7f7abc15d7d0 2023-11-24T06:15:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.425+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc0d06f0 con 0x7f7abc15d7d0 2023-11-24T06:15:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.426+0000 7f7ab9ffb640 1 -- 172.21.15.37:0/2479141708 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ab4007bd0 con 0x7f7abc15d7d0 2023-11-24T06:15:05.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.427+0000 7f7ab9ffb640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7aa806ae40 0x7f7aa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.427+0000 7f7ab9ffb640 1 -- 172.21.15.37:0/2479141708 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ab4089370 con 0x7f7abc15d7d0 2023-11-24T06:15:05.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.427+0000 7f7ac16ef640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7aa806ae40 0x7f7aa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.428+0000 7f7ac16ef640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7aa806ae40 0x7f7aa806d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7aac035000 tx=0x7f7aac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.431+0000 7f7ab9ffb640 1 -- 172.21.15.37:0/2479141708 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7abc0d06f0 con 0x7f7abc15d7d0 2023-11-24T06:15:05.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.624+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7abc0b6320 con 0x7f7abc15d7d0 2023-11-24T06:15:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.625+0000 7f7ab9ffb640 1 -- 172.21.15.37:0/2479141708 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7abc0b6320 con 0x7f7abc15d7d0 2023-11-24T06:15:05.628 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7aa806ae40 msgr2=0x7f7aa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7aa806ae40 0x7f7aa806d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7aac035000 tx=0x7f7aac030000 comp rx=0 tx=0).stop 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d7d0 msgr2=0x7f7abc0ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d7d0 0x7f7abc0ca960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c820 tx=0x7f7ab400cce0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 shutdown_connections 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7aa806ae40 0x7f7aa806d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7abc15d3f0 0x7f7abc0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7abc15d7d0 0x7f7abc0ca960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 --2- 172.21.15.37:0/2479141708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7abc0d0e40 0x7f7abc0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 >> 172.21.15.37:0/2479141708 conn(0x7f7abc09c5b0 msgr2=0x7f7abc06c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 shutdown_connections 2023-11-24T06:15:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.628+0000 7f7ac26f1640 1 -- 172.21.15.37:0/2479141708 wait complete. 2023-11-24T06:15:05.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:05.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.877+0000 7f808ae72640 1 Processor -- start 2023-11-24T06:15:05.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.877+0000 7f808ae72640 1 -- start start 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f808ae72640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f808406e160 0x7f80840ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f808ae72640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80840cd510 con 0x7f8084146eb0 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f808ae72640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8084161a10 con 0x7f80840cd110 2023-11-24T06:15:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f808ae72640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8084161cf0 con 0x7f808406e160 2023-11-24T06:15:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f8088c0e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8084146eb0 0x7f8084161150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57240/0 (socket says 172.21.15.37:57240) 2023-11-24T06:15:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f8088c0e640 1 -- 172.21.15.37:0/1935760356 learned_addr learned my addr 172.21.15.37:0/1935760356 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f8083fff640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f808406e160 0x7f80840ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.879+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701078939 0 0) 0x7f80840cd510 con 0x7f8084146eb0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f806c003520 con 0x7f8084146eb0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1330546533 0 0) 0x7f806c003520 con 0x7f8084146eb0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f808406e160 msgr2=0x7f80840ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f808406e160 0x7f80840ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 >> v1:172.21.15.188:6789/0 conn(0x7f80840cd110 legacy=0x7f8084070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8084161fd0 con 0x7f8084146eb0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f80740019f0 con 0x7f8084146eb0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 >> v1:172.21.15.37:6789/0 conn(0x7f8084146eb0 legacy=0x7f8084161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f806c0039a0 0x7f806c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f806c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f808406e160 0x7f806c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8084161cf0 con 0x7f806c0047c0 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c00ba60 con 0x7f806c0039a0 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c00bc20 con 0x7f808406e160 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.880+0000 7f8083fff640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f806c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.881+0000 7f8088c0e640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f806c0039a0 0x7f806c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.881+0000 7f8083fff640 1 -- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f808406e160 msgr2=0x7f806c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.881+0000 7f8083fff640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f808406e160 0x7f806c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.881+0000 7f8083fff640 1 -- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f806c0039a0 msgr2=0x7f806c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.881+0000 7f8083fff640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f806c0039a0 0x7f806c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.881+0000 7f8083fff640 1 -- 172.21.15.37:0/1935760356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c003520 con 0x7f806c0047c0 2023-11-24T06:15:05.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.882+0000 7f8083fff640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f806c004c40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8078009a90 tx=0x7f806c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5446432651481c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.882+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807802c6b0 con 0x7f806c0047c0 2023-11-24T06:15:05.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.882+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807802c810 con 0x7f806c0047c0 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.882+0000 7f80837fe640 1 -- 172.21.15.37:0/1935760356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807802cba0 con 0x7f806c0047c0 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.883+0000 7f808ae72640 1 -- 172.21.15.37:0/1935760356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 msgr2=0x7f806c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.883+0000 7f808ae72640 1 --2- 172.21.15.37:0/1935760356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f806c004c40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8078009a90 tx=0x7f806c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.883+0000 7f808940f640 1 -- 172.21.15.37:0/1935760356 reap_dead start 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.883+0000 7f808ae72640 1 -- 172.21.15.37:0/1935760356 shutdown_connections 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.883+0000 7f808ae72640 1 -- 172.21.15.37:0/1935760356 >> 172.21.15.37:0/1935760356 conn(0x7f80840b0c50 msgr2=0x7f80840b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.883+0000 7f808ae72640 1 -- 172.21.15.37:0/1935760356 shutdown_connections 2023-11-24T06:15:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.883+0000 7f808ae72640 1 -- 172.21.15.37:0/1935760356 wait complete. 2023-11-24T06:15:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.885+0000 7f808ae72640 1 Processor -- start 2023-11-24T06:15:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.885+0000 7f808ae72640 1 -- start start 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f808ae72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f808415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f808ae72640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80840b4680 0x7f808415f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f808ae72640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80840b4b00 0x7f808415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f808ae72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808415f1c0 con 0x7f806c0047c0 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f808ae72640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808415e680 con 0x7f80840b4680 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f808ae72640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808415e920 con 0x7f80840b4b00 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f8088c0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f808415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f8088c0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f808415cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34054/0 (socket says 172.21.15.37:34054) 2023-11-24T06:15:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.886+0000 7f8088c0e640 1 -- 172.21.15.37:0/4148292023 learned_addr learned my addr 172.21.15.37:0/4148292023 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8083fff640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80840b4680 0x7f808415f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8088c0e640 1 -- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80840b4b00 msgr2=0x7f808415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f808940f640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80840b4b00 0x7f808415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8088c0e640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80840b4b00 0x7f808415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8088c0e640 1 -- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80840b4680 msgr2=0x7f808415f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8088c0e640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80840b4680 0x7f808415f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8088c0e640 1 -- 172.21.15.37:0/4148292023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808415ec00 con 0x7f806c0047c0 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8083fff640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80840b4680 0x7f808415f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f808940f640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80840b4b00 0x7f808415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f8088c0e640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f808415cdc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8074005fd0 tx=0x7f807400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f80817fa640 1 -- 172.21.15.37:0/4148292023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400edf0 con 0x7f806c0047c0 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f80817fa640 1 -- 172.21.15.37:0/4148292023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8074013420 con 0x7f806c0047c0 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808415eee0 con 0x7f806c0047c0 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.887+0000 7f80817fa640 1 -- 172.21.15.37:0/4148292023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740137d0 con 0x7f806c0047c0 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.888+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8084143f10 con 0x7f806c0047c0 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.889+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808404e8b0 con 0x7f806c0047c0 2023-11-24T06:15:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.890+0000 7f80817fa640 1 -- 172.21.15.37:0/4148292023 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8074013930 con 0x7f806c0047c0 2023-11-24T06:15:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.890+0000 7f80817fa640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f807006ae90 0x7f807006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.891+0000 7f80817fa640 1 -- 172.21.15.37:0/4148292023 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8074089d30 con 0x7f806c0047c0 2023-11-24T06:15:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.891+0000 7f8083fff640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f807006ae90 0x7f807006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.891+0000 7f8083fff640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f807006ae90 0x7f807006d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8078036000 tx=0x7f8078030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:05.895+0000 7f80817fa640 1 -- 172.21.15.37:0/4148292023 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8074054f50 con 0x7f806c0047c0 2023-11-24T06:15:06.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.094+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f808406ded0 con 0x7f806c0047c0 2023-11-24T06:15:06.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.095+0000 7f80817fa640 1 -- 172.21.15.37:0/4148292023 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80740018e0 con 0x7f806c0047c0 2023-11-24T06:15:06.098 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f807006ae90 msgr2=0x7f807006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f807006ae90 0x7f807006d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8078036000 tx=0x7f8078030000 comp rx=0 tx=0).stop 2023-11-24T06:15:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 msgr2=0x7f808415cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f808415cdc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8074005fd0 tx=0x7f807400e530 comp rx=0 tx=0).stop 2023-11-24T06:15:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 shutdown_connections 2023-11-24T06:15:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f807006ae90 0x7f807006d350 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80840b4680 0x7f808415f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80840b4b00 0x7f808415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 --2- 172.21.15.37:0/4148292023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c0047c0 0x7f808415cdc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 >> 172.21.15.37:0/4148292023 conn(0x7f80840b0c50 msgr2=0x7f8084146030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 shutdown_connections 2023-11-24T06:15:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.098+0000 7f808ae72640 1 -- 172.21.15.37:0/4148292023 wait complete. 2023-11-24T06:15:06.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.342+0000 7fa4d19ac640 1 Processor -- start 2023-11-24T06:15:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.342+0000 7fa4d19ac640 1 -- start start 2023-11-24T06:15:06.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.344+0000 7fa4d19ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 0x7fa4cc168080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.344+0000 7fa4d19ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc0ce990 con 0x7fa4cc0d1e20 2023-11-24T06:15:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.344+0000 7fa4d19ac640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc0cec70 con 0x7fa4cc15d4e0 2023-11-24T06:15:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.344+0000 7fa4d19ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0d4110 con 0x7fa4cc0d0240 2023-11-24T06:15:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.344+0000 7fa4cbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa4cc0d1e20 0x7fa4cc0cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57246/0 (socket says 172.21.15.37:57246) 2023-11-24T06:15:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.344+0000 7fa4cbfff640 1 -- 172.21.15.37:0/683094079 learned_addr learned my addr 172.21.15.37:0/683094079 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4d11ab640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 0x7fa4cc168080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354515619 0 0) 0x7fa4cc0ce990 con 0x7fa4cc0d1e20 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc003520 con 0x7fa4cc0d1e20 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3009135565 0 0) 0x7fa4bc003520 con 0x7fa4cc0d1e20 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 msgr2=0x7fa4cc168080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 0x7fa4cc168080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 >> v1:172.21.15.188:6789/0 conn(0x7fa4cc15d4e0 legacy=0x7fa4cc0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0cef50 con 0x7fa4cc0d1e20 2023-11-24T06:15:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fa4b8001670 con 0x7fa4cc0d1e20 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 >> v1:172.21.15.37:6789/0 conn(0x7fa4cc0d1e20 legacy=0x7fa4cc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc0039a0 0x7fa4bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 0x7fa4bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4bc004d00 0x7fa4bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0d4110 con 0x7fa4bc004d00 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc00ba60 con 0x7fa4bc0039a0 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.345+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc00bc20 con 0x7fa4cc0d0240 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4d11ab640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4bc004d00 0x7fa4bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4cbfff640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 0x7fa4bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4d09aa640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc0039a0 0x7fa4bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4d11ab640 1 -- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 msgr2=0x7fa4bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4d11ab640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0d0240 0x7fa4bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4d11ab640 1 -- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc0039a0 msgr2=0x7fa4bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4d11ab640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc0039a0 0x7fa4bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.346+0000 7fa4d11ab640 1 -- 172.21.15.37:0/683094079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc003520 con 0x7fa4bc004d00 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.347+0000 7fa4d11ab640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4bc004d00 0x7fa4bc005180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009f90 tx=0x7fa4bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63201360113167ac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c402cbd0 con 0x7fa4bc004d00 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c400f040 con 0x7fa4bc004d00 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4cb7fe640 1 -- 172.21.15.37:0/683094079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4034440 con 0x7fa4bc004d00 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4d19ac640 1 -- 172.21.15.37:0/683094079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4bc004d00 msgr2=0x7fa4bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4d19ac640 1 --2- 172.21.15.37:0/683094079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4bc004d00 0x7fa4bc005180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009f90 tx=0x7fa4bc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4d11ab640 1 -- 172.21.15.37:0/683094079 reap_dead start 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4d19ac640 1 -- 172.21.15.37:0/683094079 shutdown_connections 2023-11-24T06:15:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4d19ac640 1 -- 172.21.15.37:0/683094079 >> 172.21.15.37:0/683094079 conn(0x7fa4cc09c510 msgr2=0x7fa4cc0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4d19ac640 1 -- 172.21.15.37:0/683094079 shutdown_connections 2023-11-24T06:15:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.348+0000 7fa4d19ac640 1 -- 172.21.15.37:0/683094079 wait complete. 2023-11-24T06:15:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.350+0000 7fa4d19ac640 1 Processor -- start 2023-11-24T06:15:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.350+0000 7fa4d19ac640 1 -- start start 2023-11-24T06:15:06.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.351+0000 7fa4d19ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc004d00 0x7fa4cc160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.351+0000 7fa4d19ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc152890 0x7fa4cc1495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.351+0000 7fa4d19ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0cb9d0 0x7fa4cc0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.351+0000 7fa4d19ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc1608a0 con 0x7fa4cc152890 2023-11-24T06:15:06.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.351+0000 7fa4d19ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc160ad0 con 0x7fa4bc004d00 2023-11-24T06:15:06.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.351+0000 7fa4d19ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc153010 con 0x7fa4cc0cb9d0 2023-11-24T06:15:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc152890 0x7fa4cc1495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc152890 0x7fa4cc1495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34072/0 (socket says 172.21.15.37:34072) 2023-11-24T06:15:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 -- 172.21.15.37:0/2402352491 learned_addr learned my addr 172.21.15.37:0/2402352491 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4d09aa640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc004d00 0x7fa4cc160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 -- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0cb9d0 msgr2=0x7fa4cc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4d11ab640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0cb9d0 0x7fa4cc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0cb9d0 0x7fa4cc0cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 -- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc004d00 msgr2=0x7fa4cc160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc004d00 0x7fa4cc160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 -- 172.21.15.37:0/2402352491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc0cc730 con 0x7fa4cc152890 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4d09aa640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc004d00 0x7fa4cc160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.352+0000 7fa4cbfff640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc152890 0x7fa4cc1495d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800e760 tx=0x7fa4b800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.353+0000 7fa4c97fa640 1 -- 172.21.15.37:0/2402352491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800ee70 con 0x7fa4cc152890 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.353+0000 7fa4c97fa640 1 -- 172.21.15.37:0/2402352491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b800c8d0 con 0x7fa4cc152890 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.353+0000 7fa4c97fa640 1 -- 172.21.15.37:0/2402352491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800cc80 con 0x7fa4cc152890 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.353+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc0cca10 con 0x7fa4cc152890 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.353+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc0ccfd0 con 0x7fa4cc152890 2023-11-24T06:15:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.354+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc04e840 con 0x7fa4cc152890 2023-11-24T06:15:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.355+0000 7fa4c97fa640 1 -- 172.21.15.37:0/2402352491 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4b801d460 con 0x7fa4cc152890 2023-11-24T06:15:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.356+0000 7fa4c97fa640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4b006ae40 0x7fa4b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.356+0000 7fa4c97fa640 1 -- 172.21.15.37:0/2402352491 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4b80896f0 con 0x7fa4cc152890 2023-11-24T06:15:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.356+0000 7fa4d09aa640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4b006ae40 0x7fa4b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.357+0000 7fa4d09aa640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4b006ae40 0x7fa4b006d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0001630 tx=0x7fa4c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.360+0000 7fa4c97fa640 1 -- 172.21.15.37:0/2402352491 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4b8058100 con 0x7fa4cc152890 2023-11-24T06:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.595+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4cc09ca30 con 0x7fa4cc152890 2023-11-24T06:15:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.597+0000 7fa4c97fa640 1 -- 172.21.15.37:0/2402352491 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fa4b8001540 con 0x7fa4cc152890 2023-11-24T06:15:06.599 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:06.600 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:15:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.599+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4b006ae40 msgr2=0x7fa4b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.599+0000 7fa4d19ac640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4b006ae40 0x7fa4b006d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0001630 tx=0x7fa4c0009040 comp rx=0 tx=0).stop 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.599+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc152890 msgr2=0x7fa4cc1495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.599+0000 7fa4d19ac640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc152890 0x7fa4cc1495d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800e760 tx=0x7fa4b800ec20 comp rx=0 tx=0).stop 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 shutdown_connections 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa4b006ae40 0x7fa4b006d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4cc0cb9d0 0x7fa4cc0cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc152890 0x7fa4cc1495d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 --2- 172.21.15.37:0/2402352491 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4bc004d00 0x7fa4cc160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 >> 172.21.15.37:0/2402352491 conn(0x7fa4cc09c510 msgr2=0x7fa4cc06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 shutdown_connections 2023-11-24T06:15:06.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.600+0000 7fa4d19ac640 1 -- 172.21.15.37:0/2402352491 wait complete. 2023-11-24T06:15:06.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.850+0000 7fa398e02640 1 Processor -- start 2023-11-24T06:15:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.850+0000 7fa398e02640 1 -- start start 2023-11-24T06:15:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa398e02640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa39413ea10 0x7fa39415b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa398e02640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3940cb870 0x7fa3940cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa398e02640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39413e780 con 0x7fa3940709b0 2023-11-24T06:15:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa398e02640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3940cc200 con 0x7fa39413ea10 2023-11-24T06:15:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa398e02640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940cd880 con 0x7fa3940cb870 2023-11-24T06:15:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa39259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa3940709b0 0x7fa39415f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57250/0 (socket says 172.21.15.37:57250) 2023-11-24T06:15:06.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa39259c640 1 -- 172.21.15.37:0/1962110192 learned_addr learned my addr 172.21.15.37:0/1962110192 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:06.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa391d9b640 1 --2- 172.21.15.37:0/1962110192 >> v2:172.21.15.37:3300/0 conn(0x7fa39413ea10 0x7fa39415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa39159a640 1 -- 172.21.15.37:0/1962110192 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831456235 0 0) 0x7fa39413e780 con 0x7fa3940709b0 2023-11-24T06:15:06.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa39159a640 1 -- 172.21.15.37:0/1962110192 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa380003520 con 0x7fa3940709b0 2023-11-24T06:15:06.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa392d9d640 1 --2- 172.21.15.37:0/1962110192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3940cb870 0x7fa3940cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.852+0000 7fa391d9b640 1 -- 172.21.15.37:0/1962110192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3940cb870 msgr2=0x7fa3940cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.853+0000 7fa391d9b640 1 --2- 172.21.15.37:0/1962110192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3940cb870 0x7fa3940cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.853+0000 7fa391d9b640 1 -- 172.21.15.37:0/1962110192 >> v1:172.21.15.37:6789/0 conn(0x7fa3940709b0 legacy=0x7fa39415f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.853+0000 7fa391d9b640 1 -- 172.21.15.37:0/1962110192 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39415bf10 con 0x7fa39413ea10 2023-11-24T06:15:06.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.853+0000 7fa392d9d640 1 --2- 172.21.15.37:0/1962110192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3940cb870 0x7fa3940cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:06.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.854+0000 7fa391d9b640 1 --2- 172.21.15.37:0/1962110192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa39413ea10 0x7fa39415b860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0097a0 tx=0x7fa37c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8523f92de526a58 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.854+0000 7fa39159a640 1 -- 172.21.15.37:0/1962110192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c02e070 con 0x7fa39413ea10 2023-11-24T06:15:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.854+0000 7fa39159a640 1 -- 172.21.15.37:0/1962110192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c0315a0 con 0x7fa39413ea10 2023-11-24T06:15:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.854+0000 7fa39159a640 1 -- 172.21.15.37:0/1962110192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c031930 con 0x7fa39413ea10 2023-11-24T06:15:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.854+0000 7fa398e02640 1 -- 172.21.15.37:0/1962110192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa39413ea10 msgr2=0x7fa39415b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.854+0000 7fa398e02640 1 --2- 172.21.15.37:0/1962110192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa39413ea10 0x7fa39415b860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0097a0 tx=0x7fa37c02b840 comp rx=0 tx=0).stop 2023-11-24T06:15:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.855+0000 7fa398e02640 1 -- 172.21.15.37:0/1962110192 shutdown_connections 2023-11-24T06:15:06.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.855+0000 7fa398e02640 1 --2- 172.21.15.37:0/1962110192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa3940cb870 0x7fa3940cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.855+0000 7fa398e02640 1 --2- 172.21.15.37:0/1962110192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa39413ea10 0x7fa39415b860 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.855+0000 7fa398e02640 1 -- 172.21.15.37:0/1962110192 >> 172.21.15.37:0/1962110192 conn(0x7fa3940b2eb0 msgr2=0x7fa3940b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.855+0000 7fa398e02640 1 -- 172.21.15.37:0/1962110192 shutdown_connections 2023-11-24T06:15:06.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.855+0000 7fa398e02640 1 -- 172.21.15.37:0/1962110192 wait complete. 2023-11-24T06:15:06.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.857+0000 7fa398e02640 1 Processor -- start 2023-11-24T06:15:06.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.857+0000 7fa398e02640 1 -- start start 2023-11-24T06:15:06.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa398e02640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3940709b0 0x7fa3941f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa398e02640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3940cb870 0x7fa394150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa398e02640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa39413ea10 0x7fa3941e4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa398e02640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941f1380 con 0x7fa3940709b0 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa398e02640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940b50f0 con 0x7fa3940cb870 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa398e02640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940b53d0 con 0x7fa39413ea10 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa39259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3940709b0 0x7fa3941f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa39259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3940709b0 0x7fa3941f0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34086/0 (socket says 172.21.15.37:34086) 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.858+0000 7fa39259c640 1 -- 172.21.15.37:0/522044300 learned_addr learned my addr 172.21.15.37:0/522044300 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa39259c640 1 -- 172.21.15.37:0/522044300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa39413ea10 msgr2=0x7fa3941e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa39259c640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa39413ea10 0x7fa3941e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa39259c640 1 -- 172.21.15.37:0/522044300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3940cb870 msgr2=0x7fa394150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa39259c640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3940cb870 0x7fa394150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa39259c640 1 -- 172.21.15.37:0/522044300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c009400 con 0x7fa3940709b0 2023-11-24T06:15:06.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa39259c640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3940709b0 0x7fa3941f0e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa38400caa0 tx=0x7fa38400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa38affd640 1 -- 172.21.15.37:0/522044300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400ac00 con 0x7fa3940709b0 2023-11-24T06:15:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa38affd640 1 -- 172.21.15.37:0/522044300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38400ad60 con 0x7fa3940709b0 2023-11-24T06:15:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa38affd640 1 -- 172.21.15.37:0/522044300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384012620 con 0x7fa3940709b0 2023-11-24T06:15:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3940b56b0 con 0x7fa3940709b0 2023-11-24T06:15:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.859+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3940b5c70 con 0x7fa3940709b0 2023-11-24T06:15:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.860+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3940b5e60 con 0x7fa3940709b0 2023-11-24T06:15:06.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.861+0000 7fa38affd640 1 -- 172.21.15.37:0/522044300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa384007070 con 0x7fa3940709b0 2023-11-24T06:15:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.863+0000 7fa38affd640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa37406ae70 0x7fa37406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.863+0000 7fa38affd640 1 -- 172.21.15.37:0/522044300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3840895f0 con 0x7fa3940709b0 2023-11-24T06:15:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.863+0000 7fa391d9b640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa37406ae70 0x7fa37406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.864+0000 7fa391d9b640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa37406ae70 0x7fa37406d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa37c036000 tx=0x7fa37c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:06.867+0000 7fa38affd640 1 -- 172.21.15.37:0/522044300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa384054690 con 0x7fa3940709b0 2023-11-24T06:15:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.064+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa394067b80 con 0x7fa3940709b0 2023-11-24T06:15:07.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.066+0000 7fa38affd640 1 -- 172.21.15.37:0/522044300 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fa384017090 con 0x7fa3940709b0 2023-11-24T06:15:07.069 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:07.069 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.068+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa37406ae70 msgr2=0x7fa37406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.068+0000 7fa398e02640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa37406ae70 0x7fa37406d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa37c036000 tx=0x7fa37c030000 comp rx=0 tx=0).stop 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3940709b0 msgr2=0x7fa3941f0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3940709b0 0x7fa3941f0e40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa38400caa0 tx=0x7fa38400cf60 comp rx=0 tx=0).stop 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 shutdown_connections 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa37406ae70 0x7fa37406d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa3940cb870 0x7fa394150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa39413ea10 0x7fa3941e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 --2- 172.21.15.37:0/522044300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3940709b0 0x7fa3941f0e40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 >> 172.21.15.37:0/522044300 conn(0x7fa3940b2eb0 msgr2=0x7fa3940d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 shutdown_connections 2023-11-24T06:15:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.069+0000 7fa398e02640 1 -- 172.21.15.37:0/522044300 wait complete. 2023-11-24T06:15:07.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.309+0000 7fb01522e640 1 Processor -- start 2023-11-24T06:15:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.309+0000 7fb01522e640 1 -- start start 2023-11-24T06:15:07.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb01522e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01013d120 0x7fb01015af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb01522e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb01006d6c0 0x7fb01006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb01522e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb0100b0a70 0x7fb0100b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb01522e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01006e060 con 0x7fb01006d6c0 2023-11-24T06:15:07.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb01522e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01013f9e0 con 0x7fb0100b0a70 2023-11-24T06:15:07.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb01522e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01013fcc0 con 0x7fb01013d120 2023-11-24T06:15:07.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb00f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb01006d6c0 0x7fb01006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb00f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb01006d6c0 0x7fb01006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34102/0 (socket says 172.21.15.37:34102) 2023-11-24T06:15:07.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.311+0000 7fb00f7fe640 1 -- 172.21.15.37:0/1326442020 learned_addr learned my addr 172.21.15.37:0/1326442020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:07.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb00ffff640 1 --2- 172.21.15.37:0/1326442020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01013d120 0x7fb01015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb014a2d640 1 --2- 172.21.15.37:0/1326442020 >> v2:172.21.15.188:3300/0 conn(0x7fb0100b0a70 0x7fb0100b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb00f7fe640 1 -- 172.21.15.37:0/1326442020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01013d120 msgr2=0x7fb01015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb00f7fe640 1 --2- 172.21.15.37:0/1326442020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01013d120 0x7fb01015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb00f7fe640 1 -- 172.21.15.37:0/1326442020 >> v2:172.21.15.188:3300/0 conn(0x7fb0100b0a70 msgr2=0x7fb0100b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb00f7fe640 1 --2- 172.21.15.37:0/1326442020 >> v2:172.21.15.188:3300/0 conn(0x7fb0100b0a70 0x7fb0100b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb00f7fe640 1 -- 172.21.15.37:0/1326442020 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01013ffa0 con 0x7fb01006d6c0 2023-11-24T06:15:07.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.312+0000 7fb014a2d640 1 --2- 172.21.15.37:0/1326442020 >> v2:172.21.15.188:3300/0 conn(0x7fb0100b0a70 0x7fb0100b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:07.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.313+0000 7fb00f7fe640 1 --2- 172.21.15.37:0/1326442020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01006d6c0 0x7fb01006db20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb010151660 tx=0x7fb00402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b693244c12234b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb00effd640 1 -- 172.21.15.37:0/1326442020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00402ee00 con 0x7fb01006d6c0 2023-11-24T06:15:07.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb00effd640 1 -- 172.21.15.37:0/1326442020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004036440 con 0x7fb01006d6c0 2023-11-24T06:15:07.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb00effd640 1 -- 172.21.15.37:0/1326442020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0040367d0 con 0x7fb01006d6c0 2023-11-24T06:15:07.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb01522e640 1 -- 172.21.15.37:0/1326442020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01006d6c0 msgr2=0x7fb01006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb01522e640 1 --2- 172.21.15.37:0/1326442020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01006d6c0 0x7fb01006db20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb010151660 tx=0x7fb00402e050 comp rx=0 tx=0).stop 2023-11-24T06:15:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb01522e640 1 -- 172.21.15.37:0/1326442020 shutdown_connections 2023-11-24T06:15:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb01522e640 1 --2- 172.21.15.37:0/1326442020 >> v2:172.21.15.188:3300/0 conn(0x7fb0100b0a70 0x7fb0100b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb01522e640 1 --2- 172.21.15.37:0/1326442020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01006d6c0 0x7fb01006db20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb01522e640 1 --2- 172.21.15.37:0/1326442020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01013d120 0x7fb01015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.314+0000 7fb01522e640 1 -- 172.21.15.37:0/1326442020 >> 172.21.15.37:0/1326442020 conn(0x7fb0100cb830 msgr2=0x7fb0100cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.315+0000 7fb01522e640 1 -- 172.21.15.37:0/1326442020 shutdown_connections 2023-11-24T06:15:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.315+0000 7fb01522e640 1 -- 172.21.15.37:0/1326442020 wait complete. 2023-11-24T06:15:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.316+0000 7fb01522e640 1 Processor -- start 2023-11-24T06:15:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.317+0000 7fb01522e640 1 -- start start 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.317+0000 7fb01522e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01006d6c0 0x7fb0100b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.317+0000 7fb01522e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0100b0a70 0x7fb0101599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.317+0000 7fb01522e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01013d120 0x7fb01015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb01522e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0101f6330 con 0x7fb01013d120 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb01522e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0101f6610 con 0x7fb0100b0a70 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb01522e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0101f68f0 con 0x7fb01006d6c0 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01013d120 0x7fb01015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01013d120 0x7fb01015c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34106/0 (socket says 172.21.15.37:34106) 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 -- 172.21.15.37:0/1110856442 learned_addr learned my addr 172.21.15.37:0/1110856442 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:07.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb00ffff640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01006d6c0 0x7fb0100b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb00f7fe640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0100b0a70 0x7fb0101599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 -- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01006d6c0 msgr2=0x7fb0100b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01006d6c0 0x7fb0100b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 -- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0100b0a70 msgr2=0x7fb0101599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0100b0a70 0x7fb0101599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.318+0000 7fb014a2d640 1 -- 172.21.15.37:0/1110856442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00400b770 con 0x7fb01013d120 2023-11-24T06:15:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.319+0000 7fb014a2d640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01013d120 0x7fb01015c650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb008009fa0 tx=0x7fb00800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.319+0000 7fb00cff9640 1 -- 172.21.15.37:0/1110856442 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008003b90 con 0x7fb01013d120 2023-11-24T06:15:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.319+0000 7fb00cff9640 1 -- 172.21.15.37:0/1110856442 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800f040 con 0x7fb01013d120 2023-11-24T06:15:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.319+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0101f6bd0 con 0x7fb01013d120 2023-11-24T06:15:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.319+0000 7fb00cff9640 1 -- 172.21.15.37:0/1110856442 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008004030 con 0x7fb01013d120 2023-11-24T06:15:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.319+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0101f5f70 con 0x7fb01013d120 2023-11-24T06:15:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.321+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01015b400 con 0x7fb01013d120 2023-11-24T06:15:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.321+0000 7fb00cff9640 1 -- 172.21.15.37:0/1110856442 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb008004190 con 0x7fb01013d120 2023-11-24T06:15:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.322+0000 7fb00cff9640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faffc06ae90 0x7faffc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.322+0000 7fb00cff9640 1 -- 172.21.15.37:0/1110856442 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb008089930 con 0x7fb01013d120 2023-11-24T06:15:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.322+0000 7fb00ffff640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faffc06ae90 0x7faffc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.323+0000 7fb00ffff640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faffc06ae90 0x7faffc06d350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb000009a50 tx=0x7fb000008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.327+0000 7fb00cff9640 1 -- 172.21.15.37:0/1110856442 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb008054ac0 con 0x7fb01013d120 2023-11-24T06:15:07.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.557+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb01004e840 con 0x7fb01013d120 2023-11-24T06:15:07.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.558+0000 7fb00cff9640 1 -- 172.21.15.37:0/1110856442 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fb00801a090 con 0x7fb01013d120 2023-11-24T06:15:07.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:07.561 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:15:07.561 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:15:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.560+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faffc06ae90 msgr2=0x7faffc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.560+0000 7fb01522e640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faffc06ae90 0x7faffc06d350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb000009a50 tx=0x7fb000008040 comp rx=0 tx=0).stop 2023-11-24T06:15:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.560+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01013d120 msgr2=0x7fb01015c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.560+0000 7fb01522e640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01013d120 0x7fb01015c650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb008009fa0 tx=0x7fb00800d560 comp rx=0 tx=0).stop 2023-11-24T06:15:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 shutdown_connections 2023-11-24T06:15:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faffc06ae90 0x7faffc06d350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0100b0a70 0x7fb0101599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01013d120 0x7fb01015c650 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 --2- 172.21.15.37:0/1110856442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb01006d6c0 0x7fb0100b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 >> 172.21.15.37:0/1110856442 conn(0x7fb0100cb830 msgr2=0x7fb0100ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 shutdown_connections 2023-11-24T06:15:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:07.561+0000 7fb01522e640 1 -- 172.21.15.37:0/1110856442 wait complete. 2023-11-24T06:15:07.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:14:50.152195+0000', 'modified': '2023-11-24T06:14:53.205981+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6833/554885584', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6832', 'nonce': 554885584}, {'type': 'v1', 'addr': '172.21.15.188:6833', 'nonce': 554885584}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:15:07.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:15:07.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T06:15:08.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.223+0000 7f08fb59e640 1 Processor -- start 2023-11-24T06:15:08.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.223+0000 7f08fb59e640 1 -- start start 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08fb59e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f08fc15b1d0 0x7f08fc071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08fb59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08fc070550 0x7f08fc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08fb59e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc0ca0e0 con 0x7f08fc0b1080 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08fb59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc15fde0 con 0x7f08fc070550 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08fb59e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc0b14a0 con 0x7f08fc15b1d0 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08f9d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08fc070550 0x7f08fc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08f9d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08fc070550 0x7f08fc0b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34114/0 (socket says 172.21.15.37:34114) 2023-11-24T06:15:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.225+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2089509813 learned_addr learned my addr 172.21.15.37:0/2089509813 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.226+0000 7f08fa59c640 1 --2- 172.21.15.37:0/2089509813 >> v2:172.21.15.188:3300/0 conn(0x7f08fc15b1d0 0x7f08fc071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.226+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2089509813 >> v2:172.21.15.188:3300/0 conn(0x7f08fc15b1d0 msgr2=0x7f08fc071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.226+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2089509813 >> v2:172.21.15.188:3300/0 conn(0x7f08fc15b1d0 0x7f08fc071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.226+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2089509813 >> v1:172.21.15.188:6789/0 conn(0x7f08fc0b1080 legacy=0x7f08fc06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.226+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2089509813 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc072800 con 0x7f08fc070550 2023-11-24T06:15:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.227+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2089509813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc0b0b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f08fc06e7a0 tx=0x7f08f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb1efc66324b2a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.228+0000 7f08f959a640 1 -- 172.21.15.37:0/2089509813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0031870 con 0x7f08fc070550 2023-11-24T06:15:08.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.228+0000 7f08f959a640 1 -- 172.21.15.37:0/2089509813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f00319d0 con 0x7f08fc070550 2023-11-24T06:15:08.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.228+0000 7f08f959a640 1 -- 172.21.15.37:0/2089509813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0031d60 con 0x7f08fc070550 2023-11-24T06:15:08.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.228+0000 7f08fb59e640 1 -- 172.21.15.37:0/2089509813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 msgr2=0x7f08fc0b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.228+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2089509813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc0b0b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f08fc06e7a0 tx=0x7f08f002b910 comp rx=0 tx=0).stop 2023-11-24T06:15:08.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.229+0000 7f08fb59e640 1 -- 172.21.15.37:0/2089509813 shutdown_connections 2023-11-24T06:15:08.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.229+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2089509813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc0b0b40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.229+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2089509813 >> v2:172.21.15.188:3300/0 conn(0x7f08fc15b1d0 0x7f08fc071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.229+0000 7f08fb59e640 1 -- 172.21.15.37:0/2089509813 >> 172.21.15.37:0/2089509813 conn(0x7f08fc0cbb40 msgr2=0x7f08fc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.229+0000 7f08fb59e640 1 -- 172.21.15.37:0/2089509813 shutdown_connections 2023-11-24T06:15:08.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.229+0000 7f08fb59e640 1 -- 172.21.15.37:0/2089509813 wait complete. 2023-11-24T06:15:08.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.231+0000 7f08fb59e640 1 Processor -- start 2023-11-24T06:15:08.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.231+0000 7f08fb59e640 1 -- start start 2023-11-24T06:15:08.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc09bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fb59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08fc0b1080 0x7f08fc0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fb59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08fc15b1d0 0x7f08fc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fb59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0cfca0 con 0x7f08fc070550 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fb59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc15e020 con 0x7f08fc0b1080 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fb59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0ceee0 con 0x7f08fc15b1d0 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc09bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc09bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34126/0 (socket says 172.21.15.37:34126) 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fa59c640 1 -- 172.21.15.37:0/2488690870 learned_addr learned my addr 172.21.15.37:0/2488690870 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:08.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08fc0b1080 0x7f08fc0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fad9d640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08fc15b1d0 0x7f08fc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.232+0000 7f08fa59c640 1 -- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08fc15b1d0 msgr2=0x7f08fc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fa59c640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08fc15b1d0 0x7f08fc0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fa59c640 1 -- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08fc0b1080 msgr2=0x7f08fc0ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fa59c640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08fc0b1080 0x7f08fc0ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fa59c640 1 -- 172.21.15.37:0/2488690870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00094d0 con 0x7f08fc070550 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08fc0b1080 0x7f08fc0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fad9d640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08fc15b1d0 0x7f08fc0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fa59c640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc09bc50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00efc0 tx=0x7f08ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08eaffd640 1 -- 172.21.15.37:0/2488690870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec009b80 con 0x7f08fc070550 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08eaffd640 1 -- 172.21.15.37:0/2488690870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00f040 con 0x7f08fc070550 2023-11-24T06:15:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08eaffd640 1 -- 172.21.15.37:0/2488690870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0146a0 con 0x7f08fc070550 2023-11-24T06:15:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc0cf1c0 con 0x7f08fc070550 2023-11-24T06:15:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.233+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc0cf780 con 0x7f08fc070550 2023-11-24T06:15:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.235+0000 7f08eaffd640 1 -- 172.21.15.37:0/2488690870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08ec014800 con 0x7f08fc070550 2023-11-24T06:15:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.236+0000 7f08eaffd640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08dc06ae40 0x7f08dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.236+0000 7f08eaffd640 1 -- 172.21.15.37:0/2488690870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08ec08a220 con 0x7f08fc070550 2023-11-24T06:15:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.237+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08dc06ae40 0x7f08dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.237+0000 7f09035ae740 1 Processor -- start 2023-11-24T06:15:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.237+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08dc06ae40 0x7f08dc06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08f0036000 tx=0x7f08f003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.238+0000 7f09035ae740 1 -- start start 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.238+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186c82450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.238+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186c81270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f09035ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cc5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f09035ae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558186be0880 con 0x558186c817b0 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558186befae0 con 0x558186c82070 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x558186bed1d0 con 0x558186c7cd70 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f08fad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cc5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f08fad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cc5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34136/0 (socket says 172.21.15.37:34136) 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f08fad9d640 1 -- 172.21.15.37:0/3074462163 learned_addr learned my addr 172.21.15.37:0/3074462163 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f08fa59c640 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186c82450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186c81270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f08fad9d640 1 -- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 msgr2=0x558186c81270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.239+0000 7f08fad9d640 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186c81270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.240+0000 7f08fad9d640 1 -- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 msgr2=0x558186c82450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.240+0000 7f08fad9d640 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186c82450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.240+0000 7f08fad9d640 1 -- 172.21.15.37:0/3074462163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558186bb0860 con 0x558186c817b0 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.240+0000 7f08fad9d640 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cc5730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08f4003f00 tx=0x7f08f40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95260ea516810f3a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.240+0000 7f08dbfff640 1 -- 172.21.15.37:0/3074462163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400db40 con 0x558186c817b0 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.240+0000 7f08dbfff640 1 -- 172.21.15.37:0/3074462163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400dca0 con 0x558186c817b0 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.240+0000 7f08dbfff640 1 -- 172.21.15.37:0/3074462163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4007030 con 0x558186c817b0 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 -- 172.21.15.37:0/3074462163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 msgr2=0x558186cc5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cc5730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08f4003f00 tx=0x7f08f40043c0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 -- 172.21.15.37:0/3074462163 shutdown_connections 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cc5730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186c81270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 --2- 172.21.15.37:0/3074462163 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186c82450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 -- 172.21.15.37:0/3074462163 >> 172.21.15.37:0/3074462163 conn(0x558186c43c70 msgr2=0x558186cc7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 -- 172.21.15.37:0/3074462163 shutdown_connections 2023-11-24T06:15:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.241+0000 7f09035ae740 1 -- 172.21.15.37:0/3074462163 wait complete. 2023-11-24T06:15:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.242+0000 7f09035ae740 1 -- start start 2023-11-24T06:15:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.242+0000 7f09035ae740 1 Processor -- start 2023-11-24T06:15:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186ca7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f09035ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cabd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186cac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f09035ae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558186be8ac0 con 0x558186c817b0 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558186b852f0 con 0x558186c82070 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x558186ba2c70 con 0x558186c7cd70 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f09035ae740 10 client.0 _ll_register_callbacks cb 0x558186ba73b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f08f9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cabd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f08f9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cabd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34152/0 (socket says 172.21.15.37:34152) 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.243+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2636320671 learned_addr learned my addr 172.21.15.37:0/2636320671 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08fad9d640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186cac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08fa59c640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186ca7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 msgr2=0x558186ca7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186ca7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 msgr2=0x558186cac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186cac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08f9d9b640 1 -- 172.21.15.37:0/2636320671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f4003ad0 con 0x558186c817b0 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08fad9d640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186cac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cabd00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009930 tx=0x7f08f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77ddc365214029a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08d97fa640 1 -- 172.21.15.37:0/2636320671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f004b070 con 0x558186c817b0 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f08d97fa640 1 -- 172.21.15.37:0/2636320671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08f002d040 con 0x558186c817b0 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.244+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558186be1aa0 con 0x558186c817b0 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f08d97fa640 1 -- 172.21.15.37:0/2636320671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08f00456d0 con 0x558186c817b0 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 10 client.4653 fetch_fsmap learned FSMap version 8 2023-11-24T06:15:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558186be7140 con 0x558186c817b0 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f08d97fa640 1 -- 172.21.15.37:0/2636320671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558186be1aa0 con 0x558186c817b0 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f08d97fa640 1 -- 172.21.15.37:0/2636320671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f08f0045830 con 0x558186c817b0 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 20 client.4653 populate_metadata read hostname 'smithi037' 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ccfce0 0x558186ccd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 4 client.4653 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.245+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 --> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558186be17c0 con 0x558186ccfce0 2023-11-24T06:15:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.246+0000 7f08fa59c640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ccfce0 0x558186ccd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.247+0000 7f08fa59c640 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ccfce0 0x558186ccd070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57cbe48cb6e5986a server_cookie=4e61886f9103d5ba in_seq=0 out_seq=0 2023-11-24T06:15:08.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.247+0000 7f08d97fa640 10 client.4653 ms_handle_connect on v2:172.21.15.188:6832/554885584 2023-11-24T06:15:08.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.248+0000 7f08d97fa640 1 -- 172.21.15.37:0/2636320671 <== mds.0 v2:172.21.15.188:6832/554885584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558186be17c0 con 0x558186ccfce0 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.248+0000 7f08d97fa640 10 client.4653 handle_command_reply: tid=0 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 client.4653 shutdown 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 msgr2=0x558186cabd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cabd00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009930 tx=0x7f08f0004730 comp rx=0 tx=0).stop 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 shutdown_connections 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ccfce0 0x558186ccd070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c82070 0x558186cac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186cabd00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 --2- 172.21.15.37:0/2636320671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c7cd70 0x558186ca7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f08d97fa640 0 client.4653 ms_handle_reset on v2:172.21.15.188:6832/554885584 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 >> 172.21.15.37:0/2636320671 conn(0x558186c43c70 msgr2=0x558186c7bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 shutdown_connections 2023-11-24T06:15:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 1 -- 172.21.15.37:0/2636320671 wait complete. 2023-11-24T06:15:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.249+0000 7f09035ae740 20 client.4653 trim_cache size 0 max 16384 2023-11-24T06:15:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.267+0000 7f09035ae740 1 Processor -- start 2023-11-24T06:15:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.267+0000 7f09035ae740 1 -- start start 2023-11-24T06:15:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c7cd70 0x558186cafd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f09035ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186c80b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 0x558186ca66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f09035ae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55818694bf20 con 0x558186c817b0 2023-11-24T06:15:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558186cce880 con 0x558186c7cd70 2023-11-24T06:15:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x558186ca9db0 con 0x558186c82070 2023-11-24T06:15:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186c80b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186c80b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34166/0 (socket says 172.21.15.37:34166) 2023-11-24T06:15:08.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 -- 172.21.15.37:0/3717603301 learned_addr learned my addr 172.21.15.37:0/3717603301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 -- 172.21.15.37:0/3717603301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 msgr2=0x558186ca66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/3717603301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 0x558186ca66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 -- 172.21.15.37:0/3717603301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c7cd70 msgr2=0x558186cafd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/3717603301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c7cd70 0x558186cafd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.268+0000 7f08f9d9b640 1 -- 172.21.15.37:0/3717603301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558186b84b80 con 0x558186c817b0 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.269+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/3717603301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186c80b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009960 tx=0x7f08f004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4934cfc0af94e0d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.269+0000 7f08e8ff9640 1 -- 172.21.15.37:0/3717603301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00456d0 con 0x558186c817b0 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.269+0000 7f08e8ff9640 1 -- 172.21.15.37:0/3717603301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0045830 con 0x558186c817b0 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.269+0000 7f08e8ff9640 1 -- 172.21.15.37:0/3717603301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004240 con 0x558186c817b0 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.269+0000 7f09035ae740 1 -- 172.21.15.37:0/3717603301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 msgr2=0x558186c80b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.269+0000 7f09035ae740 1 --2- 172.21.15.37:0/3717603301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186c80b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009960 tx=0x7f08f004b000 comp rx=0 tx=0).stop 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 -- 172.21.15.37:0/3717603301 shutdown_connections 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 --2- 172.21.15.37:0/3717603301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 0x558186ca66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 --2- 172.21.15.37:0/3717603301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c817b0 0x558186c80b50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 --2- 172.21.15.37:0/3717603301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c7cd70 0x558186cafd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 -- 172.21.15.37:0/3717603301 >> 172.21.15.37:0/3717603301 conn(0x558186c43c70 msgr2=0x558186ca7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 -- 172.21.15.37:0/3717603301 shutdown_connections 2023-11-24T06:15:08.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 -- 172.21.15.37:0/3717603301 wait complete. 2023-11-24T06:15:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.270+0000 7f09035ae740 1 -- start start 2023-11-24T06:15:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.271+0000 7f09035ae740 1 Processor -- start 2023-11-24T06:15:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.271+0000 7f09035ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c7cd70 0x558186d34b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c817b0 0x558186ce0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f09035ae740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 0x558186ce0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f09035ae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558186ce9e90 con 0x558186c7cd70 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x558186ce73a0 con 0x558186c817b0 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f09035ae740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x558186cabe90 con 0x558186c82070 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f09035ae740 10 client.0 _ll_register_callbacks cb 0x7f08ec0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c7cd70 0x558186d34b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c7cd70 0x558186d34b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34174/0 (socket says 172.21.15.37:34174) 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 -- 172.21.15.37:0/3198399593 learned_addr learned my addr 172.21.15.37:0/3198399593 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 -- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 msgr2=0x558186ce0680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 0x558186ce0680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 -- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c817b0 msgr2=0x558186ce0140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c817b0 0x558186ce0140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.272+0000 7f08fa59c640 1 -- 172.21.15.37:0/3198399593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558186be7140 con 0x558186c7cd70 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f08fa59c640 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c7cd70 0x558186d34b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08ec055490 tx=0x7f08ec0097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fa355d97a8548 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f08d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f08d97fa640 1 -- 172.21.15.37:0/3198399593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0556a0 con 0x558186c7cd70 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f08d97fa640 1 -- 172.21.15.37:0/3198399593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08ec055800 con 0x558186c7cd70 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08f400dca0 con 0x558186c7cd70 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f08d97fa640 1 -- 172.21.15.37:0/3198399593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08ec0882c0 con 0x558186c7cd70 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 10 client.4659 fetch_fsmap learned FSMap version 8 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558186baa170 con 0x558186c7cd70 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f08d97fa640 1 -- 172.21.15.37:0/3198399593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400dca0 con 0x558186c7cd70 2023-11-24T06:15:08.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f08d97fa640 1 -- 172.21.15.37:0/3198399593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f08ec060e00 con 0x558186c7cd70 2023-11-24T06:15:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:15:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:15:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 20 client.4659 populate_metadata read hostname 'smithi037' 2023-11-24T06:15:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ca9120 0x558186ca9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 4 client.4659 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:15:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.273+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 --> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5581868e96c0 con 0x558186ca9120 2023-11-24T06:15:08.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.274+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ca9120 0x558186ca9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.276+0000 7f08f9d9b640 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ca9120 0x558186ca9500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b4f20b542a9330 server_cookie=4cb509d1505c6057 in_seq=0 out_seq=0 2023-11-24T06:15:08.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.276+0000 7f08d97fa640 10 client.4659 ms_handle_connect on v2:172.21.15.188:6832/554885584 2023-11-24T06:15:08.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.276+0000 7f08d97fa640 1 -- 172.21.15.37:0/3198399593 <== mds.0 v2:172.21.15.188:6832/554885584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5581868e96c0 con 0x558186ca9120 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.276+0000 7f08d97fa640 10 client.4659 handle_command_reply: tid=0 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.276+0000 7f09035ae740 1 client.4659 shutdown 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c7cd70 msgr2=0x558186d34b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c7cd70 0x558186d34b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f08ec055490 tx=0x7f08ec0097e0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 shutdown_connections 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:6832/554885584,v1:172.21.15.188:6833/554885584] conn(0x558186ca9120 0x558186ca9500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558186c817b0 0x558186ce0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558186c82070 0x558186ce0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 --2- 172.21.15.37:0/3198399593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558186c7cd70 0x558186d34b20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f08d97fa640 0 client.4659 ms_handle_reset on v2:172.21.15.188:6832/554885584 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 >> 172.21.15.37:0/3198399593 conn(0x558186c43c70 msgr2=0x558186caa470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 shutdown_connections 2023-11-24T06:15:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 1 -- 172.21.15.37:0/3198399593 wait complete. 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.277+0000 7f09035ae740 20 client.4659 trim_cache size 0 max 16384 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3", 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4276, 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-11-24T06:15:08.282 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-11-24T06:15:08.283 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 17.581227132999999, 2023-11-24T06:15:08.283 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2023-11-24T06:15:08.283 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 20, 2023-11-24T06:15:08.283 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 20, 2023-11-24T06:15:08.283 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 23.020866067 2023-11-24T06:15:08.283 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08dc06ae40 msgr2=0x7f08dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08dc06ae40 0x7f08dc06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08f0036000 tx=0x7f08f003c040 comp rx=0 tx=0).stop 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 msgr2=0x7f08fc09bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc09bc50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00efc0 tx=0x7f08ec00c490 comp rx=0 tx=0).stop 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 shutdown_connections 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08dc06ae40 0x7f08dc06d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08fc0b1080 0x7f08fc0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08fc15b1d0 0x7f08fc0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 --2- 172.21.15.37:0/2488690870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08fc070550 0x7f08fc09bc50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 >> 172.21.15.37:0/2488690870 conn(0x7f08fc0cbb40 msgr2=0x7f08fc0c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 shutdown_connections 2023-11-24T06:15:08.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:08.278+0000 7f08fb59e640 1 -- 172.21.15.37:0/2488690870 wait complete. 2023-11-24T06:15:08.297 INFO:teuthology.run_tasks:Running task kclient... 2023-11-24T06:15:08.326 INFO:tasks.kclient:Mounting kernel clients... 2023-11-24T06:15:08.327 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T06:15:08.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.327 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:15:08.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-11-24T06:15:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:08.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:08.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.509 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:15:08.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-11-24T06:15:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:08.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:08.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.674 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:15:08.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2023-11-24T06:15:08.836 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:08.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:08.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.839 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:15:08.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:08.892 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2023-11-24T06:15:08.988 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:08.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:08.992 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-24T06:15:08.992 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:15:08.992 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:15:08.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:15:09.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:09.167 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:09.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.222+0000 7ff99bf33640 1 Processor -- start 2023-11-24T06:15:09.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.222+0000 7ff99bf33640 1 -- start start 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff99bf33640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9940cf450 0x7ff9940cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff99bf33640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff9940cdfb0 0x7ff9940ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff99bf33640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940cece0 con 0x7ff99415c7f0 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff99bf33640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940cfe40 con 0x7ff9940cf450 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff99bf33640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff994156010 con 0x7ff9940cdfb0 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff9994ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9940cf450 0x7ff9940cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff9994ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9940cf450 0x7ff9940cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34190/0 (socket says 172.21.15.37:34190) 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff9994ce640 1 -- 172.21.15.37:0/2898985837 learned_addr learned my addr 172.21.15.37:0/2898985837 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.224+0000 7ff99a4d0640 1 --2- 172.21.15.37:0/2898985837 >> v2:172.21.15.188:3300/0 conn(0x7ff9940cdfb0 0x7ff9940ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.225+0000 7ff9994ce640 1 -- 172.21.15.37:0/2898985837 >> v2:172.21.15.188:3300/0 conn(0x7ff9940cdfb0 msgr2=0x7ff9940ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.225+0000 7ff9994ce640 1 --2- 172.21.15.37:0/2898985837 >> v2:172.21.15.188:3300/0 conn(0x7ff9940cdfb0 0x7ff9940ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.225+0000 7ff9994ce640 1 -- 172.21.15.37:0/2898985837 >> v1:172.21.15.188:6789/0 conn(0x7ff99415c7f0 legacy=0x7ff99406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.225+0000 7ff9994ce640 1 -- 172.21.15.37:0/2898985837 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99406d040 con 0x7ff9940cf450 2023-11-24T06:15:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.227+0000 7ff9994ce640 1 --2- 172.21.15.37:0/2898985837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940cf450 0x7ff9940cf900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff9940d00e0 tx=0x7ff98402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc28812dbde743d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.227+0000 7ff998ccd640 1 -- 172.21.15.37:0/2898985837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984030860 con 0x7ff9940cf450 2023-11-24T06:15:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.227+0000 7ff998ccd640 1 -- 172.21.15.37:0/2898985837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9840309c0 con 0x7ff9940cf450 2023-11-24T06:15:09.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.227+0000 7ff998ccd640 1 -- 172.21.15.37:0/2898985837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984030d50 con 0x7ff9940cf450 2023-11-24T06:15:09.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 -- 172.21.15.37:0/2898985837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940cf450 msgr2=0x7ff9940cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 --2- 172.21.15.37:0/2898985837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940cf450 0x7ff9940cf900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff9940d00e0 tx=0x7ff98402b9a0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 -- 172.21.15.37:0/2898985837 shutdown_connections 2023-11-24T06:15:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 --2- 172.21.15.37:0/2898985837 >> v2:172.21.15.188:3300/0 conn(0x7ff9940cdfb0 0x7ff9940ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 --2- 172.21.15.37:0/2898985837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9940cf450 0x7ff9940cf900 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 -- 172.21.15.37:0/2898985837 >> 172.21.15.37:0/2898985837 conn(0x7ff99406a920 msgr2=0x7ff99406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 -- 172.21.15.37:0/2898985837 shutdown_connections 2023-11-24T06:15:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.228+0000 7ff99bf33640 1 -- 172.21.15.37:0/2898985837 wait complete. 2023-11-24T06:15:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.230+0000 7ff99bf33640 1 Processor -- start 2023-11-24T06:15:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.230+0000 7ff99bf33640 1 -- start start 2023-11-24T06:15:09.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99bf33640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9940cdfb0 0x7ff994150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99bf33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9940cf450 0x7ff994156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99bf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99415c7f0 0x7ff9940abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99bf33640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940b3100 con 0x7ff99415c7f0 2023-11-24T06:15:09.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99bf33640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940ac9a0 con 0x7ff9940cf450 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99bf33640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940ad190 con 0x7ff9940cdfb0 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99a4d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99415c7f0 0x7ff9940abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99a4d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99415c7f0 0x7ff9940abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34198/0 (socket says 172.21.15.37:34198) 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff99a4d0640 1 -- 172.21.15.37:0/200928306 learned_addr learned my addr 172.21.15.37:0/200928306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff999ccf640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9940cdfb0 0x7ff994150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.231+0000 7ff9994ce640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9940cf450 0x7ff994156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99a4d0640 1 -- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9940cdfb0 msgr2=0x7ff994150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99a4d0640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9940cdfb0 0x7ff994150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99a4d0640 1 -- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9940cf450 msgr2=0x7ff994156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99a4d0640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9940cf450 0x7ff994156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99a4d0640 1 -- 172.21.15.37:0/200928306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840094d0 con 0x7ff99415c7f0 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff999ccf640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9940cdfb0 0x7ff994150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99a4d0640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99415c7f0 0x7ff9940abfc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00efc0 tx=0x7ff98c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff98a7fc640 1 -- 172.21.15.37:0/200928306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c009b10 con 0x7ff99415c7f0 2023-11-24T06:15:09.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff98a7fc640 1 -- 172.21.15.37:0/200928306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c00f040 con 0x7ff99415c7f0 2023-11-24T06:15:09.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff98a7fc640 1 -- 172.21.15.37:0/200928306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0146c0 con 0x7ff99415c7f0 2023-11-24T06:15:09.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9941517c0 con 0x7ff99415c7f0 2023-11-24T06:15:09.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.232+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9940aceb0 con 0x7ff99415c7f0 2023-11-24T06:15:09.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.234+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9940b3240 con 0x7ff99415c7f0 2023-11-24T06:15:09.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.235+0000 7ff98a7fc640 1 -- 172.21.15.37:0/200928306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff98c014820 con 0x7ff99415c7f0 2023-11-24T06:15:09.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.235+0000 7ff98a7fc640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff97806ae40 0x7ff97806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.236+0000 7ff98a7fc640 1 -- 172.21.15.37:0/200928306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff98c08a480 con 0x7ff99415c7f0 2023-11-24T06:15:09.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.236+0000 7ff999ccf640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff97806ae40 0x7ff97806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.236+0000 7ff999ccf640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff97806ae40 0x7ff97806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9940ae480 tx=0x7ff990009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.240+0000 7ff98a7fc640 1 -- 172.21.15.37:0/200928306 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff98c055490 con 0x7ff99415c7f0 2023-11-24T06:15:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.474+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff994067470 con 0x7ff99415c7f0 2023-11-24T06:15:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.475+0000 7ff98a7fc640 1 -- 172.21.15.37:0/200928306 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff98c058ab0 con 0x7ff99415c7f0 2023-11-24T06:15:09.477 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:15:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.477+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff97806ae40 msgr2=0x7ff97806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.477+0000 7ff99bf33640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff97806ae40 0x7ff97806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9940ae480 tx=0x7ff990009040 comp rx=0 tx=0).stop 2023-11-24T06:15:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.477+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99415c7f0 msgr2=0x7ff9940abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.477+0000 7ff99bf33640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99415c7f0 0x7ff9940abfc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00efc0 tx=0x7ff98c00c490 comp rx=0 tx=0).stop 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 shutdown_connections 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff97806ae40 0x7ff97806d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9940cf450 0x7ff994156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99415c7f0 0x7ff9940abfc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 --2- 172.21.15.37:0/200928306 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9940cdfb0 0x7ff994150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 >> 172.21.15.37:0/200928306 conn(0x7ff99406a920 msgr2=0x7ff99406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 shutdown_connections 2023-11-24T06:15:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:09.478+0000 7ff99bf33640 1 -- 172.21.15.37:0/200928306 wait complete. 2023-11-24T06:15:09.499 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:15:09.499 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:15:09.499 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-11-24T06:15:09.500 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:15:09.500 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:15:09.500 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:15:09.500 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:15:09.500 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:15:09.500 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:15:09.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:09.500 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-11-24T06:15:09.555 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:09.556 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42350sec preferred_lft 42350sec 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-11-24T06:15:09.558 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:15:09.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:09.559 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:09.559 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:09.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:15:09.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-11-24T06:15:09.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-11-24T06:15:09.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:15:09.559 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:10.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:10.039 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:15:10.124 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-11-24T06:15:10.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:10.127 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-11-24T06:15:10.185 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-11-24T06:15:10.185 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:15:10.185 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:15:10.185 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:15:10.185 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:15:10.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:10.186 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:10.186 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:10.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:15:10.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:15:10.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:15:10.186 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:10.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:10.943 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:15:11.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:11.003 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-11-24T06:15:11.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:11.063 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:11.063 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:11.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:15:11.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T06:15:11.063 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:11.217 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T06:15:11.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T06:15:11.218 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:11.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:11.507 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:11.507 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:11.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-11-24T06:15:11.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:15:11.507 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:11.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:11.679 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:15:11.733 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:15:11.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:11.733 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:15:11.788 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:15:11.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:11.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:11.945 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:11.945 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:12.427 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:12.427 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:12.427 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:15:12.428 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:15:12.428 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:15:12.431 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-24T06:15:12.431 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:15:12.431 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:15:12.431 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:15:12.431 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:15:12.436 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:15:12.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:12.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:15:12.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:12.545 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:12.632 INFO:teuthology.orchestra.run.smithi037.stdout:client4528 2023-11-24T06:15:12.633 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:12.633 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:12.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:12.698 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:12.781 INFO:teuthology.orchestra.run.smithi037.stdout:client4528 2023-11-24T06:15:12.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:12.782 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:12.869 INFO:teuthology.orchestra.run.smithi037.stdout:client4528 2023-11-24T06:15:12.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:12.869 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.client4528/status') 2023-11-24T06:15:12.986 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4528 (3)172.21.15.37:0/1312669723 2023-11-24T06:15:12.986 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-11-24T06:15:12.987 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-11-24T06:15:12.987 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-11-24T06:15:12.987 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 7.7968e-05 s, 898 kB/s 2023-11-24T06:15:12.991 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-11-24T06:15:12.991 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:15:12.991 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:15:12.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:15:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.219+0000 7f710561a640 1 Processor -- start 2023-11-24T06:15:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.220+0000 7f710561a640 1 -- start start 2023-11-24T06:15:13.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.221+0000 7f710561a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f710014b100 0x7f7100162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.221+0000 7f710561a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71000703f0 0x7f7100165c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.221+0000 7f710561a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7100162eb0 con 0x7f7100166150 2023-11-24T06:15:13.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.221+0000 7f710561a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71001654a0 con 0x7f710014b100 2023-11-24T06:15:13.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.221+0000 7f710561a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000ccf00 con 0x7f71000703f0 2023-11-24T06:15:13.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f7104e19640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7100166150 0x7f71000cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43126/0 (socket says 172.21.15.37:43126) 2023-11-24T06:15:13.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f7104e19640 1 -- 172.21.15.37:0/419958048 learned_addr learned my addr 172.21.15.37:0/419958048 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:13.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70f7fff640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71000703f0 0x7f7100165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69776812 0 0) 0x7f70f8001490 con 0x7f7100166150 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec003520 con 0x7f7100166150 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70fffff640 1 --2- 172.21.15.37:0/419958048 >> v2:172.21.15.188:3300/0 conn(0x7f710014b100 0x7f7100162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 701282108 0 0) 0x7f70ec003520 con 0x7f7100166150 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71000703f0 msgr2=0x7f7100165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71000703f0 0x7f7100165c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 >> v2:172.21.15.188:3300/0 conn(0x7f710014b100 msgr2=0x7f7100162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 --2- 172.21.15.37:0/419958048 >> v2:172.21.15.188:3300/0 conn(0x7f710014b100 0x7f7100162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000708f0 con 0x7f7100166150 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.222+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f70f8001b80 con 0x7f7100166150 2023-11-24T06:15:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 >> v1:172.21.15.37:6789/0 conn(0x7f7100166150 legacy=0x7f71000cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70ff7fe640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70ec003970 0x7f70ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70ff7fe640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f70ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70ff7fe640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71000703f0 0x7f70ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001654a0 con 0x7f70ec0047c0 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000ccf00 con 0x7f70ec003970 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec00ba60 con 0x7f71000703f0 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70f7fff640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f70ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70fffff640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70ec003970 0x7f70ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70f7fff640 1 -- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71000703f0 msgr2=0x7f70ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70f7fff640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71000703f0 0x7f70ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70f7fff640 1 -- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70ec003970 msgr2=0x7f70ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70f7fff640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70ec003970 0x7f70ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70f7fff640 1 -- 172.21.15.37:0/419958048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec003520 con 0x7f70ec0047c0 2023-11-24T06:15:13.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.223+0000 7f70fffff640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70ec003970 0x7f70ec003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.225+0000 7f70f7fff640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f70ec004c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009a90 tx=0x7f70ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6582a0e03016d11e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.225+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e802c600 con 0x7f70ec0047c0 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.225+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e802c760 con 0x7f70ec0047c0 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.225+0000 7f70ff7fe640 1 -- 172.21.15.37:0/419958048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e802caf0 con 0x7f70ec0047c0 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.225+0000 7f710561a640 1 -- 172.21.15.37:0/419958048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 msgr2=0x7f70ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.225+0000 7f710561a640 1 --2- 172.21.15.37:0/419958048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f70ec004c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009a90 tx=0x7f70ec0057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.226+0000 7f7104e19640 1 -- 172.21.15.37:0/419958048 reap_dead start 2023-11-24T06:15:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.226+0000 7f710561a640 1 -- 172.21.15.37:0/419958048 shutdown_connections 2023-11-24T06:15:13.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.226+0000 7f710561a640 1 -- 172.21.15.37:0/419958048 >> 172.21.15.37:0/419958048 conn(0x7f71000cb830 msgr2=0x7f71000cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:13.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.226+0000 7f710561a640 1 -- 172.21.15.37:0/419958048 shutdown_connections 2023-11-24T06:15:13.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.226+0000 7f710561a640 1 -- 172.21.15.37:0/419958048 wait complete. 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.228+0000 7f710561a640 1 Processor -- start 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.228+0000 7f710561a640 1 -- start start 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f710561a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f71000b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f710561a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7100161590 0x7f71001ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f710561a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7100145910 0x7f7100145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f710561a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001437c0 con 0x7f70ec0047c0 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f710561a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001462e0 con 0x7f7100145910 2023-11-24T06:15:13.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f710561a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71001eceb0 con 0x7f7100161590 2023-11-24T06:15:13.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f70fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f71000b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f70fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f71000b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39156/0 (socket says 172.21.15.37:39156) 2023-11-24T06:15:13.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.229+0000 7f70fffff640 1 -- 172.21.15.37:0/3031885949 learned_addr learned my addr 172.21.15.37:0/3031885949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:13.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f7104e19640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7100145910 0x7f7100145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70f7fff640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7100161590 0x7f71001ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fffff640 1 -- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7100161590 msgr2=0x7f71001ebd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fffff640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7100161590 0x7f71001ebd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fffff640 1 -- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7100145910 msgr2=0x7f7100145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fffff640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7100145910 0x7f7100145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fffff640 1 -- 172.21.15.37:0/3031885949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71001ec610 con 0x7f70ec0047c0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fffff640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f71000b4b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70f000e810 tx=0x7f70f000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fd7fa640 1 -- 172.21.15.37:0/3031885949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000c8d0 con 0x7f70ec0047c0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fd7fa640 1 -- 172.21.15.37:0/3031885949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000ca30 con 0x7f70ec0047c0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f70fd7fa640 1 -- 172.21.15.37:0/3031885949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000cda0 con 0x7f70ec0047c0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.230+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71001ec8f0 con 0x7f70ec0047c0 2023-11-24T06:15:13.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.231+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710015eab0 con 0x7f70ec0047c0 2023-11-24T06:15:13.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.232+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710004e840 con 0x7f70ec0047c0 2023-11-24T06:15:13.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.233+0000 7f70fd7fa640 1 -- 172.21.15.37:0/3031885949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70f0013410 con 0x7f70ec0047c0 2023-11-24T06:15:13.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.233+0000 7f70fd7fa640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f70e006ae40 0x7f70e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:13.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.233+0000 7f70fd7fa640 1 -- 172.21.15.37:0/3031885949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70f0089490 con 0x7f70ec0047c0 2023-11-24T06:15:13.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.234+0000 7f70f7fff640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f70e006ae40 0x7f70e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:13.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.234+0000 7f70f7fff640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f70e006ae40 0x7f70e006d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f70e8036000 tx=0x7f70e8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:13.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.238+0000 7f70fd7fa640 1 -- 172.21.15.37:0/3031885949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70f0054530 con 0x7f70ec0047c0 2023-11-24T06:15:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.470+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f710006dd80 con 0x7f70ec0047c0 2023-11-24T06:15:13.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.471+0000 7f70fd7fa640 1 -- 172.21.15.37:0/3031885949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f70f0057b50 con 0x7f70ec0047c0 2023-11-24T06:15:13.474 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:15:13.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f70e006ae40 msgr2=0x7f70e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:13.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f70e006ae40 0x7f70e006d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f70e8036000 tx=0x7f70e8030000 comp rx=0 tx=0).stop 2023-11-24T06:15:13.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 msgr2=0x7f71000b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f71000b4b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70f000e810 tx=0x7f70f000ecd0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 shutdown_connections 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f70e006ae40 0x7f70e006d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7100145910 0x7f7100145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7100161590 0x7f71001ebd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 --2- 172.21.15.37:0/3031885949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ec0047c0 0x7f71000b4b30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 >> 172.21.15.37:0/3031885949 conn(0x7f71000cb830 msgr2=0x7f7100164cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 shutdown_connections 2023-11-24T06:15:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:13.474+0000 7f710561a640 1 -- 172.21.15.37:0/3031885949 wait complete. 2023-11-24T06:15:13.496 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:15:13.497 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:15:13.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:13.497 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:13.553 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42346sec preferred_lft 42346sec 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:13.554 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::40b6:eeff:fe98:3c34/64 scope link 2023-11-24T06:15:13.555 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:13.556 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:15:13.556 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:15:13.556 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a462:2eff:fec6:6249/64 scope link 2023-11-24T06:15:13.556 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:13.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:13.557 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:15:13.656 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-11-24T06:15:13.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:13.661 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-11-24T06:15:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-11-24T06:15:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:15:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:15:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:15:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:15:13.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:13.721 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:13.721 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:13.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:15:13.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:15:13.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:15:13.722 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:13.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:13.921 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:15:13.974 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:15:13.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:13.975 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-11-24T06:15:14.029 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T06:15:14.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:14.029 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:14.029 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:14.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:15:14.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T06:15:14.030 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:14.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:14.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:15:14.281 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether da:09:e0:d7:10:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:15:14.282 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:15:14.282 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.282 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d809:e0ff:fed7:1057/64 scope link 2023-11-24T06:15:14.282 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:14.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:15:14.392 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether da:09:e0:d7:10:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:15:14.393 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:15:14.393 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.393 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d809:e0ff:fed7:1057/64 scope link 2023-11-24T06:15:14.393 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:14.396 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T06:15:14.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:14.397 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:14.397 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T06:15:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:15:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T06:15:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T06:15:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T06:15:14.398 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:14.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:14.695 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:15:14.695 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:15:14.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-11-24T06:15:14.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:15:14.695 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:15:14.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:14.869 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T06:15:14.923 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:15:14.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:14.923 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:15:14.978 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-11-24T06:15:14.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:14.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:15.130 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:15.131 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:15.169 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:15.169 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:15.169 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:15:15.169 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 2@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:15:15.169 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:15:15.173 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-11-24T06:15:15.173 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:15:15.173 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:15:15.173 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:15:15.173 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:15:15.177 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:15:15.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:15.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:15:15.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:15.262 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:15.323 INFO:teuthology.orchestra.run.smithi037.stdout:client4674 2023-11-24T06:15:15.323 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:15.323 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:15.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:15.377 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:15.438 INFO:teuthology.orchestra.run.smithi037.stdout:client4674 2023-11-24T06:15:15.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:15.438 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:15.503 INFO:teuthology.orchestra.run.smithi037.stdout:client4674 2023-11-24T06:15:15.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:15.503 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.client4674/status') 2023-11-24T06:15:15.603 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4674 (3)192.168.0.2:0/914912515 2023-11-24T06:15:15.603 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-11-24T06:15:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-11-24T06:15:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-11-24T06:15:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:68 bytes copied, 7.3386e-05 s, 927 kB/s 2023-11-24T06:15:15.606 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-11-24T06:15:15.607 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:15:15.607 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:15:15.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:15:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.832+0000 7f88d8c2e640 1 Processor -- start 2023-11-24T06:15:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.833+0000 7f88d8c2e640 1 -- start start 2023-11-24T06:15:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.834+0000 7f88d8c2e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d40b1180 0x7f88d41683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.834+0000 7f88d8c2e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d4161510 con 0x7f88d4143870 2023-11-24T06:15:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.834+0000 7f88d8c2e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d41617f0 con 0x7f88d4161080 2023-11-24T06:15:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.834+0000 7f88d8c2e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d4070460 con 0x7f88d40b1180 2023-11-24T06:15:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.835+0000 7f88d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d40b1180 0x7f88d41683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.835+0000 7f88d37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f88d4143870 0x7f88d4146970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43136/0 (socket says 172.21.15.37:43136) 2023-11-24T06:15:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.835+0000 7f88d37fe640 1 -- 172.21.15.37:0/3598258226 learned_addr learned my addr 172.21.15.37:0/3598258226 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.835+0000 7f88d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d40b1180 0x7f88d41683f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39160/0 (socket says 172.21.15.37:39160) 2023-11-24T06:15:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.835+0000 7f88d3fff640 1 -- 172.21.15.37:0/3598258226 >> v1:172.21.15.188:6789/0 conn(0x7f88d4161080 legacy=0x7f88d40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.835+0000 7f88d3fff640 1 -- 172.21.15.37:0/3598258226 >> v1:172.21.15.37:6789/0 conn(0x7f88d4143870 legacy=0x7f88d4146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.835+0000 7f88d3fff640 1 -- 172.21.15.37:0/3598258226 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4161ad0 con 0x7f88d40b1180 2023-11-24T06:15:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.836+0000 7f88d3fff640 1 --2- 172.21.15.37:0/3598258226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d41683f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009d90 tx=0x7f88cc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdefaa628b7bc03b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.837+0000 7f88d2ffd640 1 -- 172.21.15.37:0/3598258226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc02cc60 con 0x7f88d40b1180 2023-11-24T06:15:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.837+0000 7f88d2ffd640 1 -- 172.21.15.37:0/3598258226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc02cdc0 con 0x7f88d40b1180 2023-11-24T06:15:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.837+0000 7f88d2ffd640 1 -- 172.21.15.37:0/3598258226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc034660 con 0x7f88d40b1180 2023-11-24T06:15:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.837+0000 7f88d8c2e640 1 -- 172.21.15.37:0/3598258226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 msgr2=0x7f88d41683f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.837+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/3598258226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d41683f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009d90 tx=0x7f88cc02beb0 comp rx=0 tx=0).stop 2023-11-24T06:15:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.838+0000 7f88d8c2e640 1 -- 172.21.15.37:0/3598258226 shutdown_connections 2023-11-24T06:15:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.838+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/3598258226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d41683f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.838+0000 7f88d8c2e640 1 -- 172.21.15.37:0/3598258226 >> 172.21.15.37:0/3598258226 conn(0x7f88d40cb830 msgr2=0x7f88d40cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.838+0000 7f88d8c2e640 1 -- 172.21.15.37:0/3598258226 shutdown_connections 2023-11-24T06:15:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.838+0000 7f88d8c2e640 1 -- 172.21.15.37:0/3598258226 wait complete. 2023-11-24T06:15:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.840+0000 7f88d8c2e640 1 Processor -- start 2023-11-24T06:15:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.840+0000 7f88d8c2e640 1 -- start start 2023-11-24T06:15:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.841+0000 7f88d8c2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d415f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d8c2e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88d4143870 0x7f88d4141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d8c2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88d415fb00 0x7f88d4142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d8c2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d40b2a40 con 0x7f88d40b1180 2023-11-24T06:15:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d8c2e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d4160010 con 0x7f88d4143870 2023-11-24T06:15:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d8c2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d41602f0 con 0x7f88d415fb00 2023-11-24T06:15:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d415f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d415f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39176/0 (socket says 172.21.15.37:39176) 2023-11-24T06:15:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 -- 172.21.15.37:0/2475653751 learned_addr learned my addr 172.21.15.37:0/2475653751 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 -- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88d415fb00 msgr2=0x7f88d4142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88d415fb00 0x7f88d4142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 -- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88d4143870 msgr2=0x7f88d4141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88cbfff640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88d4143870 0x7f88d4141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88d4143870 0x7f88d4141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88d37fe640 1 -- 172.21.15.37:0/2475653751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc009a70 con 0x7f88d40b1180 2023-11-24T06:15:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.842+0000 7f88cbfff640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88d4143870 0x7f88d4141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.843+0000 7f88d37fe640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d415f5c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f88c400c4a0 tx=0x7f88c400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.843+0000 7f88d0ff9640 1 -- 172.21.15.37:0/2475653751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4005ce0 con 0x7f88d40b1180 2023-11-24T06:15:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.843+0000 7f88d0ff9640 1 -- 172.21.15.37:0/2475653751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c4005e40 con 0x7f88d40b1180 2023-11-24T06:15:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.843+0000 7f88d0ff9640 1 -- 172.21.15.37:0/2475653751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4007270 con 0x7f88d40b1180 2023-11-24T06:15:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.843+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d40b2ce0 con 0x7f88d40b1180 2023-11-24T06:15:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.843+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d40ac420 con 0x7f88d40b1180 2023-11-24T06:15:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.845+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d4147000 con 0x7f88d40b1180 2023-11-24T06:15:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.845+0000 7f88d0ff9640 1 -- 172.21.15.37:0/2475653751 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88c4007490 con 0x7f88d40b1180 2023-11-24T06:15:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.846+0000 7f88d0ff9640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f88b406ae40 0x7f88b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.846+0000 7f88d0ff9640 1 -- 172.21.15.37:0/2475653751 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88c4088b70 con 0x7f88d40b1180 2023-11-24T06:15:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.847+0000 7f88cbfff640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f88b406ae40 0x7f88b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.847+0000 7f88cbfff640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f88b406ae40 0x7f88b406d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f88d415d300 tx=0x7f88bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:15.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:15.851+0000 7f88d0ff9640 1 -- 172.21.15.37:0/2475653751 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88c4053c30 con 0x7f88d40b1180 2023-11-24T06:15:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.083+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88d40ce500 con 0x7f88d40b1180 2023-11-24T06:15:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.084+0000 7f88d0ff9640 1 -- 172.21.15.37:0/2475653751 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f88c4017020 con 0x7f88d40b1180 2023-11-24T06:15:16.088 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.086+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f88b406ae40 msgr2=0x7f88b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.086+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f88b406ae40 0x7f88b406d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f88d415d300 tx=0x7f88bc008040 comp rx=0 tx=0).stop 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.086+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 msgr2=0x7f88d415f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.086+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d415f5c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f88c400c4a0 tx=0x7f88c400c960 comp rx=0 tx=0).stop 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 shutdown_connections 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f88b406ae40 0x7f88b406d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88d4143870 0x7f88d4141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88d415fb00 0x7f88d4142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 --2- 172.21.15.37:0/2475653751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d40b1180 0x7f88d415f5c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 >> 172.21.15.37:0/2475653751 conn(0x7f88d40cb830 msgr2=0x7f88d40aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:16.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 shutdown_connections 2023-11-24T06:15:16.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:16.087+0000 7f88d8c2e640 1 -- 172.21.15.37:0/2475653751 wait complete. 2023-11-24T06:15:16.110 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:15:16.110 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:15:16.110 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-11-24T06:15:16.111 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:15:16.111 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:15:16.111 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:15:16.111 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:15:16.111 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:15:16.111 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:15:16.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:16.111 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-11-24T06:15:16.171 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:16.171 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:16.172 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:16.172 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:16.172 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:16.172 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:16.172 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:16.172 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:16.172 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:16.173 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:15:16.174 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42351sec preferred_lft 42351sec 2023-11-24T06:15:16.174 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2023-11-24T06:15:16.174 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:16.175 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:15:16.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:16.175 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:16.175 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:16.175 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:15:16.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr flush dev ceph-brx 2023-11-24T06:15:16.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set ceph-brx up 2023-11-24T06:15:16.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:15:16.176 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:16.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:16.646 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:15:16.732 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-11-24T06:15:16.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:16.735 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-11-24T06:15:16.805 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-11-24T06:15:16.806 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:15:16.806 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:15:16.806 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:15:16.806 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:15:16.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:16.806 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:16.806 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:16.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:15:16.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:15:16.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:15:16.807 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:17.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:17.550 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:15:17.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:17.607 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2023-11-24T06:15:17.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:17.663 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:17.663 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:17.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:15:17.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T06:15:17.663 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:17.802 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T06:15:17.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:17.802 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:17.802 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:17.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T06:15:17.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:15:17.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T06:15:17.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T06:15:17.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T06:15:17.803 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:18.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:18.123 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:18.124 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:18.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2023-11-24T06:15:18.124 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:15:18.124 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:18.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:18.282 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:15:18.327 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:15:18.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:18.328 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:15:18.427 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:15:18.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:18.427 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:18.581 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:18.581 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:19.013 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:15:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with new device syntax: 1@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:15:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:15:19.017 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-24T06:15:19.017 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:15:19.017 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:15:19.017 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:15:19.017 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:15:19.021 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:15:19.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:19.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:15:19.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:19.106 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:19.160 INFO:teuthology.orchestra.run.smithi188.stdout:client4415 2023-11-24T06:15:19.161 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:19.161 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:19.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:19.211 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:19.318 INFO:teuthology.orchestra.run.smithi188.stdout:client4415 2023-11-24T06:15:19.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:19.318 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:19.381 INFO:teuthology.orchestra.run.smithi188.stdout:client4415 2023-11-24T06:15:19.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:19.381 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.client4415/status') 2023-11-24T06:15:19.477 INFO:teuthology.orchestra.run.smithi188.stdout:instance: client.4415 (3)192.168.0.1:0/43910353 2023-11-24T06:15:19.477 INFO:teuthology.orchestra.run.smithi188.stdout:blocklisted: false 2023-11-24T06:15:19.477 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2023-11-24T06:15:19.477 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2023-11-24T06:15:19.477 INFO:teuthology.orchestra.run.smithi188.stderr:67 bytes copied, 7.066e-05 s, 948 kB/s 2023-11-24T06:15:19.481 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-11-24T06:15:19.481 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:15:19.481 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:15:19.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:15:19.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.714+0000 7fb66f007640 1 Processor -- start 2023-11-24T06:15:19.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.714+0000 7fb66f007640 1 -- start start 2023-11-24T06:15:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.716+0000 7fb66f007640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb6680cf450 0x7fb6680cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.716+0000 7fb66f007640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6680cdfb0 0x7fb6680ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.716+0000 7fb66f007640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6680cece0 con 0x7fb66815c7f0 2023-11-24T06:15:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.716+0000 7fb66f007640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6680cfe40 con 0x7fb6680cdfb0 2023-11-24T06:15:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.716+0000 7fb66f007640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb668156010 con 0x7fb6680cf450 2023-11-24T06:15:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.716+0000 7fb66d5a4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6680cdfb0 0x7fb6680ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.716+0000 7fb66d5a4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6680cdfb0 0x7fb6680ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39182/0 (socket says 172.21.15.37:39182) 2023-11-24T06:15:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.717+0000 7fb66d5a4640 1 -- 172.21.15.37:0/1366598176 learned_addr learned my addr 172.21.15.37:0/1366598176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.717+0000 7fb667fff640 1 --2- 172.21.15.37:0/1366598176 >> v2:172.21.15.188:3300/0 conn(0x7fb6680cf450 0x7fb6680cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.717+0000 7fb66d5a4640 1 -- 172.21.15.37:0/1366598176 >> v2:172.21.15.188:3300/0 conn(0x7fb6680cf450 msgr2=0x7fb6680cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.717+0000 7fb66d5a4640 1 --2- 172.21.15.37:0/1366598176 >> v2:172.21.15.188:3300/0 conn(0x7fb6680cf450 0x7fb6680cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.717+0000 7fb66d5a4640 1 -- 172.21.15.37:0/1366598176 >> v1:172.21.15.188:6789/0 conn(0x7fb66815c7f0 legacy=0x7fb66806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.717+0000 7fb66d5a4640 1 -- 172.21.15.37:0/1366598176 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66806d040 con 0x7fb6680cdfb0 2023-11-24T06:15:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.718+0000 7fb66d5a4640 1 --2- 172.21.15.37:0/1366598176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb6680ce3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb668070410 tx=0x7fb66002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c301fc4262ac8cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.719+0000 7fb6677fe640 1 -- 172.21.15.37:0/1366598176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66002cb10 con 0x7fb6680cdfb0 2023-11-24T06:15:19.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.719+0000 7fb6677fe640 1 -- 172.21.15.37:0/1366598176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66002cc70 con 0x7fb6680cdfb0 2023-11-24T06:15:19.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.719+0000 7fb6677fe640 1 -- 172.21.15.37:0/1366598176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6600343f0 con 0x7fb6680cdfb0 2023-11-24T06:15:19.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 -- 172.21.15.37:0/1366598176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 msgr2=0x7fb6680ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:19.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 --2- 172.21.15.37:0/1366598176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb6680ce3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb668070410 tx=0x7fb66002bf70 comp rx=0 tx=0).stop 2023-11-24T06:15:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 -- 172.21.15.37:0/1366598176 shutdown_connections 2023-11-24T06:15:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 --2- 172.21.15.37:0/1366598176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb6680ce3e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 --2- 172.21.15.37:0/1366598176 >> v2:172.21.15.188:3300/0 conn(0x7fb6680cf450 0x7fb6680cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 -- 172.21.15.37:0/1366598176 >> 172.21.15.37:0/1366598176 conn(0x7fb66806a920 msgr2=0x7fb66806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 -- 172.21.15.37:0/1366598176 shutdown_connections 2023-11-24T06:15:19.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.720+0000 7fb66f007640 1 -- 172.21.15.37:0/1366598176 wait complete. 2023-11-24T06:15:19.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.722+0000 7fb66f007640 1 Processor -- start 2023-11-24T06:15:19.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.722+0000 7fb66f007640 1 -- start start 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66f007640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb668158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66f007640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6680cf450 0x7fb66814b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66f007640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb66815c7f0 0x7fb66815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66f007640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680ac440 con 0x7fb6680cdfb0 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66f007640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb668158b00 con 0x7fb6680cf450 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66f007640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb668158de0 con 0x7fb66815c7f0 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66cda3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb668158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66cda3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb668158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39192/0 (socket says 172.21.15.37:39192) 2023-11-24T06:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb66cda3640 1 -- 172.21.15.37:0/1189690475 learned_addr learned my addr 172.21.15.37:0/1189690475 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.723+0000 7fb667fff640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6680cf450 0x7fb66814b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66cda3640 1 -- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb66815c7f0 msgr2=0x7fb66815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66d5a4640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb66815c7f0 0x7fb66815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66cda3640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb66815c7f0 0x7fb66815eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66cda3640 1 -- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6680cf450 msgr2=0x7fb66814b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66cda3640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6680cf450 0x7fb66814b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66cda3640 1 -- 172.21.15.37:0/1189690475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660009b30 con 0x7fb6680cdfb0 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb667fff640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6680cf450 0x7fb66814b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66cda3640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb668158220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c400 tx=0x7fb65c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb6657fa640 1 -- 172.21.15.37:0/1189690475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0052d0 con 0x7fb6680cdfb0 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb6657fa640 1 -- 172.21.15.37:0/1189690475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c005430 con 0x7fb6680cdfb0 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb6657fa640 1 -- 172.21.15.37:0/1189690475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c003830 con 0x7fb6680cdfb0 2023-11-24T06:15:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6681590c0 con 0x7fb6680cdfb0 2023-11-24T06:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.724+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb668158760 con 0x7fb6680cdfb0 2023-11-24T06:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.726+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb668067470 con 0x7fb6680cdfb0 2023-11-24T06:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.727+0000 7fb6657fa640 1 -- 172.21.15.37:0/1189690475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb65c003990 con 0x7fb6680cdfb0 2023-11-24T06:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.728+0000 7fb6657fa640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb64c06ae40 0x7fb64c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.728+0000 7fb6657fa640 1 -- 172.21.15.37:0/1189690475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb65c088b90 con 0x7fb6680cdfb0 2023-11-24T06:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.728+0000 7fb667fff640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb64c06ae40 0x7fb64c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.729+0000 7fb667fff640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb64c06ae40 0x7fb64c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb668159380 tx=0x7fb654008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:19.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.732+0000 7fb6657fa640 1 -- 172.21.15.37:0/1189690475 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb65c053c40 con 0x7fb6680cdfb0 2023-11-24T06:15:19.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.965+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb6680cd730 con 0x7fb6680cdfb0 2023-11-24T06:15:19.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.966+0000 7fb6657fa640 1 -- 172.21.15.37:0/1189690475 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb65c017070 con 0x7fb6680cdfb0 2023-11-24T06:15:19.968 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:15:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb64c06ae40 msgr2=0x7fb64c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb64c06ae40 0x7fb64c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb668159380 tx=0x7fb654008040 comp rx=0 tx=0).stop 2023-11-24T06:15:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 msgr2=0x7fb668158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb668158220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c400 tx=0x7fb65c00c8c0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 shutdown_connections 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb64c06ae40 0x7fb64c06d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6680cf450 0x7fb66814b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb66815c7f0 0x7fb66815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 --2- 172.21.15.37:0/1189690475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6680cdfb0 0x7fb668158220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.968+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 >> 172.21.15.37:0/1189690475 conn(0x7fb66806a920 msgr2=0x7fb668155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.969+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 shutdown_connections 2023-11-24T06:15:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:19.969+0000 7fb66f007640 1 -- 172.21.15.37:0/1189690475 wait complete. 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:15:19.988 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:15:19.989 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:15:19.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:19.989 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2023-11-24T06:15:20.050 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.051 INFO:teuthology.orchestra.run.smithi188.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9460:4eff:fe42:69c0/64 scope link 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::88b7:c8ff:fef4:7a4d/64 scope link tentative 2023-11-24T06:15:20.052 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.053 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:15:20.148 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-11-24T06:15:20.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.152 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-11-24T06:15:20.206 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-11-24T06:15:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:15:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:15:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:15:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:15:20.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.208 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:20.208 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:20.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:15:20.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:15:20.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:15:20.208 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:20.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.385 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:15:20.438 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:15:20.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.439 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2023-11-24T06:15:20.488 INFO:teuthology.orchestra.run.smithi188.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T06:15:20.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.489 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:20.489 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:20.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:15:20.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T06:15:20.489 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:20.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.625 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:15:20.708 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:20.708 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:20.708 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:20.708 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.708 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:20.709 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.709 INFO:teuthology.orchestra.run.smithi188.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:15:20.709 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether be:35:c2:16:9d:09 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:15:20.709 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:15:20.709 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.709 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::bc35:c2ff:fe16:9d09/64 scope link 2023-11-24T06:15:20.709 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.711 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether be:35:c2:16:9d:09 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:15:20.793 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:15:20.794 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.794 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::bc35:c2ff:fe16:9d09/64 scope link 2023-11-24T06:15:20.794 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:15:20.796 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T06:15:20.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:20.796 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:20.797 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:20.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T06:15:20.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:15:20.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T06:15:20.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T06:15:20.797 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T06:15:20.797 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:21.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:21.066 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:15:21.066 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:15:21.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.1 up 2023-11-24T06:15:21.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:15:21.066 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:15:21.234 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:21.234 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T06:15:21.280 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:15:21.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:15:21.281 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:15:21.379 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-11-24T06:15:21.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:21.379 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:21.527 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:21.527 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:21.561 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:15:21.561 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:15:21.562 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:15:21.562 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with new device syntax: 3@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:15:21.562 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:15:21.563 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-11-24T06:15:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:15:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:15:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:15:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:15:21.567 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:15:21.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:21.568 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:15:21.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:21.655 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:21.711 INFO:teuthology.orchestra.run.smithi188.stdout:client4540 2023-11-24T06:15:21.711 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:21.712 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:21.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:21.759 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:21.860 INFO:teuthology.orchestra.run.smithi188.stdout:client4540 2023-11-24T06:15:21.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:21.860 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:15:21.917 INFO:teuthology.orchestra.run.smithi188.stdout:client4540 2023-11-24T06:15:21.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:21.917 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.client4540/status') 2023-11-24T06:15:22.005 INFO:teuthology.orchestra.run.smithi188.stdout:instance: client.4540 (3)192.168.0.2:0/4176226560 2023-11-24T06:15:22.005 INFO:teuthology.orchestra.run.smithi188.stdout:blocklisted: false 2023-11-24T06:15:22.005 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2023-11-24T06:15:22.006 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2023-11-24T06:15:22.006 INFO:teuthology.orchestra.run.smithi188.stderr:69 bytes copied, 7.5761e-05 s, 911 kB/s 2023-11-24T06:15:22.009 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T06:15:22.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.269+0000 7fe00d333640 1 Processor -- start 2023-11-24T06:15:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.270+0000 7fe00d333640 1 -- start start 2023-11-24T06:15:22.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.272+0000 7fe00d333640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0080ae4b0 0x7fe00815b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.272+0000 7fe00d333640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080ad010 con 0x7fe0081549f0 2023-11-24T06:15:22.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.272+0000 7fe00d333640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080acd20 con 0x7fe00815a800 2023-11-24T06:15:22.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.272+0000 7fe00d333640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0080b39c0 con 0x7fe0080ae4b0 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.272+0000 7fe006ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0081549f0 0x7fe0080b28f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42264/0 (socket says 172.21.15.37:42264) 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.272+0000 7fe006ffd640 1 -- 172.21.15.37:0/3936890050 learned_addr learned my addr 172.21.15.37:0/3936890050 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130945174 0 0) 0x7fe0080ad010 con 0x7fe0081549f0 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff4005730 con 0x7fe0081549f0 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0077fe640 1 --2- 172.21.15.37:0/3936890050 >> v2:172.21.15.188:3300/0 conn(0x7fe0080ae4b0 0x7fe00815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 474738141 0 0) 0x7fdff4005730 con 0x7fe0081549f0 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 >> v2:172.21.15.188:3300/0 conn(0x7fe0080ae4b0 msgr2=0x7fe00815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 --2- 172.21.15.37:0/3936890050 >> v2:172.21.15.188:3300/0 conn(0x7fe0080ae4b0 0x7fe00815b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 >> v1:172.21.15.188:6789/0 conn(0x7fe00815a800 legacy=0x7fe00815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080b3120 con 0x7fe0081549f0 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fdff8001670 con 0x7fe0081549f0 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 >> v1:172.21.15.37:6789/0 conn(0x7fe0081549f0 legacy=0x7fe0080b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff4005bd0 0x7fdff4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.273+0000 7fe0067fc640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff40069d0 0x7fdff4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fe0067fc640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40074b0 0x7fdff400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080b39c0 con 0x7fdff40069d0 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff400e3d0 con 0x7fdff40074b0 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff400e590 con 0x7fdff4005bd0 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fdffe7fc640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff40069d0 0x7fdff4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fe0077fe640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40074b0 0x7fdff400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fe006ffd640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff4005bd0 0x7fdff4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fdffe7fc640 1 -- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff4005bd0 msgr2=0x7fdff4005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fdffe7fc640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff4005bd0 0x7fdff4005ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fdffe7fc640 1 -- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40074b0 msgr2=0x7fdff400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fdffe7fc640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40074b0 0x7fdff400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fdffe7fc640 1 -- 172.21.15.37:0/3936890050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4005730 con 0x7fdff40069d0 2023-11-24T06:15:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.274+0000 7fe0077fe640 1 -- 172.21.15.37:0/3936890050 reap_dead start 2023-11-24T06:15:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.275+0000 7fdffe7fc640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff40069d0 0x7fdff4006e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdff0001750 tx=0x7fdff4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcda006de53fdcd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00052d0 con 0x7fdff40069d0 2023-11-24T06:15:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff002e050 con 0x7fdff40069d0 2023-11-24T06:15:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe0067fc640 1 -- 172.21.15.37:0/3936890050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0003830 con 0x7fdff40069d0 2023-11-24T06:15:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe00d333640 1 -- 172.21.15.37:0/3936890050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff40069d0 msgr2=0x7fdff4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe00d333640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff40069d0 0x7fdff4006e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdff0001750 tx=0x7fdff4007a00 comp rx=0 tx=0).stop 2023-11-24T06:15:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe00d333640 1 -- 172.21.15.37:0/3936890050 shutdown_connections 2023-11-24T06:15:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe00d333640 1 --2- 172.21.15.37:0/3936890050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff40069d0 0x7fdff4006e50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.276+0000 7fe00d333640 1 -- 172.21.15.37:0/3936890050 >> 172.21.15.37:0/3936890050 conn(0x7fe0080b0be0 msgr2=0x7fe0080b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.277+0000 7fe00d333640 1 -- 172.21.15.37:0/3936890050 shutdown_connections 2023-11-24T06:15:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.277+0000 7fe00d333640 1 -- 172.21.15.37:0/3936890050 wait complete. 2023-11-24T06:15:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.278+0000 7fe00d333640 1 Processor -- start 2023-11-24T06:15:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.279+0000 7fe00d333640 1 -- start start 2023-11-24T06:15:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe00d333640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff40069d0 0x7fe00813bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe00d333640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe00813b420 0x7fe00814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe00d333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00809a790 0x7fe00809ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe00d333640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00814f6f0 con 0x7fe00809a790 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe00d333640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00809a300 con 0x7fe00813b420 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe00d333640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00813b8a0 con 0x7fdff40069d0 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe0077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00809a790 0x7fe00809ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe0077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00809a790 0x7fe00809ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47214/0 (socket says 172.21.15.37:47214) 2023-11-24T06:15:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe0077fe640 1 -- 172.21.15.37:0/157876870 learned_addr learned my addr 172.21.15.37:0/157876870 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fe006ffd640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff40069d0 0x7fe00813bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.280+0000 7fdffe7fc640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe00813b420 0x7fe00814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fe0077fe640 1 -- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff40069d0 msgr2=0x7fe00813bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fe0077fe640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff40069d0 0x7fe00813bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fe0077fe640 1 -- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe00813b420 msgr2=0x7fe00814cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fe0077fe640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe00813b420 0x7fe00814cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fe0077fe640 1 -- 172.21.15.37:0/157876870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00814f940 con 0x7fe00809a790 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fe0077fe640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00809a790 0x7fe00809ac10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe00806e040 tx=0x7fe000009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fdffffff640 1 -- 172.21.15.37:0/157876870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000007cf0 con 0x7fe00809a790 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fdffffff640 1 -- 172.21.15.37:0/157876870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000f050 con 0x7fe00809a790 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fdffffff640 1 -- 172.21.15.37:0/157876870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000014650 con 0x7fe00809a790 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.281+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0080999d0 con 0x7fe00809a790 2023-11-24T06:15:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.282+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe008099f90 con 0x7fe00809a790 2023-11-24T06:15:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.283+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00809a120 con 0x7fe00809a790 2023-11-24T06:15:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.284+0000 7fdffffff640 1 -- 172.21.15.37:0/157876870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0000147b0 con 0x7fe00809a790 2023-11-24T06:15:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.285+0000 7fdffffff640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdfe806ae70 0x7fdfe806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.285+0000 7fdffffff640 1 -- 172.21.15.37:0/157876870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe000089ba0 con 0x7fe00809a790 2023-11-24T06:15:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.285+0000 7fe006ffd640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdfe806ae70 0x7fdfe806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.286+0000 7fe006ffd640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdfe806ae70 0x7fdfe806d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe00814f470 tx=0x7fdff8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.290+0000 7fdffffff640 1 -- 172.21.15.37:0/157876870 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe000054c40 con 0x7fe00809a790 2023-11-24T06:15:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.486+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe00804e840 con 0x7fe00809a790 2023-11-24T06:15:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.488+0000 7fdffffff640 1 -- 172.21.15.37:0/157876870 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fe000058260 con 0x7fe00809a790 2023-11-24T06:15:22.491 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdfe806ae70 msgr2=0x7fdfe806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdfe806ae70 0x7fdfe806d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe00814f470 tx=0x7fdff8009040 comp rx=0 tx=0).stop 2023-11-24T06:15:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00809a790 msgr2=0x7fe00809ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00809a790 0x7fe00809ac10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe00806e040 tx=0x7fe000009cd0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 shutdown_connections 2023-11-24T06:15:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdfe806ae70 0x7fdfe806d330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe00813b420 0x7fe00814cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00809a790 0x7fe00809ac10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 --2- 172.21.15.37:0/157876870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff40069d0 0x7fe00813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.490+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 >> 172.21.15.37:0/157876870 conn(0x7fe0080b0be0 msgr2=0x7fe00806cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.491+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 shutdown_connections 2023-11-24T06:15:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.491+0000 7fe00d333640 1 -- 172.21.15.37:0/157876870 wait complete. 2023-11-24T06:15:22.513 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:22.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.752+0000 7fdddb59e640 1 Processor -- start 2023-11-24T06:15:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.752+0000 7fdddb59e640 1 -- start start 2023-11-24T06:15:22.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.753+0000 7fdddb59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.753+0000 7fdddb59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdddc0cce40 0x7fdddc0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.753+0000 7fdddb59e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0b14a0 con 0x7fdddc15d310 2023-11-24T06:15:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fdddb59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc06cd10 con 0x7fdddc0cce40 2023-11-24T06:15:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fdddb59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0ae5d0 con 0x7fdddc0b0b40 2023-11-24T06:15:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fdddad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdddc0cce40 0x7fdddc0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fdddad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdddc0cce40 0x7fdddc0cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47220/0 (socket says 172.21.15.37:47220) 2023-11-24T06:15:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fdddad9d640 1 -- 172.21.15.37:0/3604473845 learned_addr learned my addr 172.21.15.37:0/3604473845 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fddd9d9b640 1 --2- 172.21.15.37:0/3604473845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fdddad9d640 1 -- 172.21.15.37:0/3604473845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 msgr2=0x7fdddc0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.754+0000 7fdddad9d640 1 --2- 172.21.15.37:0/3604473845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.755+0000 7fdddad9d640 1 -- 172.21.15.37:0/3604473845 >> v1:172.21.15.188:6789/0 conn(0x7fdddc15d310 legacy=0x7fdddc0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.755+0000 7fdddad9d640 1 -- 172.21.15.37:0/3604473845 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0ae8b0 con 0x7fdddc0cce40 2023-11-24T06:15:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.756+0000 7fdddad9d640 1 --2- 172.21.15.37:0/3604473845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0cd2a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009e50 tx=0x7fddd402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85134e7ed8c1c01c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.756+0000 7fddd959a640 1 -- 172.21.15.37:0/3604473845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd402ca70 con 0x7fdddc0cce40 2023-11-24T06:15:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.756+0000 7fddd959a640 1 -- 172.21.15.37:0/3604473845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd402cbd0 con 0x7fdddc0cce40 2023-11-24T06:15:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.756+0000 7fddd959a640 1 -- 172.21.15.37:0/3604473845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40343f0 con 0x7fdddc0cce40 2023-11-24T06:15:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 -- 172.21.15.37:0/3604473845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 msgr2=0x7fdddc0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 --2- 172.21.15.37:0/3604473845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0cd2a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009e50 tx=0x7fddd402bed0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 -- 172.21.15.37:0/3604473845 shutdown_connections 2023-11-24T06:15:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 --2- 172.21.15.37:0/3604473845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0cd2a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 --2- 172.21.15.37:0/3604473845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 -- 172.21.15.37:0/3604473845 >> 172.21.15.37:0/3604473845 conn(0x7fdddc0cbb40 msgr2=0x7fdddc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 -- 172.21.15.37:0/3604473845 shutdown_connections 2023-11-24T06:15:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.757+0000 7fdddb59e640 1 -- 172.21.15.37:0/3604473845 wait complete. 2023-11-24T06:15:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.759+0000 7fdddb59e640 1 Processor -- start 2023-11-24T06:15:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.759+0000 7fdddb59e640 1 -- start start 2023-11-24T06:15:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fdddb59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fdddb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fdddb59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc15d310 0x7fdddc0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fdddb59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0c9090 con 0x7fdddc0cce40 2023-11-24T06:15:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fdddb59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc146800 con 0x7fdddc15d310 2023-11-24T06:15:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fdddb59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0c5350 con 0x7fdddc0b0b40 2023-11-24T06:15:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fddd9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fddd9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47222/0 (socket says 172.21.15.37:47222) 2023-11-24T06:15:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.760+0000 7fddd9d9b640 1 -- 172.21.15.37:0/4139342143 learned_addr learned my addr 172.21.15.37:0/4139342143 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddda59c640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd9d9b640 1 -- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 msgr2=0x7fdddc1462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fdddad9d640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc15d310 0x7fdddc0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd9d9b640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc1462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd9d9b640 1 -- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc15d310 msgr2=0x7fdddc0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd9d9b640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc15d310 0x7fdddc0b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd9d9b640 1 -- 172.21.15.37:0/4139342143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4009b30 con 0x7fdddc0cce40 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddda59c640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd9d9b640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0b2ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fddc400d800 tx=0x7fddc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd2ffd640 1 -- 172.21.15.37:0/4139342143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400b660 con 0x7fdddc0cce40 2023-11-24T06:15:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd2ffd640 1 -- 172.21.15.37:0/4139342143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400b7c0 con 0x7fdddc0cce40 2023-11-24T06:15:22.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fddd2ffd640 1 -- 172.21.15.37:0/4139342143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400bb50 con 0x7fdddc0cce40 2023-11-24T06:15:22.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.761+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc146a10 con 0x7fdddc0cce40 2023-11-24T06:15:22.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.762+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc0c5860 con 0x7fdddc0cce40 2023-11-24T06:15:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.763+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04e840 con 0x7fdddc0cce40 2023-11-24T06:15:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.764+0000 7fddd2ffd640 1 -- 172.21.15.37:0/4139342143 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fddc400bcb0 con 0x7fdddc0cce40 2023-11-24T06:15:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.765+0000 7fddd2ffd640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fddbc06ae40 0x7fddbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.765+0000 7fddd2ffd640 1 -- 172.21.15.37:0/4139342143 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddc4089bd0 con 0x7fdddc0cce40 2023-11-24T06:15:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.765+0000 7fddda59c640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fddbc06ae40 0x7fddbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.766+0000 7fddda59c640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fddbc06ae40 0x7fddbc06d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00a830 tx=0x7fddcc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.770+0000 7fddd2ffd640 1 -- 172.21.15.37:0/4139342143 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fddc4054be0 con 0x7fdddc0cce40 2023-11-24T06:15:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.962+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdddc0cb2a0 con 0x7fdddc0cce40 2023-11-24T06:15:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.963+0000 7fddd2ffd640 1 -- 172.21.15.37:0/4139342143 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddc4058200 con 0x7fdddc0cce40 2023-11-24T06:15:22.966 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.965+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fddbc06ae40 msgr2=0x7fddbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.965+0000 7fdddb59e640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fddbc06ae40 0x7fddbc06d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00a830 tx=0x7fddcc008040 comp rx=0 tx=0).stop 2023-11-24T06:15:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 msgr2=0x7fdddc0b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0b2ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fddc400d800 tx=0x7fddc400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 shutdown_connections 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fddbc06ae40 0x7fddbc06d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdddc15d310 0x7fdddc0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdddc0cce40 0x7fdddc0b2ee0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 --2- 172.21.15.37:0/4139342143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdddc0b0b40 0x7fdddc1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 >> 172.21.15.37:0/4139342143 conn(0x7fdddc0cbb40 msgr2=0x7fdddc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:22.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 shutdown_connections 2023-11-24T06:15:22.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:22.966+0000 7fdddb59e640 1 -- 172.21.15.37:0/4139342143 wait complete. 2023-11-24T06:15:22.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:23.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.210+0000 7fa1c1f97640 1 Processor -- start 2023-11-24T06:15:23.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.210+0000 7fa1c1f97640 1 -- start start 2023-11-24T06:15:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.211+0000 7fa1c1f97640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1bc13e3e0 0x7fa1bc0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.211+0000 7fa1c1f97640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa1bc13ea00 0x7fa1bc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.211+0000 7fa1c1f97640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc0cf320 0x7fa1bc0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.211+0000 7fa1c1f97640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc13e7c0 con 0x7fa1bc13e3e0 2023-11-24T06:15:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.211+0000 7fa1c1f97640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0cf7d0 con 0x7fa1bc13ea00 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.211+0000 7fa1c1f97640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc15b810 con 0x7fa1bc0cf320 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1bc13e3e0 0x7fa1bc0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1bc13e3e0 0x7fa1bc0ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47226/0 (socket says 172.21.15.37:47226) 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 -- 172.21.15.37:0/2853308817 learned_addr learned my addr 172.21.15.37:0/2853308817 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bbfff640 1 --2- 172.21.15.37:0/2853308817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc0cf320 0x7fa1bc0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 -- 172.21.15.37:0/2853308817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc0cf320 msgr2=0x7fa1bc0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 --2- 172.21.15.37:0/2853308817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc0cf320 0x7fa1bc0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 -- 172.21.15.37:0/2853308817 >> v2:172.21.15.188:3300/0 conn(0x7fa1bc13ea00 msgr2=0x7fa1bc0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 --2- 172.21.15.37:0/2853308817 >> v2:172.21.15.188:3300/0 conn(0x7fa1bc13ea00 0x7fa1bc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.212+0000 7fa1bb7fe640 1 -- 172.21.15.37:0/2853308817 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc15c630 con 0x7fa1bc13e3e0 2023-11-24T06:15:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.213+0000 7fa1bb7fe640 1 --2- 172.21.15.37:0/2853308817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13e3e0 0x7fa1bc0ce3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac009870 tx=0x7fa1ac02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9706dc8c2b0b492 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.214+0000 7fa1baffd640 1 -- 172.21.15.37:0/2853308817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0317c0 con 0x7fa1bc13e3e0 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.214+0000 7fa1baffd640 1 -- 172.21.15.37:0/2853308817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac031920 con 0x7fa1bc13e3e0 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.214+0000 7fa1baffd640 1 -- 172.21.15.37:0/2853308817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac031cb0 con 0x7fa1bc13e3e0 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.214+0000 7fa1c1f97640 1 -- 172.21.15.37:0/2853308817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13e3e0 msgr2=0x7fa1bc0ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/2853308817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13e3e0 0x7fa1bc0ce3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac009870 tx=0x7fa1ac02b860 comp rx=0 tx=0).stop 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 -- 172.21.15.37:0/2853308817 shutdown_connections 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/2853308817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc0cf320 0x7fa1bc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/2853308817 >> v2:172.21.15.188:3300/0 conn(0x7fa1bc13ea00 0x7fa1bc0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/2853308817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13e3e0 0x7fa1bc0ce3e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 -- 172.21.15.37:0/2853308817 >> 172.21.15.37:0/2853308817 conn(0x7fa1bc0b2e40 msgr2=0x7fa1bc0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 -- 172.21.15.37:0/2853308817 shutdown_connections 2023-11-24T06:15:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.215+0000 7fa1c1f97640 1 -- 172.21.15.37:0/2853308817 wait complete. 2023-11-24T06:15:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.217+0000 7fa1c1f97640 1 Processor -- start 2023-11-24T06:15:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.218+0000 7fa1c1f97640 1 -- start start 2023-11-24T06:15:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.219+0000 7fa1c1f97640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1bc0cf320 0x7fa1bc154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.219+0000 7fa1c1f97640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc13e3e0 0x7fa1bc06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.219+0000 7fa1c1f97640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13ea00 0x7fa1bc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.219+0000 7fa1c1f97640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc06b6b0 con 0x7fa1bc13ea00 2023-11-24T06:15:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.219+0000 7fa1c1f97640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc154e90 con 0x7fa1bc0cf320 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.219+0000 7fa1c1f97640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc06b950 con 0x7fa1bc13e3e0 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.219+0000 7fa1bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13ea00 0x7fa1bc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13ea00 0x7fa1bc06d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47240/0 (socket says 172.21.15.37:47240) 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 -- 172.21.15.37:0/1936018671 learned_addr learned my addr 172.21.15.37:0/1936018671 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1b3fff640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc13e3e0 0x7fa1bc06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 -- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc13e3e0 msgr2=0x7fa1bc06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc13e3e0 0x7fa1bc06cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bb7fe640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1bc0cf320 0x7fa1bc154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 -- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1bc0cf320 msgr2=0x7fa1bc154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1bc0cf320 0x7fa1bc154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 -- 172.21.15.37:0/1936018671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0094d0 con 0x7fa1bc13ea00 2023-11-24T06:15:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1b3fff640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc13e3e0 0x7fa1bc06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.220+0000 7fa1bbfff640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13ea00 0x7fa1bc06d150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400cc30 tx=0x7fa1b400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.221+0000 7fa1b8ff9640 1 -- 172.21.15.37:0/1936018671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400ce40 con 0x7fa1bc13ea00 2023-11-24T06:15:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.221+0000 7fa1b8ff9640 1 -- 172.21.15.37:0/1936018671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4003990 con 0x7fa1bc13ea00 2023-11-24T06:15:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.221+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc06bc30 con 0x7fa1bc13ea00 2023-11-24T06:15:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.221+0000 7fa1b8ff9640 1 -- 172.21.15.37:0/1936018671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4003d20 con 0x7fa1bc13ea00 2023-11-24T06:15:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.221+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc06c1f0 con 0x7fa1bc13ea00 2023-11-24T06:15:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.222+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc06c3e0 con 0x7fa1bc13ea00 2023-11-24T06:15:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.223+0000 7fa1b8ff9640 1 -- 172.21.15.37:0/1936018671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1b4003e80 con 0x7fa1bc13ea00 2023-11-24T06:15:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.224+0000 7fa1b8ff9640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa19c06ae40 0x7fa19c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.224+0000 7fa1b8ff9640 1 -- 172.21.15.37:0/1936018671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1b4089a50 con 0x7fa1bc13ea00 2023-11-24T06:15:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.225+0000 7fa1bb7fe640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa19c06ae40 0x7fa19c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.226+0000 7fa1bb7fe640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa19c06ae40 0x7fa19c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac036000 tx=0x7fa1ac03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.229+0000 7fa1b8ff9640 1 -- 172.21.15.37:0/1936018671 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1b4054af0 con 0x7fa1bc13ea00 2023-11-24T06:15:23.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.422+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1bc04e8b0 con 0x7fa1bc13ea00 2023-11-24T06:15:23.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.423+0000 7fa1b8ff9640 1 -- 172.21.15.37:0/1936018671 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1b401d020 con 0x7fa1bc13ea00 2023-11-24T06:15:23.426 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa19c06ae40 msgr2=0x7fa19c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa19c06ae40 0x7fa19c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac036000 tx=0x7fa1ac03d040 comp rx=0 tx=0).stop 2023-11-24T06:15:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13ea00 msgr2=0x7fa1bc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13ea00 0x7fa1bc06d150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400cc30 tx=0x7fa1b400a5c0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 shutdown_connections 2023-11-24T06:15:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa19c06ae40 0x7fa19c06d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1bc13ea00 0x7fa1bc06d150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1bc13e3e0 0x7fa1bc06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 --2- 172.21.15.37:0/1936018671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1bc0cf320 0x7fa1bc154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 >> 172.21.15.37:0/1936018671 conn(0x7fa1bc0b2e40 msgr2=0x7fa1bc0703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 shutdown_connections 2023-11-24T06:15:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.426+0000 7fa1c1f97640 1 -- 172.21.15.37:0/1936018671 wait complete. 2023-11-24T06:15:23.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:23.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.677+0000 7f0b1ad48640 1 Processor -- start 2023-11-24T06:15:23.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.678+0000 7f0b1ad48640 1 -- start start 2023-11-24T06:15:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.679+0000 7f0b1ad48640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 0x7f0b140cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.679+0000 7f0b1ad48640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0b140d0a00 0x7f0b1406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.679+0000 7f0b1ad48640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140cc170 con 0x7f0b140b40d0 2023-11-24T06:15:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.679+0000 7f0b1ad48640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b14070870 con 0x7f0b140d0a00 2023-11-24T06:15:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.679+0000 7f0b1ad48640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14070b50 con 0x7f0b140cb850 2023-11-24T06:15:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b192e5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b140b40d0 0x7f0b140cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42278/0 (socket says 172.21.15.37:42278) 2023-11-24T06:15:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b192e5640 1 -- 172.21.15.37:0/108873354 learned_addr learned my addr 172.21.15.37:0/108873354 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b18ae4640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 0x7f0b140cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b13fff640 1 --2- 172.21.15.37:0/108873354 >> v2:172.21.15.188:3300/0 conn(0x7f0b140d0a00 0x7f0b1406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247913448 0 0) 0x7f0b140cc170 con 0x7f0b140b40d0 2023-11-24T06:15:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b04003520 con 0x7f0b140b40d0 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737957370 0 0) 0x7f0b04003520 con 0x7f0b140b40d0 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 msgr2=0x7f0b140cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.680+0000 7f0b137fe640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 0x7f0b140cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 >> v2:172.21.15.188:3300/0 conn(0x7f0b140d0a00 msgr2=0x7f0b1406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 --2- 172.21.15.37:0/108873354 >> v2:172.21.15.188:3300/0 conn(0x7f0b140d0a00 0x7f0b1406ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b14070e30 con 0x7f0b140b40d0 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f0b0c0019f0 con 0x7f0b140b40d0 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 >> v1:172.21.15.37:6789/0 conn(0x7f0b140b40d0 legacy=0x7f0b140cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 0x7f0b04003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04003f40 0x7f0b040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b04004d00 0x7f0b04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14070870 con 0x7f0b04004d00 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14070b50 con 0x7f0b04003f40 2023-11-24T06:15:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0400bae0 con 0x7f0b140cb850 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b13fff640 1 --2- 172.21.15.37:0/108873354 >> v2:172.21.15.188:3300/0 conn(0x7f0b140d0a00 0x7f0b1406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.681+0000 7f0b192e5640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b04004d00 0x7f0b04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.682+0000 7f0b18ae4640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 0x7f0b04003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.682+0000 7f0b192e5640 1 -- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 msgr2=0x7f0b04003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.682+0000 7f0b192e5640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140cb850 0x7f0b04003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.682+0000 7f0b192e5640 1 -- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04003f40 msgr2=0x7f0b040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.682+0000 7f0b192e5640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04003f40 0x7f0b040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.682+0000 7f0b192e5640 1 -- 172.21.15.37:0/108873354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04003520 con 0x7f0b04004d00 2023-11-24T06:15:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.683+0000 7f0b192e5640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b04004d00 0x7f0b04005180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a790 tx=0x7f0b040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e91fce2aa9cbaa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.683+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c034630 con 0x7f0b04004d00 2023-11-24T06:15:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.683+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c02f070 con 0x7f0b04004d00 2023-11-24T06:15:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.683+0000 7f0b137fe640 1 -- 172.21.15.37:0/108873354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c034a50 con 0x7f0b04004d00 2023-11-24T06:15:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.684+0000 7f0b1ad48640 1 -- 172.21.15.37:0/108873354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b04004d00 msgr2=0x7f0b04005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.684+0000 7f0b1ad48640 1 --2- 172.21.15.37:0/108873354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b04004d00 0x7f0b04005180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a790 tx=0x7f0b040057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.684+0000 7f0b192e5640 1 -- 172.21.15.37:0/108873354 reap_dead start 2023-11-24T06:15:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.684+0000 7f0b1ad48640 1 -- 172.21.15.37:0/108873354 shutdown_connections 2023-11-24T06:15:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.684+0000 7f0b1ad48640 1 -- 172.21.15.37:0/108873354 >> 172.21.15.37:0/108873354 conn(0x7f0b1406e7d0 msgr2=0x7f0b1406ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.684+0000 7f0b1ad48640 1 -- 172.21.15.37:0/108873354 shutdown_connections 2023-11-24T06:15:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.684+0000 7f0b1ad48640 1 -- 172.21.15.37:0/108873354 wait complete. 2023-11-24T06:15:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.686+0000 7f0b1ad48640 1 Processor -- start 2023-11-24T06:15:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.686+0000 7f0b1ad48640 1 -- start start 2023-11-24T06:15:23.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b1ad48640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04004d00 0x7f0b140af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b1ad48640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140c4d30 0x7f0b1414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b1ad48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1415c330 0x7f0b1415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b1ad48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1414ec00 con 0x7f0b1415c330 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b1ad48640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140c5210 con 0x7f0b04004d00 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b1ad48640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140c54f0 con 0x7f0b140c4d30 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b192e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1415c330 0x7f0b1415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b192e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1415c330 0x7f0b1415c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47272/0 (socket says 172.21.15.37:47272) 2023-11-24T06:15:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b192e5640 1 -- 172.21.15.37:0/2612227610 learned_addr learned my addr 172.21.15.37:0/2612227610 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:23.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b13fff640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140c4d30 0x7f0b1414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.687+0000 7f0b18ae4640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04004d00 0x7f0b140af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b192e5640 1 -- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140c4d30 msgr2=0x7f0b1414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b192e5640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140c4d30 0x7f0b1414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b192e5640 1 -- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04004d00 msgr2=0x7f0b140af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b192e5640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04004d00 0x7f0b140af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b192e5640 1 -- 172.21.15.37:0/2612227610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140c57d0 con 0x7f0b1415c330 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b18ae4640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04004d00 0x7f0b140af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b192e5640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1415c330 0x7f0b1415c7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a8b0 tx=0x7f0b0c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b117fa640 1 -- 172.21.15.37:0/2612227610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c034c40 con 0x7f0b1415c330 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b117fa640 1 -- 172.21.15.37:0/2612227610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c034da0 con 0x7f0b1415c330 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b117fa640 1 -- 172.21.15.37:0/2612227610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c034650 con 0x7f0b1415c330 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b140c5ab0 con 0x7f0b1415c330 2023-11-24T06:15:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.688+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b14158f20 con 0x7f0b1415c330 2023-11-24T06:15:23.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.690+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b140c5fd0 con 0x7f0b1415c330 2023-11-24T06:15:23.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.690+0000 7f0b117fa640 1 -- 172.21.15.37:0/2612227610 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b0c031030 con 0x7f0b1415c330 2023-11-24T06:15:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.691+0000 7f0b117fa640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0af806ae70 0x7f0af806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.692+0000 7f0b117fa640 1 -- 172.21.15.37:0/2612227610 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b0c0ab990 con 0x7f0b1415c330 2023-11-24T06:15:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.692+0000 7f0b18ae4640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0af806ae70 0x7f0af806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.692+0000 7f0b18ae4640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0af806ae70 0x7f0af806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009980 tx=0x7f0b08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.696+0000 7f0b117fa640 1 -- 172.21.15.37:0/2612227610 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b140c5fd0 con 0x7f0b1415c330 2023-11-24T06:15:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.893+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b140c5fd0 con 0x7f0b1415c330 2023-11-24T06:15:23.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.894+0000 7f0b117fa640 1 -- 172.21.15.37:0/2612227610 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b140c5fd0 con 0x7f0b1415c330 2023-11-24T06:15:23.897 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.896+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0af806ae70 msgr2=0x7f0af806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.896+0000 7f0b1ad48640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0af806ae70 0x7f0af806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009980 tx=0x7f0b08008040 comp rx=0 tx=0).stop 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1415c330 msgr2=0x7f0b1415c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1415c330 0x7f0b1415c7c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00a8b0 tx=0x7f0b0c001cb0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 shutdown_connections 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0af806ae70 0x7f0af806d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1415c330 0x7f0b1415c7c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b140c4d30 0x7f0b1414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 --2- 172.21.15.37:0/2612227610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b04004d00 0x7f0b140af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 >> 172.21.15.37:0/2612227610 conn(0x7f0b1406e7d0 msgr2=0x7f0b140734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 shutdown_connections 2023-11-24T06:15:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:23.897+0000 7f0b1ad48640 1 -- 172.21.15.37:0/2612227610 wait complete. 2023-11-24T06:15:23.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.145+0000 7ff0fd747640 1 Processor -- start 2023-11-24T06:15:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.145+0000 7ff0fd747640 1 -- start start 2023-11-24T06:15:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.147+0000 7ff0fd747640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff0f8143870 0x7ff0f8146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.147+0000 7ff0fd747640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f8161510 con 0x7ff0f80b1180 2023-11-24T06:15:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.147+0000 7ff0fd747640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f81617f0 con 0x7ff0f8161080 2023-11-24T06:15:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.147+0000 7ff0fd747640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f8070460 con 0x7ff0f8143870 2023-11-24T06:15:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.147+0000 7ff0fcf46640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff0f80b1180 0x7ff0f80cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42288/0 (socket says 172.21.15.37:42288) 2023-11-24T06:15:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.147+0000 7ff0fcf46640 1 -- 172.21.15.37:0/2203259751 learned_addr learned my addr 172.21.15.37:0/2203259751 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/2203259751 >> v2:172.21.15.188:3300/0 conn(0x7ff0f8143870 0x7ff0f8146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637961344 0 0) 0x7ff0f8161510 con 0x7ff0f80b1180 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e0003520 con 0x7ff0f80b1180 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2804750131 0 0) 0x7ff0e0003520 con 0x7ff0f80b1180 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 >> v2:172.21.15.188:3300/0 conn(0x7ff0f8143870 msgr2=0x7ff0f8146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 --2- 172.21.15.37:0/2203259751 >> v2:172.21.15.188:3300/0 conn(0x7ff0f8143870 0x7ff0f8146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 >> v1:172.21.15.188:6789/0 conn(0x7ff0f8161080 legacy=0x7ff0f80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8161ad0 con 0x7ff0f80b1180 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7ff0f00019f0 con 0x7ff0f80b1180 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 >> v1:172.21.15.37:6789/0 conn(0x7ff0f80b1180 legacy=0x7ff0f80cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.148+0000 7ff0f6ffd640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0003970 0x7ff0e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f6ffd640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0e00047c0 0x7ff0e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f6ffd640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0005180 0x7ff0e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8070460 con 0x7ff0e0003970 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e000c020 con 0x7ff0e0005180 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e000c1e0 con 0x7ff0e00047c0 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0003970 0x7ff0e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f77fe640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0e00047c0 0x7ff0e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0fcf46640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0005180 0x7ff0e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f7fff640 1 -- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0e00047c0 msgr2=0x7ff0e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0e00047c0 0x7ff0e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f7fff640 1 -- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0005180 msgr2=0x7ff0e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0005180 0x7ff0e000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f7fff640 1 -- 172.21.15.37:0/2203259751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0003520 con 0x7ff0e0003970 2023-11-24T06:15:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0fcf46640 1 -- 172.21.15.37:0/2203259751 reap_dead start 2023-11-24T06:15:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.149+0000 7ff0f77fe640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0e00047c0 0x7ff0e0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.150+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0003970 0x7ff0e0003d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009ac0 tx=0x7ff0e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab414dc5ebaf8a17 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.151+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e802c6b0 con 0x7ff0e0003970 2023-11-24T06:15:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.151+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e802c810 con 0x7ff0e0003970 2023-11-24T06:15:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.151+0000 7ff0f6ffd640 1 -- 172.21.15.37:0/2203259751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e802cba0 con 0x7ff0e0003970 2023-11-24T06:15:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.151+0000 7ff0fd747640 1 -- 172.21.15.37:0/2203259751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0003970 msgr2=0x7ff0e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.151+0000 7ff0fd747640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0003970 0x7ff0e0003d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009ac0 tx=0x7ff0e00057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.152+0000 7ff0fd747640 1 -- 172.21.15.37:0/2203259751 shutdown_connections 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.152+0000 7ff0fd747640 1 --2- 172.21.15.37:0/2203259751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0003970 0x7ff0e0003d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.152+0000 7ff0fd747640 1 -- 172.21.15.37:0/2203259751 >> 172.21.15.37:0/2203259751 conn(0x7ff0f80cb830 msgr2=0x7ff0f80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.152+0000 7ff0fd747640 1 -- 172.21.15.37:0/2203259751 shutdown_connections 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.152+0000 7ff0fd747640 1 -- 172.21.15.37:0/2203259751 wait complete. 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.154+0000 7ff0fd747640 1 Processor -- start 2023-11-24T06:15:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.154+0000 7ff0fd747640 1 -- start start 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fd747640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0003970 0x7ff0f80b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fd747640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f80b1ba0 0x7ff0f81e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fd747640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0f81e72e0 0x7ff0f815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fd747640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f815eb50 con 0x7ff0f81e72e0 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fd747640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f815ee30 con 0x7ff0e0003970 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fd747640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f815f110 con 0x7ff0f80b1ba0 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0f81e72e0 0x7ff0f815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0f81e72e0 0x7ff0f815fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47288/0 (socket says 172.21.15.37:47288) 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 -- 172.21.15.37:0/977597210 learned_addr learned my addr 172.21.15.37:0/977597210 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0003970 0x7ff0f80b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 -- 172.21.15.37:0/977597210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f80b1ba0 msgr2=0x7ff0f81e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f80b1ba0 0x7ff0f81e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 -- 172.21.15.37:0/977597210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0003970 msgr2=0x7ff0f80b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0003970 0x7ff0f80b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.155+0000 7ff0fcf46640 1 -- 172.21.15.37:0/977597210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f815f3f0 con 0x7ff0f81e72e0 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.156+0000 7ff0fcf46640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0f81e72e0 0x7ff0f815fbf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0000f80 tx=0x7ff0f000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:24.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.156+0000 7ff0f4ff9640 1 -- 172.21.15.37:0/977597210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000bb80 con 0x7ff0f81e72e0 2023-11-24T06:15:24.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.156+0000 7ff0f4ff9640 1 -- 172.21.15.37:0/977597210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000bce0 con 0x7ff0f81e72e0 2023-11-24T06:15:24.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.156+0000 7ff0f4ff9640 1 -- 172.21.15.37:0/977597210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0007350 con 0x7ff0f81e72e0 2023-11-24T06:15:24.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.156+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f815f6d0 con 0x7ff0f81e72e0 2023-11-24T06:15:24.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.156+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f815e720 con 0x7ff0f81e72e0 2023-11-24T06:15:24.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.157+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f815e910 con 0x7ff0f81e72e0 2023-11-24T06:15:24.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.158+0000 7ff0f4ff9640 1 -- 172.21.15.37:0/977597210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0f00074b0 con 0x7ff0f81e72e0 2023-11-24T06:15:24.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.159+0000 7ff0f4ff9640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff0e406ae70 0x7ff0e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.159+0000 7ff0f4ff9640 1 -- 172.21.15.37:0/977597210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0f0089b20 con 0x7ff0f81e72e0 2023-11-24T06:15:24.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.159+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff0e406ae70 0x7ff0e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.160+0000 7ff0f7fff640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff0e406ae70 0x7ff0e406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8036000 tx=0x7ff0e8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.164+0000 7ff0f4ff9640 1 -- 172.21.15.37:0/977597210 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0f815e910 con 0x7ff0f81e72e0 2023-11-24T06:15:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.358+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f815e910 con 0x7ff0f81e72e0 2023-11-24T06:15:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.360+0000 7ff0f4ff9640 1 -- 172.21.15.37:0/977597210 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7ff0f815e910 con 0x7ff0f81e72e0 2023-11-24T06:15:24.363 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:24.364 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:24.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff0e406ae70 msgr2=0x7ff0e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff0e406ae70 0x7ff0e406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8036000 tx=0x7ff0e8030000 comp rx=0 tx=0).stop 2023-11-24T06:15:24.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0f81e72e0 msgr2=0x7ff0f815fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0f81e72e0 0x7ff0f815fbf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0000f80 tx=0x7ff0f000b4a0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 shutdown_connections 2023-11-24T06:15:24.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff0e406ae70 0x7ff0e406d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0f81e72e0 0x7ff0f815fbf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f80b1ba0 0x7ff0f81e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 --2- 172.21.15.37:0/977597210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0e0003970 0x7ff0f80b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 >> 172.21.15.37:0/977597210 conn(0x7ff0f80cb830 msgr2=0x7ff0f8146000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.363+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 shutdown_connections 2023-11-24T06:15:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.364+0000 7ff0fd747640 1 -- 172.21.15.37:0/977597210 wait complete. 2023-11-24T06:15:24.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:24.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.604+0000 7ff08df47640 1 Processor -- start 2023-11-24T06:15:24.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.604+0000 7ff08df47640 1 -- start start 2023-11-24T06:15:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.605+0000 7ff08df47640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff0880b0b40 0x7ff0880b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff08df47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880cce40 0x7ff0880cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff08df47640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880b14d0 con 0x7ff08815d310 2023-11-24T06:15:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff08df47640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08806cd10 con 0x7ff0880b0b40 2023-11-24T06:15:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff08df47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880ae5d0 con 0x7ff0880cce40 2023-11-24T06:15:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff08cf45640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff08815d310 0x7ff0880ca120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42304/0 (socket says 172.21.15.37:42304) 2023-11-24T06:15:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff08cf45640 1 -- 172.21.15.37:0/546984924 learned_addr learned my addr 172.21.15.37:0/546984924 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:24.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff07ffff640 1 --2- 172.21.15.37:0/546984924 >> v2:172.21.15.188:3300/0 conn(0x7ff0880b0b40 0x7ff0880b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189936117 0 0) 0x7ff084001110 con 0x7ff08815d310 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff070003520 con 0x7ff08815d310 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.606+0000 7ff08d746640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880cce40 0x7ff0880cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2775672190 0 0) 0x7ff070003520 con 0x7ff08815d310 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880cce40 msgr2=0x7ff0880cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880cce40 0x7ff0880cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 >> v2:172.21.15.188:3300/0 conn(0x7ff0880b0b40 msgr2=0x7ff0880b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 --2- 172.21.15.37:0/546984924 >> v2:172.21.15.188:3300/0 conn(0x7ff0880b0b40 0x7ff0880b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880ae8b0 con 0x7ff08815d310 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7ff084001820 con 0x7ff08815d310 2023-11-24T06:15:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 >> v1:172.21.15.37:6789/0 conn(0x7ff08815d310 legacy=0x7ff0880ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff070003970 0x7ff070003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0700047c0 0x7ff070004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff070005180 0x7ff07000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08806cd10 con 0x7ff070005180 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880ae5d0 con 0x7ff0700047c0 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000c020 con 0x7ff070003970 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff08d746640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880cce40 0x7ff0880cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.607+0000 7ff08d746640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff070005180 0x7ff07000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.608+0000 7ff08cf45640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff070003970 0x7ff070003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.608+0000 7ff07ffff640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0700047c0 0x7ff070004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.608+0000 7ff08d746640 1 -- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff070003970 msgr2=0x7ff070003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.608+0000 7ff08d746640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff070003970 0x7ff070003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.608+0000 7ff08d746640 1 -- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0700047c0 msgr2=0x7ff070004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:24.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.608+0000 7ff08d746640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0700047c0 0x7ff070004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.608+0000 7ff08d746640 1 -- 172.21.15.37:0/546984924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070003520 con 0x7ff070005180 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.609+0000 7ff08d746640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff070005180 0x7ff07000b980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff080009f00 tx=0x7ff0700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec44f6b79663b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.609+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08002cc70 con 0x7ff070005180 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.609+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08002cdd0 con 0x7ff070005180 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.609+0000 7ff07f7fe640 1 -- 172.21.15.37:0/546984924 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080003bb0 con 0x7ff070005180 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.610+0000 7ff08df47640 1 -- 172.21.15.37:0/546984924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff070005180 msgr2=0x7ff07000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.610+0000 7ff08df47640 1 --2- 172.21.15.37:0/546984924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff070005180 0x7ff07000b980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff080009f00 tx=0x7ff0700057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.610+0000 7ff08d746640 1 -- 172.21.15.37:0/546984924 reap_dead start 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.610+0000 7ff08df47640 1 -- 172.21.15.37:0/546984924 shutdown_connections 2023-11-24T06:15:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.610+0000 7ff08df47640 1 -- 172.21.15.37:0/546984924 >> 172.21.15.37:0/546984924 conn(0x7ff0880cbb40 msgr2=0x7ff0880cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.610+0000 7ff08df47640 1 -- 172.21.15.37:0/546984924 shutdown_connections 2023-11-24T06:15:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.610+0000 7ff08df47640 1 -- 172.21.15.37:0/546984924 wait complete. 2023-11-24T06:15:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.612+0000 7ff08df47640 1 Processor -- start 2023-11-24T06:15:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.612+0000 7ff08df47640 1 -- start start 2023-11-24T06:15:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.613+0000 7ff08df47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff070005180 0x7ff0881484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.613+0000 7ff08df47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880ad9b0 0x7ff0880ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.613+0000 7ff08df47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0880999d0 0x7ff088099e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.613+0000 7ff08df47640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08809a390 con 0x7ff0880999d0 2023-11-24T06:15:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.613+0000 7ff08df47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880c2f00 con 0x7ff070005180 2023-11-24T06:15:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.613+0000 7ff08df47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880c31e0 con 0x7ff0880ad9b0 2023-11-24T06:15:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0880999d0 0x7ff088099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0880999d0 0x7ff088099e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47316/0 (socket says 172.21.15.37:47316) 2023-11-24T06:15:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 -- 172.21.15.37:0/4154087785 learned_addr learned my addr 172.21.15.37:0/4154087785 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff07ffff640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880ad9b0 0x7ff0880ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08cf45640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff070005180 0x7ff0881484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 -- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880ad9b0 msgr2=0x7ff0880ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880ad9b0 0x7ff0880ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 -- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff070005180 msgr2=0x7ff0881484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff070005180 0x7ff0881484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 -- 172.21.15.37:0/4154087785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880c34c0 con 0x7ff0880999d0 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff07ffff640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880ad9b0 0x7ff0880ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.614+0000 7ff08d746640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0880999d0 0x7ff088099e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff080007360 tx=0x7ff080004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.615+0000 7ff07d7fa640 1 -- 172.21.15.37:0/4154087785 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08003c070 con 0x7ff0880999d0 2023-11-24T06:15:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.615+0000 7ff07d7fa640 1 -- 172.21.15.37:0/4154087785 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff080003e30 con 0x7ff0880999d0 2023-11-24T06:15:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.615+0000 7ff07d7fa640 1 -- 172.21.15.37:0/4154087785 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080004730 con 0x7ff0880999d0 2023-11-24T06:15:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.615+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880c37a0 con 0x7ff0880999d0 2023-11-24T06:15:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.615+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0880c2b20 con 0x7ff0880999d0 2023-11-24T06:15:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.616+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08804e840 con 0x7ff0880999d0 2023-11-24T06:15:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.617+0000 7ff07d7fa640 1 -- 172.21.15.37:0/4154087785 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff080037460 con 0x7ff0880999d0 2023-11-24T06:15:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.618+0000 7ff07d7fa640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff07406ae40 0x7ff07406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.618+0000 7ff07d7fa640 1 -- 172.21.15.37:0/4154087785 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0800aa9a0 con 0x7ff0880999d0 2023-11-24T06:15:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.619+0000 7ff08cf45640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff07406ae40 0x7ff07406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.619+0000 7ff08cf45640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff07406ae40 0x7ff07406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff084001270 tx=0x7ff084009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.623+0000 7ff07d7fa640 1 -- 172.21.15.37:0/4154087785 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0800759b0 con 0x7ff0880999d0 2023-11-24T06:15:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.815+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff08806e870 con 0x7ff0880999d0 2023-11-24T06:15:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.816+0000 7ff07d7fa640 1 -- 172.21.15.37:0/4154087785 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff080046020 con 0x7ff0880999d0 2023-11-24T06:15:24.818 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff07406ae40 msgr2=0x7ff07406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff07406ae40 0x7ff07406d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff084001270 tx=0x7ff084009040 comp rx=0 tx=0).stop 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0880999d0 msgr2=0x7ff088099e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0880999d0 0x7ff088099e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff080007360 tx=0x7ff080004ab0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 shutdown_connections 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff07406ae40 0x7ff07406d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0880999d0 0x7ff088099e50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0880ad9b0 0x7ff0880ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 --2- 172.21.15.37:0/4154087785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff070005180 0x7ff0881484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 >> 172.21.15.37:0/4154087785 conn(0x7ff0880cbb40 msgr2=0x7ff0880cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.818+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 shutdown_connections 2023-11-24T06:15:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:24.819+0000 7ff08df47640 1 -- 172.21.15.37:0/4154087785 wait complete. 2023-11-24T06:15:24.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.061+0000 7fc1f7d89640 1 Processor -- start 2023-11-24T06:15:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.061+0000 7fc1f7d89640 1 -- start start 2023-11-24T06:15:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.062+0000 7fc1f7d89640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f015b440 0x7fc1f00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.062+0000 7fc1f7d89640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc1f00cbf20 0x7fc1f00c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.063+0000 7fc1f7d89640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f00cc3a0 con 0x7fc1f00c57e0 2023-11-24T06:15:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.063+0000 7fc1f7d89640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f015b820 con 0x7fc1f00cbf20 2023-11-24T06:15:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.063+0000 7fc1f7d89640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f015eea0 con 0x7fc1f015b440 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.063+0000 7fc1f5b25640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f015b440 0x7fc1f00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.063+0000 7fc1f6326640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc1f00c57e0 0x7fc1f00c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:55114/0 (socket says 172.21.15.37:55114) 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.063+0000 7fc1f6326640 1 -- 172.21.15.37:0/1598027805 learned_addr learned my addr 172.21.15.37:0/1598027805 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.064+0000 7fc1f5324640 1 --2- 172.21.15.37:0/1598027805 >> v2:172.21.15.188:3300/0 conn(0x7fc1f00cbf20 0x7fc1f00c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.064+0000 7fc1f5b25640 1 -- 172.21.15.37:0/1598027805 >> v2:172.21.15.188:3300/0 conn(0x7fc1f00cbf20 msgr2=0x7fc1f00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.064+0000 7fc1f5b25640 1 --2- 172.21.15.37:0/1598027805 >> v2:172.21.15.188:3300/0 conn(0x7fc1f00cbf20 0x7fc1f00c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.064+0000 7fc1f5b25640 1 -- 172.21.15.37:0/1598027805 >> v1:172.21.15.188:6789/0 conn(0x7fc1f00c57e0 legacy=0x7fc1f00c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.064+0000 7fc1f5b25640 1 -- 172.21.15.37:0/1598027805 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f006d600 con 0x7fc1f015b440 2023-11-24T06:15:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.065+0000 7fc1f5b25640 1 --2- 172.21.15.37:0/1598027805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f015b440 0x7fc1f00cb9e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097a0 tx=0x7fc1ec02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a4448e269123ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.066+0000 7fc1f4b23640 1 -- 172.21.15.37:0/1598027805 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec031780 con 0x7fc1f015b440 2023-11-24T06:15:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.066+0000 7fc1f4b23640 1 -- 172.21.15.37:0/1598027805 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec0318e0 con 0x7fc1f015b440 2023-11-24T06:15:25.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.066+0000 7fc1f4b23640 1 -- 172.21.15.37:0/1598027805 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec031c70 con 0x7fc1f015b440 2023-11-24T06:15:25.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.066+0000 7fc1f7d89640 1 -- 172.21.15.37:0/1598027805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f015b440 msgr2=0x7fc1f00cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.066+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/1598027805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f015b440 0x7fc1f00cb9e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097a0 tx=0x7fc1ec02b820 comp rx=0 tx=0).stop 2023-11-24T06:15:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.067+0000 7fc1f7d89640 1 -- 172.21.15.37:0/1598027805 shutdown_connections 2023-11-24T06:15:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.067+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/1598027805 >> v2:172.21.15.188:3300/0 conn(0x7fc1f00cbf20 0x7fc1f00c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.067+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/1598027805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f015b440 0x7fc1f00cb9e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.067+0000 7fc1f7d89640 1 -- 172.21.15.37:0/1598027805 >> 172.21.15.37:0/1598027805 conn(0x7fc1f00b0c50 msgr2=0x7fc1f00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.067+0000 7fc1f7d89640 1 -- 172.21.15.37:0/1598027805 shutdown_connections 2023-11-24T06:15:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.067+0000 7fc1f7d89640 1 -- 172.21.15.37:0/1598027805 wait complete. 2023-11-24T06:15:25.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.069+0000 7fc1f7d89640 1 Processor -- start 2023-11-24T06:15:25.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.069+0000 7fc1f7d89640 1 -- start start 2023-11-24T06:15:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f7d89640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f00c57e0 0x7fc1f00c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f7d89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1f00cbf20 0x7fc1f0156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f7d89640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1f015b440 0x7fc1f009b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f7d89640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c6610 con 0x7fc1f00cbf20 2023-11-24T06:15:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f7d89640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c68b0 con 0x7fc1f015b440 2023-11-24T06:15:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f7d89640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c6b90 con 0x7fc1f00c57e0 2023-11-24T06:15:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1f00cbf20 0x7fc1f0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1f00cbf20 0x7fc1f0156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47326/0 (socket says 172.21.15.37:47326) 2023-11-24T06:15:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 -- 172.21.15.37:0/4214299414 learned_addr learned my addr 172.21.15.37:0/4214299414 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:25.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 -- 172.21.15.37:0/4214299414 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f00c57e0 msgr2=0x7fc1f00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f00c57e0 0x7fc1f00c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 -- 172.21.15.37:0/4214299414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1f015b440 msgr2=0x7fc1f009b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1f015b440 0x7fc1f009b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.070+0000 7fc1f5324640 1 -- 172.21.15.37:0/4214299414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009400 con 0x7fc1f00cbf20 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.071+0000 7fc1f5324640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1f00cbf20 0x7fc1f0156430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d800 tx=0x7fc1e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.071+0000 7fc1e67fc640 1 -- 172.21.15.37:0/4214299414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000b6c0 con 0x7fc1f00cbf20 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.071+0000 7fc1e67fc640 1 -- 172.21.15.37:0/4214299414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e000b820 con 0x7fc1f00cbf20 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.071+0000 7fc1e67fc640 1 -- 172.21.15.37:0/4214299414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000bbb0 con 0x7fc1f00cbf20 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.071+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f00c6e70 con 0x7fc1f00cbf20 2023-11-24T06:15:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.071+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f00c7430 con 0x7fc1f00cbf20 2023-11-24T06:15:25.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.072+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f00c75f0 con 0x7fc1f00cbf20 2023-11-24T06:15:25.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.073+0000 7fc1e67fc640 1 -- 172.21.15.37:0/4214299414 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1e000bd10 con 0x7fc1f00cbf20 2023-11-24T06:15:25.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.074+0000 7fc1e67fc640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.074+0000 7fc1e67fc640 1 -- 172.21.15.37:0/4214299414 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e0089ce0 con 0x7fc1f00cbf20 2023-11-24T06:15:25.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.074+0000 7fc1f5b25640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.075+0000 7fc1f5b25640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc1d406ae40 0x7fc1d406d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec036000 tx=0x7fc1ec030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.078+0000 7fc1e67fc640 1 -- 172.21.15.37:0/4214299414 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1e0054c60 con 0x7fc1f00cbf20 2023-11-24T06:15:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.273+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1f004e8b0 con 0x7fc1f00cbf20 2023-11-24T06:15:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.274+0000 7fc1e67fc640 1 -- 172.21.15.37:0/4214299414 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1e0058280 con 0x7fc1f00cbf20 2023-11-24T06:15:25.277 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:25.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc1d406ae40 msgr2=0x7fc1d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc1d406ae40 0x7fc1d406d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec036000 tx=0x7fc1ec030000 comp rx=0 tx=0).stop 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1f00cbf20 msgr2=0x7fc1f0156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1f00cbf20 0x7fc1f0156430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d800 tx=0x7fc1e000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 shutdown_connections 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1f015b440 0x7fc1f009b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1f00cbf20 0x7fc1f0156430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 --2- 172.21.15.37:0/4214299414 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1f00c57e0 0x7fc1f00c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.277+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 >> 172.21.15.37:0/4214299414 conn(0x7fc1f00b0c50 msgr2=0x7fc1f006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.278+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 shutdown_connections 2023-11-24T06:15:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.278+0000 7fc1f7d89640 1 -- 172.21.15.37:0/4214299414 wait complete. 2023-11-24T06:15:25.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:25.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.509+0000 7fb0f759e640 1 Processor -- start 2023-11-24T06:15:25.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.509+0000 7fb0f759e640 1 -- start start 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.510+0000 7fb0f759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f80b0b40 0x7fb0f80b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.510+0000 7fb0f759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0f806c5b0 0x7fb0f806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.510+0000 7fb0f759e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f815ed20 con 0x7fb0f815b260 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f815b640 con 0x7fb0f806c5b0 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f815f8a0 con 0x7fb0f80b0b40 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0f806c5b0 0x7fb0f806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0f806c5b0 0x7fb0f806ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47338/0 (socket says 172.21.15.37:47338) 2023-11-24T06:15:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f6d9d640 1 -- 172.21.15.37:0/399572544 learned_addr learned my addr 172.21.15.37:0/399572544 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0effff640 1 --2- 172.21.15.37:0/399572544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f80b0b40 0x7fb0f80b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f6d9d640 1 -- 172.21.15.37:0/399572544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f80b0b40 msgr2=0x7fb0f80b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f6d9d640 1 --2- 172.21.15.37:0/399572544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f80b0b40 0x7fb0f80b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f6d9d640 1 -- 172.21.15.37:0/399572544 >> v1:172.21.15.188:6789/0 conn(0x7fb0f815b260 legacy=0x7fb0f806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.511+0000 7fb0f6d9d640 1 -- 172.21.15.37:0/399572544 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80b14c0 con 0x7fb0f806c5b0 2023-11-24T06:15:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.513+0000 7fb0f6d9d640 1 --2- 172.21.15.37:0/399572544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f806c5b0 0x7fb0f806ca40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009e50 tx=0x7fb0f002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba466049dbb710c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.513+0000 7fb0f5d9b640 1 -- 172.21.15.37:0/399572544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f002c950 con 0x7fb0f806c5b0 2023-11-24T06:15:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.513+0000 7fb0f5d9b640 1 -- 172.21.15.37:0/399572544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f002cab0 con 0x7fb0f806c5b0 2023-11-24T06:15:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.513+0000 7fb0f5d9b640 1 -- 172.21.15.37:0/399572544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f002ce40 con 0x7fb0f806c5b0 2023-11-24T06:15:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.513+0000 7fb0f759e640 1 -- 172.21.15.37:0/399572544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f806c5b0 msgr2=0x7fb0f806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.513+0000 7fb0f759e640 1 --2- 172.21.15.37:0/399572544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f806c5b0 0x7fb0f806ca40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009e50 tx=0x7fb0f002bdb0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.514+0000 7fb0f759e640 1 -- 172.21.15.37:0/399572544 shutdown_connections 2023-11-24T06:15:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.514+0000 7fb0f759e640 1 --2- 172.21.15.37:0/399572544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f806c5b0 0x7fb0f806ca40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.514+0000 7fb0f759e640 1 --2- 172.21.15.37:0/399572544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f80b0b40 0x7fb0f80b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.514+0000 7fb0f759e640 1 -- 172.21.15.37:0/399572544 >> 172.21.15.37:0/399572544 conn(0x7fb0f80cbb40 msgr2=0x7fb0f80cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.514+0000 7fb0f759e640 1 -- 172.21.15.37:0/399572544 shutdown_connections 2023-11-24T06:15:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.514+0000 7fb0f759e640 1 -- 172.21.15.37:0/399572544 wait complete. 2023-11-24T06:15:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.515+0000 7fb0f759e640 1 Processor -- start 2023-11-24T06:15:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.516+0000 7fb0f759e640 1 -- start start 2023-11-24T06:15:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.516+0000 7fb0f759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f806c5b0 0x7fb0f814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.516+0000 7fb0f759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f80b0b40 0x7fb0f815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.516+0000 7fb0f759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f815b260 0x7fb0f80c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.516+0000 7fb0f759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f814da60 con 0x7fb0f80b0b40 2023-11-24T06:15:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.516+0000 7fb0f759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f815c0f0 con 0x7fb0f815b260 2023-11-24T06:15:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.516+0000 7fb0f759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f815c3d0 con 0x7fb0f806c5b0 2023-11-24T06:15:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f80b0b40 0x7fb0f815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f80b0b40 0x7fb0f815b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47344/0 (socket says 172.21.15.37:47344) 2023-11-24T06:15:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 -- 172.21.15.37:0/2825609941 learned_addr learned my addr 172.21.15.37:0/2825609941 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 -- 172.21.15.37:0/2825609941 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f806c5b0 msgr2=0x7fb0f814d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f806c5b0 0x7fb0f814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 -- 172.21.15.37:0/2825609941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f815b260 msgr2=0x7fb0f80c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0f6d9d640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f815b260 0x7fb0f80c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f815b260 0x7fb0f80c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.517+0000 7fb0effff640 1 -- 172.21.15.37:0/2825609941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f0009b30 con 0x7fb0f80b0b40 2023-11-24T06:15:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.518+0000 7fb0effff640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f80b0b40 0x7fb0f815b780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000c7f0 tx=0x7fb0e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.518+0000 7fb0eeffd640 1 -- 172.21.15.37:0/2825609941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0004220 con 0x7fb0f80b0b40 2023-11-24T06:15:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.518+0000 7fb0eeffd640 1 -- 172.21.15.37:0/2825609941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0004380 con 0x7fb0f80b0b40 2023-11-24T06:15:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.518+0000 7fb0eeffd640 1 -- 172.21.15.37:0/2825609941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0007840 con 0x7fb0f80b0b40 2023-11-24T06:15:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.518+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f815c6b0 con 0x7fb0f80b0b40 2023-11-24T06:15:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.518+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f815cc70 con 0x7fb0f80b0b40 2023-11-24T06:15:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.519+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f804e840 con 0x7fb0f80b0b40 2023-11-24T06:15:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.520+0000 7fb0eeffd640 1 -- 172.21.15.37:0/2825609941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0e0007bb0 con 0x7fb0f80b0b40 2023-11-24T06:15:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.522+0000 7fb0eeffd640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0d806ae40 0x7fb0d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.522+0000 7fb0eeffd640 1 -- 172.21.15.37:0/2825609941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0e0089610 con 0x7fb0f80b0b40 2023-11-24T06:15:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.522+0000 7fb0f659c640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0d806ae40 0x7fb0d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.523+0000 7fb0f659c640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0d806ae40 0x7fb0d806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8006fd0 tx=0x7fb0e8006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.526+0000 7fb0eeffd640 1 -- 172.21.15.37:0/2825609941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0e0054620 con 0x7fb0f80b0b40 2023-11-24T06:15:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.714+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0f80c5b40 con 0x7fb0f80b0b40 2023-11-24T06:15:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.715+0000 7fb0eeffd640 1 -- 172.21.15.37:0/2825609941 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0e005e030 con 0x7fb0f80b0b40 2023-11-24T06:15:25.718 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:25.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0d806ae40 msgr2=0x7fb0d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0d806ae40 0x7fb0d806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8006fd0 tx=0x7fb0e8006bc0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f80b0b40 msgr2=0x7fb0f815b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f80b0b40 0x7fb0f815b780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000c7f0 tx=0x7fb0e000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 shutdown_connections 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0d806ae40 0x7fb0d806d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0f815b260 0x7fb0f80c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0f80b0b40 0x7fb0f815b780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 --2- 172.21.15.37:0/2825609941 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0f806c5b0 0x7fb0f814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.718+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 >> 172.21.15.37:0/2825609941 conn(0x7fb0f80cbb40 msgr2=0x7fb0f806c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.719+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 shutdown_connections 2023-11-24T06:15:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.719+0000 7fb0f759e640 1 -- 172.21.15.37:0/2825609941 wait complete. 2023-11-24T06:15:25.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.951+0000 7f39a0800640 1 Processor -- start 2023-11-24T06:15:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.952+0000 7f39a0800640 1 -- start start 2023-11-24T06:15:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.953+0000 7f39a0800640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f39980cf450 0x7f39980cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.953+0000 7f39a0800640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cdfb0 0x7f39980ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.953+0000 7f39a0800640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39980cece0 con 0x7f399815c7f0 2023-11-24T06:15:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.953+0000 7f39a0800640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39980cfe40 con 0x7f39980cf450 2023-11-24T06:15:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.953+0000 7f39a0800640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3998156010 con 0x7f39980cdfb0 2023-11-24T06:15:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.954+0000 7f399e59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f399815c7f0 0x7f399806db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:55126/0 (socket says 172.21.15.37:55126) 2023-11-24T06:15:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.954+0000 7f399e59c640 1 -- 172.21.15.37:0/4286637364 learned_addr learned my addr 172.21.15.37:0/4286637364 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.954+0000 7f399ed9d640 1 --2- 172.21.15.37:0/4286637364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cdfb0 0x7f39980ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.954+0000 7f399dd9b640 1 --2- 172.21.15.37:0/4286637364 >> v2:172.21.15.188:3300/0 conn(0x7f39980cf450 0x7f39980cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.955+0000 7f399ed9d640 1 -- 172.21.15.37:0/4286637364 >> v2:172.21.15.188:3300/0 conn(0x7f39980cf450 msgr2=0x7f39980cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.955+0000 7f399ed9d640 1 --2- 172.21.15.37:0/4286637364 >> v2:172.21.15.188:3300/0 conn(0x7f39980cf450 0x7f39980cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.955+0000 7f399d59a640 1 -- 172.21.15.37:0/4286637364 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502630409 0 0) 0x7f39980cece0 con 0x7f399815c7f0 2023-11-24T06:15:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.955+0000 7f399ed9d640 1 -- 172.21.15.37:0/4286637364 >> v1:172.21.15.188:6789/0 conn(0x7f399815c7f0 legacy=0x7f399806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.955+0000 7f399ed9d640 1 -- 172.21.15.37:0/4286637364 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399806d040 con 0x7f39980cdfb0 2023-11-24T06:15:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.957+0000 7f399ed9d640 1 --2- 172.21.15.37:0/4286637364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cdfb0 0x7f39980ce420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3994009d90 tx=0x7f399402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8161c07c6bfa074 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.957+0000 7f399d59a640 1 -- 172.21.15.37:0/4286637364 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399402cc50 con 0x7f39980cdfb0 2023-11-24T06:15:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.957+0000 7f399d59a640 1 -- 172.21.15.37:0/4286637364 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399402cdb0 con 0x7f39980cdfb0 2023-11-24T06:15:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.957+0000 7f399d59a640 1 -- 172.21.15.37:0/4286637364 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994034660 con 0x7f39980cdfb0 2023-11-24T06:15:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 -- 172.21.15.37:0/4286637364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cdfb0 msgr2=0x7f39980ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 --2- 172.21.15.37:0/4286637364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cdfb0 0x7f39980ce420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3994009d90 tx=0x7f399402bea0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 -- 172.21.15.37:0/4286637364 shutdown_connections 2023-11-24T06:15:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 --2- 172.21.15.37:0/4286637364 >> v2:172.21.15.188:3300/0 conn(0x7f39980cf450 0x7f39980cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 --2- 172.21.15.37:0/4286637364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cdfb0 0x7f39980ce420 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 -- 172.21.15.37:0/4286637364 >> 172.21.15.37:0/4286637364 conn(0x7f399806a920 msgr2=0x7f399806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 -- 172.21.15.37:0/4286637364 shutdown_connections 2023-11-24T06:15:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.958+0000 7f39a0800640 1 -- 172.21.15.37:0/4286637364 wait complete. 2023-11-24T06:15:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.961+0000 7f39a0800640 1 Processor -- start 2023-11-24T06:15:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.961+0000 7f39a0800640 1 -- start start 2023-11-24T06:15:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.962+0000 7f39a0800640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39980cdfb0 0x7f3998144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.962+0000 7f39a0800640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cf450 0x7f3998158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.962+0000 7f39a0800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f399815c7f0 0x7f399809cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.962+0000 7f39a0800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3998156150 con 0x7f399815c7f0 2023-11-24T06:15:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.962+0000 7f39a0800640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3998153560 con 0x7f39980cdfb0 2023-11-24T06:15:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.962+0000 7f39a0800640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3998159480 con 0x7f39980cf450 2023-11-24T06:15:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.962+0000 7f399ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f399815c7f0 0x7f399809cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f399815c7f0 0x7f399809cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47360/0 (socket says 172.21.15.37:47360) 2023-11-24T06:15:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 -- 172.21.15.37:0/1151194350 learned_addr learned my addr 172.21.15.37:0/1151194350 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399dd9b640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cf450 0x7f3998158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399e59c640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39980cdfb0 0x7f3998144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 -- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cf450 msgr2=0x7f3998158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cf450 0x7f3998158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 -- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39980cdfb0 msgr2=0x7f3998144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39980cdfb0 0x7f3998144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:25.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 -- 172.21.15.37:0/1151194350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994009a70 con 0x7f399815c7f0 2023-11-24T06:15:25.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.963+0000 7f399ed9d640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f399815c7f0 0x7f399809cb60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3994009d90 tx=0x7f3994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.964+0000 7f398affd640 1 -- 172.21.15.37:0/1151194350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994003b90 con 0x7f399815c7f0 2023-11-24T06:15:25.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.964+0000 7f398affd640 1 -- 172.21.15.37:0/1151194350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994003d10 con 0x7f399815c7f0 2023-11-24T06:15:25.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.964+0000 7f398affd640 1 -- 172.21.15.37:0/1151194350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994004270 con 0x7f399815c7f0 2023-11-24T06:15:25.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.964+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3998153800 con 0x7f399815c7f0 2023-11-24T06:15:25.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.964+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39981563a0 con 0x7f399815c7f0 2023-11-24T06:15:25.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.965+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3998061a50 con 0x7f399815c7f0 2023-11-24T06:15:25.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.967+0000 7f398affd640 1 -- 172.21.15.37:0/1151194350 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f399403b050 con 0x7f399815c7f0 2023-11-24T06:15:25.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.967+0000 7f398affd640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f397c06ae40 0x7f397c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:25.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.968+0000 7f398affd640 1 -- 172.21.15.37:0/1151194350 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39940aba10 con 0x7f399815c7f0 2023-11-24T06:15:25.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.968+0000 7f399e59c640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f397c06ae40 0x7f397c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:25.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.968+0000 7f399e59c640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f397c06ae40 0x7f397c06d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f398c000f60 tx=0x7f398c007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:25.972+0000 7f398affd640 1 -- 172.21.15.37:0/1151194350 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3994076b50 con 0x7f399815c7f0 2023-11-24T06:15:26.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.164+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3998067470 con 0x7f399815c7f0 2023-11-24T06:15:26.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.167+0000 7f398affd640 1 -- 172.21.15.37:0/1151194350 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f3994039090 con 0x7f399815c7f0 2023-11-24T06:15:26.170 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:26.171 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f397c06ae40 msgr2=0x7f397c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f397c06ae40 0x7f397c06d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f398c000f60 tx=0x7f398c007c00 comp rx=0 tx=0).stop 2023-11-24T06:15:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f399815c7f0 msgr2=0x7f399809cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f399815c7f0 0x7f399809cb60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3994009d90 tx=0x7f3994004a40 comp rx=0 tx=0).stop 2023-11-24T06:15:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 shutdown_connections 2023-11-24T06:15:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f397c06ae40 0x7f397c06d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f399815c7f0 0x7f399809cb60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39980cf450 0x7f3998158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 --2- 172.21.15.37:0/1151194350 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39980cdfb0 0x7f3998144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 >> 172.21.15.37:0/1151194350 conn(0x7f399806a920 msgr2=0x7f399806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 shutdown_connections 2023-11-24T06:15:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.170+0000 7f39a0800640 1 -- 172.21.15.37:0/1151194350 wait complete. 2023-11-24T06:15:26.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:26.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.420+0000 7fc1c15d4640 1 Processor -- start 2023-11-24T06:15:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.420+0000 7fc1c15d4640 1 -- start start 2023-11-24T06:15:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.421+0000 7fc1c15d4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc1bc15d3f0 0x7fc1bc0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.421+0000 7fc1c15d4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1bc15d7d0 0x7fc1bc0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1c15d4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc0d15e0 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1c15d4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc0d0280 con 0x7fc1bc15d7d0 2023-11-24T06:15:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1c15d4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc0d1300 con 0x7fc1bc15d3f0 2023-11-24T06:15:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1bc15d7d0 0x7fc1bc0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1bc15d7d0 0x7fc1bc0d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47364/0 (socket says 172.21.15.37:47364) 2023-11-24T06:15:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1bb7fe640 1 -- 172.21.15.37:0/87355948 learned_addr learned my addr 172.21.15.37:0/87355948 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1bbfff640 1 --2- 172.21.15.37:0/87355948 >> v2:172.21.15.188:3300/0 conn(0x7fc1bc15d3f0 0x7fc1bc0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1bb7fe640 1 -- 172.21.15.37:0/87355948 >> v2:172.21.15.188:3300/0 conn(0x7fc1bc15d3f0 msgr2=0x7fc1bc0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1bb7fe640 1 --2- 172.21.15.37:0/87355948 >> v2:172.21.15.188:3300/0 conn(0x7fc1bc15d3f0 0x7fc1bc0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.422+0000 7fc1bb7fe640 1 -- 172.21.15.37:0/87355948 >> v1:172.21.15.37:6789/0 conn(0x7fc1bc0d0e40 legacy=0x7fc1bc0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.423+0000 7fc1bb7fe640 1 -- 172.21.15.37:0/87355948 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc0cfc30 con 0x7fc1bc15d7d0 2023-11-24T06:15:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.424+0000 7fc1bb7fe640 1 --2- 172.21.15.37:0/87355948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc15d7d0 0x7fc1bc0d1d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc067c60 tx=0x7fc1ac02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed31e68b19698a9e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.424+0000 7fc1baffd640 1 -- 172.21.15.37:0/87355948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac02cb10 con 0x7fc1bc15d7d0 2023-11-24T06:15:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.424+0000 7fc1baffd640 1 -- 172.21.15.37:0/87355948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac02cc70 con 0x7fc1bc15d7d0 2023-11-24T06:15:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.424+0000 7fc1baffd640 1 -- 172.21.15.37:0/87355948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0343f0 con 0x7fc1bc15d7d0 2023-11-24T06:15:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 -- 172.21.15.37:0/87355948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc15d7d0 msgr2=0x7fc1bc0d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/87355948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc15d7d0 0x7fc1bc0d1d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc067c60 tx=0x7fc1ac02bf70 comp rx=0 tx=0).stop 2023-11-24T06:15:26.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 -- 172.21.15.37:0/87355948 shutdown_connections 2023-11-24T06:15:26.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/87355948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc15d7d0 0x7fc1bc0d1d70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/87355948 >> v2:172.21.15.188:3300/0 conn(0x7fc1bc15d3f0 0x7fc1bc0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 -- 172.21.15.37:0/87355948 >> 172.21.15.37:0/87355948 conn(0x7fc1bc09c5b0 msgr2=0x7fc1bc0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:26.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 -- 172.21.15.37:0/87355948 shutdown_connections 2023-11-24T06:15:26.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.425+0000 7fc1c15d4640 1 -- 172.21.15.37:0/87355948 wait complete. 2023-11-24T06:15:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.427+0000 7fc1c15d4640 1 Processor -- start 2023-11-24T06:15:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.427+0000 7fc1c15d4640 1 -- start start 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1c15d4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0d0e40 0x7fc1bc14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1c15d4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1bc15d3f0 0x7fc1bc0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1c15d4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1bc15d7d0 0x7fc1bc14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1c15d4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc14bc20 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1c15d4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc0cc230 con 0x7fc1bc15d3f0 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1c15d4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc0b2eb0 con 0x7fc1bc15d7d0 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0d0e40 0x7fc1bc14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0d0e40 0x7fc1bc14b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47366/0 (socket says 172.21.15.37:47366) 2023-11-24T06:15:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.428+0000 7fc1bbfff640 1 -- 172.21.15.37:0/4060628914 learned_addr learned my addr 172.21.15.37:0/4060628914 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1c0dd3640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1bc15d7d0 0x7fc1bc14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1bb7fe640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1bc15d3f0 0x7fc1bc0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1bbfff640 1 -- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1bc15d7d0 msgr2=0x7fc1bc14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1bbfff640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1bc15d7d0 0x7fc1bc14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1bbfff640 1 -- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1bc15d3f0 msgr2=0x7fc1bc0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1bbfff640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1bc15d3f0 0x7fc1bc0b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1bbfff640 1 -- 172.21.15.37:0/4060628914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac009b30 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1c0dd3640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1bc15d7d0 0x7fc1bc14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1bbfff640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0d0e40 0x7fc1bc14b6e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400d800 tx=0x7fc1a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1b8ff9640 1 -- 172.21.15.37:0/4060628914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400b6c0 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1b8ff9640 1 -- 172.21.15.37:0/4060628914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a400b840 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.429+0000 7fc1b8ff9640 1 -- 172.21.15.37:0/4060628914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400bbf0 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.430+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc14e990 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.430+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc0cbec0 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.431+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc14eeb0 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.432+0000 7fc1b8ff9640 1 -- 172.21.15.37:0/4060628914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1a400bd50 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.433+0000 7fc1b8ff9640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc19c06ae40 0x7fc19c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.433+0000 7fc1b8ff9640 1 -- 172.21.15.37:0/4060628914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a4089bd0 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.433+0000 7fc1bb7fe640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc19c06ae40 0x7fc19c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.434+0000 7fc1bb7fe640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc19c06ae40 0x7fc19c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac035000 tx=0x7fc1ac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.437+0000 7fc1b8ff9640 1 -- 172.21.15.37:0/4060628914 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1a4054c70 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.623+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1bc04e840 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.624+0000 7fc1b8ff9640 1 -- 172.21.15.37:0/4060628914 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1a4058290 con 0x7fc1bc0d0e40 2023-11-24T06:15:26.627 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.626+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc19c06ae40 msgr2=0x7fc19c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.626+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc19c06ae40 0x7fc19c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac035000 tx=0x7fc1ac030000 comp rx=0 tx=0).stop 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.626+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0d0e40 msgr2=0x7fc1bc14b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.626+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0d0e40 0x7fc1bc14b6e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400d800 tx=0x7fc1a400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 shutdown_connections 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc19c06ae40 0x7fc19c06d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc1bc15d3f0 0x7fc1bc0b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1bc15d7d0 0x7fc1bc14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 --2- 172.21.15.37:0/4060628914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0d0e40 0x7fc1bc14b6e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 >> 172.21.15.37:0/4060628914 conn(0x7fc1bc09c5b0 msgr2=0x7fc1bc0c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 shutdown_connections 2023-11-24T06:15:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.627+0000 7fc1c15d4640 1 -- 172.21.15.37:0/4060628914 wait complete. 2023-11-24T06:15:26.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:26.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.878+0000 7f3dbe456640 1 Processor -- start 2023-11-24T06:15:26.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.878+0000 7f3dbe456640 1 -- start start 2023-11-24T06:15:26.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.879+0000 7f3dbe456640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80d3a40 0x7f3db806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.879+0000 7f3dbe456640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3db80b1ed0 0x7f3db806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.879+0000 7f3dbe456640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db815db00 con 0x7f3db815d720 2023-11-24T06:15:26.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.879+0000 7f3dbe456640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db80d0ce0 con 0x7f3db80b1ed0 2023-11-24T06:15:26.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.879+0000 7f3dbe456640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db806d400 con 0x7f3db80d3a40 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.880+0000 7f3db77fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80d3a40 0x7f3db806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.880+0000 7f3db77fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80d3a40 0x7f3db806ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:48414/0 (socket says 172.21.15.37:48414) 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.880+0000 7f3db77fe640 1 -- 172.21.15.37:0/1705524045 learned_addr learned my addr 172.21.15.37:0/1705524045 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.880+0000 7f3dbc9f3640 1 --2- 172.21.15.37:0/1705524045 >> v2:172.21.15.188:3300/0 conn(0x7f3db80b1ed0 0x7f3db806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.881+0000 7f3db77fe640 1 -- 172.21.15.37:0/1705524045 >> v2:172.21.15.188:3300/0 conn(0x7f3db80b1ed0 msgr2=0x7f3db806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.881+0000 7f3db77fe640 1 --2- 172.21.15.37:0/1705524045 >> v2:172.21.15.188:3300/0 conn(0x7f3db80b1ed0 0x7f3db806bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.881+0000 7f3db77fe640 1 -- 172.21.15.37:0/1705524045 >> v1:172.21.15.188:6789/0 conn(0x7f3db815d720 legacy=0x7f3db80d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.881+0000 7f3db77fe640 1 -- 172.21.15.37:0/1705524045 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80b0100 con 0x7f3db80d3a40 2023-11-24T06:15:26.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.882+0000 7f3db77fe640 1 --2- 172.21.15.37:0/1705524045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80d3a40 0x7f3db806ba80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009870 tx=0x7f3da802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ecd928f396c3da4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:26.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.883+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1705524045 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8031640 con 0x7f3db80d3a40 2023-11-24T06:15:26.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.883+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1705524045 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da80317a0 con 0x7f3db80d3a40 2023-11-24T06:15:26.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.883+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1705524045 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8031b30 con 0x7f3db80d3a40 2023-11-24T06:15:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.883+0000 7f3dbe456640 1 -- 172.21.15.37:0/1705524045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80d3a40 msgr2=0x7f3db806ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.883+0000 7f3dbe456640 1 --2- 172.21.15.37:0/1705524045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80d3a40 0x7f3db806ba80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009870 tx=0x7f3da802b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.884+0000 7f3dbe456640 1 -- 172.21.15.37:0/1705524045 shutdown_connections 2023-11-24T06:15:26.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.884+0000 7f3dbe456640 1 --2- 172.21.15.37:0/1705524045 >> v2:172.21.15.188:3300/0 conn(0x7f3db80b1ed0 0x7f3db806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.884+0000 7f3dbe456640 1 --2- 172.21.15.37:0/1705524045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80d3a40 0x7f3db806ba80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.884+0000 7f3dbe456640 1 -- 172.21.15.37:0/1705524045 >> 172.21.15.37:0/1705524045 conn(0x7f3db808af60 msgr2=0x7f3db809c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:26.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.884+0000 7f3dbe456640 1 -- 172.21.15.37:0/1705524045 shutdown_connections 2023-11-24T06:15:26.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.884+0000 7f3dbe456640 1 -- 172.21.15.37:0/1705524045 wait complete. 2023-11-24T06:15:26.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.886+0000 7f3dbe456640 1 Processor -- start 2023-11-24T06:15:26.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.886+0000 7f3dbe456640 1 -- start start 2023-11-24T06:15:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbe456640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80b1ed0 0x7f3db8153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbe456640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3db80d3a40 0x7f3db80c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbe456640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db815d720 0x7f3db80b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbe456640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c7470 con 0x7f3db815d720 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbe456640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db815e6a0 con 0x7f3db80d3a40 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbe456640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db815e980 con 0x7f3db80b1ed0 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbc9f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db815d720 0x7f3db80b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbc9f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db815d720 0x7f3db80b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47368/0 (socket says 172.21.15.37:47368) 2023-11-24T06:15:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbc9f3640 1 -- 172.21.15.37:0/428469197 learned_addr learned my addr 172.21.15.37:0/428469197 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3db7fff640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80b1ed0 0x7f3db8153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3db77fe640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3db80d3a40 0x7f3db80c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.888+0000 7f3dbc9f3640 1 -- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80b1ed0 msgr2=0x7f3db8153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3dbc9f3640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80b1ed0 0x7f3db8153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3dbc9f3640 1 -- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3db80d3a40 msgr2=0x7f3db80c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3dbc9f3640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3db80d3a40 0x7f3db80c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3dbc9f3640 1 -- 172.21.15.37:0/428469197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80094d0 con 0x7f3db815d720 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3dbc9f3640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db815d720 0x7f3db80b8880 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3db000efc0 tx=0x7f3db000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3db4ff9640 1 -- 172.21.15.37:0/428469197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0009ba0 con 0x7f3db815d720 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3db4ff9640 1 -- 172.21.15.37:0/428469197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db000f040 con 0x7f3db815d720 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3db4ff9640 1 -- 172.21.15.37:0/428469197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db00146c0 con 0x7f3db815d720 2023-11-24T06:15:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db815ec60 con 0x7f3db815d720 2023-11-24T06:15:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.889+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db815f220 con 0x7f3db815d720 2023-11-24T06:15:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.891+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db815f440 con 0x7f3db815d720 2023-11-24T06:15:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.892+0000 7f3db4ff9640 1 -- 172.21.15.37:0/428469197 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3db0014820 con 0x7f3db815d720 2023-11-24T06:15:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.892+0000 7f3db4ff9640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3d9806ae40 0x7f3d9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.892+0000 7f3db4ff9640 1 -- 172.21.15.37:0/428469197 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3db008a0f0 con 0x7f3db815d720 2023-11-24T06:15:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.893+0000 7f3db7fff640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3d9806ae40 0x7f3d9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.894+0000 7f3db7fff640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3d9806ae40 0x7f3d9806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3da0000f60 tx=0x7f3da0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:26.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:26.897+0000 7f3db4ff9640 1 -- 172.21.15.37:0/428469197 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3db00551a0 con 0x7f3db815d720 2023-11-24T06:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.091+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3db80d1f30 con 0x7f3db815d720 2023-11-24T06:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.092+0000 7f3db4ff9640 1 -- 172.21.15.37:0/428469197 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3db00587c0 con 0x7f3db815d720 2023-11-24T06:15:27.095 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.094+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3d9806ae40 msgr2=0x7f3d9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.094+0000 7f3dbe456640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3d9806ae40 0x7f3d9806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3da0000f60 tx=0x7f3da0009040 comp rx=0 tx=0).stop 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.094+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db815d720 msgr2=0x7f3db80b8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.094+0000 7f3dbe456640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db815d720 0x7f3db80b8880 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3db000efc0 tx=0x7f3db000c490 comp rx=0 tx=0).stop 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 shutdown_connections 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3d9806ae40 0x7f3d9806d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3db80d3a40 0x7f3db80c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db815d720 0x7f3db80b8880 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 --2- 172.21.15.37:0/428469197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3db80b1ed0 0x7f3db8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 >> 172.21.15.37:0/428469197 conn(0x7f3db808af60 msgr2=0x7f3db80b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 shutdown_connections 2023-11-24T06:15:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.095+0000 7f3dbe456640 1 -- 172.21.15.37:0/428469197 wait complete. 2023-11-24T06:15:27.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.342+0000 7f1cd2ff4640 1 Processor -- start 2023-11-24T06:15:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.342+0000 7f1cd2ff4640 1 -- start start 2023-11-24T06:15:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd2ff4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc15b260 0x7f1ccc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd2ff4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ccc06e580 0x7f1ccc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd2ff4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc06d5c0 con 0x7f1ccc0b1080 2023-11-24T06:15:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd2ff4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0b1530 con 0x7f1ccc06e580 2023-11-24T06:15:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd2ff4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc15b640 con 0x7f1ccc15b260 2023-11-24T06:15:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd17f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ccc06e580 0x7f1ccc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd27f3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1ccc0b1080 0x7f1ccc0ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42332/0 (socket says 172.21.15.37:42332) 2023-11-24T06:15:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd27f3640 1 -- 172.21.15.37:0/1972086976 learned_addr learned my addr 172.21.15.37:0/1972086976 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.344+0000 7f1cd1ff2640 1 --2- 172.21.15.37:0/1972086976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc15b260 0x7f1ccc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.345+0000 7f1cd17f1640 1 -- 172.21.15.37:0/1972086976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc15b260 msgr2=0x7f1ccc06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.345+0000 7f1cd17f1640 1 --2- 172.21.15.37:0/1972086976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc15b260 0x7f1ccc06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.345+0000 7f1cd17f1640 1 -- 172.21.15.37:0/1972086976 >> v1:172.21.15.37:6789/0 conn(0x7f1ccc0b1080 legacy=0x7f1ccc0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.345+0000 7f1cd17f1640 1 -- 172.21.15.37:0/1972086976 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc15ed20 con 0x7f1ccc06e580 2023-11-24T06:15:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.346+0000 7f1cd17f1640 1 --2- 172.21.15.37:0/1972086976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc06e580 0x7f1ccc0b0b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0097a0 tx=0x7f1cbc02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bed441a5c7365d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.346+0000 7f1cd0ff0640 1 -- 172.21.15.37:0/1972086976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0316f0 con 0x7f1ccc06e580 2023-11-24T06:15:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.346+0000 7f1cd0ff0640 1 -- 172.21.15.37:0/1972086976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc031850 con 0x7f1ccc06e580 2023-11-24T06:15:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.346+0000 7f1cd0ff0640 1 -- 172.21.15.37:0/1972086976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc031be0 con 0x7f1ccc06e580 2023-11-24T06:15:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1972086976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc06e580 msgr2=0x7f1ccc0b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1972086976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc06e580 0x7f1ccc0b0b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0097a0 tx=0x7f1cbc02b790 comp rx=0 tx=0).stop 2023-11-24T06:15:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1972086976 shutdown_connections 2023-11-24T06:15:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1972086976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc06e580 0x7f1ccc0b0b40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1972086976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc15b260 0x7f1ccc06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1972086976 >> 172.21.15.37:0/1972086976 conn(0x7f1ccc0cbb40 msgr2=0x7f1ccc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1972086976 shutdown_connections 2023-11-24T06:15:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.347+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1972086976 wait complete. 2023-11-24T06:15:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.349+0000 7f1cd2ff4640 1 Processor -- start 2023-11-24T06:15:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.349+0000 7f1cd2ff4640 1 -- start start 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd2ff4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc06e580 0x7f1ccc0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd2ff4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ccc0b1080 0x7f1ccc158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd2ff4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc15b260 0x7f1ccc158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd2ff4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc159200 con 0x7f1ccc15b260 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd2ff4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0b2a40 con 0x7f1ccc0b1080 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd2ff4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc15d7d0 con 0x7f1ccc06e580 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd27f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc15b260 0x7f1ccc158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd27f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc15b260 0x7f1ccc158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47394/0 (socket says 172.21.15.37:47394) 2023-11-24T06:15:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.350+0000 7f1cd27f3640 1 -- 172.21.15.37:0/1257244778 learned_addr learned my addr 172.21.15.37:0/1257244778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd1ff2640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc06e580 0x7f1ccc0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd27f3640 1 -- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc06e580 msgr2=0x7f1ccc0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd27f3640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc06e580 0x7f1ccc0b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd27f3640 1 -- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ccc0b1080 msgr2=0x7f1ccc158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd27f3640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ccc0b1080 0x7f1ccc158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd27f3640 1 -- 172.21.15.37:0/1257244778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc009400 con 0x7f1ccc15b260 2023-11-24T06:15:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd1ff2640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc06e580 0x7f1ccc0b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd27f3640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc15b260 0x7f1ccc158cc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400ca80 tx=0x7f1cc400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cc27fc640 1 -- 172.21.15.37:0/1257244778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400ac30 con 0x7f1ccc15b260 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cc27fc640 1 -- 172.21.15.37:0/1257244778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400ad90 con 0x7f1ccc15b260 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cc27fc640 1 -- 172.21.15.37:0/1257244778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4012600 con 0x7f1ccc15b260 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.351+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc0b23f0 con 0x7f1ccc15b260 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.352+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc15dab0 con 0x7f1ccc15b260 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.353+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc0b2250 con 0x7f1ccc15b260 2023-11-24T06:15:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.354+0000 7f1cc27fc640 1 -- 172.21.15.37:0/1257244778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1cc4007070 con 0x7f1ccc15b260 2023-11-24T06:15:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.354+0000 7f1cc27fc640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1cb006ae70 0x7f1cb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.355+0000 7f1cc27fc640 1 -- 172.21.15.37:0/1257244778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cc4089560 con 0x7f1ccc15b260 2023-11-24T06:15:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.355+0000 7f1cd1ff2640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1cb006ae70 0x7f1cb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.356+0000 7f1cd1ff2640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1cb006ae70 0x7f1cb006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.359+0000 7f1cc27fc640 1 -- 172.21.15.37:0/1257244778 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ccc0b2250 con 0x7f1ccc15b260 2023-11-24T06:15:27.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.552+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ccc0b2250 con 0x7f1ccc15b260 2023-11-24T06:15:27.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.553+0000 7f1cc27fc640 1 -- 172.21.15.37:0/1257244778 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ccc0b2250 con 0x7f1ccc15b260 2023-11-24T06:15:27.556 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:27.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1cb006ae70 msgr2=0x7f1cb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1cb006ae70 0x7f1cb006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8006fd0 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2023-11-24T06:15:27.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc15b260 msgr2=0x7f1ccc158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc15b260 0x7f1ccc158cc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400ca80 tx=0x7f1cc400cf40 comp rx=0 tx=0).stop 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 shutdown_connections 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1cb006ae70 0x7f1cb006d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ccc0b1080 0x7f1ccc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ccc15b260 0x7f1ccc158cc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 --2- 172.21.15.37:0/1257244778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ccc06e580 0x7f1ccc0b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.555+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 >> 172.21.15.37:0/1257244778 conn(0x7f1ccc0cbb40 msgr2=0x7f1ccc0ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.556+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 shutdown_connections 2023-11-24T06:15:27.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.556+0000 7f1cd2ff4640 1 -- 172.21.15.37:0/1257244778 wait complete. 2023-11-24T06:15:27.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:27.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.782+0000 7fa1ff3d4640 1 Processor -- start 2023-11-24T06:15:27.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.783+0000 7fa1ff3d4640 1 -- start start 2023-11-24T06:15:27.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.784+0000 7fa1ff3d4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa1f815c410 0x7fa1f815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.784+0000 7fa1ff3d4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f80b1de0 0x7fa1f80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.784+0000 7fa1ff3d4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f815bf80 con 0x7fa1f8144b30 2023-11-24T06:15:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.784+0000 7fa1ff3d4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80b27b0 con 0x7fa1f815c410 2023-11-24T06:15:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.784+0000 7fa1ff3d4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80b1560 con 0x7fa1f80b1de0 2023-11-24T06:15:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.785+0000 7fa1febd3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f80b1de0 0x7fa1f80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.785+0000 7fa1febd3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f80b1de0 0x7fa1f80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:48448/0 (socket says 172.21.15.37:48448) 2023-11-24T06:15:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.785+0000 7fa1febd3640 1 -- 172.21.15.37:0/3325392663 learned_addr learned my addr 172.21.15.37:0/3325392663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.785+0000 7fa1fdbd1640 1 --2- 172.21.15.37:0/3325392663 >> v2:172.21.15.188:3300/0 conn(0x7fa1f815c410 0x7fa1f815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.785+0000 7fa1febd3640 1 -- 172.21.15.37:0/3325392663 >> v2:172.21.15.188:3300/0 conn(0x7fa1f815c410 msgr2=0x7fa1f815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.785+0000 7fa1febd3640 1 --2- 172.21.15.37:0/3325392663 >> v2:172.21.15.188:3300/0 conn(0x7fa1f815c410 0x7fa1f815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.785+0000 7fa1febd3640 1 -- 172.21.15.37:0/3325392663 >> v1:172.21.15.188:6789/0 conn(0x7fa1f8144b30 legacy=0x7fa1f80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.786+0000 7fa1febd3640 1 -- 172.21.15.37:0/3325392663 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80b1280 con 0x7fa1f80b1de0 2023-11-24T06:15:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.787+0000 7fa1febd3640 1 --2- 172.21.15.37:0/3325392663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f80b1de0 0x7fa1f80b2270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009e50 tx=0x7fa1f002bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae02bd2db39bb755 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.787+0000 7fa1fd3d0640 1 -- 172.21.15.37:0/3325392663 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002c8d0 con 0x7fa1f80b1de0 2023-11-24T06:15:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.787+0000 7fa1fd3d0640 1 -- 172.21.15.37:0/3325392663 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f002ca30 con 0x7fa1f80b1de0 2023-11-24T06:15:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.787+0000 7fa1fd3d0640 1 -- 172.21.15.37:0/3325392663 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002cdc0 con 0x7fa1f80b1de0 2023-11-24T06:15:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.788+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/3325392663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f80b1de0 msgr2=0x7fa1f80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.788+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/3325392663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f80b1de0 0x7fa1f80b2270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009e50 tx=0x7fa1f002bdb0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.788+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/3325392663 shutdown_connections 2023-11-24T06:15:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.788+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/3325392663 >> v2:172.21.15.188:3300/0 conn(0x7fa1f815c410 0x7fa1f815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.788+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/3325392663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f80b1de0 0x7fa1f80b2270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.788+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/3325392663 >> 172.21.15.37:0/3325392663 conn(0x7fa1f80cb830 msgr2=0x7fa1f80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:27.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.789+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/3325392663 shutdown_connections 2023-11-24T06:15:27.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.789+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/3325392663 wait complete. 2023-11-24T06:15:27.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.790+0000 7fa1ff3d4640 1 Processor -- start 2023-11-24T06:15:27.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.790+0000 7fa1ff3d4640 1 -- start start 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.791+0000 7fa1ff3d4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f80b1de0 0x7fa1f8071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.791+0000 7fa1ff3d4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f8144b30 0x7fa1f815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.791+0000 7fa1ff3d4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f815c410 0x7fa1f815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.791+0000 7fa1ff3d4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8070420 con 0x7fa1f8144b30 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.791+0000 7fa1ff3d4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80722e0 con 0x7fa1f80b1de0 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.791+0000 7fa1ff3d4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80706c0 con 0x7fa1f815c410 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f8144b30 0x7fa1f815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f8144b30 0x7fa1f815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47408/0 (socket says 172.21.15.37:47408) 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 -- 172.21.15.37:0/514227863 learned_addr learned my addr 172.21.15.37:0/514227863 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fe3d2640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f80b1de0 0x7fa1f8071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1febd3640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f815c410 0x7fa1f815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 -- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f815c410 msgr2=0x7fa1f815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f815c410 0x7fa1f815df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 -- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f80b1de0 msgr2=0x7fa1f8071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f80b1de0 0x7fa1f8071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.792+0000 7fa1fdbd1640 1 -- 172.21.15.37:0/514227863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0009b30 con 0x7fa1f8144b30 2023-11-24T06:15:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.793+0000 7fa1fdbd1640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f8144b30 0x7fa1f815a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e870 tx=0x7fa1e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.793+0000 7fa1eeffd640 1 -- 172.21.15.37:0/514227863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80094f0 con 0x7fa1f8144b30 2023-11-24T06:15:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.793+0000 7fa1eeffd640 1 -- 172.21.15.37:0/514227863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e800c940 con 0x7fa1f8144b30 2023-11-24T06:15:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.793+0000 7fa1eeffd640 1 -- 172.21.15.37:0/514227863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800ccf0 con 0x7fa1f8144b30 2023-11-24T06:15:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.793+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f80709a0 con 0x7fa1f8144b30 2023-11-24T06:15:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.793+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f8070f60 con 0x7fa1f8144b30 2023-11-24T06:15:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.794+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f804e840 con 0x7fa1f8144b30 2023-11-24T06:15:27.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.795+0000 7fa1eeffd640 1 -- 172.21.15.37:0/514227863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1e8013470 con 0x7fa1f8144b30 2023-11-24T06:15:27.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.796+0000 7fa1eeffd640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa1dc06ae40 0x7fa1dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:27.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.796+0000 7fa1eeffd640 1 -- 172.21.15.37:0/514227863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1e8089740 con 0x7fa1f8144b30 2023-11-24T06:15:27.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.796+0000 7fa1fe3d2640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa1dc06ae40 0x7fa1dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:27.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.797+0000 7fa1fe3d2640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa1dc06ae40 0x7fa1dc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4000f60 tx=0x7fa1f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.801+0000 7fa1eeffd640 1 -- 172.21.15.37:0/514227863 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1e80547e0 con 0x7fa1f8144b30 2023-11-24T06:15:28.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:27.999+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f80b4ad0 con 0x7fa1f8144b30 2023-11-24T06:15:28.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.001+0000 7fa1eeffd640 1 -- 172.21.15.37:0/514227863 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fa1e8057e00 con 0x7fa1f8144b30 2023-11-24T06:15:28.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:28.004 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:28.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa1dc06ae40 msgr2=0x7fa1dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa1dc06ae40 0x7fa1dc06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4000f60 tx=0x7fa1f4009040 comp rx=0 tx=0).stop 2023-11-24T06:15:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f8144b30 msgr2=0x7fa1f815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f8144b30 0x7fa1f815a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e870 tx=0x7fa1e800ed30 comp rx=0 tx=0).stop 2023-11-24T06:15:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 shutdown_connections 2023-11-24T06:15:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa1dc06ae40 0x7fa1dc06d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1f815c410 0x7fa1f815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f8144b30 0x7fa1f815a8c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 --2- 172.21.15.37:0/514227863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1f80b1de0 0x7fa1f8071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.004+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 >> 172.21.15.37:0/514227863 conn(0x7fa1f80cb830 msgr2=0x7fa1f80cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.005+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 shutdown_connections 2023-11-24T06:15:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.005+0000 7fa1ff3d4640 1 -- 172.21.15.37:0/514227863 wait complete. 2023-11-24T06:15:28.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:28.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.244+0000 7f5156a9b640 1 Processor -- start 2023-11-24T06:15:28.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.244+0000 7f5156a9b640 1 -- start start 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f5156a9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f515015b440 0x7f51500cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f5156a9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51500cbf20 0x7f51500c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f5156a9b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515015eea0 con 0x7f51500c57e0 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f5156a9b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500cc3d0 con 0x7f51500cbf20 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f5156a9b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515015b820 con 0x7f515015b440 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f514ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51500cbf20 0x7f51500c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f5155038640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f51500c57e0 0x7f51500c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42340/0 (socket says 172.21.15.37:42340) 2023-11-24T06:15:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.246+0000 7f5155038640 1 -- 172.21.15.37:0/2838681100 learned_addr learned my addr 172.21.15.37:0/2838681100 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.247+0000 7f5154837640 1 --2- 172.21.15.37:0/2838681100 >> v2:172.21.15.188:3300/0 conn(0x7f515015b440 0x7f51500cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.247+0000 7f514ffff640 1 -- 172.21.15.37:0/2838681100 >> v2:172.21.15.188:3300/0 conn(0x7f515015b440 msgr2=0x7f51500cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.247+0000 7f514ffff640 1 --2- 172.21.15.37:0/2838681100 >> v2:172.21.15.188:3300/0 conn(0x7f515015b440 0x7f51500cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.247+0000 7f514ffff640 1 -- 172.21.15.37:0/2838681100 >> v1:172.21.15.37:6789/0 conn(0x7f51500c57e0 legacy=0x7f51500c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.247+0000 7f514ffff640 1 -- 172.21.15.37:0/2838681100 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515006d600 con 0x7f51500cbf20 2023-11-24T06:15:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.247+0000 7f5154837640 1 --2- 172.21.15.37:0/2838681100 >> v2:172.21.15.188:3300/0 conn(0x7f515015b440 0x7f51500cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.248+0000 7f514ffff640 1 --2- 172.21.15.37:0/2838681100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51500cbf20 0x7f51500c52a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f515006e770 tx=0x7f514402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bf3ecf446d13fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f514f7fe640 1 -- 172.21.15.37:0/2838681100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514402e070 con 0x7f51500cbf20 2023-11-24T06:15:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f514f7fe640 1 -- 172.21.15.37:0/2838681100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51440315a0 con 0x7f51500cbf20 2023-11-24T06:15:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f514f7fe640 1 -- 172.21.15.37:0/2838681100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144031930 con 0x7f51500cbf20 2023-11-24T06:15:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 -- 172.21.15.37:0/2838681100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51500cbf20 msgr2=0x7f51500c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 --2- 172.21.15.37:0/2838681100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51500cbf20 0x7f51500c52a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f515006e770 tx=0x7f514402b840 comp rx=0 tx=0).stop 2023-11-24T06:15:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 -- 172.21.15.37:0/2838681100 shutdown_connections 2023-11-24T06:15:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 --2- 172.21.15.37:0/2838681100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51500cbf20 0x7f51500c52a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 --2- 172.21.15.37:0/2838681100 >> v2:172.21.15.188:3300/0 conn(0x7f515015b440 0x7f51500cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 -- 172.21.15.37:0/2838681100 >> 172.21.15.37:0/2838681100 conn(0x7f51500b0c50 msgr2=0x7f51500b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 -- 172.21.15.37:0/2838681100 shutdown_connections 2023-11-24T06:15:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.249+0000 7f5156a9b640 1 -- 172.21.15.37:0/2838681100 wait complete. 2023-11-24T06:15:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.252+0000 7f5156a9b640 1 Processor -- start 2023-11-24T06:15:28.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.252+0000 7f5156a9b640 1 -- start start 2023-11-24T06:15:28.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5156a9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51500c57e0 0x7f5150153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5156a9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51500cbf20 0x7f5150070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5156a9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515015b440 0x7f5150071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5156a9b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500acf30 con 0x7f515015b440 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5156a9b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500b39f0 con 0x7f51500cbf20 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5156a9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500b3cd0 con 0x7f51500c57e0 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5155038640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515015b440 0x7f5150071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5155038640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515015b440 0x7f5150071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47434/0 (socket says 172.21.15.37:47434) 2023-11-24T06:15:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.254+0000 7f5155038640 1 -- 172.21.15.37:0/1949132119 learned_addr learned my addr 172.21.15.37:0/1949132119 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5154837640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51500c57e0 0x7f5150153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f514ffff640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51500cbf20 0x7f5150070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5155038640 1 -- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51500c57e0 msgr2=0x7f5150153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5155038640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51500c57e0 0x7f5150153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5155038640 1 -- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51500cbf20 msgr2=0x7f5150070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5155038640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51500cbf20 0x7f5150070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5155038640 1 -- 172.21.15.37:0/1949132119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009400 con 0x7f515015b440 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f514ffff640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51500cbf20 0x7f5150070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5155038640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515015b440 0x7f5150071290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f514800c420 tx=0x7f514800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f514d7fa640 1 -- 172.21.15.37:0/1949132119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148005ce0 con 0x7f515015b440 2023-11-24T06:15:28.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f514d7fa640 1 -- 172.21.15.37:0/1949132119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148005e40 con 0x7f515015b440 2023-11-24T06:15:28.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f514d7fa640 1 -- 172.21.15.37:0/1949132119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51480072d0 con 0x7f515015b440 2023-11-24T06:15:28.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51500acbc0 con 0x7f515015b440 2023-11-24T06:15:28.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.255+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51500b3fb0 con 0x7f515015b440 2023-11-24T06:15:28.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.257+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51500ad0a0 con 0x7f515015b440 2023-11-24T06:15:28.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.258+0000 7f514d7fa640 1 -- 172.21.15.37:0/1949132119 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5148007430 con 0x7f515015b440 2023-11-24T06:15:28.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.258+0000 7f514d7fa640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f513c06ae70 0x7f513c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.259+0000 7f514d7fa640 1 -- 172.21.15.37:0/1949132119 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5148088b20 con 0x7f515015b440 2023-11-24T06:15:28.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.259+0000 7f5154837640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f513c06ae70 0x7f513c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.260+0000 7f5154837640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f513c06ae70 0x7f513c06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5140008ee0 tx=0x7f5140008430 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:28.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.263+0000 7f514d7fa640 1 -- 172.21.15.37:0/1949132119 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5148053be0 con 0x7f515015b440 2023-11-24T06:15:28.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.455+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f515004e8b0 con 0x7f515015b440 2023-11-24T06:15:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.456+0000 7f514d7fa640 1 -- 172.21.15.37:0/1949132119 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5148017020 con 0x7f515015b440 2023-11-24T06:15:28.459 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.458+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f513c06ae70 msgr2=0x7f513c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.458+0000 7f5156a9b640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f513c06ae70 0x7f513c06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5140008ee0 tx=0x7f5140008430 comp rx=0 tx=0).stop 2023-11-24T06:15:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.458+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515015b440 msgr2=0x7f5150071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.458+0000 7f5156a9b640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515015b440 0x7f5150071290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f514800c420 tx=0x7f514800c8e0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 shutdown_connections 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f513c06ae70 0x7f513c06d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51500cbf20 0x7f5150070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515015b440 0x7f5150071290 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 --2- 172.21.15.37:0/1949132119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51500c57e0 0x7f5150153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 >> 172.21.15.37:0/1949132119 conn(0x7f51500b0c50 msgr2=0x7f51500b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 shutdown_connections 2023-11-24T06:15:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.459+0000 7f5156a9b640 1 -- 172.21.15.37:0/1949132119 wait complete. 2023-11-24T06:15:28.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.700+0000 7fcd71a2e640 1 Processor -- start 2023-11-24T06:15:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.701+0000 7fcd71a2e640 1 -- start start 2023-11-24T06:15:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd71a2e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcd6c15d3f0 0x7fcd6c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd71a2e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd6c0d0e40 0x7fcd6c0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd71a2e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6c0d15e0 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd71a2e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6c0d0280 con 0x7fcd6c0d0e40 2023-11-24T06:15:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd71a2e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6c0d1300 con 0x7fcd6c15d3f0 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd7122d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd6c0d0e40 0x7fcd6c0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd7122d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd6c0d0e40 0x7fcd6c0d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47440/0 (socket says 172.21.15.37:47440) 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.702+0000 7fcd7122d640 1 -- 172.21.15.37:0/3610547761 learned_addr learned my addr 172.21.15.37:0/3610547761 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.703+0000 7fcd70a2c640 1 --2- 172.21.15.37:0/3610547761 >> v2:172.21.15.188:3300/0 conn(0x7fcd6c15d3f0 0x7fcd6c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.703+0000 7fcd7122d640 1 -- 172.21.15.37:0/3610547761 >> v2:172.21.15.188:3300/0 conn(0x7fcd6c15d3f0 msgr2=0x7fcd6c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.703+0000 7fcd7122d640 1 --2- 172.21.15.37:0/3610547761 >> v2:172.21.15.188:3300/0 conn(0x7fcd6c15d3f0 0x7fcd6c0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.703+0000 7fcd7122d640 1 -- 172.21.15.37:0/3610547761 >> v1:172.21.15.188:6789/0 conn(0x7fcd6c15d7d0 legacy=0x7fcd6c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.703+0000 7fcd7122d640 1 -- 172.21.15.37:0/3610547761 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0cfc30 con 0x7fcd6c0d0e40 2023-11-24T06:15:28.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.704+0000 7fcd7122d640 1 --2- 172.21.15.37:0/3610547761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c0d0e40 0x7fcd6c0d1d70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c067c60 tx=0x7fcd6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1ff016d7199a6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:28.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.705+0000 7fcd6b7fe640 1 -- 172.21.15.37:0/3610547761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd64031870 con 0x7fcd6c0d0e40 2023-11-24T06:15:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.705+0000 7fcd6b7fe640 1 -- 172.21.15.37:0/3610547761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd640319d0 con 0x7fcd6c0d0e40 2023-11-24T06:15:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.705+0000 7fcd6b7fe640 1 -- 172.21.15.37:0/3610547761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd64031d60 con 0x7fcd6c0d0e40 2023-11-24T06:15:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 -- 172.21.15.37:0/3610547761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c0d0e40 msgr2=0x7fcd6c0d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/3610547761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c0d0e40 0x7fcd6c0d1d70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c067c60 tx=0x7fcd6402b910 comp rx=0 tx=0).stop 2023-11-24T06:15:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 -- 172.21.15.37:0/3610547761 shutdown_connections 2023-11-24T06:15:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/3610547761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c0d0e40 0x7fcd6c0d1d70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/3610547761 >> v2:172.21.15.188:3300/0 conn(0x7fcd6c15d3f0 0x7fcd6c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 -- 172.21.15.37:0/3610547761 >> 172.21.15.37:0/3610547761 conn(0x7fcd6c09c5b0 msgr2=0x7fcd6c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 -- 172.21.15.37:0/3610547761 shutdown_connections 2023-11-24T06:15:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.706+0000 7fcd71a2e640 1 -- 172.21.15.37:0/3610547761 wait complete. 2023-11-24T06:15:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.708+0000 7fcd71a2e640 1 Processor -- start 2023-11-24T06:15:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.708+0000 7fcd71a2e640 1 -- start start 2023-11-24T06:15:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd71a2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcd6c0d0e40 0x7fcd6c0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd71a2e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd6c15d3f0 0x7fcd6c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd71a2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c15d7d0 0x7fcd6c0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd71a2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0b5370 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd71a2e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0b4440 con 0x7fcd6c15d3f0 2023-11-24T06:15:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd71a2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0b46f0 con 0x7fcd6c0d0e40 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd7122d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c15d7d0 0x7fcd6c0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd7122d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c15d7d0 0x7fcd6c0b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47442/0 (socket says 172.21.15.37:47442) 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd7122d640 1 -- 172.21.15.37:0/1444153363 learned_addr learned my addr 172.21.15.37:0/1444153363 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd6bfff640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd6c15d3f0 0x7fcd6c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd70a2c640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcd6c0d0e40 0x7fcd6c0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd7122d640 1 -- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcd6c0d0e40 msgr2=0x7fcd6c0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd7122d640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcd6c0d0e40 0x7fcd6c0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.709+0000 7fcd7122d640 1 -- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd6c15d3f0 msgr2=0x7fcd6c0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd7122d640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd6c15d3f0 0x7fcd6c0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd7122d640 1 -- 172.21.15.37:0/1444153363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd640094d0 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd6bfff640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd6c15d3f0 0x7fcd6c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd70a2c640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcd6c0d0e40 0x7fcd6c0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd7122d640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c15d7d0 0x7fcd6c0b3f00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd6402b950 tx=0x7fcd640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd697fa640 1 -- 172.21.15.37:0/1444153363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd640443f0 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd697fa640 1 -- 172.21.15.37:0/1444153363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd64044570 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd697fa640 1 -- 172.21.15.37:0/1444153363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd64044920 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c0b49d0 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.710+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c0b4f90 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.711+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6c1f4530 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.712+0000 7fcd697fa640 1 -- 172.21.15.37:0/1444153363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd64044a80 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.713+0000 7fcd697fa640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcd4c06ae40 0x7fcd4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.713+0000 7fcd697fa640 1 -- 172.21.15.37:0/1444153363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd6402d040 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.714+0000 7fcd70a2c640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcd4c06ae40 0x7fcd4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.714+0000 7fcd70a2c640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcd4c06ae40 0x7fcd4c06d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0cab60 tx=0x7fcd5c0074c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.718+0000 7fcd697fa640 1 -- 172.21.15.37:0/1444153363 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd6c1f4530 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.914+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd6c1f4530 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.914+0000 7fcd697fa640 1 -- 172.21.15.37:0/1444153363 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd6c1f4530 con 0x7fcd6c15d7d0 2023-11-24T06:15:28.917 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:28.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcd4c06ae40 msgr2=0x7fcd4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcd4c06ae40 0x7fcd4c06d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0cab60 tx=0x7fcd5c0074c0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c15d7d0 msgr2=0x7fcd6c0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:28.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c15d7d0 0x7fcd6c0b3f00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd6402b950 tx=0x7fcd640046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 shutdown_connections 2023-11-24T06:15:28.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcd4c06ae40 0x7fcd4c06d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcd6c15d3f0 0x7fcd6c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd6c15d7d0 0x7fcd6c0b3f00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 --2- 172.21.15.37:0/1444153363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcd6c0d0e40 0x7fcd6c0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:28.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.917+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 >> 172.21.15.37:0/1444153363 conn(0x7fcd6c09c5b0 msgr2=0x7fcd6c15c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:28.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.918+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 shutdown_connections 2023-11-24T06:15:28.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:28.918+0000 7fcd71a2e640 1 -- 172.21.15.37:0/1444153363 wait complete. 2023-11-24T06:15:28.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.166+0000 7fe0d3fff640 1 Processor -- start 2023-11-24T06:15:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.166+0000 7fe0d3fff640 1 -- start start 2023-11-24T06:15:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.168+0000 7fe0d3fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 0x7fe0d40b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.168+0000 7fe0d3fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0d415ded0 0x7fe0d415e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.168+0000 7fe0d3fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d406d430 con 0x7fe0d415a1c0 2023-11-24T06:15:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.168+0000 7fe0d3fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d415ec50 con 0x7fe0d415ded0 2023-11-24T06:15:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.169+0000 7fe0d3fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d406cb00 con 0x7fe0d40b0b40 2023-11-24T06:15:29.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.169+0000 7fe0d2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0d415a1c0 0x7fe0d406d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42352/0 (socket says 172.21.15.37:42352) 2023-11-24T06:15:29.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.169+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3819056534 learned_addr learned my addr 172.21.15.37:0/3819056534 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.169+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992255112 0 0) 0x7fe0d406d430 con 0x7fe0d415a1c0 2023-11-24T06:15:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.169+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c0003520 con 0x7fe0d415a1c0 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.169+0000 7fe0d37fe640 1 --2- 172.21.15.37:0/3819056534 >> v2:172.21.15.188:3300/0 conn(0x7fe0d415ded0 0x7fe0d415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.169+0000 7fe0cbfff640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 0x7fe0d40b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3780198503 0 0) 0x7fe0c0003520 con 0x7fe0d415a1c0 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 msgr2=0x7fe0d40b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 0x7fe0d40b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 >> v2:172.21.15.188:3300/0 conn(0x7fe0d415ded0 msgr2=0x7fe0d415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 --2- 172.21.15.37:0/3819056534 >> v2:172.21.15.188:3300/0 conn(0x7fe0d415ded0 0x7fe0d415e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d40b14e0 con 0x7fe0d415a1c0 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fe0c4001670 con 0x7fe0d415a1c0 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 >> v1:172.21.15.37:6789/0 conn(0x7fe0d415a1c0 legacy=0x7fe0d406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 0x7fe0c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d415ec50 con 0x7fe0c0003970 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d406cb00 con 0x7fe0c00047c0 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c000dc90 con 0x7fe0d40b0b40 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d2ffd640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0cbfff640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.170+0000 7fe0d37fe640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 0x7fe0c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.171+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 msgr2=0x7fe0c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.171+0000 7fe0d2ffd640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d40b0b40 0x7fe0c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.171+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c00047c0 msgr2=0x7fe0c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.171+0000 7fe0d2ffd640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.171+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3819056534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0003520 con 0x7fe0c0003970 2023-11-24T06:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.171+0000 7fe0cbfff640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c00047c0 0x7fe0c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.172+0000 7fe0d2ffd640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0c0003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400c0e0 tx=0x7fe0c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc619ee908becfa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.172+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4005ad0 con 0x7fe0c0003970 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.172+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c4005c50 con 0x7fe0c0003970 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.172+0000 7fe0d27fc640 1 -- 172.21.15.37:0/3819056534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c402c7d0 con 0x7fe0c0003970 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.173+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3819056534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 msgr2=0x7fe0c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.173+0000 7fe0d3fff640 1 --2- 172.21.15.37:0/3819056534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0c0003d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400c0e0 tx=0x7fe0c00057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.173+0000 7fe0d37fe640 1 -- 172.21.15.37:0/3819056534 reap_dead start 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.173+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3819056534 shutdown_connections 2023-11-24T06:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.173+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3819056534 >> 172.21.15.37:0/3819056534 conn(0x7fe0d40cbb40 msgr2=0x7fe0d40cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.173+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3819056534 shutdown_connections 2023-11-24T06:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.173+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3819056534 wait complete. 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.175+0000 7fe0d3fff640 1 Processor -- start 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.175+0000 7fe0d3fff640 1 -- start start 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0d40c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d3fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d415c7c0 0x7fe0d40b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d415cc20 0x7fe0d40b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d3fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d415c3a0 con 0x7fe0c0003970 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d3fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d415b720 con 0x7fe0d415cc20 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d3fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d415ba00 con 0x7fe0d415c7c0 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0d40c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0d40c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47462/0 (socket says 172.21.15.37:47462) 2023-11-24T06:15:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.176+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3408702732 learned_addr learned my addr 172.21.15.37:0/3408702732 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3408702732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d415c7c0 msgr2=0x7fe0d40b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d2ffd640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d415c7c0 0x7fe0d40b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3408702732 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d415cc20 msgr2=0x7fe0d40b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d2ffd640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d415cc20 0x7fe0d40b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d2ffd640 1 -- 172.21.15.37:0/3408702732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d415ea20 con 0x7fe0c0003970 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d2ffd640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0d40c5360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe0c402c370 tx=0x7fe0c4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d0ff9640 1 -- 172.21.15.37:0/3408702732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4039070 con 0x7fe0c0003970 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d0ff9640 1 -- 172.21.15.37:0/3408702732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c402cbe0 con 0x7fe0c0003970 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d415bce0 con 0x7fe0c0003970 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d0ff9640 1 -- 172.21.15.37:0/3408702732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c403c040 con 0x7fe0c0003970 2023-11-24T06:15:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.177+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d4157b30 con 0x7fe0c0003970 2023-11-24T06:15:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.179+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d404e840 con 0x7fe0c0003970 2023-11-24T06:15:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.180+0000 7fe0d0ff9640 1 -- 172.21.15.37:0/3408702732 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0c4032070 con 0x7fe0c0003970 2023-11-24T06:15:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.180+0000 7fe0d0ff9640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0b406ae40 0x7fe0b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.181+0000 7fe0d0ff9640 1 -- 172.21.15.37:0/3408702732 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0c40aa920 con 0x7fe0c0003970 2023-11-24T06:15:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.181+0000 7fe0cbfff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0b406ae40 0x7fe0b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.181+0000 7fe0cbfff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0b406ae40 0x7fe0b406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40c67b0 tx=0x7fe0bc009340 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.185+0000 7fe0d0ff9640 1 -- 172.21.15.37:0/3408702732 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0c4075ae0 con 0x7fe0c0003970 2023-11-24T06:15:29.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.380+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0d40ca020 con 0x7fe0c0003970 2023-11-24T06:15:29.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.381+0000 7fe0d0ff9640 1 -- 172.21.15.37:0/3408702732 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0c4079100 con 0x7fe0c0003970 2023-11-24T06:15:29.384 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.384+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0b406ae40 msgr2=0x7fe0b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.384+0000 7fe0d3fff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0b406ae40 0x7fe0b406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40c67b0 tx=0x7fe0bc009340 comp rx=0 tx=0).stop 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.384+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 msgr2=0x7fe0d40c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.384+0000 7fe0d3fff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0d40c5360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe0c402c370 tx=0x7fe0c4001930 comp rx=0 tx=0).stop 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.384+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 shutdown_connections 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.385+0000 7fe0d3fff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0b406ae40 0x7fe0b406d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.385+0000 7fe0d3fff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0d415cc20 0x7fe0d40b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.385+0000 7fe0d3fff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0d415c7c0 0x7fe0d40b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.385+0000 7fe0d3fff640 1 --2- 172.21.15.37:0/3408702732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c0003970 0x7fe0d40c5360 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.385+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 >> 172.21.15.37:0/3408702732 conn(0x7fe0d40cbb40 msgr2=0x7fe0d40caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.385+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 shutdown_connections 2023-11-24T06:15:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.385+0000 7fe0d3fff640 1 -- 172.21.15.37:0/3408702732 wait complete. 2023-11-24T06:15:29.471 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2023-11-24T06:15:29.472 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2023-11-24T06:15:29.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.707+0000 7f9649ead640 1 Processor -- start 2023-11-24T06:15:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.707+0000 7f9649ead640 1 -- start start 2023-11-24T06:15:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.709+0000 7f9649ead640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96440cf450 0x7f96440cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.709+0000 7f9649ead640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440cece0 con 0x7f96440cdfb0 2023-11-24T06:15:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.709+0000 7f9649ead640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964406d040 con 0x7f964415c7f0 2023-11-24T06:15:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.709+0000 7f9649ead640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96440cfe40 con 0x7f96440cf450 2023-11-24T06:15:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.709+0000 7f9643fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96440cdfb0 0x7f96440ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42364/0 (socket says 172.21.15.37:42364) 2023-11-24T06:15:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.709+0000 7f9643fff640 1 -- 172.21.15.37:0/1207091420 learned_addr learned my addr 172.21.15.37:0/1207091420 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:29.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.709+0000 7f9642ffd640 1 --2- 172.21.15.37:0/1207091420 >> v2:172.21.15.37:3300/0 conn(0x7f96440cf450 0x7f96440cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.710+0000 7f96427fc640 1 -- 172.21.15.37:0/1207091420 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455612764 0 0) 0x7f96440cece0 con 0x7f96440cdfb0 2023-11-24T06:15:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.710+0000 7f96427fc640 1 -- 172.21.15.37:0/1207091420 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f962c003520 con 0x7f96440cdfb0 2023-11-24T06:15:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.710+0000 7f9642ffd640 1 -- 172.21.15.37:0/1207091420 >> v1:172.21.15.188:6789/0 conn(0x7f964415c7f0 legacy=0x7f964406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.710+0000 7f9642ffd640 1 -- 172.21.15.37:0/1207091420 >> v1:172.21.15.37:6789/0 conn(0x7f96440cdfb0 legacy=0x7f96440ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.710+0000 7f9642ffd640 1 -- 172.21.15.37:0/1207091420 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964406d320 con 0x7f96440cf450 2023-11-24T06:15:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.712+0000 7f9642ffd640 1 --2- 172.21.15.37:0/1207091420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cf450 0x7f96440cf900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96380097a0 tx=0x7f963802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1f890f1a420176 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:29.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.715+0000 7f96427fc640 1 -- 172.21.15.37:0/1207091420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638030610 con 0x7f96440cf450 2023-11-24T06:15:29.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.715+0000 7f96427fc640 1 -- 172.21.15.37:0/1207091420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9638030770 con 0x7f96440cf450 2023-11-24T06:15:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.715+0000 7f96427fc640 1 -- 172.21.15.37:0/1207091420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638030b00 con 0x7f96440cf450 2023-11-24T06:15:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.716+0000 7f9649ead640 1 -- 172.21.15.37:0/1207091420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cf450 msgr2=0x7f96440cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.716+0000 7f9649ead640 1 --2- 172.21.15.37:0/1207091420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cf450 0x7f96440cf900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96380097a0 tx=0x7f963802b960 comp rx=0 tx=0).stop 2023-11-24T06:15:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.716+0000 7f9649ead640 1 -- 172.21.15.37:0/1207091420 shutdown_connections 2023-11-24T06:15:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.716+0000 7f9649ead640 1 --2- 172.21.15.37:0/1207091420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cf450 0x7f96440cf900 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.716+0000 7f9649ead640 1 -- 172.21.15.37:0/1207091420 >> 172.21.15.37:0/1207091420 conn(0x7f964406a920 msgr2=0x7f964406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.716+0000 7f9649ead640 1 -- 172.21.15.37:0/1207091420 shutdown_connections 2023-11-24T06:15:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.716+0000 7f9649ead640 1 -- 172.21.15.37:0/1207091420 wait complete. 2023-11-24T06:15:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.718+0000 7f9649ead640 1 Processor -- start 2023-11-24T06:15:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.719+0000 7f9649ead640 1 -- start start 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f9649ead640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cdfb0 0x7f96441fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f9649ead640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f964415c7f0 0x7f964415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f9649ead640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f964415e040 0x7f96441f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f9649ead640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964415a920 con 0x7f96440cdfb0 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f9649ead640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964415ab30 con 0x7f964415e040 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f9649ead640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964415ae10 con 0x7f964415c7f0 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f96437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cdfb0 0x7f96441fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f96437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cdfb0 0x7f96441fbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47478/0 (socket says 172.21.15.37:47478) 2023-11-24T06:15:29.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.720+0000 7f96437fe640 1 -- 172.21.15.37:0/35007487 learned_addr learned my addr 172.21.15.37:0/35007487 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.721+0000 7f9642ffd640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f964415c7f0 0x7f964415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.721+0000 7f96437fe640 1 -- 172.21.15.37:0/35007487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f964415c7f0 msgr2=0x7f964415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.721+0000 7f96437fe640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f964415c7f0 0x7f964415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.721+0000 7f96437fe640 1 -- 172.21.15.37:0/35007487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f964415e040 msgr2=0x7f96441f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.721+0000 7f96437fe640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f964415e040 0x7f96441f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.721+0000 7f96437fe640 1 -- 172.21.15.37:0/35007487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9638009400 con 0x7f96440cdfb0 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.721+0000 7f96437fe640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cdfb0 0x7f96441fbd30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f963400c400 tx=0x7f963400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.722+0000 7f962bfff640 1 -- 172.21.15.37:0/35007487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340052d0 con 0x7f96440cdfb0 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.722+0000 7f962bfff640 1 -- 172.21.15.37:0/35007487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634005430 con 0x7f96440cdfb0 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.722+0000 7f962bfff640 1 -- 172.21.15.37:0/35007487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634003830 con 0x7f96440cdfb0 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.722+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964415b0f0 con 0x7f96440cdfb0 2023-11-24T06:15:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.722+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964415b6b0 con 0x7f96440cdfb0 2023-11-24T06:15:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.723+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96440af640 con 0x7f96440cdfb0 2023-11-24T06:15:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.724+0000 7f962bfff640 1 -- 172.21.15.37:0/35007487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9634003990 con 0x7f96440cdfb0 2023-11-24T06:15:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.725+0000 7f962bfff640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f963006ae40 0x7f963006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.725+0000 7f962bfff640 1 -- 172.21.15.37:0/35007487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9634088cc0 con 0x7f96440cdfb0 2023-11-24T06:15:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.725+0000 7f9642ffd640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f963006ae40 0x7f963006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:29.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.727+0000 7f9642ffd640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f963006ae40 0x7f963006d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9638036000 tx=0x7f9638008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.733+0000 7f962bfff640 1 -- 172.21.15.37:0/35007487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f963408f080 con 0x7f96440cdfb0 2023-11-24T06:15:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.929+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9644067470 con 0x7f96440cdfb0 2023-11-24T06:15:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.931+0000 7f962bfff640 1 -- 172.21.15.37:0/35007487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f9634017020 con 0x7f96440cdfb0 2023-11-24T06:15:29.934 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:29.934 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:14:51.638012+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f963006ae40 msgr2=0x7f963006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f963006ae40 0x7f963006d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9638036000 tx=0x7f9638008030 comp rx=0 tx=0).stop 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cdfb0 msgr2=0x7f96441fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cdfb0 0x7f96441fbd30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f963400c400 tx=0x7f963400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 shutdown_connections 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f963006ae40 0x7f963006d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f964415e040 0x7f96441f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f964415c7f0 0x7f964415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 --2- 172.21.15.37:0/35007487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440cdfb0 0x7f96441fbd30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 >> 172.21.15.37:0/35007487 conn(0x7f964406a920 msgr2=0x7f96440aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 shutdown_connections 2023-11-24T06:15:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:29.934+0000 7f9649ead640 1 -- 172.21.15.37:0/35007487 wait complete. 2023-11-24T06:15:29.957 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:29.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.180+0000 7f6a115fa640 1 Processor -- start 2023-11-24T06:15:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.180+0000 7f6a115fa640 1 -- start start 2023-11-24T06:15:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.181+0000 7f6a115fa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d7d0 0x7f6a0c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.181+0000 7f6a115fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0c0d15e0 con 0x7f6a0c15d3f0 2023-11-24T06:15:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.181+0000 7f6a115fa640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0c0d0280 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.181+0000 7f6a115fa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b0eb0 con 0x7f6a0c15d7d0 2023-11-24T06:15:30.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.182+0000 7f6a0bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6a0c15d3f0 0x7f6a0c0d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42376/0 (socket says 172.21.15.37:42376) 2023-11-24T06:15:30.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.182+0000 7f6a0bfff640 1 -- 172.21.15.37:0/161171655 learned_addr learned my addr 172.21.15.37:0/161171655 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:30.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.182+0000 7f6a0b7fe640 1 --2- 172.21.15.37:0/161171655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d7d0 0x7f6a0c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.182+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366994621 0 0) 0x7f6a0c0d15e0 con 0x7f6a0c15d3f0 2023-11-24T06:15:30.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.182+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f8003520 con 0x7f6a0c15d3f0 2023-11-24T06:15:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.183+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095551063 0 0) 0x7f6a0c0d0280 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.183+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0c0d15e0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.183+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2520272129 0 0) 0x7f69f8003520 con 0x7f6a0c15d3f0 2023-11-24T06:15:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.183+0000 7f6a0b7fe640 1 -- 172.21.15.37:0/161171655 >> v1:172.21.15.188:6789/0 conn(0x7f6a0c0d1f40 legacy=0x7f6a0c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.183+0000 7f6a0b7fe640 1 -- 172.21.15.37:0/161171655 >> v1:172.21.15.37:6789/0 conn(0x7f6a0c15d3f0 legacy=0x7f6a0c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.183+0000 7f6a0b7fe640 1 -- 172.21.15.37:0/161171655 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0d1300 con 0x7f6a0c15d7d0 2023-11-24T06:15:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.185+0000 7f6a0b7fe640 1 --2- 172.21.15.37:0/161171655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d7d0 0x7f6a0c0cdd40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097d0 tx=0x7f69f402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa65413711e0af7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.185+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc001970 con 0x7f6a0c15d7d0 2023-11-24T06:15:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.185+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f402e050 con 0x7f6a0c15d7d0 2023-11-24T06:15:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.185+0000 7f6a0affd640 1 -- 172.21.15.37:0/161171655 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4030710 con 0x7f6a0c15d7d0 2023-11-24T06:15:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.186+0000 7f6a115fa640 1 -- 172.21.15.37:0/161171655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d7d0 msgr2=0x7f6a0c0cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.186+0000 7f6a115fa640 1 --2- 172.21.15.37:0/161171655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d7d0 0x7f6a0c0cdd40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097d0 tx=0x7f69f402b800 comp rx=0 tx=0).stop 2023-11-24T06:15:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.186+0000 7f6a115fa640 1 -- 172.21.15.37:0/161171655 shutdown_connections 2023-11-24T06:15:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.186+0000 7f6a115fa640 1 --2- 172.21.15.37:0/161171655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d7d0 0x7f6a0c0cdd40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.186+0000 7f6a115fa640 1 -- 172.21.15.37:0/161171655 >> 172.21.15.37:0/161171655 conn(0x7f6a0c09c5b0 msgr2=0x7f6a0c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.186+0000 7f6a115fa640 1 -- 172.21.15.37:0/161171655 shutdown_connections 2023-11-24T06:15:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.186+0000 7f6a115fa640 1 -- 172.21.15.37:0/161171655 wait complete. 2023-11-24T06:15:30.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.188+0000 7f6a115fa640 1 Processor -- start 2023-11-24T06:15:30.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.188+0000 7f6a115fa640 1 -- start start 2023-11-24T06:15:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.189+0000 7f6a115fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0d1f40 0x7f6a0c0b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.189+0000 7f6a115fa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d3f0 0x7f6a0c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.189+0000 7f6a115fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c15d7d0 0x7f6a0c0b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.189+0000 7f6a115fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b8cb0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.189+0000 7f6a115fa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b2e10 con 0x7f6a0c15d7d0 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.189+0000 7f6a115fa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b86f0 con 0x7f6a0c15d3f0 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0d1f40 0x7f6a0c0b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0d1f40 0x7f6a0c0b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47482/0 (socket says 172.21.15.37:47482) 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 -- 172.21.15.37:0/3279111180 learned_addr learned my addr 172.21.15.37:0/3279111180 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0b7fe640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d3f0 0x7f6a0c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a10df9640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c15d7d0 0x7f6a0c0b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 -- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d3f0 msgr2=0x7f6a0c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d3f0 0x7f6a0c0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 -- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c15d7d0 msgr2=0x7f6a0c0b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c15d7d0 0x7f6a0c0b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 -- 172.21.15.37:0/3279111180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009400 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a10df9640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c15d7d0 0x7f6a0c0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.190+0000 7f6a0bfff640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0d1f40 0x7f6a0c0b7da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69fc001fc0 tx=0x7f69fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.191+0000 7f6a08ff9640 1 -- 172.21.15.37:0/3279111180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc012400 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.191+0000 7f6a08ff9640 1 -- 172.21.15.37:0/3279111180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc012560 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.191+0000 7f6a08ff9640 1 -- 172.21.15.37:0/3279111180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc012910 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.191+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c0b89d0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.191+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c0b82e0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.192+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c0d06f0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.193+0000 7f6a08ff9640 1 -- 172.21.15.37:0/3279111180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f69fc012a70 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.194+0000 7f6a08ff9640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69ec06ae40 0x7f69ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.194+0000 7f6a08ff9640 1 -- 172.21.15.37:0/3279111180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69fc089e00 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.195+0000 7f6a0b7fe640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69ec06ae40 0x7f69ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.195+0000 7f6a0b7fe640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69ec06ae40 0x7f69ec06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f69f4034000 tx=0x7f69f4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.198+0000 7f6a08ff9640 1 -- 172.21.15.37:0/3279111180 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a0c0d06f0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.389+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a0c0d06f0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.389+0000 7f6a08ff9640 1 -- 172.21.15.37:0/3279111180 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a0c0d06f0 con 0x7f6a0c0d1f40 2023-11-24T06:15:30.392 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:30.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69ec06ae40 msgr2=0x7f69ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69ec06ae40 0x7f69ec06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f69f4034000 tx=0x7f69f4008030 comp rx=0 tx=0).stop 2023-11-24T06:15:30.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0d1f40 msgr2=0x7f6a0c0b7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0d1f40 0x7f6a0c0b7da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69fc001fc0 tx=0x7f69fc00a430 comp rx=0 tx=0).stop 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 shutdown_connections 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f69ec06ae40 0x7f69ec06d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a0c15d7d0 0x7f6a0c0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a0c15d3f0 0x7f6a0c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 --2- 172.21.15.37:0/3279111180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c0d1f40 0x7f6a0c0b7da0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 >> 172.21.15.37:0/3279111180 conn(0x7f6a0c09c5b0 msgr2=0x7f6a0c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 shutdown_connections 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.392+0000 7f6a115fa640 1 -- 172.21.15.37:0/3279111180 wait complete. 2023-11-24T06:15:30.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:30.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.625+0000 7f57fffff640 1 Processor -- start 2023-11-24T06:15:30.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.625+0000 7f57fffff640 1 -- start start 2023-11-24T06:15:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.627+0000 7f57fffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f580015b260 0x7f580006e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.627+0000 7f57fffff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580015ed20 con 0x7f58000b1250 2023-11-24T06:15:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.627+0000 7f57fffff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580015f8a0 con 0x7f580006e580 2023-11-24T06:15:30.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.627+0000 7f57fffff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580015b640 con 0x7f580015b260 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.627+0000 7f57ff7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58000b1250 0x7f580006c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42384/0 (socket says 172.21.15.37:42384) 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.627+0000 7f57ff7fe640 1 -- 172.21.15.37:0/4171091193 learned_addr learned my addr 172.21.15.37:0/4171091193 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57feffd640 1 --2- 172.21.15.37:0/4171091193 >> v2:172.21.15.188:3300/0 conn(0x7f580015b260 0x7f580006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799312377 0 0) 0x7f580015ed20 con 0x7f58000b1250 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e8003520 con 0x7f58000b1250 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 285908421 0 0) 0x7f57e8003520 con 0x7f58000b1250 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 >> v2:172.21.15.188:3300/0 conn(0x7f580015b260 msgr2=0x7f580006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 --2- 172.21.15.37:0/4171091193 >> v2:172.21.15.188:3300/0 conn(0x7f580015b260 0x7f580006e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 >> v1:172.21.15.188:6789/0 conn(0x7f580006e580 legacy=0x7f58000b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000abe50 con 0x7f58000b1250 2023-11-24T06:15:30.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f57f80019f0 con 0x7f58000b1250 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 >> v1:172.21.15.37:6789/0 conn(0x7f58000b1250 legacy=0x7f580006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57e80039c0 0x7f57e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80047c0 0x7f57e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80052a0 0x7f57e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580015b640 con 0x7f57e80052a0 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e800c1a0 con 0x7f57e80039c0 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.628+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e800c360 con 0x7f57e80047c0 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57ff7fe640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80052a0 0x7f57e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57fe7fc640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80047c0 0x7f57e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57feffd640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57e80039c0 0x7f57e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57ff7fe640 1 -- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80047c0 msgr2=0x7f57e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:30.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57ff7fe640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80047c0 0x7f57e8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57ff7fe640 1 -- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57e80039c0 msgr2=0x7f57e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:30.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57ff7fe640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57e80039c0 0x7f57e8003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.629+0000 7f57ff7fe640 1 -- 172.21.15.37:0/4171091193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8003520 con 0x7f57e80052a0 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.630+0000 7f57ff7fe640 1 -- 172.21.15.37:0/4171091193 reap_dead start 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.630+0000 7f57ff7fe640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80052a0 0x7f57e800b980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f580006dff0 tx=0x7f57e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b56e37d5d8965a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.630+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8034630 con 0x7f57e80052a0 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f802f070 con 0x7f57e80052a0 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fdffb640 1 -- 172.21.15.37:0/4171091193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8034a10 con 0x7f57e80052a0 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fffff640 1 -- 172.21.15.37:0/4171091193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80052a0 msgr2=0x7f57e800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fffff640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80052a0 0x7f57e800b980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f580006dff0 tx=0x7f57e80057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fffff640 1 -- 172.21.15.37:0/4171091193 shutdown_connections 2023-11-24T06:15:30.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fffff640 1 --2- 172.21.15.37:0/4171091193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80052a0 0x7f57e800b980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fffff640 1 -- 172.21.15.37:0/4171091193 >> 172.21.15.37:0/4171091193 conn(0x7f58000cbb40 msgr2=0x7f58000cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fffff640 1 -- 172.21.15.37:0/4171091193 shutdown_connections 2023-11-24T06:15:30.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.631+0000 7f57fffff640 1 -- 172.21.15.37:0/4171091193 wait complete. 2023-11-24T06:15:30.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.633+0000 7f57fffff640 1 Processor -- start 2023-11-24T06:15:30.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.633+0000 7f57fffff640 1 -- start start 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.634+0000 7f57fffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80052a0 0x7f580009c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.634+0000 7f57fffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5800157d00 0x7f58000b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.634+0000 7f57fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58000b3360 0x7f58000b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.634+0000 7f57fffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000c32c0 con 0x7f58000b3360 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.634+0000 7f57fffff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000b3ea0 con 0x7f5800157d00 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.634+0000 7f57fffff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000b4180 con 0x7f57e80052a0 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58000b3360 0x7f58000b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58000b3360 0x7f58000b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47488/0 (socket says 172.21.15.37:47488) 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 -- 172.21.15.37:0/3274514339 learned_addr learned my addr 172.21.15.37:0/3274514339 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57fe7fc640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5800157d00 0x7f58000b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57feffd640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80052a0 0x7f580009c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 -- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80052a0 msgr2=0x7f580009c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80052a0 0x7f580009c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 -- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5800157d00 msgr2=0x7f58000b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5800157d00 0x7f58000b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.635+0000 7f57ff7fe640 1 -- 172.21.15.37:0/3274514339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000c2c70 con 0x7f58000b3360 2023-11-24T06:15:30.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.636+0000 7f57ff7fe640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58000b3360 0x7f58000b37e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000f80 tx=0x7f57f8001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.636+0000 7f57e7fff640 1 -- 172.21.15.37:0/3274514339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8001930 con 0x7f58000b3360 2023-11-24T06:15:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.636+0000 7f57e7fff640 1 -- 172.21.15.37:0/3274514339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8004b60 con 0x7f58000b3360 2023-11-24T06:15:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.636+0000 7f57e7fff640 1 -- 172.21.15.37:0/3274514339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80347b0 con 0x7f58000b3360 2023-11-24T06:15:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.636+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58000c2f50 con 0x7f58000b3360 2023-11-24T06:15:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.636+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5800158180 con 0x7f58000b3360 2023-11-24T06:15:30.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.637+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58001583a0 con 0x7f58000b3360 2023-11-24T06:15:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.638+0000 7f57e7fff640 1 -- 172.21.15.37:0/3274514339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57f8031030 con 0x7f58000b3360 2023-11-24T06:15:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.639+0000 7f57e7fff640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f57ec06ae70 0x7f57ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.639+0000 7f57e7fff640 1 -- 172.21.15.37:0/3274514339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57f80aa590 con 0x7f58000b3360 2023-11-24T06:15:30.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.639+0000 7f57feffd640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f57ec06ae70 0x7f57ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.640+0000 7f57feffd640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f57ec06ae70 0x7f57ec06d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009910 tx=0x7f57f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.644+0000 7f57e7fff640 1 -- 172.21.15.37:0/3274514339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57f8075630 con 0x7f58000b3360 2023-11-24T06:15:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.844+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f580004e840 con 0x7f58000b3360 2023-11-24T06:15:30.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.844+0000 7f57e7fff640 1 -- 172.21.15.37:0/3274514339 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57f8078c50 con 0x7f58000b3360 2023-11-24T06:15:30.847 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f57ec06ae70 msgr2=0x7f57ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f57ec06ae70 0x7f57ec06d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009910 tx=0x7f57f0008040 comp rx=0 tx=0).stop 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58000b3360 msgr2=0x7f58000b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58000b3360 0x7f58000b37e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000f80 tx=0x7f57f8001cb0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 shutdown_connections 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f57ec06ae70 0x7f57ec06d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5800157d00 0x7f58000b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58000b3360 0x7f58000b37e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 --2- 172.21.15.37:0/3274514339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57e80052a0 0x7f580009c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 >> 172.21.15.37:0/3274514339 conn(0x7f58000cbb40 msgr2=0x7f58000acd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 shutdown_connections 2023-11-24T06:15:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:30.847+0000 7f57fffff640 1 -- 172.21.15.37:0/3274514339 wait complete. 2023-11-24T06:15:30.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.091+0000 7fe62359e640 1 Processor -- start 2023-11-24T06:15:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.091+0000 7fe62359e640 1 -- start start 2023-11-24T06:15:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.093+0000 7fe62359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 0x7fe6240d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.093+0000 7fe62359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6240d15e0 con 0x7fe62415d7d0 2023-11-24T06:15:31.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.093+0000 7fe62359e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6240d0280 con 0x7fe6240d0e40 2023-11-24T06:15:31.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.093+0000 7fe62359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240d1300 con 0x7fe62415d3f0 2023-11-24T06:15:31.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.094+0000 7fe61bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe62415d7d0 0x7fe6240afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44464/0 (socket says 172.21.15.37:44464) 2023-11-24T06:15:31.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.094+0000 7fe61bfff640 1 -- 172.21.15.37:0/1850173351 learned_addr learned my addr 172.21.15.37:0/1850173351 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.094+0000 7fe62259c640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 0x7fe6240d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.094+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304297320 0 0) 0x7fe6240d15e0 con 0x7fe62415d7d0 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.094+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe610003520 con 0x7fe62415d7d0 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118750055 0 0) 0x7fe6240d0280 con 0x7fe6240d0e40 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6240d15e0 con 0x7fe6240d0e40 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1328183437 0 0) 0x7fe610003520 con 0x7fe62415d7d0 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 msgr2=0x7fe6240d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:31.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 0x7fe6240d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 >> v1:172.21.15.188:6789/0 conn(0x7fe6240d0e40 legacy=0x7fe6240b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240cfc30 con 0x7fe62415d7d0 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fe60c001670 con 0x7fe62415d7d0 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 >> v1:172.21.15.37:6789/0 conn(0x7fe62415d7d0 legacy=0x7fe6240afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 0x7fe610003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6100040e0 0x7fe6100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe610004d00 0x7fe610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240d1300 con 0x7fe610004d00 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61000bb70 con 0x7fe6100040e0 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61000bd30 con 0x7fe62415d3f0 2023-11-24T06:15:31.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.095+0000 7fe622d9d640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe610004d00 0x7fe610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe62259c640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 0x7fe610003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe61bfff640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6100040e0 0x7fe6100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe622d9d640 1 -- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 msgr2=0x7fe610003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe622d9d640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe62415d3f0 0x7fe610003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe622d9d640 1 -- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6100040e0 msgr2=0x7fe6100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe622d9d640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6100040e0 0x7fe6100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe622d9d640 1 -- 172.21.15.37:0/1850173351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610003520 con 0x7fe610004d00 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.096+0000 7fe61bfff640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6100040e0 0x7fe6100047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.097+0000 7fe622d9d640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe610004d00 0x7fe610005180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001fa0 tx=0x7fe6100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9dea177e73772a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.097+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c003b70 con 0x7fe610004d00 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.097+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c003cd0 con 0x7fe610004d00 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.097+0000 7fe621d9b640 1 -- 172.21.15.37:0/1850173351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c0052f0 con 0x7fe610004d00 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.098+0000 7fe62359e640 1 -- 172.21.15.37:0/1850173351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe610004d00 msgr2=0x7fe610005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.098+0000 7fe62359e640 1 --2- 172.21.15.37:0/1850173351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe610004d00 0x7fe610005180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001fa0 tx=0x7fe6100057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.098+0000 7fe622d9d640 1 -- 172.21.15.37:0/1850173351 reap_dead start 2023-11-24T06:15:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.098+0000 7fe62359e640 1 -- 172.21.15.37:0/1850173351 shutdown_connections 2023-11-24T06:15:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.098+0000 7fe62359e640 1 -- 172.21.15.37:0/1850173351 >> 172.21.15.37:0/1850173351 conn(0x7fe62409c5b0 msgr2=0x7fe6240d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.098+0000 7fe62359e640 1 -- 172.21.15.37:0/1850173351 shutdown_connections 2023-11-24T06:15:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.098+0000 7fe62359e640 1 -- 172.21.15.37:0/1850173351 wait complete. 2023-11-24T06:15:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.100+0000 7fe62359e640 1 Processor -- start 2023-11-24T06:15:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.100+0000 7fe62359e640 1 -- start start 2023-11-24T06:15:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.101+0000 7fe62359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6240b4670 0x7fe6240b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.101+0000 7fe62359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240b2eb0 0x7fe6240b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.101+0000 7fe62359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6240b4f90 0x7fe6240c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.101+0000 7fe62359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240b7a00 con 0x7fe6240b2eb0 2023-11-24T06:15:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.101+0000 7fe62359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240b6df0 con 0x7fe6240b4670 2023-11-24T06:15:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.101+0000 7fe62359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240b70d0 con 0x7fe6240b4f90 2023-11-24T06:15:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240b2eb0 0x7fe6240b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240b2eb0 0x7fe6240b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51722/0 (socket says 172.21.15.37:51722) 2023-11-24T06:15:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 -- 172.21.15.37:0/1572394691 learned_addr learned my addr 172.21.15.37:0/1572394691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe62259c640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6240b4670 0x7fe6240b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 -- 172.21.15.37:0/1572394691 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6240b4f90 msgr2=0x7fe6240c7000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:15:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6240b4f90 0x7fe6240c7000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 -- 172.21.15.37:0/1572394691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6240b4670 msgr2=0x7fe6240b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6240b4670 0x7fe6240b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.102+0000 7fe61bfff640 1 -- 172.21.15.37:0/1572394691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240b73b0 con 0x7fe6240b2eb0 2023-11-24T06:15:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.103+0000 7fe61bfff640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240b2eb0 0x7fe6240b4a50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00db10 tx=0x7fe60c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.103+0000 7fe61affd640 1 -- 172.21.15.37:0/1572394691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c004cb0 con 0x7fe6240b2eb0 2023-11-24T06:15:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.103+0000 7fe61affd640 1 -- 172.21.15.37:0/1572394691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c004e10 con 0x7fe6240b2eb0 2023-11-24T06:15:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.103+0000 7fe61affd640 1 -- 172.21.15.37:0/1572394691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c007310 con 0x7fe6240b2eb0 2023-11-24T06:15:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.103+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6240b7690 con 0x7fe6240b2eb0 2023-11-24T06:15:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.103+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6240b5840 con 0x7fe6240b2eb0 2023-11-24T06:15:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.104+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6240b7bb0 con 0x7fe6240b2eb0 2023-11-24T06:15:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.105+0000 7fe61affd640 1 -- 172.21.15.37:0/1572394691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe60c007470 con 0x7fe6240b2eb0 2023-11-24T06:15:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.106+0000 7fe61affd640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe60406ae70 0x7fe60406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.106+0000 7fe61affd640 1 -- 172.21.15.37:0/1572394691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe60c088f30 con 0x7fe6240b2eb0 2023-11-24T06:15:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.107+0000 7fe62259c640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe60406ae70 0x7fe60406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.107+0000 7fe62259c640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe60406ae70 0x7fe60406d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe614006fd0 tx=0x7fe614008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:31.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.111+0000 7fe61affd640 1 -- 172.21.15.37:0/1572394691 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6240b7bb0 con 0x7fe6240b2eb0 2023-11-24T06:15:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.306+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6240b0c40 con 0x7fe6240b2eb0 2023-11-24T06:15:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.307+0000 7fe61affd640 1 -- 172.21.15.37:0/1572394691 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe60c0190a0 con 0x7fe6240b2eb0 2023-11-24T06:15:31.310 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:31.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe60406ae70 msgr2=0x7fe60406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe60406ae70 0x7fe60406d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe614006fd0 tx=0x7fe614008040 comp rx=0 tx=0).stop 2023-11-24T06:15:31.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240b2eb0 msgr2=0x7fe6240b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240b2eb0 0x7fe6240b4a50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00db10 tx=0x7fe60c007e30 comp rx=0 tx=0).stop 2023-11-24T06:15:31.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 shutdown_connections 2023-11-24T06:15:31.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe60406ae70 0x7fe60406d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6240b4f90 0x7fe6240c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240b2eb0 0x7fe6240b4a50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 --2- 172.21.15.37:0/1572394691 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6240b4670 0x7fe6240b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 >> 172.21.15.37:0/1572394691 conn(0x7fe62409c5b0 msgr2=0x7fe6241603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:31.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 shutdown_connections 2023-11-24T06:15:31.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.310+0000 7fe62359e640 1 -- 172.21.15.37:0/1572394691 wait complete. 2023-11-24T06:15:31.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-11-24T06:15:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.558+0000 7fee52d73640 1 Processor -- start 2023-11-24T06:15:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.559+0000 7fee52d73640 1 -- start start 2023-11-24T06:15:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.560+0000 7fee52d73640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fee4c0d1e20 0x7fee4c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.560+0000 7fee52d73640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee4c0d0070 0x7fee4c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.560+0000 7fee52d73640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0d04b0 con 0x7fee4c15d4e0 2023-11-24T06:15:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.560+0000 7fee52d73640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0d4110 con 0x7fee4c0d1e20 2023-11-24T06:15:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.560+0000 7fee52d73640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0ce990 con 0x7fee4c0d0070 2023-11-24T06:15:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.560+0000 7fee51d71640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee4c15d4e0 0x7fee4c0d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44478/0 (socket says 172.21.15.37:44478) 2023-11-24T06:15:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.560+0000 7fee51d71640 1 -- 172.21.15.37:0/37112111 learned_addr learned my addr 172.21.15.37:0/37112111 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee52572640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee4c0d0070 0x7fee4c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496125842 0 0) 0x7fee4c0d04b0 con 0x7fee4c15d4e0 2023-11-24T06:15:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee34003520 con 0x7fee4c15d4e0 2023-11-24T06:15:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee51570640 1 --2- 172.21.15.37:0/37112111 >> v2:172.21.15.188:3300/0 conn(0x7fee4c0d1e20 0x7fee4c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896670506 0 0) 0x7fee34003520 con 0x7fee4c15d4e0 2023-11-24T06:15:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee4c0d0070 msgr2=0x7fee4c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee4c0d0070 0x7fee4c0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 >> v2:172.21.15.188:3300/0 conn(0x7fee4c0d1e20 msgr2=0x7fee4c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 --2- 172.21.15.37:0/37112111 >> v2:172.21.15.188:3300/0 conn(0x7fee4c0d1e20 0x7fee4c0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0cec70 con 0x7fee4c15d4e0 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fee3c0019f0 con 0x7fee4c15d4e0 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee51570640 1 --2- 172.21.15.37:0/37112111 >> v2:172.21.15.188:3300/0 conn(0x7fee4c0d1e20 0x7fee4c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 >> v1:172.21.15.37:6789/0 conn(0x7fee4c15d4e0 legacy=0x7fee4c0d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee4c0d0070 0x7fee34003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee34003ef0 0x7fee340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee34004d00 0x7fee34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0d4110 con 0x7fee34004d00 2023-11-24T06:15:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0ce990 con 0x7fee34003ef0 2023-11-24T06:15:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.561+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3400b9d0 con 0x7fee4c0d0070 2023-11-24T06:15:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.562+0000 7fee52572640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee34004d00 0x7fee34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.562+0000 7fee52572640 1 -- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee4c0d0070 msgr2=0x7fee34003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.562+0000 7fee52572640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee4c0d0070 0x7fee34003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.562+0000 7fee52572640 1 -- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee34003ef0 msgr2=0x7fee340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.562+0000 7fee52572640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee34003ef0 0x7fee340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.562+0000 7fee52572640 1 -- 172.21.15.37:0/37112111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34003520 con 0x7fee34004d00 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.563+0000 7fee52572640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee34004d00 0x7fee34005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee44009ac0 tx=0x7fee340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ebcb959d59663c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4402c710 con 0x7fee34004d00 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4402c870 con 0x7fee34004d00 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee50d6f640 1 -- 172.21.15.37:0/37112111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4402cc00 con 0x7fee34004d00 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee52d73640 1 -- 172.21.15.37:0/37112111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee34004d00 msgr2=0x7fee34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee52d73640 1 --2- 172.21.15.37:0/37112111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee34004d00 0x7fee34005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee44009ac0 tx=0x7fee340057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee52572640 1 -- 172.21.15.37:0/37112111 reap_dead start 2023-11-24T06:15:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee52d73640 1 -- 172.21.15.37:0/37112111 shutdown_connections 2023-11-24T06:15:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.564+0000 7fee52d73640 1 -- 172.21.15.37:0/37112111 >> 172.21.15.37:0/37112111 conn(0x7fee4c09c510 msgr2=0x7fee4c0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.565+0000 7fee52d73640 1 -- 172.21.15.37:0/37112111 shutdown_connections 2023-11-24T06:15:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.565+0000 7fee52d73640 1 -- 172.21.15.37:0/37112111 wait complete. 2023-11-24T06:15:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.566+0000 7fee52d73640 1 Processor -- start 2023-11-24T06:15:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.567+0000 7fee52d73640 1 -- start start 2023-11-24T06:15:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.567+0000 7fee52d73640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee34004d00 0x7fee4c1f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.567+0000 7fee52d73640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee4c0b83d0 0x7fee4c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.567+0000 7fee52d73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4c15da40 0x7fee4c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.567+0000 7fee52d73640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c15e410 con 0x7fee4c15da40 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.567+0000 7fee52d73640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c1f3c00 con 0x7fee4c0b83d0 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.567+0000 7fee52d73640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c15f470 con 0x7fee34004d00 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4c15da40 0x7fee4c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4c15da40 0x7fee4c15ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51750/0 (socket says 172.21.15.37:51750) 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 -- 172.21.15.37:0/3273476775 learned_addr learned my addr 172.21.15.37:0/3273476775 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 -- 172.21.15.37:0/3273476775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee34004d00 msgr2=0x7fee4c1f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee34004d00 0x7fee4c1f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 -- 172.21.15.37:0/3273476775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee4c0b83d0 msgr2=0x7fee4c0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee4c0b83d0 0x7fee4c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 -- 172.21.15.37:0/3273476775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c15f750 con 0x7fee4c15da40 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.568+0000 7fee52572640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4c15da40 0x7fee4c15ded0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee44009ac0 tx=0x7fee44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.569+0000 7fee4a7fc640 1 -- 172.21.15.37:0/3273476775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4402c710 con 0x7fee4c15da40 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.569+0000 7fee4a7fc640 1 -- 172.21.15.37:0/3273476775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44003810 con 0x7fee4c15da40 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.569+0000 7fee4a7fc640 1 -- 172.21.15.37:0/3273476775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44003bc0 con 0x7fee4c15da40 2023-11-24T06:15:31.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.569+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c15fa30 con 0x7fee4c15da40 2023-11-24T06:15:31.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.569+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c15fff0 con 0x7fee4c15da40 2023-11-24T06:15:31.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.570+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c04e840 con 0x7fee4c15da40 2023-11-24T06:15:31.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.571+0000 7fee4a7fc640 1 -- 172.21.15.37:0/3273476775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee44003d20 con 0x7fee4c15da40 2023-11-24T06:15:31.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.572+0000 7fee4a7fc640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806ae40 0x7fee3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:31.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.572+0000 7fee4a7fc640 1 -- 172.21.15.37:0/3273476775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee440aaea0 con 0x7fee4c15da40 2023-11-24T06:15:31.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.572+0000 7fee51d71640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806ae40 0x7fee3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:31.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.573+0000 7fee51d71640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806ae40 0x7fee3806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0012e0 tx=0x7fee3c001940 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:31.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.576+0000 7fee4a7fc640 1 -- 172.21.15.37:0/3273476775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee44075f40 con 0x7fee4c15da40 2023-11-24T06:15:31.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:31.856+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fee4c06c6d0 con 0x7fee4c15da40 2023-11-24T06:15:32.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.746+0000 7fee4a7fc640 1 -- 172.21.15.37:0/3273476775 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7fee440420d0 con 0x7fee4c15da40 2023-11-24T06:15:32.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.750+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806ae40 msgr2=0x7fee3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.750+0000 7fee52d73640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806ae40 0x7fee3806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0012e0 tx=0x7fee3c001940 comp rx=0 tx=0).stop 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.750+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4c15da40 msgr2=0x7fee4c15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.750+0000 7fee52d73640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4c15da40 0x7fee4c15ded0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee44009ac0 tx=0x7fee44004730 comp rx=0 tx=0).stop 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 shutdown_connections 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806ae40 0x7fee3806d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee4c0b83d0 0x7fee4c0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4c15da40 0x7fee4c15ded0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 --2- 172.21.15.37:0/3273476775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee34004d00 0x7fee4c1f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 >> 172.21.15.37:0/3273476775 conn(0x7fee4c09c510 msgr2=0x7fee4c06cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 shutdown_connections 2023-11-24T06:15:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:32.751+0000 7fee52d73640 1 -- 172.21.15.37:0/3273476775 wait complete. 2023-11-24T06:15:32.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:15:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.004+0000 7f218e14c640 1 Processor -- start 2023-11-24T06:15:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.004+0000 7f218e14c640 1 -- start start 2023-11-24T06:15:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.006+0000 7f218e14c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f21880ccbd0 0x7f21881660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.006+0000 7f218e14c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21881655f0 con 0x7f21880ccfb0 2023-11-24T06:15:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.006+0000 7f218e14c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880cc380 con 0x7f21880c9650 2023-11-24T06:15:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.006+0000 7f218e14c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2188162b30 con 0x7f21880ccbd0 2023-11-24T06:15:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.006+0000 7f2186ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21880ccfb0 0x7f2188162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44484/0 (socket says 172.21.15.37:44484) 2023-11-24T06:15:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.006+0000 7f2186ffd640 1 -- 172.21.15.37:0/3880871158 learned_addr learned my addr 172.21.15.37:0/3880871158 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21877fe640 1 --2- 172.21.15.37:0/3880871158 >> v2:172.21.15.188:3300/0 conn(0x7f21880ccbd0 0x7f21881660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818398388 0 0) 0x7f21881655f0 con 0x7f21880ccfb0 2023-11-24T06:15:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2170003520 con 0x7f21880ccfb0 2023-11-24T06:15:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3703383218 0 0) 0x7f2170003520 con 0x7f21880ccfb0 2023-11-24T06:15:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 >> v2:172.21.15.188:3300/0 conn(0x7f21880ccbd0 msgr2=0x7f21881660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 --2- 172.21.15.37:0/3880871158 >> v2:172.21.15.188:3300/0 conn(0x7f21880ccbd0 0x7f21881660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 >> v1:172.21.15.188:6789/0 conn(0x7f21880c9650 legacy=0x7f21880c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188162e10 con 0x7f21880ccfb0 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f217c001670 con 0x7f21880ccfb0 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 >> v1:172.21.15.37:6789/0 conn(0x7f21880ccfb0 legacy=0x7f2188162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21700039c0 0x7f2170003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21700047c0 0x7f2170004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2170005180 0x7f217000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188162b30 con 0x7f2170005180 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217000c050 con 0x7f21700039c0 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.007+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217000c210 con 0x7f21700047c0 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2187fff640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2170005180 0x7f217000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2186ffd640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21700047c0 0x7f2170004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2187fff640 1 -- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21700047c0 msgr2=0x7f2170004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2187fff640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21700047c0 0x7f2170004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2187fff640 1 -- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21700039c0 msgr2=0x7f2170003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2187fff640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21700039c0 0x7f2170003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2187fff640 1 -- 172.21.15.37:0/3880871158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170003520 con 0x7f2170005180 2023-11-24T06:15:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.008+0000 7f2186ffd640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21700047c0 0x7f2170004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:33.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.009+0000 7f2187fff640 1 -- 172.21.15.37:0/3880871158 reap_dead start 2023-11-24T06:15:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.009+0000 7f2187fff640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2170005180 0x7f217000b980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2180001d50 tx=0x7f21700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44252e3d3969e121 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180034070 con 0x7f2170005180 2023-11-24T06:15:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180003970 con 0x7f2170005180 2023-11-24T06:15:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f21867fc640 1 -- 172.21.15.37:0/3880871158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180003b40 con 0x7f2170005180 2023-11-24T06:15:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f218e14c640 1 -- 172.21.15.37:0/3880871158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2170005180 msgr2=0x7f217000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f218e14c640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2170005180 0x7f217000b980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2180001d50 tx=0x7f21700057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f218e14c640 1 -- 172.21.15.37:0/3880871158 shutdown_connections 2023-11-24T06:15:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f218e14c640 1 --2- 172.21.15.37:0/3880871158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2170005180 0x7f217000b980 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f218e14c640 1 -- 172.21.15.37:0/3880871158 >> 172.21.15.37:0/3880871158 conn(0x7f21880b0c50 msgr2=0x7f21880b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:33.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.010+0000 7f218e14c640 1 -- 172.21.15.37:0/3880871158 shutdown_connections 2023-11-24T06:15:33.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.011+0000 7f218e14c640 1 -- 172.21.15.37:0/3880871158 wait complete. 2023-11-24T06:15:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.012+0000 7f218e14c640 1 Processor -- start 2023-11-24T06:15:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.013+0000 7f218e14c640 1 -- start start 2023-11-24T06:15:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f218e14c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2170005180 0x7f21881599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f218e14c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21880ad1f0 0x7f21881f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f218e14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880ad670 0x7f21881f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f218e14c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815b1c0 con 0x7f21880ad670 2023-11-24T06:15:33.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f218e14c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815a360 con 0x7f21880ad1f0 2023-11-24T06:15:33.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f218e14c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21881f7190 con 0x7f2170005180 2023-11-24T06:15:33.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880ad670 0x7f21881f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880ad670 0x7f21881f6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51780/0 (socket says 172.21.15.37:51780) 2023-11-24T06:15:33.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 -- 172.21.15.37:0/2732788302 learned_addr learned my addr 172.21.15.37:0/2732788302 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:33.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f21877fe640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2170005180 0x7f21881599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 -- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2170005180 msgr2=0x7f21881599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2186ffd640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21880ad1f0 0x7f21881f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2170005180 0x7f21881599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 -- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21880ad1f0 msgr2=0x7f21881f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21880ad1f0 0x7f21881f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.014+0000 7f2187fff640 1 -- 172.21.15.37:0/2732788302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218815a5b0 con 0x7f21880ad670 2023-11-24T06:15:33.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.015+0000 7f2187fff640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880ad670 0x7f21881f6c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2180032040 tx=0x7f2180001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.015+0000 7f216ffff640 1 -- 172.21.15.37:0/2732788302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180040070 con 0x7f21880ad670 2023-11-24T06:15:33.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.015+0000 7f216ffff640 1 -- 172.21.15.37:0/2732788302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180035040 con 0x7f21880ad670 2023-11-24T06:15:33.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.015+0000 7f216ffff640 1 -- 172.21.15.37:0/2732788302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180034070 con 0x7f21880ad670 2023-11-24T06:15:33.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.015+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218815a890 con 0x7f21880ad670 2023-11-24T06:15:33.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.015+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218815ae50 con 0x7f21880ad670 2023-11-24T06:15:33.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.016+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218815b370 con 0x7f21880ad670 2023-11-24T06:15:33.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.017+0000 7f216ffff640 1 -- 172.21.15.37:0/2732788302 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2180005280 con 0x7f21880ad670 2023-11-24T06:15:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.018+0000 7f216ffff640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217406ae40 0x7f217406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.018+0000 7f216ffff640 1 -- 172.21.15.37:0/2732788302 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f21800aa2c0 con 0x7f21880ad670 2023-11-24T06:15:33.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.019+0000 7f21877fe640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217406ae40 0x7f217406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.019+0000 7f21877fe640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217406ae40 0x7f217406d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2178009970 tx=0x7f2178008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.023+0000 7f216ffff640 1 -- 172.21.15.37:0/2732788302 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f218815b370 con 0x7f21880ad670 2023-11-24T06:15:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.221+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f218815b370 con 0x7f21880ad670 2023-11-24T06:15:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.228+0000 7f216ffff640 1 -- 172.21.15.37:0/2732788302 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f218815b370 con 0x7f21880ad670 2023-11-24T06:15:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217406ae40 msgr2=0x7f217406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217406ae40 0x7f217406d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2178009970 tx=0x7f2178008040 comp rx=0 tx=0).stop 2023-11-24T06:15:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880ad670 msgr2=0x7f21881f6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880ad670 0x7f21881f6c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2180032040 tx=0x7f2180001330 comp rx=0 tx=0).stop 2023-11-24T06:15:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 shutdown_connections 2023-11-24T06:15:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217406ae40 0x7f217406d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21880ad1f0 0x7f21881f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21880ad670 0x7f21881f6c50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 --2- 172.21.15.37:0/2732788302 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2170005180 0x7f21881599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 >> 172.21.15.37:0/2732788302 conn(0x7f21880b0c50 msgr2=0x7f218806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 shutdown_connections 2023-11-24T06:15:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.231+0000 7f218e14c640 1 -- 172.21.15.37:0/2732788302 wait complete. 2023-11-24T06:15:33.252 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:15:33.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:15:33.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:15:33.501 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:15:33.502 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:33.502 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:33.566 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:33.566 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:33.626 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:33.627 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:33.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.907+0000 7fe52662e640 1 Processor -- start 2023-11-24T06:15:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.907+0000 7fe52662e640 1 -- start start 2023-11-24T06:15:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.908+0000 7fe52662e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe52015d4e0 0x7fe5200d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.908+0000 7fe52662e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5200d38e0 0x7fe5200cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.908+0000 7fe52662e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5200d0070 0x7fe5200d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.908+0000 7fe52662e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200d4110 con 0x7fe5200d38e0 2023-11-24T06:15:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe52662e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200d04e0 con 0x7fe5200d0070 2023-11-24T06:15:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe52662e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200ce990 con 0x7fe52015d4e0 2023-11-24T06:15:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5200d38e0 0x7fe5200cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5200d38e0 0x7fe5200cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51794/0 (socket says 172.21.15.37:51794) 2023-11-24T06:15:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 -- 172.21.15.37:0/1673112838 learned_addr learned my addr 172.21.15.37:0/1673112838 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:33.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe52562c640 1 --2- 172.21.15.37:0/1673112838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe52015d4e0 0x7fe5200d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 -- 172.21.15.37:0/1673112838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe52015d4e0 msgr2=0x7fe5200d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe525e2d640 1 --2- 172.21.15.37:0/1673112838 >> v2:172.21.15.188:3300/0 conn(0x7fe5200d0070 0x7fe5200d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 --2- 172.21.15.37:0/1673112838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe52015d4e0 0x7fe5200d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 -- 172.21.15.37:0/1673112838 >> v2:172.21.15.188:3300/0 conn(0x7fe5200d0070 msgr2=0x7fe5200d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:33.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 --2- 172.21.15.37:0/1673112838 >> v2:172.21.15.188:3300/0 conn(0x7fe5200d0070 0x7fe5200d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe524e2b640 1 -- 172.21.15.37:0/1673112838 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200cec70 con 0x7fe5200d38e0 2023-11-24T06:15:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.909+0000 7fe52562c640 1 --2- 172.21.15.37:0/1673112838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe52015d4e0 0x7fe5200d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.910+0000 7fe524e2b640 1 --2- 172.21.15.37:0/1673112838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5200d38e0 0x7fe5200cfb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe5200b2a00 tx=0x7fe51002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572bcbcf9bf5787e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.911+0000 7fe517fff640 1 -- 172.21.15.37:0/1673112838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510031880 con 0x7fe5200d38e0 2023-11-24T06:15:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.911+0000 7fe517fff640 1 -- 172.21.15.37:0/1673112838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5100319e0 con 0x7fe5200d38e0 2023-11-24T06:15:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.911+0000 7fe517fff640 1 -- 172.21.15.37:0/1673112838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510031d70 con 0x7fe5200d38e0 2023-11-24T06:15:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.911+0000 7fe52662e640 1 -- 172.21.15.37:0/1673112838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5200d38e0 msgr2=0x7fe5200cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.911+0000 7fe52662e640 1 --2- 172.21.15.37:0/1673112838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5200d38e0 0x7fe5200cfb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe5200b2a00 tx=0x7fe51002b920 comp rx=0 tx=0).stop 2023-11-24T06:15:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.912+0000 7fe52662e640 1 -- 172.21.15.37:0/1673112838 shutdown_connections 2023-11-24T06:15:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.912+0000 7fe52662e640 1 --2- 172.21.15.37:0/1673112838 >> v2:172.21.15.188:3300/0 conn(0x7fe5200d0070 0x7fe5200d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.912+0000 7fe52662e640 1 --2- 172.21.15.37:0/1673112838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5200d38e0 0x7fe5200cfb30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.912+0000 7fe52662e640 1 --2- 172.21.15.37:0/1673112838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe52015d4e0 0x7fe5200d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.912+0000 7fe52662e640 1 -- 172.21.15.37:0/1673112838 >> 172.21.15.37:0/1673112838 conn(0x7fe52009c510 msgr2=0x7fe5200d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.912+0000 7fe52662e640 1 -- 172.21.15.37:0/1673112838 shutdown_connections 2023-11-24T06:15:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.912+0000 7fe52662e640 1 -- 172.21.15.37:0/1673112838 wait complete. 2023-11-24T06:15:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.913+0000 7fe52662e640 1 Processor -- start 2023-11-24T06:15:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.914+0000 7fe52662e640 1 -- start start 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52662e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5200d0070 0x7fe5200b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52662e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5200d38e0 0x7fe5200c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52662e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe52015d4e0 0x7fe5200c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52662e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b8f10 con 0x7fe52015d4e0 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52662e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200c75d0 con 0x7fe5200d0070 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52662e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b6460 con 0x7fe5200d38e0 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe52015d4e0 0x7fe5200c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe52015d4e0 0x7fe5200c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51806/0 (socket says 172.21.15.37:51806) 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 -- 172.21.15.37:0/1485106498 learned_addr learned my addr 172.21.15.37:0/1485106498 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe524e2b640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5200d38e0 0x7fe5200c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52562c640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5200d0070 0x7fe5200b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 -- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5200d38e0 msgr2=0x7fe5200c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5200d38e0 0x7fe5200c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 -- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5200d0070 msgr2=0x7fe5200b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5200d0070 0x7fe5200b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe525e2d640 1 -- 172.21.15.37:0/1485106498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100094d0 con 0x7fe52015d4e0 2023-11-24T06:15:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.915+0000 7fe52562c640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5200d0070 0x7fe5200b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.916+0000 7fe525e2d640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe52015d4e0 0x7fe5200c8ff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe51800ccf0 tx=0x7fe51800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.916+0000 7fe515ffb640 1 -- 172.21.15.37:0/1485106498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518003b90 con 0x7fe52015d4e0 2023-11-24T06:15:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.916+0000 7fe515ffb640 1 -- 172.21.15.37:0/1485106498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518003cf0 con 0x7fe52015d4e0 2023-11-24T06:15:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.916+0000 7fe515ffb640 1 -- 172.21.15.37:0/1485106498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518004240 con 0x7fe52015d4e0 2023-11-24T06:15:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.916+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5200b8570 con 0x7fe52015d4e0 2023-11-24T06:15:33.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.916+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5200b8b30 con 0x7fe52015d4e0 2023-11-24T06:15:33.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.917+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52015e190 con 0x7fe52015d4e0 2023-11-24T06:15:33.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.918+0000 7fe515ffb640 1 -- 172.21.15.37:0/1485106498 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5180043a0 con 0x7fe52015d4e0 2023-11-24T06:15:33.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.919+0000 7fe515ffb640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe50406ae40 0x7fe50406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:33.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.919+0000 7fe515ffb640 1 -- 172.21.15.37:0/1485106498 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe518012070 con 0x7fe52015d4e0 2023-11-24T06:15:33.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.920+0000 7fe52562c640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe50406ae40 0x7fe50406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:33.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.920+0000 7fe52562c640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe50406ae40 0x7fe50406d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe51c006fd0 tx=0x7fe51c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:33.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:33.923+0000 7fe515ffb640 1 -- 172.21.15.37:0/1485106498 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe52015e190 con 0x7fe52015d4e0 2023-11-24T06:15:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.117+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe52015e190 con 0x7fe52015d4e0 2023-11-24T06:15:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.119+0000 7fe515ffb640 1 -- 172.21.15.37:0/1485106498 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16764 (secure 0 0 0) 0x7fe52015e190 con 0x7fe52015d4e0 2023-11-24T06:15:34.122 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:34.122 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:32.729893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe50406ae40 msgr2=0x7fe50406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe50406ae40 0x7fe50406d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe51c006fd0 tx=0x7fe51c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe52015d4e0 msgr2=0x7fe5200c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe52015d4e0 0x7fe5200c8ff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe51800ccf0 tx=0x7fe51800a660 comp rx=0 tx=0).stop 2023-11-24T06:15:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 shutdown_connections 2023-11-24T06:15:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe50406ae40 0x7fe50406d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe52015d4e0 0x7fe5200c8ff0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5200d38e0 0x7fe5200c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 --2- 172.21.15.37:0/1485106498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5200d0070 0x7fe5200b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 >> 172.21.15.37:0/1485106498 conn(0x7fe52009c510 msgr2=0x7fe5200d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:34.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 shutdown_connections 2023-11-24T06:15:34.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.122+0000 7fe52662e640 1 -- 172.21.15.37:0/1485106498 wait complete. 2023-11-24T06:15:34.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:34.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.369+0000 7f60a1a15640 1 Processor -- start 2023-11-24T06:15:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.369+0000 7f60a1a15640 1 -- start start 2023-11-24T06:15:34.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f60a1a15640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f609c072160 0x7f609c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f60a1a15640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f609c0c49f0 0x7f609c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f60a1a15640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c15ec90 con 0x7f609c06dc40 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f60a1a15640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c06e090 con 0x7f609c072160 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f60a1a15640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0cd530 con 0x7f609c0c49f0 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f609affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f609c072160 0x7f609c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f609affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f609c072160 0x7f609c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51820/0 (socket says 172.21.15.37:51820) 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.371+0000 7f609affd640 1 -- 172.21.15.37:0/424048058 learned_addr learned my addr 172.21.15.37:0/424048058 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.372+0000 7f609affd640 1 -- 172.21.15.37:0/424048058 >> v2:172.21.15.188:3300/0 conn(0x7f609c0c49f0 msgr2=0x7f609c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.372+0000 7f609affd640 1 --2- 172.21.15.37:0/424048058 >> v2:172.21.15.188:3300/0 conn(0x7f609c0c49f0 0x7f609c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.372+0000 7f609affd640 1 -- 172.21.15.37:0/424048058 >> v1:172.21.15.188:6789/0 conn(0x7f609c06dc40 legacy=0x7f609c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.372+0000 7f609affd640 1 -- 172.21.15.37:0/424048058 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0c4ed0 con 0x7f609c072160 2023-11-24T06:15:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.373+0000 7f609affd640 1 --2- 172.21.15.37:0/424048058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c072160 0x7f609c15e750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f609c0cef60 tx=0x7f608c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c651507af16576 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.373+0000 7f6099ffb640 1 -- 172.21.15.37:0/424048058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c02ee90 con 0x7f609c072160 2023-11-24T06:15:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.373+0000 7f6099ffb640 1 -- 172.21.15.37:0/424048058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c036440 con 0x7f609c072160 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.373+0000 7f6099ffb640 1 -- 172.21.15.37:0/424048058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0367d0 con 0x7f609c072160 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 -- 172.21.15.37:0/424048058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c072160 msgr2=0x7f609c15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 --2- 172.21.15.37:0/424048058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c072160 0x7f609c15e750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f609c0cef60 tx=0x7f608c02e0e0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 -- 172.21.15.37:0/424048058 shutdown_connections 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 --2- 172.21.15.37:0/424048058 >> v2:172.21.15.188:3300/0 conn(0x7f609c0c49f0 0x7f609c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 --2- 172.21.15.37:0/424048058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c072160 0x7f609c15e750 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 -- 172.21.15.37:0/424048058 >> 172.21.15.37:0/424048058 conn(0x7f609c0b0c50 msgr2=0x7f609c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 -- 172.21.15.37:0/424048058 shutdown_connections 2023-11-24T06:15:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.374+0000 7f60a1a15640 1 -- 172.21.15.37:0/424048058 wait complete. 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.376+0000 7f60a1a15640 1 Processor -- start 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.376+0000 7f60a1a15640 1 -- start start 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.377+0000 7f60a1a15640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609c06dc40 0x7f609c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.377+0000 7f60a1a15640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609c072160 0x7f609c143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.377+0000 7f60a1a15640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c0c49f0 0x7f609c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.377+0000 7f60a1a15640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1ef600 con 0x7f609c0c49f0 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.377+0000 7f60a1a15640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c143b50 con 0x7f609c072160 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.377+0000 7f60a1a15640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1f0120 con 0x7f609c06dc40 2023-11-24T06:15:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c0c49f0 0x7f609c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c0c49f0 0x7f609c143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51828/0 (socket says 172.21.15.37:51828) 2023-11-24T06:15:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 -- 172.21.15.37:0/2001270039 learned_addr learned my addr 172.21.15.37:0/2001270039 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 -- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609c06dc40 msgr2=0x7f609c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609c06dc40 0x7f609c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 -- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609c072160 msgr2=0x7f609c143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609a7fc640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609c072160 0x7f609c143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609c072160 0x7f609c143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609b7fe640 1 -- 172.21.15.37:0/2001270039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c00b770 con 0x7f609c0c49f0 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.378+0000 7f609a7fc640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609c072160 0x7f609c143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.379+0000 7f609b7fe640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c0c49f0 0x7f609c143610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f609400b990 tx=0x7f609400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.379+0000 7f6083fff640 1 -- 172.21.15.37:0/2001270039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400cba0 con 0x7f609c0c49f0 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.379+0000 7f6083fff640 1 -- 172.21.15.37:0/2001270039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609400cd00 con 0x7f609c0c49f0 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.379+0000 7f6083fff640 1 -- 172.21.15.37:0/2001270039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094014680 con 0x7f609c0c49f0 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.379+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c0cc8e0 con 0x7f609c0c49f0 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.379+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c1ef7f0 con 0x7f609c0c49f0 2023-11-24T06:15:34.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.380+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c04e8b0 con 0x7f609c0c49f0 2023-11-24T06:15:34.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.381+0000 7f6083fff640 1 -- 172.21.15.37:0/2001270039 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f609401d3b0 con 0x7f609c0c49f0 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.383+0000 7f6083fff640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f608806ae40 0x7f608806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.383+0000 7f6083fff640 1 -- 172.21.15.37:0/2001270039 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6094089610 con 0x7f609c0c49f0 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.383+0000 7f609affd640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f608806ae40 0x7f608806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.384+0000 7f609affd640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f608806ae40 0x7f608806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f608c038000 tx=0x7f608c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.387+0000 7f6083fff640 1 -- 172.21.15.37:0/2001270039 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6094054620 con 0x7f609c0c49f0 2023-11-24T06:15:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.579+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f609c1f0290 con 0x7f609c0c49f0 2023-11-24T06:15:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.580+0000 7f6083fff640 1 -- 172.21.15.37:0/2001270039 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f609405e070 con 0x7f609c0c49f0 2023-11-24T06:15:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.582+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f608806ae40 msgr2=0x7f608806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.582+0000 7f60a1a15640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f608806ae40 0x7f608806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f608c038000 tx=0x7f608c030000 comp rx=0 tx=0).stop 2023-11-24T06:15:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.582+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c0c49f0 msgr2=0x7f609c143610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.582+0000 7f60a1a15640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c0c49f0 0x7f609c143610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f609400b990 tx=0x7f609400be50 comp rx=0 tx=0).stop 2023-11-24T06:15:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 shutdown_connections 2023-11-24T06:15:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f608806ae40 0x7f608806d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f609c072160 0x7f609c143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c0c49f0 0x7f609c143610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 --2- 172.21.15.37:0/2001270039 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f609c06dc40 0x7f609c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 >> 172.21.15.37:0/2001270039 conn(0x7f609c0b0c50 msgr2=0x7f609c0ac210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 shutdown_connections 2023-11-24T06:15:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.583+0000 7f60a1a15640 1 -- 172.21.15.37:0/2001270039 wait complete. 2023-11-24T06:15:34.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:34.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.832+0000 7fc5206ee640 1 Processor -- start 2023-11-24T06:15:34.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.832+0000 7fc5206ee640 1 -- start start 2023-11-24T06:15:34.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc5206ee640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc51815b440 0x7fc5180cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc5206ee640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5180cbf20 0x7fc5180c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc5206ee640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5180cc3a0 con 0x7fc5180c57e0 2023-11-24T06:15:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc5206ee640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51815b820 con 0x7fc5180cbf20 2023-11-24T06:15:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc5206ee640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815eea0 con 0x7fc51815b440 2023-11-24T06:15:34.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc51ec8b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc5180c57e0 0x7fc5180c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44490/0 (socket says 172.21.15.37:44490) 2023-11-24T06:15:34.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc51ec8b640 1 -- 172.21.15.37:0/109686119 learned_addr learned my addr 172.21.15.37:0/109686119 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:34.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc51dc89640 1 --2- 172.21.15.37:0/109686119 >> v2:172.21.15.37:3300/0 conn(0x7fc5180cbf20 0x7fc5180c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.834+0000 7fc51e48a640 1 --2- 172.21.15.37:0/109686119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc51815b440 0x7fc5180cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.835+0000 7fc51d488640 1 -- 172.21.15.37:0/109686119 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63515683 0 0) 0x7fc510001490 con 0x7fc5180c57e0 2023-11-24T06:15:34.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.835+0000 7fc51d488640 1 -- 172.21.15.37:0/109686119 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc504003520 con 0x7fc5180c57e0 2023-11-24T06:15:34.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.835+0000 7fc51dc89640 1 -- 172.21.15.37:0/109686119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc51815b440 msgr2=0x7fc5180cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.835+0000 7fc51dc89640 1 --2- 172.21.15.37:0/109686119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc51815b440 0x7fc5180cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.835+0000 7fc51dc89640 1 -- 172.21.15.37:0/109686119 >> v1:172.21.15.37:6789/0 conn(0x7fc5180c57e0 legacy=0x7fc5180c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.835+0000 7fc51dc89640 1 -- 172.21.15.37:0/109686119 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51806d600 con 0x7fc5180cbf20 2023-11-24T06:15:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.836+0000 7fc51dc89640 1 --2- 172.21.15.37:0/109686119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180cbf20 0x7fc5180c52a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc5080097a0 tx=0x7fc50802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931e87b3a64676d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.836+0000 7fc51d488640 1 -- 172.21.15.37:0/109686119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50802e070 con 0x7fc5180cbf20 2023-11-24T06:15:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.836+0000 7fc51d488640 1 -- 172.21.15.37:0/109686119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5080315a0 con 0x7fc5180cbf20 2023-11-24T06:15:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.836+0000 7fc51d488640 1 -- 172.21.15.37:0/109686119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508031910 con 0x7fc5180cbf20 2023-11-24T06:15:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 -- 172.21.15.37:0/109686119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180cbf20 msgr2=0x7fc5180c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 --2- 172.21.15.37:0/109686119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180cbf20 0x7fc5180c52a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc5080097a0 tx=0x7fc50802b840 comp rx=0 tx=0).stop 2023-11-24T06:15:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 -- 172.21.15.37:0/109686119 shutdown_connections 2023-11-24T06:15:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 --2- 172.21.15.37:0/109686119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180cbf20 0x7fc5180c52a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 --2- 172.21.15.37:0/109686119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc51815b440 0x7fc5180cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 -- 172.21.15.37:0/109686119 >> 172.21.15.37:0/109686119 conn(0x7fc5180b0c50 msgr2=0x7fc5180b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 -- 172.21.15.37:0/109686119 shutdown_connections 2023-11-24T06:15:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.837+0000 7fc5206ee640 1 -- 172.21.15.37:0/109686119 wait complete. 2023-11-24T06:15:34.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.839+0000 7fc5206ee640 1 Processor -- start 2023-11-24T06:15:34.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.839+0000 7fc5206ee640 1 -- start start 2023-11-24T06:15:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc5206ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180c57e0 0x7fc51815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc5206ee640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5180cbf20 0x7fc518153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc5206ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc51815b440 0x7fc5180cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc5206ee640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815d7d0 con 0x7fc5180c57e0 2023-11-24T06:15:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc5206ee640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5181548f0 con 0x7fc51815b440 2023-11-24T06:15:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc5206ee640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815cea0 con 0x7fc5180cbf20 2023-11-24T06:15:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc51e48a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180c57e0 0x7fc51815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc51e48a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180c57e0 0x7fc51815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51844/0 (socket says 172.21.15.37:51844) 2023-11-24T06:15:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.840+0000 7fc51e48a640 1 -- 172.21.15.37:0/3766011641 learned_addr learned my addr 172.21.15.37:0/3766011641 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:34.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc51e48a640 1 -- 172.21.15.37:0/3766011641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5180cbf20 msgr2=0x7fc518153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc51e48a640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5180cbf20 0x7fc518153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc51e48a640 1 -- 172.21.15.37:0/3766011641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc51815b440 msgr2=0x7fc5180cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:34.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc51e48a640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc51815b440 0x7fc5180cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:34.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc51e48a640 1 -- 172.21.15.37:0/3766011641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508009400 con 0x7fc5180c57e0 2023-11-24T06:15:34.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc51e48a640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180c57e0 0x7fc51815a6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc51400e8a0 tx=0x7fc51400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:34.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc50effd640 1 -- 172.21.15.37:0/3766011641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400c940 con 0x7fc5180c57e0 2023-11-24T06:15:34.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.841+0000 7fc50effd640 1 -- 172.21.15.37:0/3766011641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400caa0 con 0x7fc5180c57e0 2023-11-24T06:15:34.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.842+0000 7fc50effd640 1 -- 172.21.15.37:0/3766011641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400ce50 con 0x7fc5180c57e0 2023-11-24T06:15:34.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.842+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51815d180 con 0x7fc5180c57e0 2023-11-24T06:15:34.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.842+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51815cb50 con 0x7fc5180c57e0 2023-11-24T06:15:34.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.843+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51804e8b0 con 0x7fc5180c57e0 2023-11-24T06:15:34.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.844+0000 7fc50effd640 1 -- 172.21.15.37:0/3766011641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc514013470 con 0x7fc5180c57e0 2023-11-24T06:15:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.845+0000 7fc50effd640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc4fc06ae40 0x7fc4fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.845+0000 7fc50effd640 1 -- 172.21.15.37:0/3766011641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc514089710 con 0x7fc5180c57e0 2023-11-24T06:15:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.845+0000 7fc51dc89640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc4fc06ae40 0x7fc4fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.846+0000 7fc51dc89640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc4fc06ae40 0x7fc4fc06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc508036000 tx=0x7fc508030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:34.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:34.850+0000 7fc50effd640 1 -- 172.21.15.37:0/3766011641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5140547c0 con 0x7fc5180c57e0 2023-11-24T06:15:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.045+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc51806dc80 con 0x7fc5180c57e0 2023-11-24T06:15:35.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.046+0000 7fc50effd640 1 -- 172.21.15.37:0/3766011641 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc514057de0 con 0x7fc5180c57e0 2023-11-24T06:15:35.049 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:35.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc4fc06ae40 msgr2=0x7fc4fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc4fc06ae40 0x7fc4fc06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc508036000 tx=0x7fc508030000 comp rx=0 tx=0).stop 2023-11-24T06:15:35.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180c57e0 msgr2=0x7fc51815a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180c57e0 0x7fc51815a6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc51400e8a0 tx=0x7fc51400ed60 comp rx=0 tx=0).stop 2023-11-24T06:15:35.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 shutdown_connections 2023-11-24T06:15:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc4fc06ae40 0x7fc4fc06d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc51815b440 0x7fc5180cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5180cbf20 0x7fc518153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 --2- 172.21.15.37:0/3766011641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5180c57e0 0x7fc51815a6d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.049+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 >> 172.21.15.37:0/3766011641 conn(0x7fc5180b0c50 msgr2=0x7fc5180c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.050+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 shutdown_connections 2023-11-24T06:15:35.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.050+0000 7fc5206ee640 1 -- 172.21.15.37:0/3766011641 wait complete. 2023-11-24T06:15:35.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.297+0000 7ff19ea52640 1 Processor -- start 2023-11-24T06:15:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.298+0000 7ff19ea52640 1 -- start start 2023-11-24T06:15:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.299+0000 7ff19ea52640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff19815d310 0x7ff1980ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.299+0000 7ff19ea52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 0x7ff1980b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.299+0000 7ff19ea52640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980b14d0 con 0x7ff1980b0b40 2023-11-24T06:15:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.299+0000 7ff19ea52640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19806cd10 con 0x7ff19815d310 2023-11-24T06:15:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.299+0000 7ff19ea52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980ae5d0 con 0x7ff1980cde50 2023-11-24T06:15:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19d24f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff1980b0b40 0x7ff198160f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44496/0 (socket says 172.21.15.37:44496) 2023-11-24T06:15:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19d24f640 1 -- 172.21.15.37:0/1358025655 learned_addr learned my addr 172.21.15.37:0/1358025655 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19da50640 1 --2- 172.21.15.37:0/1358025655 >> v2:172.21.15.37:3300/0 conn(0x7ff19815d310 0x7ff1980ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19ca4e640 1 -- 172.21.15.37:0/1358025655 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969392800 0 0) 0x7ff18c001110 con 0x7ff1980b0b40 2023-11-24T06:15:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19ca4e640 1 -- 172.21.15.37:0/1358025655 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff184003520 con 0x7ff1980b0b40 2023-11-24T06:15:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19da50640 1 -- 172.21.15.37:0/1358025655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 msgr2=0x7ff1980b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19da50640 1 --2- 172.21.15.37:0/1358025655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 0x7ff1980b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.300+0000 7ff19da50640 1 -- 172.21.15.37:0/1358025655 >> v1:172.21.15.37:6789/0 conn(0x7ff1980b0b40 legacy=0x7ff198160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.301+0000 7ff19da50640 1 -- 172.21.15.37:0/1358025655 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980ae8b0 con 0x7ff19815d310 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.302+0000 7ff19da50640 1 --2- 172.21.15.37:0/1358025655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff19815d310 0x7ff1980ca120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff1940097a0 tx=0x7ff19402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67eee37149724484 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.302+0000 7ff19ca4e640 1 -- 172.21.15.37:0/1358025655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19402d040 con 0x7ff19815d310 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.302+0000 7ff19ca4e640 1 -- 172.21.15.37:0/1358025655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194031810 con 0x7ff19815d310 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.302+0000 7ff19ca4e640 1 -- 172.21.15.37:0/1358025655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194031b80 con 0x7ff19815d310 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 -- 172.21.15.37:0/1358025655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff19815d310 msgr2=0x7ff1980ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 --2- 172.21.15.37:0/1358025655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff19815d310 0x7ff1980ca120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff1940097a0 tx=0x7ff19402b8b0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 -- 172.21.15.37:0/1358025655 shutdown_connections 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 --2- 172.21.15.37:0/1358025655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 0x7ff1980b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 --2- 172.21.15.37:0/1358025655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff19815d310 0x7ff1980ca120 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 -- 172.21.15.37:0/1358025655 >> 172.21.15.37:0/1358025655 conn(0x7ff1980cbb40 msgr2=0x7ff1980cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 -- 172.21.15.37:0/1358025655 shutdown_connections 2023-11-24T06:15:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.303+0000 7ff19ea52640 1 -- 172.21.15.37:0/1358025655 wait complete. 2023-11-24T06:15:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.305+0000 7ff19ea52640 1 Processor -- start 2023-11-24T06:15:35.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.305+0000 7ff19ea52640 1 -- start start 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19ea52640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1980b0b40 0x7ff1981568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19ea52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 0x7ff1980c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19ea52640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff19815d310 0x7ff1980c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19ea52640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980b2720 con 0x7ff1980b0b40 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19ea52640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980b1d80 con 0x7ff19815d310 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19ea52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980b2060 con 0x7ff1980cde50 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19da50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1980b0b40 0x7ff1981568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19da50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1980b0b40 0x7ff1981568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51864/0 (socket says 172.21.15.37:51864) 2023-11-24T06:15:35.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.306+0000 7ff19da50640 1 -- 172.21.15.37:0/657470988 learned_addr learned my addr 172.21.15.37:0/657470988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.307+0000 7ff19da50640 1 -- 172.21.15.37:0/657470988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 msgr2=0x7ff1980c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.307+0000 7ff19da50640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 0x7ff1980c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.307+0000 7ff19da50640 1 -- 172.21.15.37:0/657470988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff19815d310 msgr2=0x7ff1980c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.307+0000 7ff19da50640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff19815d310 0x7ff1980c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.307+0000 7ff19da50640 1 -- 172.21.15.37:0/657470988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194009400 con 0x7ff1980b0b40 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.307+0000 7ff19da50640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1980b0b40 0x7ff1981568f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff194000c00 tx=0x7ff1940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.308+0000 7ff18a7fc640 1 -- 172.21.15.37:0/657470988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194006e10 con 0x7ff1980b0b40 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.308+0000 7ff18a7fc640 1 -- 172.21.15.37:0/657470988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19403ad60 con 0x7ff1980b0b40 2023-11-24T06:15:35.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.308+0000 7ff18a7fc640 1 -- 172.21.15.37:0/657470988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194044630 con 0x7ff1980b0b40 2023-11-24T06:15:35.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.308+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1980b2340 con 0x7ff1980b0b40 2023-11-24T06:15:35.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.308+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff198156e30 con 0x7ff1980b0b40 2023-11-24T06:15:35.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.309+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19804e840 con 0x7ff1980b0b40 2023-11-24T06:15:35.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.310+0000 7ff18a7fc640 1 -- 172.21.15.37:0/657470988 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff19404d450 con 0x7ff1980b0b40 2023-11-24T06:15:35.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.311+0000 7ff18a7fc640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff17c06ae40 0x7ff17c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.311+0000 7ff18a7fc640 1 -- 172.21.15.37:0/657470988 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff1940ab880 con 0x7ff1980b0b40 2023-11-24T06:15:35.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.311+0000 7ff19d24f640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff17c06ae40 0x7ff17c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.312+0000 7ff19d24f640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff17c06ae40 0x7ff17c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000f60 tx=0x7ff18c001110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:35.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.316+0000 7ff18a7fc640 1 -- 172.21.15.37:0/657470988 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1940768a0 con 0x7ff1980b0b40 2023-11-24T06:15:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.508+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff19806e870 con 0x7ff1980b0b40 2023-11-24T06:15:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.509+0000 7ff18a7fc640 1 -- 172.21.15.37:0/657470988 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff194079ec0 con 0x7ff1980b0b40 2023-11-24T06:15:35.512 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff17c06ae40 msgr2=0x7ff17c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff17c06ae40 0x7ff17c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000f60 tx=0x7ff18c001110 comp rx=0 tx=0).stop 2023-11-24T06:15:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1980b0b40 msgr2=0x7ff1981568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1980b0b40 0x7ff1981568f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff194000c00 tx=0x7ff1940046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 shutdown_connections 2023-11-24T06:15:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff17c06ae40 0x7ff17c06d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff19815d310 0x7ff1980c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1980cde50 0x7ff1980c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 --2- 172.21.15.37:0/657470988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1980b0b40 0x7ff1981568f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 >> 172.21.15.37:0/657470988 conn(0x7ff1980cbb40 msgr2=0x7ff198070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.512+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 shutdown_connections 2023-11-24T06:15:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.513+0000 7ff19ea52640 1 -- 172.21.15.37:0/657470988 wait complete. 2023-11-24T06:15:35.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:15:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.756+0000 7fde643ec640 1 Processor -- start 2023-11-24T06:15:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.756+0000 7fde643ec640 1 -- start start 2023-11-24T06:15:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.757+0000 7fde643ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde5c0ccbd0 0x7fde5c1660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde643ec640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde643ec640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c1655f0 con 0x7fde5c162540 2023-11-24T06:15:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde643ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0cc380 con 0x7fde5c0ccbd0 2023-11-24T06:15:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde643ec640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c162b30 con 0x7fde5c0ccfb0 2023-11-24T06:15:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde62188640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde5c0ccbd0 0x7fde5c1660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde62188640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde5c0ccbd0 0x7fde5c1660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51870/0 (socket says 172.21.15.37:51870) 2023-11-24T06:15:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde62188640 1 -- 172.21.15.37:0/550429472 learned_addr learned my addr 172.21.15.37:0/550429472 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde62188640 1 -- 172.21.15.37:0/550429472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 msgr2=0x7fde5c162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde62188640 1 --2- 172.21.15.37:0/550429472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde62188640 1 -- 172.21.15.37:0/550429472 >> v1:172.21.15.188:6789/0 conn(0x7fde5c162540 legacy=0x7fde5c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.758+0000 7fde62188640 1 -- 172.21.15.37:0/550429472 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c162e10 con 0x7fde5c0ccbd0 2023-11-24T06:15:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.760+0000 7fde62188640 1 --2- 172.21.15.37:0/550429472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c0ccbd0 0x7fde5c1660b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fde580098a0 tx=0x7fde5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12a3715f0674357 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.760+0000 7fde61186640 1 -- 172.21.15.37:0/550429472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58031640 con 0x7fde5c0ccbd0 2023-11-24T06:15:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.760+0000 7fde61186640 1 -- 172.21.15.37:0/550429472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde580317a0 con 0x7fde5c0ccbd0 2023-11-24T06:15:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.760+0000 7fde61186640 1 -- 172.21.15.37:0/550429472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58031b30 con 0x7fde5c0ccbd0 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 -- 172.21.15.37:0/550429472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c0ccbd0 msgr2=0x7fde5c1660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 --2- 172.21.15.37:0/550429472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c0ccbd0 0x7fde5c1660b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fde580098a0 tx=0x7fde5802b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 -- 172.21.15.37:0/550429472 shutdown_connections 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 --2- 172.21.15.37:0/550429472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 --2- 172.21.15.37:0/550429472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c0ccbd0 0x7fde5c1660b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 -- 172.21.15.37:0/550429472 >> 172.21.15.37:0/550429472 conn(0x7fde5c0b0c50 msgr2=0x7fde5c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 -- 172.21.15.37:0/550429472 shutdown_connections 2023-11-24T06:15:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.761+0000 7fde643ec640 1 -- 172.21.15.37:0/550429472 wait complete. 2023-11-24T06:15:35.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.763+0000 7fde643ec640 1 Processor -- start 2023-11-24T06:15:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.763+0000 7fde643ec640 1 -- start start 2023-11-24T06:15:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.764+0000 7fde643ec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c0ccbd0 0x7fde5c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.764+0000 7fde643ec640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c14b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.764+0000 7fde643ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c162540 0x7fde5c071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.764+0000 7fde643ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1ebcd0 con 0x7fde5c162540 2023-11-24T06:15:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.764+0000 7fde643ec640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c14bb00 con 0x7fde5c0ccbd0 2023-11-24T06:15:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.764+0000 7fde643ec640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c070ea0 con 0x7fde5c0ccfb0 2023-11-24T06:15:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c162540 0x7fde5c071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c162540 0x7fde5c071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51880/0 (socket says 172.21.15.37:51880) 2023-11-24T06:15:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 -- 172.21.15.37:0/2201152228 learned_addr learned my addr 172.21.15.37:0/2201152228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62188640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c0ccbd0 0x7fde5c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde61987640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c14b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 -- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 msgr2=0x7fde5c14b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c14b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 -- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c0ccbd0 msgr2=0x7fde5c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c0ccbd0 0x7fde5c15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 -- 172.21.15.37:0/2201152228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580094d0 con 0x7fde5c162540 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde61987640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c14b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.765+0000 7fde62989640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c162540 0x7fde5c071bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fde5400b990 tx=0x7fde5400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.766+0000 7fde52ffd640 1 -- 172.21.15.37:0/2201152228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400cb40 con 0x7fde5c162540 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.766+0000 7fde52ffd640 1 -- 172.21.15.37:0/2201152228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400cca0 con 0x7fde5c162540 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.766+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c071730 con 0x7fde5c162540 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.766+0000 7fde52ffd640 1 -- 172.21.15.37:0/2201152228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54014680 con 0x7fde5c162540 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.766+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c158800 con 0x7fde5c162540 2023-11-24T06:15:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.767+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c0718c0 con 0x7fde5c162540 2023-11-24T06:15:35.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.768+0000 7fde52ffd640 1 -- 172.21.15.37:0/2201152228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde5401d3b0 con 0x7fde5c162540 2023-11-24T06:15:35.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.769+0000 7fde52ffd640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde4006ae40 0x7fde4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:35.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.769+0000 7fde52ffd640 1 -- 172.21.15.37:0/2201152228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fde54089630 con 0x7fde5c162540 2023-11-24T06:15:35.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.770+0000 7fde62188640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde4006ae40 0x7fde4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:35.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.770+0000 7fde62188640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde4006ae40 0x7fde4006d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde58036000 tx=0x7fde5803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:35.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.775+0000 7fde52ffd640 1 -- 172.21.15.37:0/2201152228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde54054640 con 0x7fde5c162540 2023-11-24T06:15:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.987+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde5c04e8b0 con 0x7fde5c162540 2023-11-24T06:15:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.988+0000 7fde52ffd640 1 -- 172.21.15.37:0/2201152228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde54057c60 con 0x7fde5c162540 2023-11-24T06:15:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:15:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.990+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde4006ae40 msgr2=0x7fde4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.990+0000 7fde643ec640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde4006ae40 0x7fde4006d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde58036000 tx=0x7fde5803c040 comp rx=0 tx=0).stop 2023-11-24T06:15:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.990+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c162540 msgr2=0x7fde5c071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.990+0000 7fde643ec640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c162540 0x7fde5c071bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fde5400b990 tx=0x7fde5400be50 comp rx=0 tx=0).stop 2023-11-24T06:15:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 shutdown_connections 2023-11-24T06:15:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde4006ae40 0x7fde4006d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde5c162540 0x7fde5c071bc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde5c0ccfb0 0x7fde5c14b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 --2- 172.21.15.37:0/2201152228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde5c0ccbd0 0x7fde5c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 >> 172.21.15.37:0/2201152228 conn(0x7fde5c0b0c50 msgr2=0x7fde5c0c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 shutdown_connections 2023-11-24T06:15:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:35.991+0000 7fde643ec640 1 -- 172.21.15.37:0/2201152228 wait complete. 2023-11-24T06:15:36.011 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:15:36.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:36.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-24T06:15:36.110 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:15:36.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:36.110 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:15:36.171 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:36.171 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:36.230 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:36.230 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:36.285 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:36.285 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:36.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:36.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.570+0000 7f9e62878640 1 Processor -- start 2023-11-24T06:15:36.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.570+0000 7f9e62878640 1 -- start start 2023-11-24T06:15:36.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.572+0000 7f9e62878640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 0x7f9e5c1682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.572+0000 7f9e62878640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5c0727f0 con 0x7f9e5c146dd0 2023-11-24T06:15:36.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.572+0000 7f9e62878640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5c144110 con 0x7f9e5c143ba0 2023-11-24T06:15:36.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.572+0000 7f9e62878640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c06f030 con 0x7f9e5c06ac10 2023-11-24T06:15:36.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.572+0000 7f9e61075640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e5c146dd0 0x7f9e5c06a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44504/0 (socket says 172.21.15.37:44504) 2023-11-24T06:15:36.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.572+0000 7f9e61075640 1 -- 172.21.15.37:0/1905576033 learned_addr learned my addr 172.21.15.37:0/1905576033 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e62077640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 0x7f9e5c1682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101698505 0 0) 0x7f9e5c0727f0 con 0x7f9e5c146dd0 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e48003520 con 0x7f9e5c146dd0 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 740937833 0 0) 0x7f9e48003520 con 0x7f9e5c146dd0 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 msgr2=0x7f9e5c1682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 0x7f9e5c1682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 >> v1:172.21.15.188:6789/0 conn(0x7f9e5c143ba0 legacy=0x7f9e5c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c06f300 con 0x7f9e5c146dd0 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f9e4c001670 con 0x7f9e5c146dd0 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 >> v1:172.21.15.37:6789/0 conn(0x7f9e5c146dd0 legacy=0x7f9e5c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 0x7f9e480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e48004d00 0x7f9e48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c06f030 con 0x7f9e48003f00 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4800bb90 con 0x7f9e48004d00 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.573+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4800bd50 con 0x7f9e5c06ac10 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e61075640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e62077640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e48004d00 0x7f9e48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e61876640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 0x7f9e480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e61075640 1 -- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 msgr2=0x7f9e480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e61075640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c06ac10 0x7f9e480039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e61075640 1 -- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e48004d00 msgr2=0x7f9e48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e61075640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e48004d00 0x7f9e48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.574+0000 7f9e61075640 1 -- 172.21.15.37:0/1905576033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e48003520 con 0x7f9e48003f00 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.575+0000 7f9e61075640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e480047c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c240 tx=0x7f9e480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff00e434ab0cee07 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c005ad0 con 0x7f9e48003f00 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c005c30 con 0x7f9e48003f00 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e60874640 1 -- 172.21.15.37:0/1905576033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c02c8a0 con 0x7f9e48003f00 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e62878640 1 -- 172.21.15.37:0/1905576033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 msgr2=0x7f9e480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e62878640 1 --2- 172.21.15.37:0/1905576033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e480047c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c240 tx=0x7f9e480057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e62077640 1 -- 172.21.15.37:0/1905576033 reap_dead start 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e62878640 1 -- 172.21.15.37:0/1905576033 shutdown_connections 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e62878640 1 -- 172.21.15.37:0/1905576033 >> 172.21.15.37:0/1905576033 conn(0x7f9e5c0b1c40 msgr2=0x7f9e5c0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e62878640 1 -- 172.21.15.37:0/1905576033 shutdown_connections 2023-11-24T06:15:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.576+0000 7f9e62878640 1 -- 172.21.15.37:0/1905576033 wait complete. 2023-11-24T06:15:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.578+0000 7f9e62878640 1 Processor -- start 2023-11-24T06:15:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.578+0000 7f9e62878640 1 -- start start 2023-11-24T06:15:36.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.579+0000 7f9e62878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e5c160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.579+0000 7f9e62878640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c0af310 0x7f9e5c0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.579+0000 7f9e62878640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e5c0addd0 0x7f9e5c13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.579+0000 7f9e62878640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c0ae270 con 0x7f9e48003f00 2023-11-24T06:15:36.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.579+0000 7f9e62878640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c0ae550 con 0x7f9e5c0addd0 2023-11-24T06:15:36.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.579+0000 7f9e62878640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c0ae830 con 0x7f9e5c0af310 2023-11-24T06:15:36.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e5c160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e5c160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51896/0 (socket says 172.21.15.37:51896) 2023-11-24T06:15:36.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 -- 172.21.15.37:0/390732295 learned_addr learned my addr 172.21.15.37:0/390732295 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61075640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c0af310 0x7f9e5c0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e62077640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e5c0addd0 0x7f9e5c13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 -- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c0af310 msgr2=0x7f9e5c0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c0af310 0x7f9e5c0ad890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 -- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e5c0addd0 msgr2=0x7f9e5c13a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e5c0addd0 0x7f9e5c13a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 -- 172.21.15.37:0/390732295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c0aeb10 con 0x7f9e48003f00 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.580+0000 7f9e61876640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e5c160250 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800d4c0 tx=0x7f9e5800d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:36.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.581+0000 7f9e527fc640 1 -- 172.21.15.37:0/390732295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58005480 con 0x7f9e48003f00 2023-11-24T06:15:36.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.581+0000 7f9e527fc640 1 -- 172.21.15.37:0/390732295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e580035f0 con 0x7f9e48003f00 2023-11-24T06:15:36.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.581+0000 7f9e527fc640 1 -- 172.21.15.37:0/390732295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e580039a0 con 0x7f9e48003f00 2023-11-24T06:15:36.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.581+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c0aedf0 con 0x7f9e48003f00 2023-11-24T06:15:36.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.581+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c160970 con 0x7f9e48003f00 2023-11-24T06:15:36.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.582+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c0619d0 con 0x7f9e48003f00 2023-11-24T06:15:36.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.583+0000 7f9e527fc640 1 -- 172.21.15.37:0/390732295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e58003b00 con 0x7f9e48003f00 2023-11-24T06:15:36.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.584+0000 7f9e527fc640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9e4006ae40 0x7f9e4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:36.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.584+0000 7f9e527fc640 1 -- 172.21.15.37:0/390732295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9e580893d0 con 0x7f9e48003f00 2023-11-24T06:15:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.584+0000 7f9e61075640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9e4006ae40 0x7f9e4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.585+0000 7f9e61075640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9e4006ae40 0x7f9e4006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c034000 tx=0x7f9e4c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:36.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.588+0000 7f9e527fc640 1 -- 172.21.15.37:0/390732295 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e580544a0 con 0x7f9e48003f00 2023-11-24T06:15:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.783+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e5c067990 con 0x7f9e48003f00 2023-11-24T06:15:36.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.786+0000 7f9e527fc640 1 -- 172.21.15.37:0/390732295 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16764 (secure 0 0 0) 0x7f9e58003db0 con 0x7f9e48003f00 2023-11-24T06:15:36.789 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:36.789 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:32.729893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9e4006ae40 msgr2=0x7f9e4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9e4006ae40 0x7f9e4006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c034000 tx=0x7f9e4c009030 comp rx=0 tx=0).stop 2023-11-24T06:15:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 msgr2=0x7f9e5c160250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e5c160250 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800d4c0 tx=0x7f9e5800d980 comp rx=0 tx=0).stop 2023-11-24T06:15:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 shutdown_connections 2023-11-24T06:15:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9e4006ae40 0x7f9e4006d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9e5c0addd0 0x7f9e5c13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9e5c0af310 0x7f9e5c0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 --2- 172.21.15.37:0/390732295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e48003f00 0x7f9e5c160250 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 >> 172.21.15.37:0/390732295 conn(0x7f9e5c0b1c40 msgr2=0x7f9e5c0b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.789+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 shutdown_connections 2023-11-24T06:15:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:36.790+0000 7f9e62878640 1 -- 172.21.15.37:0/390732295 wait complete. 2023-11-24T06:15:36.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:36.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:37.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.038+0000 7f389359e640 1 Processor -- start 2023-11-24T06:15:37.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.038+0000 7f389359e640 1 -- start start 2023-11-24T06:15:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.039+0000 7f389359e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f389415d7d0 0x7f38940cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.039+0000 7f389359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940d15e0 con 0x7f38940d1f40 2023-11-24T06:15:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.039+0000 7f389359e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940d0280 con 0x7f389415d3f0 2023-11-24T06:15:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.039+0000 7f389359e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38940b0eb0 con 0x7f389415d7d0 2023-11-24T06:15:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.039+0000 7f3892d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f38940d1f40 0x7f38940ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44520/0 (socket says 172.21.15.37:44520) 2023-11-24T06:15:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.039+0000 7f3892d9d640 1 -- 172.21.15.37:0/2419749806 learned_addr learned my addr 172.21.15.37:0/2419749806 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:37.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487773174 0 0) 0x7f38940d15e0 con 0x7f38940d1f40 2023-11-24T06:15:37.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3880003520 con 0x7f38940d1f40 2023-11-24T06:15:37.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697411947 0 0) 0x7f3880003520 con 0x7f38940d1f40 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 >> v2:172.21.15.188:3300/0 conn(0x7f389415d7d0 msgr2=0x7f38940cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 --2- 172.21.15.37:0/2419749806 >> v2:172.21.15.188:3300/0 conn(0x7f389415d7d0 0x7f38940cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 >> v1:172.21.15.188:6789/0 conn(0x7f389415d3f0 legacy=0x7f38940d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940d1300 con 0x7f38940d1f40 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f388c001670 con 0x7f38940d1f40 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 >> v1:172.21.15.37:6789/0 conn(0x7f38940d1f40 legacy=0x7f38940ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3880003970 0x7f3880003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.040+0000 7f389159a640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38800047c0 0x7f3880004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f389159a640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38800052a0 0x7f388000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b0eb0 con 0x7f38800047c0 2023-11-24T06:15:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388000c1a0 con 0x7f38800052a0 2023-11-24T06:15:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000c360 con 0x7f3880003970 2023-11-24T06:15:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f3891d9b640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38800047c0 0x7f3880004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f3891d9b640 1 -- 172.21.15.37:0/2419749806 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3880003970 msgr2=0x7f3880003d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f3891d9b640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3880003970 0x7f3880003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f3891d9b640 1 -- 172.21.15.37:0/2419749806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38800052a0 msgr2=0x7f388000b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f3891d9b640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38800052a0 0x7f388000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f3891d9b640 1 -- 172.21.15.37:0/2419749806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880003520 con 0x7f38800047c0 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.041+0000 7f3892d9d640 1 -- 172.21.15.37:0/2419749806 reap_dead start 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.043+0000 7f3891d9b640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38800047c0 0x7f3880004c40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f389415dbb0 tx=0x7f38800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4269ea85e5a165cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.043+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c02cd10 con 0x7f38800047c0 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.043+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c02ce90 con 0x7f38800047c0 2023-11-24T06:15:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.043+0000 7f389159a640 1 -- 172.21.15.37:0/2419749806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c034660 con 0x7f38800047c0 2023-11-24T06:15:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.043+0000 7f389359e640 1 -- 172.21.15.37:0/2419749806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38800047c0 msgr2=0x7f3880004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.043+0000 7f389359e640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38800047c0 0x7f3880004c40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f389415dbb0 tx=0x7f38800057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.044+0000 7f389359e640 1 -- 172.21.15.37:0/2419749806 shutdown_connections 2023-11-24T06:15:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.044+0000 7f389359e640 1 --2- 172.21.15.37:0/2419749806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38800047c0 0x7f3880004c40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.044+0000 7f389359e640 1 -- 172.21.15.37:0/2419749806 >> 172.21.15.37:0/2419749806 conn(0x7f389409c5b0 msgr2=0x7f38940d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.044+0000 7f389359e640 1 -- 172.21.15.37:0/2419749806 shutdown_connections 2023-11-24T06:15:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.044+0000 7f389359e640 1 -- 172.21.15.37:0/2419749806 wait complete. 2023-11-24T06:15:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.046+0000 7f389359e640 1 Processor -- start 2023-11-24T06:15:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.046+0000 7f389359e640 1 -- start start 2023-11-24T06:15:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f389359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38800047c0 0x7f3894159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f389359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f389406c070 0x7f38940b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f389359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f389415fd80 0x7f3894160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f389359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b7d80 con 0x7f389406c070 2023-11-24T06:15:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f389359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894160770 con 0x7f389415fd80 2023-11-24T06:15:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f389359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b8270 con 0x7f38800047c0 2023-11-24T06:15:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f3891d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f389406c070 0x7f38940b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f3891d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f389406c070 0x7f38940b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51904/0 (socket says 172.21.15.37:51904) 2023-11-24T06:15:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f3891d9b640 1 -- 172.21.15.37:0/1132117265 learned_addr learned my addr 172.21.15.37:0/1132117265 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f3892d9d640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f389415fd80 0x7f3894160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f3891d9b640 1 -- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38800047c0 msgr2=0x7f3894159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f3891d9b640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38800047c0 0x7f3894159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.047+0000 7f3891d9b640 1 -- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f389415fd80 msgr2=0x7f3894160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f3891d9b640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f389415fd80 0x7f3894160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f3891d9b640 1 -- 172.21.15.37:0/1132117265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940b9120 con 0x7f389406c070 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f3892d9d640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f389415fd80 0x7f3894160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f3891d9b640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f389406c070 0x7f38940b67a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f387c02c780 tx=0x7f387c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f388affd640 1 -- 172.21.15.37:0/1132117265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c03f680 con 0x7f389406c070 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f388affd640 1 -- 172.21.15.37:0/1132117265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c02cd20 con 0x7f389406c070 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f388affd640 1 -- 172.21.15.37:0/1132117265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c03fa20 con 0x7f389406c070 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940b8510 con 0x7f389406c070 2023-11-24T06:15:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.048+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38940b8ad0 con 0x7f389406c070 2023-11-24T06:15:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.049+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389404e840 con 0x7f389406c070 2023-11-24T06:15:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.050+0000 7f388affd640 1 -- 172.21.15.37:0/1132117265 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f387c03b040 con 0x7f389406c070 2023-11-24T06:15:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.051+0000 7f388affd640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f387406ae70 0x7f387406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.051+0000 7f388affd640 1 -- 172.21.15.37:0/1132117265 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f387c0ac120 con 0x7f389406c070 2023-11-24T06:15:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.052+0000 7f389259c640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f387406ae70 0x7f387406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.052+0000 7f389259c640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f387406ae70 0x7f387406d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3894160bb0 tx=0x7f3884007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.056+0000 7f388affd640 1 -- 172.21.15.37:0/1132117265 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f387c077150 con 0x7f389406c070 2023-11-24T06:15:37.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.248+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38940d1c20 con 0x7f389406c070 2023-11-24T06:15:37.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.249+0000 7f388affd640 1 -- 172.21.15.37:0/1132117265 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f387c07a770 con 0x7f389406c070 2023-11-24T06:15:37.251 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.251+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f387406ae70 msgr2=0x7f387406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.251+0000 7f389359e640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f387406ae70 0x7f387406d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3894160bb0 tx=0x7f3884007990 comp rx=0 tx=0).stop 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.251+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f389406c070 msgr2=0x7f38940b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.251+0000 7f389359e640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f389406c070 0x7f38940b67a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f387c02c780 tx=0x7f387c004b50 comp rx=0 tx=0).stop 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 shutdown_connections 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f387406ae70 0x7f387406d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f389415fd80 0x7f3894160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f389406c070 0x7f38940b67a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 --2- 172.21.15.37:0/1132117265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38800047c0 0x7f3894159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 >> 172.21.15.37:0/1132117265 conn(0x7f389409c5b0 msgr2=0x7f38940d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 shutdown_connections 2023-11-24T06:15:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.252+0000 7f389359e640 1 -- 172.21.15.37:0/1132117265 wait complete. 2023-11-24T06:15:37.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.491+0000 7fbd6bfff640 1 Processor -- start 2023-11-24T06:15:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.491+0000 7fbd6bfff640 1 -- start start 2023-11-24T06:15:37.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.493+0000 7fbd6bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d3f0 0x7fbd6c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.493+0000 7fbd6bfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbd6c15d7d0 0x7fbd6c0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.493+0000 7fbd6bfff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0d15e0 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.493+0000 7fbd6bfff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d0280 con 0x7fbd6c15d7d0 2023-11-24T06:15:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.493+0000 7fbd6bfff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d1300 con 0x7fbd6c15d3f0 2023-11-24T06:15:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6affd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d3f0 0x7fbd6c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6a7fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbd6c15d7d0 0x7fbd6c0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6affd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d3f0 0x7fbd6c0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:34198/0 (socket says 172.21.15.37:34198) 2023-11-24T06:15:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6affd640 1 -- 172.21.15.37:0/2654648371 learned_addr learned my addr 172.21.15.37:0/2654648371 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6a7fc640 1 -- 172.21.15.37:0/2654648371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d3f0 msgr2=0x7fbd6c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6a7fc640 1 --2- 172.21.15.37:0/2654648371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d3f0 0x7fbd6c0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6a7fc640 1 -- 172.21.15.37:0/2654648371 >> v1:172.21.15.188:6789/0 conn(0x7fbd6c0d0e40 legacy=0x7fbd6c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.494+0000 7fbd6a7fc640 1 -- 172.21.15.37:0/2654648371 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0cfc30 con 0x7fbd6c15d7d0 2023-11-24T06:15:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.496+0000 7fbd6a7fc640 1 --2- 172.21.15.37:0/2654648371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d7d0 0x7fbd6c0d1d70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbd540097a0 tx=0x7fbd5402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7be001b3702780 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.497+0000 7fbd69ffb640 1 -- 172.21.15.37:0/2654648371 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54031830 con 0x7fbd6c15d7d0 2023-11-24T06:15:37.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.497+0000 7fbd69ffb640 1 -- 172.21.15.37:0/2654648371 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54031990 con 0x7fbd6c15d7d0 2023-11-24T06:15:37.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.497+0000 7fbd69ffb640 1 -- 172.21.15.37:0/2654648371 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54031d20 con 0x7fbd6c15d7d0 2023-11-24T06:15:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.497+0000 7fbd6bfff640 1 -- 172.21.15.37:0/2654648371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d7d0 msgr2=0x7fbd6c0d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.497+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/2654648371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d7d0 0x7fbd6c0d1d70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbd540097a0 tx=0x7fbd5402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.498+0000 7fbd6bfff640 1 -- 172.21.15.37:0/2654648371 shutdown_connections 2023-11-24T06:15:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.498+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/2654648371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d7d0 0x7fbd6c0d1d70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.498+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/2654648371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d3f0 0x7fbd6c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.498+0000 7fbd6bfff640 1 -- 172.21.15.37:0/2654648371 >> 172.21.15.37:0/2654648371 conn(0x7fbd6c09c5b0 msgr2=0x7fbd6c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.498+0000 7fbd6bfff640 1 -- 172.21.15.37:0/2654648371 shutdown_connections 2023-11-24T06:15:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.498+0000 7fbd6bfff640 1 -- 172.21.15.37:0/2654648371 wait complete. 2023-11-24T06:15:37.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.500+0000 7fbd6bfff640 1 Processor -- start 2023-11-24T06:15:37.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.500+0000 7fbd6bfff640 1 -- start start 2023-11-24T06:15:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.501+0000 7fbd6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6c0d0e40 0x7fbd6c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.501+0000 7fbd6bfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d3f0 0x7fbd6c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.501+0000 7fbd6bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d7d0 0x7fbd6c156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.501+0000 7fbd6bfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15f140 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.501+0000 7fbd6bfff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15f330 con 0x7fbd6c15d3f0 2023-11-24T06:15:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.501+0000 7fbd6bfff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15f610 con 0x7fbd6c15d7d0 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6c0d0e40 0x7fbd6c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6c0d0e40 0x7fbd6c15ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51912/0 (socket says 172.21.15.37:51912) 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 -- 172.21.15.37:0/1268546313 learned_addr learned my addr 172.21.15.37:0/1268546313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6a7fc640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d3f0 0x7fbd6c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6b7fe640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d7d0 0x7fbd6c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 -- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d7d0 msgr2=0x7fbd6c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d7d0 0x7fbd6c156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 -- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d3f0 msgr2=0x7fbd6c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d3f0 0x7fbd6c0b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.502+0000 7fbd6affd640 1 -- 172.21.15.37:0/1268546313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009400 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.503+0000 7fbd6affd640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6c0d0e40 0x7fbd6c15ec00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00efc0 tx=0x7fbd5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.503+0000 7fbd63fff640 1 -- 172.21.15.37:0/1268546313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00cda0 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.503+0000 7fbd63fff640 1 -- 172.21.15.37:0/1268546313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00f040 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.503+0000 7fbd63fff640 1 -- 172.21.15.37:0/1268546313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c014680 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.503+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c15f8f0 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.503+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c15feb0 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.504+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c160040 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.505+0000 7fbd63fff640 1 -- 172.21.15.37:0/1268546313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd5c0147e0 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.506+0000 7fbd63fff640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbd4c06ae40 0x7fbd4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.506+0000 7fbd63fff640 1 -- 172.21.15.37:0/1268546313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fbd5c089e60 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.507+0000 7fbd6a7fc640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbd4c06ae40 0x7fbd4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.508+0000 7fbd6a7fc640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbd4c06ae40 0x7fbd4c06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd54036000 tx=0x7fbd5403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.510+0000 7fbd63fff640 1 -- 172.21.15.37:0/1268546313 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd5c054de0 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.706+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd6c04e840 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.707+0000 7fbd63fff640 1 -- 172.21.15.37:0/1268546313 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd5c058400 con 0x7fbd6c0d0e40 2023-11-24T06:15:37.710 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbd4c06ae40 msgr2=0x7fbd4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbd4c06ae40 0x7fbd4c06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd54036000 tx=0x7fbd5403c040 comp rx=0 tx=0).stop 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6c0d0e40 msgr2=0x7fbd6c15ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6c0d0e40 0x7fbd6c15ec00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00efc0 tx=0x7fbd5c00c490 comp rx=0 tx=0).stop 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 shutdown_connections 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbd4c06ae40 0x7fbd4c06d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd6c15d3f0 0x7fbd6c0b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd6c15d7d0 0x7fbd6c156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 --2- 172.21.15.37:0/1268546313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6c0d0e40 0x7fbd6c15ec00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 >> 172.21.15.37:0/1268546313 conn(0x7fbd6c09c5b0 msgr2=0x7fbd6c0afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 shutdown_connections 2023-11-24T06:15:37.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.710+0000 7fbd6bfff640 1 -- 172.21.15.37:0/1268546313 wait complete. 2023-11-24T06:15:37.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.958+0000 7faf1d672640 1 Processor -- start 2023-11-24T06:15:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.958+0000 7faf1d672640 1 -- start start 2023-11-24T06:15:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.959+0000 7faf1d672640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf1806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.959+0000 7faf1d672640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf1806e580 0x7faf180b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.959+0000 7faf1d672640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1806d5c0 con 0x7faf180b1080 2023-11-24T06:15:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.959+0000 7faf1d672640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf180b1530 con 0x7faf1806e580 2023-11-24T06:15:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.960+0000 7faf1d672640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1815b640 con 0x7faf1815b260 2023-11-24T06:15:37.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.960+0000 7faf177fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf1806e580 0x7faf180b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.960+0000 7faf177fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf1806e580 0x7faf180b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51916/0 (socket says 172.21.15.37:51916) 2023-11-24T06:15:37.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.960+0000 7faf177fe640 1 -- 172.21.15.37:0/2377088459 learned_addr learned my addr 172.21.15.37:0/2377088459 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:37.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.960+0000 7faf17fff640 1 --2- 172.21.15.37:0/2377088459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf1806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.961+0000 7faf177fe640 1 -- 172.21.15.37:0/2377088459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 msgr2=0x7faf1806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:37.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.961+0000 7faf177fe640 1 --2- 172.21.15.37:0/2377088459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf1806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.961+0000 7faf177fe640 1 -- 172.21.15.37:0/2377088459 >> v1:172.21.15.188:6789/0 conn(0x7faf180b1080 legacy=0x7faf180ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.961+0000 7faf177fe640 1 -- 172.21.15.37:0/2377088459 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1815ed20 con 0x7faf1806e580 2023-11-24T06:15:37.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.962+0000 7faf177fe640 1 --2- 172.21.15.37:0/2377088459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf1806e580 0x7faf180b0b40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf00009870 tx=0x7faf0002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b067437f5566837e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.962+0000 7faf16ffd640 1 -- 172.21.15.37:0/2377088459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000317c0 con 0x7faf1806e580 2023-11-24T06:15:37.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.962+0000 7faf16ffd640 1 -- 172.21.15.37:0/2377088459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00031920 con 0x7faf1806e580 2023-11-24T06:15:37.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.962+0000 7faf16ffd640 1 -- 172.21.15.37:0/2377088459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00031cb0 con 0x7faf1806e580 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 -- 172.21.15.37:0/2377088459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf1806e580 msgr2=0x7faf180b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 --2- 172.21.15.37:0/2377088459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf1806e580 0x7faf180b0b40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf00009870 tx=0x7faf0002b860 comp rx=0 tx=0).stop 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 -- 172.21.15.37:0/2377088459 shutdown_connections 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 --2- 172.21.15.37:0/2377088459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf1806e580 0x7faf180b0b40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 --2- 172.21.15.37:0/2377088459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf1806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 -- 172.21.15.37:0/2377088459 >> 172.21.15.37:0/2377088459 conn(0x7faf180cbb40 msgr2=0x7faf180cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 -- 172.21.15.37:0/2377088459 shutdown_connections 2023-11-24T06:15:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.963+0000 7faf1d672640 1 -- 172.21.15.37:0/2377088459 wait complete. 2023-11-24T06:15:37.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.965+0000 7faf1d672640 1 Processor -- start 2023-11-24T06:15:37.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.965+0000 7faf1d672640 1 -- start start 2023-11-24T06:15:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf1d672640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1806e580 0x7faf180c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf1d672640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf180b1080 0x7faf181f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf1d672640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf181f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf1d672640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1809af40 con 0x7faf180b1080 2023-11-24T06:15:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf1d672640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1809c830 con 0x7faf1806e580 2023-11-24T06:15:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf1d672640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf180c1cc0 con 0x7faf1815b260 2023-11-24T06:15:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf180b1080 0x7faf181f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf180b1080 0x7faf181f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51922/0 (socket says 172.21.15.37:51922) 2023-11-24T06:15:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.966+0000 7faf177fe640 1 -- 172.21.15.37:0/3039028889 learned_addr learned my addr 172.21.15.37:0/3039028889 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:37.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf1ce71640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf181f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf17fff640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1806e580 0x7faf180c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf177fe640 1 -- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 msgr2=0x7faf181f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf177fe640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf181f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf177fe640 1 -- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1806e580 msgr2=0x7faf180c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf177fe640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1806e580 0x7faf180c2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf177fe640 1 -- 172.21.15.37:0/3039028889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000094d0 con 0x7faf180b1080 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.967+0000 7faf177fe640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf180b1080 0x7faf181f5d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf00000c00 tx=0x7faf000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.968+0000 7faf14ff9640 1 -- 172.21.15.37:0/3039028889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00032860 con 0x7faf180b1080 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.968+0000 7faf14ff9640 1 -- 172.21.15.37:0/3039028889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf000329e0 con 0x7faf180b1080 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.968+0000 7faf14ff9640 1 -- 172.21.15.37:0/3039028889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00032d90 con 0x7faf180b1080 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.968+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf180c1fa0 con 0x7faf180b1080 2023-11-24T06:15:37.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.968+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1809ab60 con 0x7faf180b1080 2023-11-24T06:15:37.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.969+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1809b080 con 0x7faf180b1080 2023-11-24T06:15:37.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.970+0000 7faf14ff9640 1 -- 172.21.15.37:0/3039028889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf0004e450 con 0x7faf180b1080 2023-11-24T06:15:37.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.971+0000 7faf14ff9640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef806ae40 0x7faef806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:37.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.971+0000 7faf14ff9640 1 -- 172.21.15.37:0/3039028889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7faf000ab840 con 0x7faf180b1080 2023-11-24T06:15:37.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.972+0000 7faf17fff640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef806ae40 0x7faef806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:37.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.972+0000 7faf17fff640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef806ae40 0x7faef806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf08009f60 tx=0x7faf0800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:37.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:37.976+0000 7faf14ff9640 1 -- 172.21.15.37:0/3039028889 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf1809b080 con 0x7faf180b1080 2023-11-24T06:15:38.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.169+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf1809b080 con 0x7faf180b1080 2023-11-24T06:15:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.170+0000 7faf14ff9640 1 -- 172.21.15.37:0/3039028889 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf1809b080 con 0x7faf180b1080 2023-11-24T06:15:38.172 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef806ae40 msgr2=0x7faef806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef806ae40 0x7faef806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf08009f60 tx=0x7faf0800b040 comp rx=0 tx=0).stop 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf180b1080 msgr2=0x7faf181f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf180b1080 0x7faf181f5d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf00000c00 tx=0x7faf000046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 shutdown_connections 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef806ae40 0x7faef806d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf1815b260 0x7faf181f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf180b1080 0x7faf181f5d80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 --2- 172.21.15.37:0/3039028889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1806e580 0x7faf180c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 >> 172.21.15.37:0/3039028889 conn(0x7faf180cbb40 msgr2=0x7faf180addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 shutdown_connections 2023-11-24T06:15:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.173+0000 7faf1d672640 1 -- 172.21.15.37:0/3039028889 wait complete. 2023-11-24T06:15:38.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:15:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.424+0000 7fbbb732e640 1 Processor -- start 2023-11-24T06:15:38.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.425+0000 7fbbb732e640 1 -- start start 2023-11-24T06:15:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.426+0000 7fbbb732e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbbb00b1250 0x7fbbb0166160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.426+0000 7fbbb732e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00ca0e0 con 0x7fbbb0070550 2023-11-24T06:15:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.426+0000 7fbbb732e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb0072800 con 0x7fbbb015b1d0 2023-11-24T06:15:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.426+0000 7fbbb732e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb015fde0 con 0x7fbbb00b1250 2023-11-24T06:15:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.427+0000 7fbbb5b2b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbbb0070550 0x7fbbb00b0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44536/0 (socket says 172.21.15.37:44536) 2023-11-24T06:15:38.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.427+0000 7fbbb5b2b640 1 -- 172.21.15.37:0/17425340 learned_addr learned my addr 172.21.15.37:0/17425340 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.427+0000 7fbbb6b2d640 1 --2- 172.21.15.37:0/17425340 >> v2:172.21.15.188:3300/0 conn(0x7fbbb00b1250 0x7fbbb0166160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.427+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946282599 0 0) 0x7fbbb00ca0e0 con 0x7fbbb0070550 2023-11-24T06:15:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.427+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb9c003520 con 0x7fbbb0070550 2023-11-24T06:15:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.427+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604672973 0 0) 0x7fbb9c003520 con 0x7fbbb0070550 2023-11-24T06:15:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 >> v2:172.21.15.188:3300/0 conn(0x7fbbb00b1250 msgr2=0x7fbbb0166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 --2- 172.21.15.37:0/17425340 >> v2:172.21.15.188:3300/0 conn(0x7fbbb00b1250 0x7fbbb0166160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 >> v1:172.21.15.188:6789/0 conn(0x7fbbb015b1d0 legacy=0x7fbbb0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00c97b0 con 0x7fbbb0070550 2023-11-24T06:15:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fbba0001670 con 0x7fbbb0070550 2023-11-24T06:15:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 >> v1:172.21.15.37:6789/0 conn(0x7fbbb0070550 legacy=0x7fbbb00b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb9c003970 0x7fbb9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c0047c0 0x7fbb9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb9c005180 0x7fbb9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb015fde0 con 0x7fbb9c003970 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c00c020 con 0x7fbb9c005180 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c00c1e0 con 0x7fbb9c0047c0 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb632c640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb9c003970 0x7fbb9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb632c640 1 -- 172.21.15.37:0/17425340 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c0047c0 msgr2=0x7fbb9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb632c640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c0047c0 0x7fbb9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb6b2d640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb9c005180 0x7fbb9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb632c640 1 -- 172.21.15.37:0/17425340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb9c005180 msgr2=0x7fbb9c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.428+0000 7fbbb632c640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb9c005180 0x7fbb9c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.429+0000 7fbbb6b2d640 1 -- 172.21.15.37:0/17425340 reap_dead start 2023-11-24T06:15:38.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.429+0000 7fbbb632c640 1 -- 172.21.15.37:0/17425340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c003520 con 0x7fbb9c003970 2023-11-24T06:15:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb632c640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb9c003970 0x7fbb9c003d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbbac001750 tx=0x7fbb9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cf3c7f41e08dbc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0052d0 con 0x7fbb9c003970 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac02e050 con 0x7fbb9c003970 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb532a640 1 -- 172.21.15.37:0/17425340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac003830 con 0x7fbb9c003970 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb732e640 1 -- 172.21.15.37:0/17425340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb9c003970 msgr2=0x7fbb9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb732e640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb9c003970 0x7fbb9c003d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbbac001750 tx=0x7fbb9c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb732e640 1 -- 172.21.15.37:0/17425340 shutdown_connections 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb732e640 1 --2- 172.21.15.37:0/17425340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb9c003970 0x7fbb9c003d90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.430+0000 7fbbb732e640 1 -- 172.21.15.37:0/17425340 >> 172.21.15.37:0/17425340 conn(0x7fbbb00cbb40 msgr2=0x7fbbb00cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.431+0000 7fbbb732e640 1 -- 172.21.15.37:0/17425340 shutdown_connections 2023-11-24T06:15:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.431+0000 7fbbb732e640 1 -- 172.21.15.37:0/17425340 wait complete. 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.432+0000 7fbbb732e640 1 Processor -- start 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.433+0000 7fbbb732e640 1 -- start start 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.433+0000 7fbbb732e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c003970 0x7fbbb01f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.433+0000 7fbbb732e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00ce5c0 0x7fbbb01f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.433+0000 7fbbb732e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb015d960 0x7fbbb00ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.433+0000 7fbbb732e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb015e800 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.433+0000 7fbbb732e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01f3820 con 0x7fbbb015d960 2023-11-24T06:15:38.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.433+0000 7fbbb732e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01f6640 con 0x7fbb9c003970 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00ce5c0 0x7fbbb01f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00ce5c0 0x7fbbb01f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51938/0 (socket says 172.21.15.37:51938) 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 -- 172.21.15.37:0/2290470616 learned_addr learned my addr 172.21.15.37:0/2290470616 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb632c640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c003970 0x7fbbb01f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb6b2d640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb015d960 0x7fbbb00ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 -- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c003970 msgr2=0x7fbbb01f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c003970 0x7fbbb01f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 -- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb015d960 msgr2=0x7fbbb00ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb015d960 0x7fbbb00ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb5b2b640 1 -- 172.21.15.37:0/2290470616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00b3220 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.434+0000 7fbbb632c640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c003970 0x7fbbb01f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.435+0000 7fbbb5b2b640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00ce5c0 0x7fbbb01f6100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c700 tx=0x7fbba000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.435+0000 7fbba6ffd640 1 -- 172.21.15.37:0/2290470616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00072d0 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.435+0000 7fbba6ffd640 1 -- 172.21.15.37:0/2290470616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba0007430 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.435+0000 7fbba6ffd640 1 -- 172.21.15.37:0/2290470616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00047e0 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.435+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb015e240 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.435+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb00b2eb0 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.436+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb00b2d10 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.437+0000 7fbba6ffd640 1 -- 172.21.15.37:0/2290470616 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbba0004940 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.439+0000 7fbba6ffd640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbb9406ae40 0x7fbb9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.439+0000 7fbba6ffd640 1 -- 172.21.15.37:0/2290470616 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fbba0088890 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.439+0000 7fbbb632c640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbb9406ae40 0x7fbb9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:38.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.440+0000 7fbbb632c640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbb9406ae40 0x7fbb9406d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbac033000 tx=0x7fbbac009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.443+0000 7fbba6ffd640 1 -- 172.21.15.37:0/2290470616 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbb00b2d10 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.653+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbbb00b2d10 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.654+0000 7fbba6ffd640 1 -- 172.21.15.37:0/2290470616 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbbb00b2d10 con 0x7fbbb00ce5c0 2023-11-24T06:15:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:15:38.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.656+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbb9406ae40 msgr2=0x7fbb9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.656+0000 7fbbb732e640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbb9406ae40 0x7fbb9406d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbac033000 tx=0x7fbbac009030 comp rx=0 tx=0).stop 2023-11-24T06:15:38.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.656+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00ce5c0 msgr2=0x7fbbb01f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.656+0000 7fbbb732e640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00ce5c0 0x7fbbb01f6100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c700 tx=0x7fbba000cbc0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.656+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 shutdown_connections 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.656+0000 7fbbb732e640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbb9406ae40 0x7fbb9406d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.657+0000 7fbbb732e640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbb015d960 0x7fbbb00ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.657+0000 7fbbb732e640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00ce5c0 0x7fbbb01f6100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.657+0000 7fbbb732e640 1 --2- 172.21.15.37:0/2290470616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb9c003970 0x7fbbb01f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.657+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 >> 172.21.15.37:0/2290470616 conn(0x7fbbb00cbb40 msgr2=0x7fbbb006c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.657+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 shutdown_connections 2023-11-24T06:15:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:38.657+0000 7fbbb732e640 1 -- 172.21.15.37:0/2290470616 wait complete. 2023-11-24T06:15:38.681 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:15:38.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:38.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-24T06:15:38.787 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:15:38.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:38.788 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:15:38.846 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:38.846 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:38.912 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:38.912 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:38.969 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:15:38.969 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:39.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:39.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.249+0000 7f2192815640 1 Processor -- start 2023-11-24T06:15:39.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.249+0000 7f2192815640 1 -- start start 2023-11-24T06:15:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.251+0000 7f2192815640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2250 0x7f218c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.251+0000 7f2192815640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c15ab80 con 0x7f218c0b2a70 2023-11-24T06:15:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.251+0000 7f2192815640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c15e680 con 0x7f218c0b2630 2023-11-24T06:15:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.251+0000 7f2192815640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c15a990 con 0x7f218c0b2250 2023-11-24T06:15:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.252+0000 7f2190db2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f218c0b2a70 0x7f218c15b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44546/0 (socket says 172.21.15.37:44546) 2023-11-24T06:15:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.252+0000 7f2190db2640 1 -- 172.21.15.37:0/1444109992 learned_addr learned my addr 172.21.15.37:0/1444109992 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.252+0000 7f218bfff640 1 --2- 172.21.15.37:0/1444109992 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2250 0x7f218c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.252+0000 7f218affd640 1 -- 172.21.15.37:0/1444109992 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565676749 0 0) 0x7f218c15ab80 con 0x7f218c0b2a70 2023-11-24T06:15:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.252+0000 7f218affd640 1 -- 172.21.15.37:0/1444109992 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2174003520 con 0x7f218c0b2a70 2023-11-24T06:15:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.253+0000 7f218bfff640 1 -- 172.21.15.37:0/1444109992 >> v1:172.21.15.188:6789/0 conn(0x7f218c0b2630 legacy=0x7f218c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.253+0000 7f218bfff640 1 -- 172.21.15.37:0/1444109992 >> v1:172.21.15.37:6789/0 conn(0x7f218c0b2a70 legacy=0x7f218c15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.253+0000 7f218affd640 1 -- 172.21.15.37:0/1444109992 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3363474116 0 0) 0x7f2174003520 con 0x7f218c0b2a70 2023-11-24T06:15:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.253+0000 7f218bfff640 1 -- 172.21.15.37:0/1444109992 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c15e960 con 0x7f218c0b2250 2023-11-24T06:15:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.254+0000 7f218bfff640 1 --2- 172.21.15.37:0/1444109992 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2250 0x7f218c15df80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f217c0097d0 tx=0x7f217c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51d4e5b1191552b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f218affd640 1 -- 172.21.15.37:0/1444109992 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c031890 con 0x7f218c0b2250 2023-11-24T06:15:39.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f218affd640 1 -- 172.21.15.37:0/1444109992 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c0319f0 con 0x7f218c0b2250 2023-11-24T06:15:39.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f218affd640 1 -- 172.21.15.37:0/1444109992 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c031d80 con 0x7f218c0b2250 2023-11-24T06:15:39.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f2192815640 1 -- 172.21.15.37:0/1444109992 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2250 msgr2=0x7f218c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f2192815640 1 --2- 172.21.15.37:0/1444109992 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2250 0x7f218c15df80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f217c0097d0 tx=0x7f217c02b930 comp rx=0 tx=0).stop 2023-11-24T06:15:39.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f2192815640 1 -- 172.21.15.37:0/1444109992 shutdown_connections 2023-11-24T06:15:39.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f2192815640 1 --2- 172.21.15.37:0/1444109992 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2250 0x7f218c15df80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f2192815640 1 -- 172.21.15.37:0/1444109992 >> 172.21.15.37:0/1444109992 conn(0x7f218c06a920 msgr2=0x7f218c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:39.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f2192815640 1 -- 172.21.15.37:0/1444109992 shutdown_connections 2023-11-24T06:15:39.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.255+0000 7f2192815640 1 -- 172.21.15.37:0/1444109992 wait complete. 2023-11-24T06:15:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.257+0000 7f2192815640 1 Processor -- start 2023-11-24T06:15:39.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.257+0000 7f2192815640 1 -- start start 2023-11-24T06:15:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.258+0000 7f2192815640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218c0b2250 0x7f218c154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.258+0000 7f2192815640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2630 0x7f218c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.258+0000 7f2192815640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218c0b2a70 0x7f218c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.258+0000 7f2192815640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1f3db0 con 0x7f218c0b2a70 2023-11-24T06:15:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.258+0000 7f2192815640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1f4090 con 0x7f218c0b2250 2023-11-24T06:15:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.258+0000 7f2192815640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1f4370 con 0x7f218c0b2630 2023-11-24T06:15:39.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218c0b2a70 0x7f218c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218c0b2a70 0x7f218c155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51952/0 (socket says 172.21.15.37:51952) 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 -- 172.21.15.37:0/2650367704 learned_addr learned my addr 172.21.15.37:0/2650367704 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f218bfff640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218c0b2250 0x7f218c154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f218b7fe640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2630 0x7f218c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 -- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2630 msgr2=0x7f218c071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2630 0x7f218c071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 -- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218c0b2250 msgr2=0x7f218c154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218c0b2250 0x7f218c154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.259+0000 7f2190db2640 1 -- 172.21.15.37:0/2650367704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c009400 con 0x7f218c0b2a70 2023-11-24T06:15:39.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.260+0000 7f2190db2640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218c0b2a70 0x7f218c155730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f218400caf0 tx=0x7f2184002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.260+0000 7f2188ff9640 1 -- 172.21.15.37:0/2650367704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218400abd0 con 0x7f218c0b2a70 2023-11-24T06:15:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.260+0000 7f2188ff9640 1 -- 172.21.15.37:0/2650367704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218400ad30 con 0x7f218c0b2a70 2023-11-24T06:15:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.260+0000 7f2188ff9640 1 -- 172.21.15.37:0/2650367704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184012620 con 0x7f218c0b2a70 2023-11-24T06:15:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.260+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c0cd7c0 con 0x7f218c0b2a70 2023-11-24T06:15:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.260+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c0c90c0 con 0x7f218c0b2a70 2023-11-24T06:15:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.261+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c0c92e0 con 0x7f218c0b2a70 2023-11-24T06:15:39.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.262+0000 7f2188ff9640 1 -- 172.21.15.37:0/2650367704 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2184012780 con 0x7f218c0b2a70 2023-11-24T06:15:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.264+0000 7f2188ff9640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217806ae40 0x7f217806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.264+0000 7f2188ff9640 1 -- 172.21.15.37:0/2650367704 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2184089b90 con 0x7f218c0b2a70 2023-11-24T06:15:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.264+0000 7f218bfff640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217806ae40 0x7f217806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.265+0000 7f218bfff640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217806ae40 0x7f217806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f217c036000 tx=0x7f217c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.268+0000 7f2188ff9640 1 -- 172.21.15.37:0/2650367704 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2184054bb0 con 0x7f218c0b2a70 2023-11-24T06:15:39.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:39.327 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:39.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.465+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f218c067470 con 0x7f218c0b2a70 2023-11-24T06:15:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.467+0000 7f2188ff9640 1 -- 172.21.15.37:0/2650367704 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16764 (secure 0 0 0) 0x7f21840581d0 con 0x7f218c0b2a70 2023-11-24T06:15:39.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:32.729893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:39.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217806ae40 msgr2=0x7f217806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217806ae40 0x7f217806d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f217c036000 tx=0x7f217c03c040 comp rx=0 tx=0).stop 2023-11-24T06:15:39.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218c0b2a70 msgr2=0x7f218c155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218c0b2a70 0x7f218c155730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f218400caf0 tx=0x7f2184002190 comp rx=0 tx=0).stop 2023-11-24T06:15:39.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 shutdown_connections 2023-11-24T06:15:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f217806ae40 0x7f217806d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f218c0b2a70 0x7f218c155730 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f218c0b2630 0x7f218c071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 --2- 172.21.15.37:0/2650367704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f218c0b2250 0x7f218c154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.469+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 >> 172.21.15.37:0/2650367704 conn(0x7f218c06a920 msgr2=0x7f218c15bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.470+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 shutdown_connections 2023-11-24T06:15:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.470+0000 7f2192815640 1 -- 172.21.15.37:0/2650367704 wait complete. 2023-11-24T06:15:39.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:39.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.759+0000 7f6f07a1e640 1 Processor -- start 2023-11-24T06:15:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.760+0000 7f6f07a1e640 1 -- start start 2023-11-24T06:15:39.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.761+0000 7f6f07a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f001660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.761+0000 7f6f07a1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6f000c9650 0x7f6f000c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.761+0000 7f6f07a1e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f001655f0 con 0x7f6f000ccfb0 2023-11-24T06:15:39.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.761+0000 7f6f07a1e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f000cc380 con 0x7f6f000c9650 2023-11-24T06:15:39.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.761+0000 7f6f07a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00162b30 con 0x7f6f000ccbd0 2023-11-24T06:15:39.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.762+0000 7f6f05fbb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6f000c9650 0x7f6f000c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.762+0000 7f6f05fbb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6f000c9650 0x7f6f000c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38194/0 (socket says 172.21.15.37:38194) 2023-11-24T06:15:39.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.762+0000 7f6f05fbb640 1 -- 172.21.15.37:0/914158496 learned_addr learned my addr 172.21.15.37:0/914158496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:39.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.762+0000 7f6f057ba640 1 --2- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f001660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.763+0000 7f6f05fbb640 1 -- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 msgr2=0x7f6f001660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.763+0000 7f6f05fbb640 1 --2- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f001660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.763+0000 7f6f05fbb640 1 -- 172.21.15.37:0/914158496 >> v1:172.21.15.188:6789/0 conn(0x7f6f000ccfb0 legacy=0x7f6f00162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.763+0000 7f6f05fbb640 1 -- 172.21.15.37:0/914158496 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00162e10 con 0x7f6f000c9650 2023-11-24T06:15:39.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.764+0000 7f6f05fbb640 1 --2- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000c9650 0x7f6f000c9ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80098a0 tx=0x7f6ef802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371098e6690ae1e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.765+0000 7f6ef7fff640 1 -- 172.21.15.37:0/914158496 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8030840 con 0x7f6f000c9650 2023-11-24T06:15:39.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.765+0000 7f6ef7fff640 1 -- 172.21.15.37:0/914158496 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef80309a0 con 0x7f6f000c9650 2023-11-24T06:15:39.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.765+0000 7f6ef7fff640 1 -- 172.21.15.37:0/914158496 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8030d30 con 0x7f6f000c9650 2023-11-24T06:15:39.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 -- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000c9650 msgr2=0x7f6f000c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000c9650 0x7f6f000c9ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80098a0 tx=0x7f6ef802b980 comp rx=0 tx=0).stop 2023-11-24T06:15:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 -- 172.21.15.37:0/914158496 shutdown_connections 2023-11-24T06:15:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000c9650 0x7f6f000c9ae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/914158496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f001660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 -- 172.21.15.37:0/914158496 >> 172.21.15.37:0/914158496 conn(0x7f6f000b0c50 msgr2=0x7f6f000b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 -- 172.21.15.37:0/914158496 shutdown_connections 2023-11-24T06:15:39.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.766+0000 7f6f07a1e640 1 -- 172.21.15.37:0/914158496 wait complete. 2023-11-24T06:15:39.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.768+0000 7f6f07a1e640 1 Processor -- start 2023-11-24T06:15:39.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.769+0000 7f6f07a1e640 1 -- start start 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f07a1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f000c9650 0x7f6f00158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f07a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f00070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f07a1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000ccfb0 0x7f6f001fab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f07a1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001fb9f0 con 0x7f6f000c9650 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f07a1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001fb430 con 0x7f6f000ccfb0 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f07a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001fb710 con 0x7f6f000ccbd0 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f057ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f000c9650 0x7f6f00158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f057ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f000c9650 0x7f6f00158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51964/0 (socket says 172.21.15.37:51964) 2023-11-24T06:15:39.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.770+0000 7f6f057ba640 1 -- 172.21.15.37:0/850825196 learned_addr learned my addr 172.21.15.37:0/850825196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f05fbb640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000ccfb0 0x7f6f001fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f04fb9640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f00070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f057ba640 1 -- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 msgr2=0x7f6f00070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f057ba640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f00070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f057ba640 1 -- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000ccfb0 msgr2=0x7f6f001fab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f057ba640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000ccfb0 0x7f6f001fab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f057ba640 1 -- 172.21.15.37:0/850825196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80094d0 con 0x7f6f000c9650 2023-11-24T06:15:39.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6f057ba640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f000c9650 0x7f6f00158890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00efc0 tx=0x7f6efc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6ef5ffb640 1 -- 172.21.15.37:0/850825196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc014480 con 0x7f6f000c9650 2023-11-24T06:15:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.771+0000 7f6ef5ffb640 1 -- 172.21.15.37:0/850825196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc00f040 con 0x7f6f000c9650 2023-11-24T06:15:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.772+0000 7f6ef5ffb640 1 -- 172.21.15.37:0/850825196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc014800 con 0x7f6f000c9650 2023-11-24T06:15:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.772+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f000705f0 con 0x7f6f000c9650 2023-11-24T06:15:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.772+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00071330 con 0x7f6f000c9650 2023-11-24T06:15:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.773+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0004e8b0 con 0x7f6f000c9650 2023-11-24T06:15:39.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.774+0000 7f6ef5ffb640 1 -- 172.21.15.37:0/850825196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6efc014960 con 0x7f6f000c9650 2023-11-24T06:15:39.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.776+0000 7f6ef5ffb640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ee406ae40 0x7f6ee406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.776+0000 7f6ef5ffb640 1 -- 172.21.15.37:0/850825196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6efc08a330 con 0x7f6f000c9650 2023-11-24T06:15:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.776+0000 7f6f04fb9640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ee406ae40 0x7f6ee406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.777+0000 7f6f04fb9640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ee406ae40 0x7f6ee406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f000b5060 tx=0x7f6ef0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:39.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.780+0000 7f6ef5ffb640 1 -- 172.21.15.37:0/850825196 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6efc055340 con 0x7f6f000c9650 2023-11-24T06:15:39.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.980+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f0012c1b0 con 0x7f6f000c9650 2023-11-24T06:15:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.980+0000 7f6ef5ffb640 1 -- 172.21.15.37:0/850825196 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6efc058960 con 0x7f6f000c9650 2023-11-24T06:15:39.983 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ee406ae40 msgr2=0x7f6ee406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ee406ae40 0x7f6ee406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f000b5060 tx=0x7f6ef0009040 comp rx=0 tx=0).stop 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f000c9650 msgr2=0x7f6f00158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f000c9650 0x7f6f00158890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00efc0 tx=0x7f6efc00c490 comp rx=0 tx=0).stop 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 shutdown_connections 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ee406ae40 0x7f6ee406d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f000ccfb0 0x7f6f001fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f000ccbd0 0x7f6f00070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 --2- 172.21.15.37:0/850825196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f000c9650 0x7f6f00158890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:39.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 >> 172.21.15.37:0/850825196 conn(0x7f6f000b0c50 msgr2=0x7f6f000c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:39.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 shutdown_connections 2023-11-24T06:15:39.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:39.983+0000 7f6f07a1e640 1 -- 172.21.15.37:0/850825196 wait complete. 2023-11-24T06:15:40.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:40.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.220+0000 7efff80b4640 1 Processor -- start 2023-11-24T06:15:40.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.220+0000 7efff80b4640 1 -- start start 2023-11-24T06:15:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.222+0000 7efff80b4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efff015b440 0x7efff00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.222+0000 7efff80b4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff00c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.222+0000 7efff80b4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff015eea0 con 0x7efff00c57e0 2023-11-24T06:15:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.222+0000 7efff80b4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff00cc3d0 con 0x7efff015b440 2023-11-24T06:15:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.222+0000 7efff80b4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff015b820 con 0x7efff00cbf20 2023-11-24T06:15:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.223+0000 7efff6651640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7efff00c57e0 0x7efff00c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:34876/0 (socket says 172.21.15.37:34876) 2023-11-24T06:15:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.223+0000 7efff6651640 1 -- 172.21.15.37:0/4841762 learned_addr learned my addr 172.21.15.37:0/4841762 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.224+0000 7efff564f640 1 --2- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff00c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.224+0000 7efff5e50640 1 --2- 172.21.15.37:0/4841762 >> v2:172.21.15.188:3300/0 conn(0x7efff015b440 0x7efff00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.224+0000 7efff4e4e640 1 -- 172.21.15.37:0/4841762 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237188704 0 0) 0x7efff015eea0 con 0x7efff00c57e0 2023-11-24T06:15:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.224+0000 7efff4e4e640 1 -- 172.21.15.37:0/4841762 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe0003520 con 0x7efff00c57e0 2023-11-24T06:15:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.224+0000 7efff5e50640 1 -- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 msgr2=0x7efff00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.224+0000 7efff5e50640 1 --2- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff00c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.224+0000 7efff5e50640 1 -- 172.21.15.37:0/4841762 >> v1:172.21.15.188:6789/0 conn(0x7efff00c57e0 legacy=0x7efff00c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.225+0000 7efff5e50640 1 -- 172.21.15.37:0/4841762 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff006d600 con 0x7efff015b440 2023-11-24T06:15:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.226+0000 7efff5e50640 1 --2- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff00cb9e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effe4009d90 tx=0x7effe402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a522853e662bf47f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.227+0000 7efff4e4e640 1 -- 172.21.15.37:0/4841762 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe402cbc0 con 0x7efff015b440 2023-11-24T06:15:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.227+0000 7efff4e4e640 1 -- 172.21.15.37:0/4841762 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe402cd20 con 0x7efff015b440 2023-11-24T06:15:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.227+0000 7efff4e4e640 1 -- 172.21.15.37:0/4841762 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4034640 con 0x7efff015b440 2023-11-24T06:15:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.227+0000 7efff80b4640 1 -- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 msgr2=0x7efff00cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.227+0000 7efff80b4640 1 --2- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff00cb9e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effe4009d90 tx=0x7effe402be10 comp rx=0 tx=0).stop 2023-11-24T06:15:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.228+0000 7efff80b4640 1 -- 172.21.15.37:0/4841762 shutdown_connections 2023-11-24T06:15:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.228+0000 7efff80b4640 1 --2- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff00c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.228+0000 7efff80b4640 1 --2- 172.21.15.37:0/4841762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff00cb9e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.228+0000 7efff80b4640 1 -- 172.21.15.37:0/4841762 >> 172.21.15.37:0/4841762 conn(0x7efff00b0c50 msgr2=0x7efff00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.228+0000 7efff80b4640 1 -- 172.21.15.37:0/4841762 shutdown_connections 2023-11-24T06:15:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.228+0000 7efff80b4640 1 -- 172.21.15.37:0/4841762 wait complete. 2023-11-24T06:15:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.229+0000 7efff80b4640 1 Processor -- start 2023-11-24T06:15:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.230+0000 7efff80b4640 1 -- start start 2023-11-24T06:15:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff80b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff00c57e0 0x7efff0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff80b4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff0156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff80b4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff0156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff80b4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff009c8e0 con 0x7efff00c57e0 2023-11-24T06:15:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff80b4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c6bb0 con 0x7efff015b440 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff80b4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c6e90 con 0x7efff00cbf20 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff00c57e0 0x7efff0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff00c57e0 0x7efff0154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51972/0 (socket says 172.21.15.37:51972) 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 -- 172.21.15.37:0/3441062805 learned_addr learned my addr 172.21.15.37:0/3441062805 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff564f640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff0156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff6651640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff0156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 -- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 msgr2=0x7efff0156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff0156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 -- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 msgr2=0x7efff0156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff0156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff5e50640 1 -- 172.21.15.37:0/3441062805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4009a70 con 0x7efff00c57e0 2023-11-24T06:15:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.231+0000 7efff6651640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff0156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.232+0000 7efff5e50640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff00c57e0 0x7efff0154ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7effe4000f80 tx=0x7effe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.232+0000 7effee7fc640 1 -- 172.21.15.37:0/3441062805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4004880 con 0x7efff00c57e0 2023-11-24T06:15:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.232+0000 7effee7fc640 1 -- 172.21.15.37:0/3441062805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe402ce90 con 0x7efff00c57e0 2023-11-24T06:15:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.232+0000 7effee7fc640 1 -- 172.21.15.37:0/3441062805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4034680 con 0x7efff00c57e0 2023-11-24T06:15:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.232+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff00c7170 con 0x7efff00c57e0 2023-11-24T06:15:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.232+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff009a770 con 0x7efff00c57e0 2023-11-24T06:15:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.234+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff004e8b0 con 0x7efff00c57e0 2023-11-24T06:15:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.235+0000 7effee7fc640 1 -- 172.21.15.37:0/3441062805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effe403b030 con 0x7efff00c57e0 2023-11-24T06:15:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.236+0000 7effee7fc640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7effd406ae40 0x7effd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.236+0000 7effee7fc640 1 -- 172.21.15.37:0/3441062805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7effe40abe70 con 0x7efff00c57e0 2023-11-24T06:15:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.236+0000 7efff564f640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7effd406ae40 0x7effd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.237+0000 7efff564f640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7effd406ae40 0x7effd406d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efff01f6760 tx=0x7effdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:40.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.240+0000 7effee7fc640 1 -- 172.21.15.37:0/3441062805 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effe4076fe0 con 0x7efff00c57e0 2023-11-24T06:15:40.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.431+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efff006dc80 con 0x7efff00c57e0 2023-11-24T06:15:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.432+0000 7effee7fc640 1 -- 172.21.15.37:0/3441062805 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7effe4009450 con 0x7efff00c57e0 2023-11-24T06:15:40.435 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7effd406ae40 msgr2=0x7effd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7effd406ae40 0x7effd406d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efff01f6760 tx=0x7effdc008040 comp rx=0 tx=0).stop 2023-11-24T06:15:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff00c57e0 msgr2=0x7efff0154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff00c57e0 0x7efff0154ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7effe4000f80 tx=0x7effe4004a40 comp rx=0 tx=0).stop 2023-11-24T06:15:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 shutdown_connections 2023-11-24T06:15:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7effd406ae40 0x7effd406d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efff015b440 0x7efff0156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efff00cbf20 0x7efff0156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 --2- 172.21.15.37:0/3441062805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff00c57e0 0x7efff0154ad0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 >> 172.21.15.37:0/3441062805 conn(0x7efff00b0c50 msgr2=0x7efff006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 shutdown_connections 2023-11-24T06:15:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.435+0000 7efff80b4640 1 -- 172.21.15.37:0/3441062805 wait complete. 2023-11-24T06:15:40.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.656+0000 7fecf42c6640 1 Processor -- start 2023-11-24T06:15:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.656+0000 7fecf42c6640 1 -- start start 2023-11-24T06:15:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.658+0000 7fecf42c6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecec0af000 0x7fecec0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.658+0000 7fecf42c6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec06dca0 con 0x7fecec161060 2023-11-24T06:15:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.658+0000 7fecf42c6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec06df40 con 0x7fecec06b680 2023-11-24T06:15:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.658+0000 7fecf42c6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0af3e0 con 0x7fecec0af000 2023-11-24T06:15:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.658+0000 7fecf1861640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fecec161060 0x7fecec15da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44550/0 (socket says 172.21.15.37:44550) 2023-11-24T06:15:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.658+0000 7fecf2062640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecec0af000 0x7fecec0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.658+0000 7fecf1861640 1 -- 172.21.15.37:0/1022267424 learned_addr learned my addr 172.21.15.37:0/1022267424 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.659+0000 7fecf2062640 1 -- 172.21.15.37:0/1022267424 >> v1:172.21.15.188:6789/0 conn(0x7fecec06b680 legacy=0x7fecec15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.659+0000 7fecf2062640 1 -- 172.21.15.37:0/1022267424 >> v1:172.21.15.37:6789/0 conn(0x7fecec161060 legacy=0x7fecec15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.659+0000 7fecf2062640 1 -- 172.21.15.37:0/1022267424 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec06e220 con 0x7fecec0af000 2023-11-24T06:15:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.659+0000 7fecf1060640 1 -- 172.21.15.37:0/1022267424 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764670202 0 0) 0x7fecec06dca0 con 0x7fecec161060 2023-11-24T06:15:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.660+0000 7fecf2062640 1 --2- 172.21.15.37:0/1022267424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec0af000 0x7fecec0b3330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fece80097d0 tx=0x7fece802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8451c03414fe7e4d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.660+0000 7fecf1060640 1 -- 172.21.15.37:0/1022267424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8031830 con 0x7fecec0af000 2023-11-24T06:15:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.660+0000 7fecf1060640 1 -- 172.21.15.37:0/1022267424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8031990 con 0x7fecec0af000 2023-11-24T06:15:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.660+0000 7fecf1060640 1 -- 172.21.15.37:0/1022267424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8031d20 con 0x7fecec0af000 2023-11-24T06:15:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.661+0000 7fecf42c6640 1 -- 172.21.15.37:0/1022267424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec0af000 msgr2=0x7fecec0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.661+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1022267424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec0af000 0x7fecec0b3330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fece80097d0 tx=0x7fece802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.661+0000 7fecf42c6640 1 -- 172.21.15.37:0/1022267424 shutdown_connections 2023-11-24T06:15:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.661+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1022267424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec0af000 0x7fecec0b3330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.661+0000 7fecf42c6640 1 -- 172.21.15.37:0/1022267424 >> 172.21.15.37:0/1022267424 conn(0x7fecec0cf900 msgr2=0x7fecec0cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.661+0000 7fecf42c6640 1 -- 172.21.15.37:0/1022267424 shutdown_connections 2023-11-24T06:15:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.661+0000 7fecf42c6640 1 -- 172.21.15.37:0/1022267424 wait complete. 2023-11-24T06:15:40.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.663+0000 7fecf42c6640 1 Processor -- start 2023-11-24T06:15:40.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.663+0000 7fecf42c6640 1 -- start start 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf42c6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecec06b680 0x7fecec13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf42c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecec0af000 0x7fecec143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf42c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec161060 0x7fecec141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf42c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec141480 con 0x7fecec161060 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf42c6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec140590 con 0x7fecec06b680 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf42c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec140870 con 0x7fecec0af000 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf2863640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec161060 0x7fecec141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf2863640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec161060 0x7fecec141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51990/0 (socket says 172.21.15.37:51990) 2023-11-24T06:15:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.664+0000 7fecf2863640 1 -- 172.21.15.37:0/1556825621 learned_addr learned my addr 172.21.15.37:0/1556825621 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf1861640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecec0af000 0x7fecec143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf2062640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecec06b680 0x7fecec13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf2863640 1 -- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecec0af000 msgr2=0x7fecec143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf2863640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecec0af000 0x7fecec143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf2863640 1 -- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecec06b680 msgr2=0x7fecec13fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf2863640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecec06b680 0x7fecec13fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf2863640 1 -- 172.21.15.37:0/1556825621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8009400 con 0x7fecec161060 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf2863640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec161060 0x7fecec141910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fece400c700 tx=0x7fece400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fece2ffd640 1 -- 172.21.15.37:0/1556825621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400aa50 con 0x7fecec161060 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fece2ffd640 1 -- 172.21.15.37:0/1556825621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400abb0 con 0x7fecec161060 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fece2ffd640 1 -- 172.21.15.37:0/1556825621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400ce10 con 0x7fecec161060 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.665+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec140b50 con 0x7fecec161060 2023-11-24T06:15:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.666+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec141110 con 0x7fecec161060 2023-11-24T06:15:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.667+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec141630 con 0x7fecec161060 2023-11-24T06:15:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.668+0000 7fece2ffd640 1 -- 172.21.15.37:0/1556825621 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fece4012420 con 0x7fecec161060 2023-11-24T06:15:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.669+0000 7fece2ffd640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fecd006ae70 0x7fecd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.669+0000 7fece2ffd640 1 -- 172.21.15.37:0/1556825621 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fece4089b00 con 0x7fecec161060 2023-11-24T06:15:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.669+0000 7fecf2062640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fecd006ae70 0x7fecd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.670+0000 7fecf2062640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fecd006ae70 0x7fecd006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fece8036000 tx=0x7fece803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:40.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.673+0000 7fece2ffd640 1 -- 172.21.15.37:0/1556825621 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecec141630 con 0x7fecec161060 2023-11-24T06:15:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.868+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecec04e8b0 con 0x7fecec161060 2023-11-24T06:15:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.869+0000 7fece2ffd640 1 -- 172.21.15.37:0/1556825621 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fece4016020 con 0x7fecec161060 2023-11-24T06:15:40.872 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fecd006ae70 msgr2=0x7fecd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fecd006ae70 0x7fecd006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fece8036000 tx=0x7fece803c040 comp rx=0 tx=0).stop 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec161060 msgr2=0x7fecec141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec161060 0x7fecec141910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fece400c700 tx=0x7fece400cbc0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 shutdown_connections 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fecd006ae70 0x7fecd006d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecec161060 0x7fecec141910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fecec0af000 0x7fecec143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 --2- 172.21.15.37:0/1556825621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fecec06b680 0x7fecec13fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:40.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 >> 172.21.15.37:0/1556825621 conn(0x7fecec0cf900 msgr2=0x7fecec0afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:40.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 shutdown_connections 2023-11-24T06:15:40.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:40.872+0000 7fecf42c6640 1 -- 172.21.15.37:0/1556825621 wait complete. 2023-11-24T06:15:40.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:15:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.083+0000 7f19e2d35640 1 Processor -- start 2023-11-24T06:15:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.084+0000 7f19e2d35640 1 -- start start 2023-11-24T06:15:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.085+0000 7f19e2d35640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 0x7f19dc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.085+0000 7f19e2d35640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f19dc0b1080 0x7f19dc15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.085+0000 7f19e2d35640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0ca0e0 con 0x7f19dc15b1d0 2023-11-24T06:15:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.085+0000 7f19e2d35640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0b1510 con 0x7f19dc0b1080 2023-11-24T06:15:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.085+0000 7f19e2d35640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc072800 con 0x7f19dc070550 2023-11-24T06:15:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.085+0000 7f19e1d33640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f19dc15b1d0 0x7f19dc071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36038/0 (socket says 172.21.15.37:36038) 2023-11-24T06:15:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.085+0000 7f19e1d33640 1 -- 172.21.15.37:0/80506057 learned_addr learned my addr 172.21.15.37:0/80506057 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313947924 0 0) 0x7f19dc0ca0e0 con 0x7f19dc15b1d0 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e1532640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 0x7f19dc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c8003520 con 0x7f19dc15b1d0 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 401872146 0 0) 0x7f19c8003520 con 0x7f19dc15b1d0 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 msgr2=0x7f19dc0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 0x7f19dc0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 >> v2:172.21.15.188:3300/0 conn(0x7f19dc0b1080 msgr2=0x7f19dc15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 --2- 172.21.15.37:0/80506057 >> v2:172.21.15.188:3300/0 conn(0x7f19dc0b1080 0x7f19dc15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0c97b0 con 0x7f19dc15b1d0 2023-11-24T06:15:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f19d8001670 con 0x7f19dc15b1d0 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 >> v1:172.21.15.37:6789/0 conn(0x7f19dc15b1d0 legacy=0x7f19dc071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8003970 0x7f19c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 0x7f19c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c8004d00 0x7f19c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0b1510 con 0x7f19c8004d00 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc072800 con 0x7f19c8003970 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.086+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c800bb10 con 0x7f19dc070550 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e2534640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c8004d00 0x7f19c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e1d33640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8003970 0x7f19c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e2534640 1 -- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 msgr2=0x7f19c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e1532640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 0x7f19c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e2534640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc070550 0x7f19c80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e2534640 1 -- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8003970 msgr2=0x7f19c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e2534640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8003970 0x7f19c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.087+0000 7f19e2534640 1 -- 172.21.15.37:0/80506057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8003520 con 0x7f19c8004d00 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.088+0000 7f19e2534640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c8004d00 0x7f19c8005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009e40 tx=0x7f19c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb78852f5d032c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.088+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d402cd90 con 0x7f19c8004d00 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.088+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d4034440 con 0x7f19c8004d00 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.088+0000 7f19e0d31640 1 -- 172.21.15.37:0/80506057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d40347f0 con 0x7f19c8004d00 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.089+0000 7f19e2d35640 1 -- 172.21.15.37:0/80506057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c8004d00 msgr2=0x7f19c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.089+0000 7f19e2d35640 1 --2- 172.21.15.37:0/80506057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c8004d00 0x7f19c8005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009e40 tx=0x7f19c80057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.089+0000 7f19e2534640 1 -- 172.21.15.37:0/80506057 reap_dead start 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.089+0000 7f19e2d35640 1 -- 172.21.15.37:0/80506057 shutdown_connections 2023-11-24T06:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.089+0000 7f19e2d35640 1 -- 172.21.15.37:0/80506057 >> 172.21.15.37:0/80506057 conn(0x7f19dc0cbb40 msgr2=0x7f19dc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.089+0000 7f19e2d35640 1 -- 172.21.15.37:0/80506057 shutdown_connections 2023-11-24T06:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.089+0000 7f19e2d35640 1 -- 172.21.15.37:0/80506057 wait complete. 2023-11-24T06:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.091+0000 7f19e2d35640 1 Processor -- start 2023-11-24T06:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.091+0000 7f19e2d35640 1 -- start start 2023-11-24T06:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e2d35640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8004d00 0x7f19dc0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e2d35640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc14f150 0x7f19dc14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e2d35640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc1e5340 0x7f19dc1e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e2d35640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc14fb10 con 0x7f19dc14f150 2023-11-24T06:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e2d35640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc1e5d00 con 0x7f19c8004d00 2023-11-24T06:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e2d35640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0c4d80 con 0x7f19dc1e5340 2023-11-24T06:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e1532640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc14f150 0x7f19dc14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.092+0000 7f19e1532640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc14f150 0x7f19dc14f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39314/0 (socket says 172.21.15.37:39314) 2023-11-24T06:15:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1532640 1 -- 172.21.15.37:0/2968963558 learned_addr learned my addr 172.21.15.37:0/2968963558 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e2534640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc1e5340 0x7f19dc1e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1d33640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8004d00 0x7f19dc0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1532640 1 -- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc1e5340 msgr2=0x7f19dc1e57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1532640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc1e5340 0x7f19dc1e57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1532640 1 -- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8004d00 msgr2=0x7f19dc0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1532640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8004d00 0x7f19dc0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1532640 1 -- 172.21.15.37:0/2968963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc1e5f40 con 0x7f19dc14f150 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e2534640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc1e5340 0x7f19dc1e57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.093+0000 7f19e1532640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc14f150 0x7f19dc14f5d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19d000e7e0 tx=0x7f19d000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.094+0000 7f19ce7fc640 1 -- 172.21.15.37:0/2968963558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000c670 con 0x7f19dc14f150 2023-11-24T06:15:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.094+0000 7f19ce7fc640 1 -- 172.21.15.37:0/2968963558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d000c7d0 con 0x7f19dc14f150 2023-11-24T06:15:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.094+0000 7f19ce7fc640 1 -- 172.21.15.37:0/2968963558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000cb80 con 0x7f19dc14f150 2023-11-24T06:15:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.094+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc1e6220 con 0x7f19dc14f150 2023-11-24T06:15:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.094+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc1e67e0 con 0x7f19dc14f150 2023-11-24T06:15:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.095+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc04e840 con 0x7f19dc14f150 2023-11-24T06:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.096+0000 7f19ce7fc640 1 -- 172.21.15.37:0/2968963558 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19d000cce0 con 0x7f19dc14f150 2023-11-24T06:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.097+0000 7f19ce7fc640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.097+0000 7f19ce7fc640 1 -- 172.21.15.37:0/2968963558 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f19d0089500 con 0x7f19dc14f150 2023-11-24T06:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.097+0000 7f19e1d33640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.098+0000 7f19e1d33640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19d8001eb0 tx=0x7f19d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.101+0000 7f19ce7fc640 1 -- 172.21.15.37:0/2968963558 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19d0054510 con 0x7f19dc14f150 2023-11-24T06:15:41.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.306+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19dc0c2800 con 0x7f19dc14f150 2023-11-24T06:15:41.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.307+0000 7f19ce7fc640 1 -- 172.21.15.37:0/2968963558 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f19d0009380 con 0x7f19dc14f150 2023-11-24T06:15:41.310 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:15:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 msgr2=0x7f19c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19d8001eb0 tx=0x7f19d8009040 comp rx=0 tx=0).stop 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc14f150 msgr2=0x7f19dc14f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc14f150 0x7f19dc14f5d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19d000e7e0 tx=0x7f19d000eca0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 shutdown_connections 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f19c006ae40 0x7f19c006d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19dc1e5340 0x7f19dc1e57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19dc14f150 0x7f19dc14f5d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 --2- 172.21.15.37:0/2968963558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19c8004d00 0x7f19dc0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.310+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 >> 172.21.15.37:0/2968963558 conn(0x7f19dc0cbb40 msgr2=0x7f19dc0ad530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.311+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 shutdown_connections 2023-11-24T06:15:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.311+0000 7f19e2d35640 1 -- 172.21.15.37:0/2968963558 wait complete. 2023-11-24T06:15:41.331 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-24T06:15:41.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:41.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-24T06:15:41.434 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:15:41.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:41.435 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T06:15:41.493 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:41.493 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:41.554 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:41.554 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:41.608 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:15:41.609 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:41.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:41.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.890+0000 7f2e6f127640 1 Processor -- start 2023-11-24T06:15:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.890+0000 7f2e6f127640 1 -- start start 2023-11-24T06:15:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.891+0000 7f2e6f127640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.891+0000 7f2e6f127640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e680b1de0 0x7f2e680b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.891+0000 7f2e6f127640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6815bf80 con 0x7f2e68144b30 2023-11-24T06:15:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.891+0000 7f2e6f127640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e680b27b0 con 0x7f2e680b1de0 2023-11-24T06:15:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.891+0000 7f2e6f127640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680b1560 con 0x7f2e6815c410 2023-11-24T06:15:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.892+0000 7f2e6d924640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.892+0000 7f2e6e926640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e680b1de0 0x7f2e680b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.892+0000 7f2e6e926640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e680b1de0 0x7f2e680b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:59090/0 (socket says 172.21.15.37:59090) 2023-11-24T06:15:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.892+0000 7f2e6e926640 1 -- 172.21.15.37:0/2727824218 learned_addr learned my addr 172.21.15.37:0/2727824218 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.893+0000 7f2e6d924640 1 -- 172.21.15.37:0/2727824218 >> v2:172.21.15.188:3300/0 conn(0x7f2e680b1de0 msgr2=0x7f2e680b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.893+0000 7f2e6d924640 1 --2- 172.21.15.37:0/2727824218 >> v2:172.21.15.188:3300/0 conn(0x7f2e680b1de0 0x7f2e680b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.893+0000 7f2e6d924640 1 -- 172.21.15.37:0/2727824218 >> v1:172.21.15.188:6789/0 conn(0x7f2e68144b30 legacy=0x7f2e680b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.893+0000 7f2e6d924640 1 -- 172.21.15.37:0/2727824218 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e680b1280 con 0x7f2e6815c410 2023-11-24T06:15:41.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.893+0000 7f2e6e926640 1 --2- 172.21.15.37:0/2727824218 >> v2:172.21.15.188:3300/0 conn(0x7f2e680b1de0 0x7f2e680b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:15:41.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.894+0000 7f2e6d924640 1 --2- 172.21.15.37:0/2727824218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6815f920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e580097a0 tx=0x7f2e5802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c576d006e0ced06a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6d123640 1 -- 172.21.15.37:0/2727824218 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58031830 con 0x7f2e6815c410 2023-11-24T06:15:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6d123640 1 -- 172.21.15.37:0/2727824218 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58031990 con 0x7f2e6815c410 2023-11-24T06:15:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6d123640 1 -- 172.21.15.37:0/2727824218 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58031d20 con 0x7f2e6815c410 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 -- 172.21.15.37:0/2727824218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 msgr2=0x7f2e6815f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 --2- 172.21.15.37:0/2727824218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6815f920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e580097a0 tx=0x7f2e5802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 -- 172.21.15.37:0/2727824218 shutdown_connections 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 --2- 172.21.15.37:0/2727824218 >> v2:172.21.15.188:3300/0 conn(0x7f2e680b1de0 0x7f2e680b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 --2- 172.21.15.37:0/2727824218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6815f920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 -- 172.21.15.37:0/2727824218 >> 172.21.15.37:0/2727824218 conn(0x7f2e680cb830 msgr2=0x7f2e680cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 -- 172.21.15.37:0/2727824218 shutdown_connections 2023-11-24T06:15:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.895+0000 7f2e6f127640 1 -- 172.21.15.37:0/2727824218 wait complete. 2023-11-24T06:15:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.897+0000 7f2e6f127640 1 Processor -- start 2023-11-24T06:15:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.897+0000 7f2e6f127640 1 -- start start 2023-11-24T06:15:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.898+0000 7f2e6f127640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b1de0 0x7f2e680cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.898+0000 7f2e6f127640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e68144b30 0x7f2e68140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.898+0000 7f2e6f127640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6813df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.898+0000 7f2e6f127640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6813e960 con 0x7f2e68144b30 2023-11-24T06:15:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.898+0000 7f2e6f127640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6813e450 con 0x7f2e680b1de0 2023-11-24T06:15:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.898+0000 7f2e6f127640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68141380 con 0x7f2e6815c410 2023-11-24T06:15:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e68144b30 0x7f2e68140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e68144b30 0x7f2e68140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39320/0 (socket says 172.21.15.37:39320) 2023-11-24T06:15:41.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 -- 172.21.15.37:0/3960104381 learned_addr learned my addr 172.21.15.37:0/3960104381 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6e125640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b1de0 0x7f2e680cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6e926640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6813df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 -- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 msgr2=0x7f2e6813df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6813df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 -- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b1de0 msgr2=0x7f2e680cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b1de0 0x7f2e680cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 -- 172.21.15.37:0/3960104381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e60009b30 con 0x7f2e68144b30 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.899+0000 7f2e6d924640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e68144b30 0x7f2e68140ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.900+0000 7f2e5effd640 1 -- 172.21.15.37:0/3960104381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5803a8f0 con 0x7f2e68144b30 2023-11-24T06:15:41.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.900+0000 7f2e5effd640 1 -- 172.21.15.37:0/3960104381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5803aa50 con 0x7f2e68144b30 2023-11-24T06:15:41.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.900+0000 7f2e5effd640 1 -- 172.21.15.37:0/3960104381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5803ae00 con 0x7f2e68144b30 2023-11-24T06:15:41.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.900+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e58009400 con 0x7f2e68144b30 2023-11-24T06:15:41.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.900+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e68141940 con 0x7f2e68144b30 2023-11-24T06:15:41.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.901+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e680b3610 con 0x7f2e68144b30 2023-11-24T06:15:41.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.902+0000 7f2e5effd640 1 -- 172.21.15.37:0/3960104381 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e5804d450 con 0x7f2e68144b30 2023-11-24T06:15:41.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.903+0000 7f2e5effd640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4c06ae70 0x7f2e4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:41.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.903+0000 7f2e5effd640 1 -- 172.21.15.37:0/3960104381 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2e580ab6d0 con 0x7f2e68144b30 2023-11-24T06:15:41.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.903+0000 7f2e6e125640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4c06ae70 0x7f2e4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:41.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.904+0000 7f2e6e125640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4c06ae70 0x7f2e4c06d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e680b3350 tx=0x7f2e64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:41.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:41.907+0000 7f2e5effd640 1 -- 172.21.15.37:0/3960104381 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e680b3610 con 0x7f2e68144b30 2023-11-24T06:15:42.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.101+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e680b3610 con 0x7f2e68144b30 2023-11-24T06:15:42.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.104+0000 7f2e5effd640 1 -- 172.21.15.37:0/3960104381 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16764 (secure 0 0 0) 0x7f2e680b3610 con 0x7f2e68144b30 2023-11-24T06:15:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:42.107 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:32.729893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4c06ae70 msgr2=0x7f2e4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4c06ae70 0x7f2e4c06d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e680b3350 tx=0x7f2e64009040 comp rx=0 tx=0).stop 2023-11-24T06:15:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e68144b30 msgr2=0x7f2e68140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e68144b30 0x7f2e68140ca0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e580046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 shutdown_connections 2023-11-24T06:15:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4c06ae70 0x7f2e4c06d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e6815c410 0x7f2e6813df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e68144b30 0x7f2e68140ca0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 --2- 172.21.15.37:0/3960104381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b1de0 0x7f2e680cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 >> 172.21.15.37:0/3960104381 conn(0x7f2e680cb830 msgr2=0x7f2e6815e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 shutdown_connections 2023-11-24T06:15:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.107+0000 7f2e6f127640 1 -- 172.21.15.37:0/3960104381 wait complete. 2023-11-24T06:15:42.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:42.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:42.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.355+0000 7f78d590f640 1 Processor -- start 2023-11-24T06:15:42.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.356+0000 7f78d590f640 1 -- start start 2023-11-24T06:15:42.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78d590f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 0x7f78d00c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78d590f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78d006d600 0x7f78d00cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78d590f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d015e400 con 0x7f78d00c4220 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78d590f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d00ce880 con 0x7f78d006d600 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78d590f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c5ed0 con 0x7f78d015d7f0 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78ce7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f78d00c4220 0x7f78d00cabb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36048/0 (socket says 172.21.15.37:36048) 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78ce7fc640 1 -- 172.21.15.37:0/835859621 learned_addr learned my addr 172.21.15.37:0/835859621 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.357+0000 7f78cf7fe640 1 --2- 172.21.15.37:0/835859621 >> v2:172.21.15.37:3300/0 conn(0x7f78d006d600 0x7f78d00cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.358+0000 7f78ceffd640 1 --2- 172.21.15.37:0/835859621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 0x7f78d00c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.358+0000 7f78cdffb640 1 -- 172.21.15.37:0/835859621 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078219770 0 0) 0x7f78d015e400 con 0x7f78d00c4220 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.358+0000 7f78cdffb640 1 -- 172.21.15.37:0/835859621 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b8003520 con 0x7f78d00c4220 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.358+0000 7f78cf7fe640 1 -- 172.21.15.37:0/835859621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 msgr2=0x7f78d00c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.358+0000 7f78cf7fe640 1 --2- 172.21.15.37:0/835859621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 0x7f78d00c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.358+0000 7f78cf7fe640 1 -- 172.21.15.37:0/835859621 >> v1:172.21.15.37:6789/0 conn(0x7f78d00c4220 legacy=0x7f78d00cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.358+0000 7f78cf7fe640 1 -- 172.21.15.37:0/835859621 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d00c46e0 con 0x7f78d006d600 2023-11-24T06:15:42.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.359+0000 7f78cf7fe640 1 --2- 172.21.15.37:0/835859621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d006d600 0x7f78d00cb2c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009d90 tx=0x7f78c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4b97d8da8ea38a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.359+0000 7f78cdffb640 1 -- 172.21.15.37:0/835859621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c802cc50 con 0x7f78d006d600 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.359+0000 7f78cdffb640 1 -- 172.21.15.37:0/835859621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c802cdb0 con 0x7f78d006d600 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.359+0000 7f78cdffb640 1 -- 172.21.15.37:0/835859621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8034660 con 0x7f78d006d600 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 -- 172.21.15.37:0/835859621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d006d600 msgr2=0x7f78d00cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 --2- 172.21.15.37:0/835859621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d006d600 0x7f78d00cb2c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009d90 tx=0x7f78c802bea0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 -- 172.21.15.37:0/835859621 shutdown_connections 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 --2- 172.21.15.37:0/835859621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d006d600 0x7f78d00cb2c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 --2- 172.21.15.37:0/835859621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 0x7f78d00c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 -- 172.21.15.37:0/835859621 >> 172.21.15.37:0/835859621 conn(0x7f78d00b0c50 msgr2=0x7f78d00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 -- 172.21.15.37:0/835859621 shutdown_connections 2023-11-24T06:15:42.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.360+0000 7f78d590f640 1 -- 172.21.15.37:0/835859621 wait complete. 2023-11-24T06:15:42.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.362+0000 7f78d590f640 1 Processor -- start 2023-11-24T06:15:42.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.362+0000 7f78d590f640 1 -- start start 2023-11-24T06:15:42.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78d590f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78d006d600 0x7f78d0159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78d590f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d00c4220 0x7f78d015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78d590f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 0x7f78d00b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78d590f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0071fc0 con 0x7f78d00c4220 2023-11-24T06:15:42.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78d590f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0150be0 con 0x7f78d006d600 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78d590f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00b4b70 con 0x7f78d015d7f0 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78ce7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d00c4220 0x7f78d015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78ce7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d00c4220 0x7f78d015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39336/0 (socket says 172.21.15.37:39336) 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.363+0000 7f78ce7fc640 1 -- 172.21.15.37:0/3702933376 learned_addr learned my addr 172.21.15.37:0/3702933376 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78ce7fc640 1 -- 172.21.15.37:0/3702933376 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 msgr2=0x7f78d00b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78ce7fc640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 0x7f78d00b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78ce7fc640 1 -- 172.21.15.37:0/3702933376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78d006d600 msgr2=0x7f78d0159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78ce7fc640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78d006d600 0x7f78d0159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78ce7fc640 1 -- 172.21.15.37:0/3702933376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8009a70 con 0x7f78d00c4220 2023-11-24T06:15:42.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78ce7fc640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d00c4220 0x7f78d015a0f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c530 tx=0x7f78c400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:42.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78b7fff640 1 -- 172.21.15.37:0/3702933376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4005ce0 con 0x7f78d00c4220 2023-11-24T06:15:42.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78b7fff640 1 -- 172.21.15.37:0/3702933376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4005e40 con 0x7f78d00c4220 2023-11-24T06:15:42.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78b7fff640 1 -- 172.21.15.37:0/3702933376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c40072b0 con 0x7f78d00c4220 2023-11-24T06:15:42.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d0071620 con 0x7f78d00c4220 2023-11-24T06:15:42.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.364+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d0071be0 con 0x7f78d00c4220 2023-11-24T06:15:42.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.366+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d0072100 con 0x7f78d00c4220 2023-11-24T06:15:42.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.366+0000 7f78b7fff640 1 -- 172.21.15.37:0/3702933376 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78c4007410 con 0x7f78d00c4220 2023-11-24T06:15:42.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.367+0000 7f78b7fff640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f78bc06ae40 0x7f78bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.367+0000 7f78b7fff640 1 -- 172.21.15.37:0/3702933376 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f78c4088c70 con 0x7f78d00c4220 2023-11-24T06:15:42.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.368+0000 7f78ceffd640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f78bc06ae40 0x7f78bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.368+0000 7f78ceffd640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f78bc06ae40 0x7f78bc06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006fd0 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:42.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.371+0000 7f78b7fff640 1 -- 172.21.15.37:0/3702933376 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78d0072100 con 0x7f78d00c4220 2023-11-24T06:15:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.561+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78d0072100 con 0x7f78d00c4220 2023-11-24T06:15:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.562+0000 7f78b7fff640 1 -- 172.21.15.37:0/3702933376 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78d0072100 con 0x7f78d00c4220 2023-11-24T06:15:42.565 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f78bc06ae40 msgr2=0x7f78bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f78bc06ae40 0x7f78bc06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006fd0 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2023-11-24T06:15:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d00c4220 msgr2=0x7f78d015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d00c4220 0x7f78d015a0f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c530 tx=0x7f78c400c9f0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 shutdown_connections 2023-11-24T06:15:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f78bc06ae40 0x7f78bc06d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78d015d7f0 0x7f78d00b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d00c4220 0x7f78d015a0f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 --2- 172.21.15.37:0/3702933376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f78d006d600 0x7f78d0159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.564+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 >> 172.21.15.37:0/3702933376 conn(0x7f78d00b0c50 msgr2=0x7f78d00aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.565+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 shutdown_connections 2023-11-24T06:15:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.565+0000 7f78d590f640 1 -- 172.21.15.37:0/3702933376 wait complete. 2023-11-24T06:15:42.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.805+0000 7fe989a8c640 1 Processor -- start 2023-11-24T06:15:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.805+0000 7fe989a8c640 1 -- start start 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe989a8c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe98415b260 0x7fe98406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe989a8c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe98406e580 0x7fe9840b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe989a8c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9840b1080 0x7fe9840ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe989a8c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9840b1530 con 0x7fe9840b1080 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe989a8c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98415b640 con 0x7fe98406e580 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe989a8c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98415ed20 con 0x7fe98415b260 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe98928b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9840b1080 0x7fe9840ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe98928b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9840b1080 0x7fe9840ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39342/0 (socket says 172.21.15.37:39342) 2023-11-24T06:15:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.807+0000 7fe98928b640 1 -- 172.21.15.37:0/3913168970 learned_addr learned my addr 172.21.15.37:0/3913168970 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.808+0000 7fe983fff640 1 --2- 172.21.15.37:0/3913168970 >> v2:172.21.15.188:3300/0 conn(0x7fe98406e580 0x7fe9840b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.808+0000 7fe988a8a640 1 --2- 172.21.15.37:0/3913168970 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe98415b260 0x7fe98406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.808+0000 7fe98928b640 1 -- 172.21.15.37:0/3913168970 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe98415b260 msgr2=0x7fe98406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.808+0000 7fe98928b640 1 --2- 172.21.15.37:0/3913168970 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe98415b260 0x7fe98406e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.808+0000 7fe98928b640 1 -- 172.21.15.37:0/3913168970 >> v2:172.21.15.188:3300/0 conn(0x7fe98406e580 msgr2=0x7fe9840b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.808+0000 7fe98928b640 1 --2- 172.21.15.37:0/3913168970 >> v2:172.21.15.188:3300/0 conn(0x7fe98406e580 0x7fe9840b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.808+0000 7fe98928b640 1 -- 172.21.15.37:0/3913168970 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98415f8a0 con 0x7fe9840b1080 2023-11-24T06:15:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.809+0000 7fe98928b640 1 --2- 172.21.15.37:0/3913168970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9840b1080 0x7fe9840ccc90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe9840cba30 tx=0x7fe97c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ad8451e4e0aa2a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:42.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.813+0000 7fe9837fe640 1 -- 172.21.15.37:0/3913168970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c02c950 con 0x7fe9840b1080 2023-11-24T06:15:42.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.813+0000 7fe9837fe640 1 -- 172.21.15.37:0/3913168970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c02cab0 con 0x7fe9840b1080 2023-11-24T06:15:42.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.813+0000 7fe9837fe640 1 -- 172.21.15.37:0/3913168970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c02ce40 con 0x7fe9840b1080 2023-11-24T06:15:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.813+0000 7fe989a8c640 1 -- 172.21.15.37:0/3913168970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9840b1080 msgr2=0x7fe9840ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.813+0000 7fe989a8c640 1 --2- 172.21.15.37:0/3913168970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9840b1080 0x7fe9840ccc90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe9840cba30 tx=0x7fe97c02bdb0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.814+0000 7fe989a8c640 1 -- 172.21.15.37:0/3913168970 shutdown_connections 2023-11-24T06:15:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.814+0000 7fe989a8c640 1 --2- 172.21.15.37:0/3913168970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9840b1080 0x7fe9840ccc90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.814+0000 7fe989a8c640 1 --2- 172.21.15.37:0/3913168970 >> v2:172.21.15.188:3300/0 conn(0x7fe98406e580 0x7fe9840b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.814+0000 7fe989a8c640 1 --2- 172.21.15.37:0/3913168970 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe98415b260 0x7fe98406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.814+0000 7fe989a8c640 1 -- 172.21.15.37:0/3913168970 >> 172.21.15.37:0/3913168970 conn(0x7fe9840cbb40 msgr2=0x7fe9840cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.814+0000 7fe989a8c640 1 -- 172.21.15.37:0/3913168970 shutdown_connections 2023-11-24T06:15:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.814+0000 7fe989a8c640 1 -- 172.21.15.37:0/3913168970 wait complete. 2023-11-24T06:15:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.816+0000 7fe989a8c640 1 Processor -- start 2023-11-24T06:15:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.816+0000 7fe989a8c640 1 -- start start 2023-11-24T06:15:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe989a8c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe98406e580 0x7fe9840b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe989a8c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9840b1080 0x7fe9841514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe989a8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe98415b260 0x7fe9840b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe989a8c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840b2b10 con 0x7fe98415b260 2023-11-24T06:15:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe989a8c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840b1f00 con 0x7fe98406e580 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe989a8c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840b21e0 con 0x7fe9840b1080 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe98928b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe98415b260 0x7fe9840b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe98928b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe98415b260 0x7fe9840b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39352/0 (socket says 172.21.15.37:39352) 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe98928b640 1 -- 172.21.15.37:0/2295225741 learned_addr learned my addr 172.21.15.37:0/2295225741 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.817+0000 7fe988a8a640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe98406e580 0x7fe9840b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe983fff640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9840b1080 0x7fe9841514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe98928b640 1 -- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9840b1080 msgr2=0x7fe9841514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe98928b640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9840b1080 0x7fe9841514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe98928b640 1 -- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe98406e580 msgr2=0x7fe9840b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe98928b640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe98406e580 0x7fe9840b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe98928b640 1 -- 172.21.15.37:0/2295225741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c009b30 con 0x7fe98415b260 2023-11-24T06:15:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe98928b640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe98415b260 0x7fe9840b4630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe97c036040 tx=0x7fe97c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe9817fa640 1 -- 172.21.15.37:0/2295225741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c009510 con 0x7fe98415b260 2023-11-24T06:15:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe9817fa640 1 -- 172.21.15.37:0/2295225741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c03e450 con 0x7fe98415b260 2023-11-24T06:15:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9840b24c0 con 0x7fe98415b260 2023-11-24T06:15:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.818+0000 7fe9817fa640 1 -- 172.21.15.37:0/2295225741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c03e7e0 con 0x7fe98415b260 2023-11-24T06:15:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.819+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe984151a30 con 0x7fe98415b260 2023-11-24T06:15:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.820+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9840b2cc0 con 0x7fe98415b260 2023-11-24T06:15:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.820+0000 7fe9817fa640 1 -- 172.21.15.37:0/2295225741 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe97c03e940 con 0x7fe98415b260 2023-11-24T06:15:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.821+0000 7fe9817fa640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe96806ae40 0x7fe96806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.822+0000 7fe9817fa640 1 -- 172.21.15.37:0/2295225741 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe97c0ac4b0 con 0x7fe98415b260 2023-11-24T06:15:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.822+0000 7fe988a8a640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe96806ae40 0x7fe96806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.822+0000 7fe988a8a640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe96806ae40 0x7fe96806d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe978006fd0 tx=0x7fe978008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:42.826+0000 7fe9817fa640 1 -- 172.21.15.37:0/2295225741 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9840b2cc0 con 0x7fe98415b260 2023-11-24T06:15:43.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.018+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe98404e840 con 0x7fe98415b260 2023-11-24T06:15:43.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.019+0000 7fe9817fa640 1 -- 172.21.15.37:0/2295225741 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe97c0774c0 con 0x7fe98415b260 2023-11-24T06:15:43.022 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe96806ae40 msgr2=0x7fe96806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe96806ae40 0x7fe96806d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe978006fd0 tx=0x7fe978008040 comp rx=0 tx=0).stop 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe98415b260 msgr2=0x7fe9840b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe98415b260 0x7fe9840b4630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe97c036040 tx=0x7fe97c004a40 comp rx=0 tx=0).stop 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 shutdown_connections 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe96806ae40 0x7fe96806d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe98415b260 0x7fe9840b4630 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9840b1080 0x7fe9841514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 --2- 172.21.15.37:0/2295225741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe98406e580 0x7fe9840b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 >> 172.21.15.37:0/2295225741 conn(0x7fe9840cbb40 msgr2=0x7fe9840addb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 shutdown_connections 2023-11-24T06:15:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.022+0000 7fe989a8c640 1 -- 172.21.15.37:0/2295225741 wait complete. 2023-11-24T06:15:43.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:43.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.258+0000 7f1963459640 1 Processor -- start 2023-11-24T06:15:43.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.259+0000 7f1963459640 1 -- start start 2023-11-24T06:15:43.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.260+0000 7f1963459640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f195c15d3f0 0x7f195c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.260+0000 7f1963459640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f195c15d7d0 0x7f195c0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.260+0000 7f1963459640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0d15e0 con 0x7f195c0d0e40 2023-11-24T06:15:43.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.260+0000 7f1963459640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0d0280 con 0x7f195c15d7d0 2023-11-24T06:15:43.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.260+0000 7f1963459640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0d1300 con 0x7f195c15d3f0 2023-11-24T06:15:43.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1961c56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f195c15d7d0 0x7f195c0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1961c56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f195c15d7d0 0x7f195c0d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39356/0 (socket says 172.21.15.37:39356) 2023-11-24T06:15:43.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1961c56640 1 -- 172.21.15.37:0/146089340 learned_addr learned my addr 172.21.15.37:0/146089340 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:43.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1962457640 1 --2- 172.21.15.37:0/146089340 >> v2:172.21.15.188:3300/0 conn(0x7f195c15d3f0 0x7f195c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1961c56640 1 -- 172.21.15.37:0/146089340 >> v2:172.21.15.188:3300/0 conn(0x7f195c15d3f0 msgr2=0x7f195c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:43.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1961c56640 1 --2- 172.21.15.37:0/146089340 >> v2:172.21.15.188:3300/0 conn(0x7f195c15d3f0 0x7f195c0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1961c56640 1 -- 172.21.15.37:0/146089340 >> v1:172.21.15.188:6789/0 conn(0x7f195c0d0e40 legacy=0x7f195c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.261+0000 7f1961c56640 1 -- 172.21.15.37:0/146089340 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0cfc30 con 0x7f195c15d7d0 2023-11-24T06:15:43.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.262+0000 7f1961c56640 1 --2- 172.21.15.37:0/146089340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c0d1d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f195c067c60 tx=0x7f194c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e7b5d16707285e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.263+0000 7f1961455640 1 -- 172.21.15.37:0/146089340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c030860 con 0x7f195c15d7d0 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.263+0000 7f1961455640 1 -- 172.21.15.37:0/146089340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c0309c0 con 0x7f195c15d7d0 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.263+0000 7f1961455640 1 -- 172.21.15.37:0/146089340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c030d50 con 0x7f195c15d7d0 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.263+0000 7f1963459640 1 -- 172.21.15.37:0/146089340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 msgr2=0x7f195c0d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.263+0000 7f1963459640 1 --2- 172.21.15.37:0/146089340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c0d1d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f195c067c60 tx=0x7f194c02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.263+0000 7f1963459640 1 -- 172.21.15.37:0/146089340 shutdown_connections 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.264+0000 7f1963459640 1 --2- 172.21.15.37:0/146089340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c0d1d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.264+0000 7f1963459640 1 --2- 172.21.15.37:0/146089340 >> v2:172.21.15.188:3300/0 conn(0x7f195c15d3f0 0x7f195c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.264+0000 7f1963459640 1 -- 172.21.15.37:0/146089340 >> 172.21.15.37:0/146089340 conn(0x7f195c09c5b0 msgr2=0x7f195c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.264+0000 7f1963459640 1 -- 172.21.15.37:0/146089340 shutdown_connections 2023-11-24T06:15:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.264+0000 7f1963459640 1 -- 172.21.15.37:0/146089340 wait complete. 2023-11-24T06:15:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.265+0000 7f1963459640 1 Processor -- start 2023-11-24T06:15:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.266+0000 7f1963459640 1 -- start start 2023-11-24T06:15:43.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.266+0000 7f1963459640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f195c0d0e40 0x7f195c0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1963459640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f195c15d3f0 0x7f195c149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1963459640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1963459640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c15f360 con 0x7f195c15d7d0 2023-11-24T06:15:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1963459640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c1f2e30 con 0x7f195c0d0e40 2023-11-24T06:15:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1963459640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c156e20 con 0x7f195c15d3f0 2023-11-24T06:15:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39358/0 (socket says 172.21.15.37:39358) 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 -- 172.21.15.37:0/2189385053 learned_addr learned my addr 172.21.15.37:0/2189385053 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962457640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f195c0d0e40 0x7f195c0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1961c56640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f195c15d3f0 0x7f195c149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 -- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f195c15d3f0 msgr2=0x7f195c149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f195c15d3f0 0x7f195c149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 -- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f195c0d0e40 msgr2=0x7f195c0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f195c0d0e40 0x7f195c0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962c58640 1 -- 172.21.15.37:0/2189385053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0094d0 con 0x7f195c15d7d0 2023-11-24T06:15:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1962457640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f195c0d0e40 0x7f195c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.267+0000 7f1961c56640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f195c15d3f0 0x7f195c149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.268+0000 7f1962c58640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c149970 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f195400c3c0 tx=0x7f195400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.268+0000 7f1952ffd640 1 -- 172.21.15.37:0/2189385053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540052d0 con 0x7f195c15d7d0 2023-11-24T06:15:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.268+0000 7f1952ffd640 1 -- 172.21.15.37:0/2189385053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954005430 con 0x7f195c15d7d0 2023-11-24T06:15:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.268+0000 7f1952ffd640 1 -- 172.21.15.37:0/2189385053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954003830 con 0x7f195c15d7d0 2023-11-24T06:15:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.268+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0b54c0 con 0x7f195c15d7d0 2023-11-24T06:15:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.268+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0b5850 con 0x7f195c15d7d0 2023-11-24T06:15:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.269+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c04e840 con 0x7f195c15d7d0 2023-11-24T06:15:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.270+0000 7f1952ffd640 1 -- 172.21.15.37:0/2189385053 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1954003990 con 0x7f195c15d7d0 2023-11-24T06:15:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.271+0000 7f1952ffd640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f194006ae70 0x7f194006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.271+0000 7f1952ffd640 1 -- 172.21.15.37:0/2189385053 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1954088b60 con 0x7f195c15d7d0 2023-11-24T06:15:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.271+0000 7f1962457640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f194006ae70 0x7f194006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.272+0000 7f1962457640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f194006ae70 0x7f194006d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f195c0d3fc0 tx=0x7f195800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:43.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.276+0000 7f1952ffd640 1 -- 172.21.15.37:0/2189385053 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1954053b70 con 0x7f195c15d7d0 2023-11-24T06:15:43.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.471+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f195c149eb0 con 0x7f195c15d7d0 2023-11-24T06:15:43.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.472+0000 7f1952ffd640 1 -- 172.21.15.37:0/2189385053 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f195c149eb0 con 0x7f195c15d7d0 2023-11-24T06:15:43.475 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f194006ae70 msgr2=0x7f194006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f194006ae70 0x7f194006d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f195c0d3fc0 tx=0x7f195800b040 comp rx=0 tx=0).stop 2023-11-24T06:15:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 msgr2=0x7f195c149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c149970 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f195400c3c0 tx=0x7f195400c880 comp rx=0 tx=0).stop 2023-11-24T06:15:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 shutdown_connections 2023-11-24T06:15:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f194006ae70 0x7f194006d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15d7d0 0x7f195c149970 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f195c15d3f0 0x7f195c149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 --2- 172.21.15.37:0/2189385053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f195c0d0e40 0x7f195c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 >> 172.21.15.37:0/2189385053 conn(0x7f195c09c5b0 msgr2=0x7f195c0c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 shutdown_connections 2023-11-24T06:15:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.475+0000 7f1963459640 1 -- 172.21.15.37:0/2189385053 wait complete. 2023-11-24T06:15:43.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:15:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.723+0000 7f04d2eca640 1 Processor -- start 2023-11-24T06:15:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.723+0000 7f04d2eca640 1 -- start start 2023-11-24T06:15:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.724+0000 7f04d2eca640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc15b1d0 0x7f04cc071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.724+0000 7f04d2eca640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04cc0b1250 0x7f04cc15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.724+0000 7f04d2eca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc0ca0e0 con 0x7f04cc070550 2023-11-24T06:15:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.724+0000 7f04d2eca640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc072800 con 0x7f04cc0b1250 2023-11-24T06:15:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.724+0000 7f04d2eca640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0c97b0 con 0x7f04cc15b1d0 2023-11-24T06:15:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d26c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04cc0b1250 0x7f04cc15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d26c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04cc0b1250 0x7f04cc15edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39368/0 (socket says 172.21.15.37:39368) 2023-11-24T06:15:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d26c9640 1 -- 172.21.15.37:0/2564706823 learned_addr learned my addr 172.21.15.37:0/2564706823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d1ec8640 1 --2- 172.21.15.37:0/2564706823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc15b1d0 0x7f04cc071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d26c9640 1 -- 172.21.15.37:0/2564706823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc15b1d0 msgr2=0x7f04cc071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d0ec6640 1 -- 172.21.15.37:0/2564706823 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292123259 0 0) 0x7f04cc0ca0e0 con 0x7f04cc070550 2023-11-24T06:15:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d26c9640 1 --2- 172.21.15.37:0/2564706823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc15b1d0 0x7f04cc071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d26c9640 1 -- 172.21.15.37:0/2564706823 >> v1:172.21.15.37:6789/0 conn(0x7f04cc070550 legacy=0x7f04cc0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.725+0000 7f04d26c9640 1 -- 172.21.15.37:0/2564706823 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0c9a90 con 0x7f04cc0b1250 2023-11-24T06:15:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.726+0000 7f04d26c9640 1 --2- 172.21.15.37:0/2564706823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc0b1250 0x7f04cc15edd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009e50 tx=0x7f04c402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28f5b6ff93d82b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d0ec6640 1 -- 172.21.15.37:0/2564706823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c402cb00 con 0x7f04cc0b1250 2023-11-24T06:15:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d0ec6640 1 -- 172.21.15.37:0/2564706823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c402cc60 con 0x7f04cc0b1250 2023-11-24T06:15:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d0ec6640 1 -- 172.21.15.37:0/2564706823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c40343f0 con 0x7f04cc0b1250 2023-11-24T06:15:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d2eca640 1 -- 172.21.15.37:0/2564706823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc0b1250 msgr2=0x7f04cc15edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d2eca640 1 --2- 172.21.15.37:0/2564706823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc0b1250 0x7f04cc15edd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009e50 tx=0x7f04c402bf60 comp rx=0 tx=0).stop 2023-11-24T06:15:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d2eca640 1 -- 172.21.15.37:0/2564706823 shutdown_connections 2023-11-24T06:15:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d2eca640 1 --2- 172.21.15.37:0/2564706823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc0b1250 0x7f04cc15edd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d2eca640 1 --2- 172.21.15.37:0/2564706823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc15b1d0 0x7f04cc071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.727+0000 7f04d2eca640 1 -- 172.21.15.37:0/2564706823 >> 172.21.15.37:0/2564706823 conn(0x7f04cc0cbb40 msgr2=0x7f04cc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.728+0000 7f04d2eca640 1 -- 172.21.15.37:0/2564706823 shutdown_connections 2023-11-24T06:15:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.728+0000 7f04d2eca640 1 -- 172.21.15.37:0/2564706823 wait complete. 2023-11-24T06:15:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.729+0000 7f04d2eca640 1 Processor -- start 2023-11-24T06:15:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.730+0000 7f04d2eca640 1 -- start start 2023-11-24T06:15:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.730+0000 7f04d2eca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc070550 0x7f04cc0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.730+0000 7f04d2eca640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc0b1250 0x7f04cc0c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.730+0000 7f04d2eca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc15b1d0 0x7f04cc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.730+0000 7f04d2eca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc157f20 con 0x7f04cc070550 2023-11-24T06:15:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.730+0000 7f04d2eca640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0c6190 con 0x7f04cc15b1d0 2023-11-24T06:15:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.730+0000 7f04d2eca640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0c63e0 con 0x7f04cc0b1250 2023-11-24T06:15:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc070550 0x7f04cc0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc070550 0x7f04cc0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39378/0 (socket says 172.21.15.37:39378) 2023-11-24T06:15:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 -- 172.21.15.37:0/1755577355 learned_addr learned my addr 172.21.15.37:0/1755577355 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d16c7640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc0b1250 0x7f04cc0c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d26c9640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc15b1d0 0x7f04cc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 -- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc0b1250 msgr2=0x7f04cc0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc0b1250 0x7f04cc0c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 -- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc15b1d0 msgr2=0x7f04cc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc15b1d0 0x7f04cc0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.731+0000 7f04d1ec8640 1 -- 172.21.15.37:0/1755577355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4009b30 con 0x7f04cc070550 2023-11-24T06:15:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.732+0000 7f04d1ec8640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc070550 0x7f04cc0c2c30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f04c800d5f0 tx=0x7f04c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.732+0000 7f04c27fc640 1 -- 172.21.15.37:0/1755577355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80125f0 con 0x7f04cc070550 2023-11-24T06:15:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.732+0000 7f04c27fc640 1 -- 172.21.15.37:0/1755577355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c8012750 con 0x7f04cc070550 2023-11-24T06:15:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.732+0000 7f04c27fc640 1 -- 172.21.15.37:0/1755577355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8012b00 con 0x7f04cc070550 2023-11-24T06:15:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.732+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0c66c0 con 0x7f04cc070550 2023-11-24T06:15:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.732+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0c6c80 con 0x7f04cc070550 2023-11-24T06:15:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.734+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc04e840 con 0x7f04cc070550 2023-11-24T06:15:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.734+0000 7f04c27fc640 1 -- 172.21.15.37:0/1755577355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04c8012c60 con 0x7f04cc070550 2023-11-24T06:15:43.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.735+0000 7f04c27fc640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04b006ae40 0x7f04b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:43.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.735+0000 7f04c27fc640 1 -- 172.21.15.37:0/1755577355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f04c8089c00 con 0x7f04cc070550 2023-11-24T06:15:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.736+0000 7f04d16c7640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04b006ae40 0x7f04b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.736+0000 7f04d16c7640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04b006ae40 0x7f04b006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04cc15ded0 tx=0x7f04bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.739+0000 7f04c27fc640 1 -- 172.21.15.37:0/1755577355 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04c8090080 con 0x7f04cc070550 2023-11-24T06:15:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.946+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04cc15ab80 con 0x7f04cc070550 2023-11-24T06:15:43.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.947+0000 7f04c27fc640 1 -- 172.21.15.37:0/1755577355 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f04c8054b90 con 0x7f04cc070550 2023-11-24T06:15:43.950 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:15:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04b006ae40 msgr2=0x7f04b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04b006ae40 0x7f04b006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04cc15ded0 tx=0x7f04bc009040 comp rx=0 tx=0).stop 2023-11-24T06:15:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc070550 msgr2=0x7f04cc0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc070550 0x7f04cc0c2c30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f04c800d5f0 tx=0x7f04c800dab0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 shutdown_connections 2023-11-24T06:15:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04b006ae40 0x7f04b006d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc15b1d0 0x7f04cc0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04cc0b1250 0x7f04cc0c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 --2- 172.21.15.37:0/1755577355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04cc070550 0x7f04cc0c2c30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 >> 172.21.15.37:0/1755577355 conn(0x7f04cc0cbb40 msgr2=0x7f04cc0ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 shutdown_connections 2023-11-24T06:15:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:43.950+0000 7f04d2eca640 1 -- 172.21.15.37:0/1755577355 wait complete. 2023-11-24T06:15:43.969 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-24T06:15:43.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:43.969 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-24T06:15:44.083 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:15:44.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:44.083 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T06:15:44.132 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:15:44.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:44.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.364+0000 7fd4d8c1c640 1 Processor -- start 2023-11-24T06:15:44.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.364+0000 7fd4d8c1c640 1 -- start start 2023-11-24T06:15:44.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.365+0000 7fd4d8c1c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d415d4c0 0x7fd4d406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.365+0000 7fd4d8c1c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4d40d3d10 0x7fd4d40d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.365+0000 7fd4d8c1c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40d18f0 con 0x7fd4d40d1470 2023-11-24T06:15:44.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.365+0000 7fd4d8c1c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d40d1bd0 con 0x7fd4d40d3d10 2023-11-24T06:15:44.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.365+0000 7fd4d8c1c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40d1eb0 con 0x7fd4d415d4c0 2023-11-24T06:15:44.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.365+0000 7fd4d1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4d40d3d10 0x7fd4d40d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4d40d3d10 0x7fd4d40d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39386/0 (socket says 172.21.15.37:39386) 2023-11-24T06:15:44.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d1d9b640 1 -- 172.21.15.37:0/2079249777 learned_addr learned my addr 172.21.15.37:0/2079249777 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:44.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d1d9b640 1 -- 172.21.15.37:0/2079249777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d415d4c0 msgr2=0x7fd4d406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:44.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d259c640 1 --2- 172.21.15.37:0/2079249777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d415d4c0 0x7fd4d406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d1d9b640 1 --2- 172.21.15.37:0/2079249777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d415d4c0 0x7fd4d406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d1d9b640 1 -- 172.21.15.37:0/2079249777 >> v1:172.21.15.37:6789/0 conn(0x7fd4d40d1470 legacy=0x7fd4d40d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d1d9b640 1 -- 172.21.15.37:0/2079249777 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40d2190 con 0x7fd4d40d3d10 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d159a640 1 -- 172.21.15.37:0/2079249777 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209852142 0 0) 0x7fd4d40d18f0 con 0x7fd4d40d1470 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.366+0000 7fd4d259c640 1 --2- 172.21.15.37:0/2079249777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d415d4c0 0x7fd4d406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.367+0000 7fd4d1d9b640 1 --2- 172.21.15.37:0/2079249777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d40d3d10 0x7fd4d40d0f30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33a641b301e8c6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d159a640 1 -- 172.21.15.37:0/2079249777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc030840 con 0x7fd4d40d3d10 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d159a640 1 -- 172.21.15.37:0/2079249777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0309a0 con 0x7fd4d40d3d10 2023-11-24T06:15:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d159a640 1 -- 172.21.15.37:0/2079249777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc030d30 con 0x7fd4d40d3d10 2023-11-24T06:15:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2079249777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d40d3d10 msgr2=0x7fd4d40d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2079249777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d40d3d10 0x7fd4d40d0f30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc02b980 comp rx=0 tx=0).stop 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2079249777 shutdown_connections 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2079249777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d40d3d10 0x7fd4d40d0f30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2079249777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d415d4c0 0x7fd4d406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2079249777 >> 172.21.15.37:0/2079249777 conn(0x7fd4d408af60 msgr2=0x7fd4d409c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2079249777 shutdown_connections 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.368+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2079249777 wait complete. 2023-11-24T06:15:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.370+0000 7fd4d8c1c640 1 Processor -- start 2023-11-24T06:15:44.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.370+0000 7fd4d8c1c640 1 -- start start 2023-11-24T06:15:44.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.371+0000 7fd4d8c1c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d40d1470 0x7fd4d40cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.371+0000 7fd4d8c1c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4d415d4c0 0x7fd4d40cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.371+0000 7fd4d8c1c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d41600c0 0x7fd4d414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.371+0000 7fd4d8c1c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cc0a0 con 0x7fd4d41600c0 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.371+0000 7fd4d8c1c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cca70 con 0x7fd4d415d4c0 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.371+0000 7fd4d8c1c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cb490 con 0x7fd4d40d1470 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d41600c0 0x7fd4d414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d41600c0 0x7fd4d414eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39398/0 (socket says 172.21.15.37:39398) 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 -- 172.21.15.37:0/2112817251 learned_addr learned my addr 172.21.15.37:0/2112817251 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d259c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d40d1470 0x7fd4d40cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d1d9b640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4d415d4c0 0x7fd4d40cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 -- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d40d1470 msgr2=0x7fd4d40cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d40d1470 0x7fd4d40cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 -- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4d415d4c0 msgr2=0x7fd4d40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4d415d4c0 0x7fd4d40cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d2d9d640 1 -- 172.21.15.37:0/2112817251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0094d0 con 0x7fd4d41600c0 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.372+0000 7fd4d259c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d40d1470 0x7fd4d40cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.373+0000 7fd4d2d9d640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d41600c0 0x7fd4d414eb40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00c480 tx=0x7fd4cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.373+0000 7fd4caffd640 1 -- 172.21.15.37:0/2112817251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc005480 con 0x7fd4d41600c0 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.373+0000 7fd4caffd640 1 -- 172.21.15.37:0/2112817251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0035f0 con 0x7fd4d41600c0 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.373+0000 7fd4caffd640 1 -- 172.21.15.37:0/2112817251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0039a0 con 0x7fd4d41600c0 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.373+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d40cb770 con 0x7fd4d41600c0 2023-11-24T06:15:44.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.373+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d40cbd30 con 0x7fd4d41600c0 2023-11-24T06:15:44.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.374+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d4067990 con 0x7fd4d41600c0 2023-11-24T06:15:44.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.375+0000 7fd4caffd640 1 -- 172.21.15.37:0/2112817251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4cc003b00 con 0x7fd4d41600c0 2023-11-24T06:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.377+0000 7fd4caffd640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd4b406ae40 0x7fd4b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.377+0000 7fd4caffd640 1 -- 172.21.15.37:0/2112817251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd4cc088c60 con 0x7fd4d41600c0 2023-11-24T06:15:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.377+0000 7fd4d259c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd4b406ae40 0x7fd4b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.378+0000 7fd4d259c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd4b406ae40 0x7fd4b406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400e3d0 tx=0x7fd4c4007a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.381+0000 7fd4caffd640 1 -- 172.21.15.37:0/2112817251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4cc053c70 con 0x7fd4d41600c0 2023-11-24T06:15:44.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.611+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4d40cc250 con 0x7fd4d41600c0 2023-11-24T06:15:44.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.612+0000 7fd4caffd640 1 -- 172.21.15.37:0/2112817251 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fd4d40cc250 con 0x7fd4d41600c0 2023-11-24T06:15:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:44.614 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:15:44.615 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:15:44.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd4b406ae40 msgr2=0x7fd4b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd4b406ae40 0x7fd4b406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400e3d0 tx=0x7fd4c4007a10 comp rx=0 tx=0).stop 2023-11-24T06:15:44.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d41600c0 msgr2=0x7fd4d414eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d41600c0 0x7fd4d414eb40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00c480 tx=0x7fd4cc00c940 comp rx=0 tx=0).stop 2023-11-24T06:15:44.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 shutdown_connections 2023-11-24T06:15:44.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd4b406ae40 0x7fd4b406d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4d415d4c0 0x7fd4d40cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4d41600c0 0x7fd4d414eb40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 --2- 172.21.15.37:0/2112817251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4d40d1470 0x7fd4d40cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 >> 172.21.15.37:0/2112817251 conn(0x7fd4d408af60 msgr2=0x7fd4d415ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:44.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 shutdown_connections 2023-11-24T06:15:44.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.614+0000 7fd4d8c1c640 1 -- 172.21.15.37:0/2112817251 wait complete. 2023-11-24T06:15:44.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:44.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.861+0000 7fa886f2e640 1 Processor -- start 2023-11-24T06:15:44.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.861+0000 7fa886f2e640 1 -- start start 2023-11-24T06:15:44.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.863+0000 7fa886f2e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8800d1740 0x7fa8800ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.863+0000 7fa886f2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d0f40 0x7fa8800d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.863+0000 7fa886f2e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8800cecc0 con 0x7fa8800cf790 2023-11-24T06:15:44.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.863+0000 7fa886f2e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800d2060 con 0x7fa8800d1740 2023-11-24T06:15:44.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.863+0000 7fa886f2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800cef60 con 0x7fa8800d0f40 2023-11-24T06:15:44.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.864+0000 7fa88572b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d0f40 0x7fa8800d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.864+0000 7fa885f2c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8800d1740 0x7fa8800ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.864+0000 7fa88572b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d0f40 0x7fa8800d1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:34676/0 (socket says 172.21.15.37:34676) 2023-11-24T06:15:44.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.864+0000 7fa88572b640 1 -- 172.21.15.37:0/4262461271 learned_addr learned my addr 172.21.15.37:0/4262461271 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:44.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.864+0000 7fa88572b640 1 -- 172.21.15.37:0/4262461271 >> v2:172.21.15.188:3300/0 conn(0x7fa8800d1740 msgr2=0x7fa8800ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:44.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.864+0000 7fa88572b640 1 --2- 172.21.15.37:0/4262461271 >> v2:172.21.15.188:3300/0 conn(0x7fa8800d1740 0x7fa8800ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.864+0000 7fa88572b640 1 -- 172.21.15.37:0/4262461271 >> v1:172.21.15.188:6789/0 conn(0x7fa8800cf790 legacy=0x7fa8800cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.865+0000 7fa88572b640 1 -- 172.21.15.37:0/4262461271 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800b2ac0 con 0x7fa8800d0f40 2023-11-24T06:15:44.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.866+0000 7fa88572b640 1 --2- 172.21.15.37:0/4262461271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d0f40 0x7fa8800d1b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa870009870 tx=0x7fa87002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f592c00514f030 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:44.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.866+0000 7fa884f2a640 1 -- 172.21.15.37:0/4262461271 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87002f840 con 0x7fa8800d0f40 2023-11-24T06:15:44.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.866+0000 7fa884f2a640 1 -- 172.21.15.37:0/4262461271 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87002f9a0 con 0x7fa8800d0f40 2023-11-24T06:15:44.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.866+0000 7fa884f2a640 1 -- 172.21.15.37:0/4262461271 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87002fd30 con 0x7fa8800d0f40 2023-11-24T06:15:44.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 -- 172.21.15.37:0/4262461271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d0f40 msgr2=0x7fa8800d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 --2- 172.21.15.37:0/4262461271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d0f40 0x7fa8800d1b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa870009870 tx=0x7fa87002ba20 comp rx=0 tx=0).stop 2023-11-24T06:15:44.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 -- 172.21.15.37:0/4262461271 shutdown_connections 2023-11-24T06:15:44.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 --2- 172.21.15.37:0/4262461271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d0f40 0x7fa8800d1b20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 --2- 172.21.15.37:0/4262461271 >> v2:172.21.15.188:3300/0 conn(0x7fa8800d1740 0x7fa8800ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 -- 172.21.15.37:0/4262461271 >> 172.21.15.37:0/4262461271 conn(0x7fa88009c500 msgr2=0x7fa8800d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:44.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 -- 172.21.15.37:0/4262461271 shutdown_connections 2023-11-24T06:15:44.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.867+0000 7fa886f2e640 1 -- 172.21.15.37:0/4262461271 wait complete. 2023-11-24T06:15:44.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.869+0000 7fa886f2e640 1 Processor -- start 2023-11-24T06:15:44.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.869+0000 7fa886f2e640 1 -- start start 2023-11-24T06:15:44.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.870+0000 7fa886f2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8800cf790 0x7fa880156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.870+0000 7fa886f2e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8800d0f40 0x7fa8800b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.870+0000 7fa886f2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d1740 0x7fa8800b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.870+0000 7fa886f2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800b7650 con 0x7fa8800cf790 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.870+0000 7fa886f2e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800b69d0 con 0x7fa8800d0f40 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.870+0000 7fa886f2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800b6cb0 con 0x7fa8800d1740 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8800cf790 0x7fa880156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8800cf790 0x7fa880156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39402/0 (socket says 172.21.15.37:39402) 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 -- 172.21.15.37:0/2089422697 learned_addr learned my addr 172.21.15.37:0/2089422697 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa88672d640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d1740 0x7fa8800b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa88572b640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8800d0f40 0x7fa8800b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 -- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d1740 msgr2=0x7fa8800b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d1740 0x7fa8800b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 -- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8800d0f40 msgr2=0x7fa8800b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:44.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8800d0f40 0x7fa8800b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:44.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 -- 172.21.15.37:0/2089422697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700094d0 con 0x7fa8800cf790 2023-11-24T06:15:44.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.871+0000 7fa885f2c640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8800cf790 0x7fa880156fc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00e9b0 tx=0x7fa87c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:44.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.872+0000 7fa8767fc640 1 -- 172.21.15.37:0/2089422697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c009670 con 0x7fa8800cf790 2023-11-24T06:15:44.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.872+0000 7fa8767fc640 1 -- 172.21.15.37:0/2089422697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00c9a0 con 0x7fa8800cf790 2023-11-24T06:15:44.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.872+0000 7fa8767fc640 1 -- 172.21.15.37:0/2089422697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00cd50 con 0x7fa8800cf790 2023-11-24T06:15:44.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.872+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8800b6f90 con 0x7fa8800cf790 2023-11-24T06:15:44.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.872+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8800b65f0 con 0x7fa8800cf790 2023-11-24T06:15:44.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.873+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88004e840 con 0x7fa8800cf790 2023-11-24T06:15:44.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.874+0000 7fa8767fc640 1 -- 172.21.15.37:0/2089422697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa87c013470 con 0x7fa8800cf790 2023-11-24T06:15:44.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.875+0000 7fa8767fc640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa86406ae40 0x7fa86406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:44.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.875+0000 7fa8767fc640 1 -- 172.21.15.37:0/2089422697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa87c089820 con 0x7fa8800cf790 2023-11-24T06:15:44.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.875+0000 7fa88572b640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa86406ae40 0x7fa86406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:44.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.876+0000 7fa88572b640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa86406ae40 0x7fa86406d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa870036000 tx=0x7fa870008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:44.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:44.879+0000 7fa8767fc640 1 -- 172.21.15.37:0/2089422697 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa87c0548d0 con 0x7fa8800cf790 2023-11-24T06:15:45.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.076+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8800c9d30 con 0x7fa8800cf790 2023-11-24T06:15:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.078+0000 7fa8767fc640 1 -- 172.21.15.37:0/2089422697 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16764 (secure 0 0 0) 0x7fa87c017090 con 0x7fa8800cf790 2023-11-24T06:15:45.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:45.081 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:32.729893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:45.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa86406ae40 msgr2=0x7fa86406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa86406ae40 0x7fa86406d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa870036000 tx=0x7fa870008030 comp rx=0 tx=0).stop 2023-11-24T06:15:45.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8800cf790 msgr2=0x7fa880156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8800cf790 0x7fa880156fc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00e9b0 tx=0x7fa87c00ee70 comp rx=0 tx=0).stop 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 shutdown_connections 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa86406ae40 0x7fa86406d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8800d0f40 0x7fa8800b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8800d1740 0x7fa8800b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 --2- 172.21.15.37:0/2089422697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8800cf790 0x7fa880156fc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 >> 172.21.15.37:0/2089422697 conn(0x7fa88009c500 msgr2=0x7fa8800b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 shutdown_connections 2023-11-24T06:15:45.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.081+0000 7fa886f2e640 1 -- 172.21.15.37:0/2089422697 wait complete. 2023-11-24T06:15:45.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:48.344099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:49.175438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:45.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.328+0000 7f0ec69e5640 1 Processor -- start 2023-11-24T06:15:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.328+0000 7f0ec69e5640 1 -- start start 2023-11-24T06:15:45.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.330+0000 7f0ec69e5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec015b440 0x7f0ec00cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.330+0000 7f0ec69e5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec00c59b0 0x7f0ec006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.330+0000 7f0ec69e5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec015eea0 con 0x7f0ec00cbf20 2023-11-24T06:15:45.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.330+0000 7f0ec69e5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00c5e00 con 0x7f0ec015b440 2023-11-24T06:15:45.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.330+0000 7f0ec69e5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cc3d0 con 0x7f0ec00c59b0 2023-11-24T06:15:45.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0ebffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec015b440 0x7f0ec00cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0eb7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ec00cbf20 0x7f0ec00c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36068/0 (socket says 172.21.15.37:36068) 2023-11-24T06:15:45.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0eb7fff640 1 -- 172.21.15.37:0/1539103720 learned_addr learned my addr 172.21.15.37:0/1539103720 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:45.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0ec4f82640 1 --2- 172.21.15.37:0/1539103720 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec00c59b0 0x7f0ec006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0ebffff640 1 -- 172.21.15.37:0/1539103720 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec00c59b0 msgr2=0x7f0ec006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0ebffff640 1 --2- 172.21.15.37:0/1539103720 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec00c59b0 0x7f0ec006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0ebffff640 1 -- 172.21.15.37:0/1539103720 >> v1:172.21.15.37:6789/0 conn(0x7f0ec00cbf20 legacy=0x7f0ec00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0ebffff640 1 -- 172.21.15.37:0/1539103720 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00abf30 con 0x7f0ec015b440 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.331+0000 7f0ebf7fe640 1 -- 172.21.15.37:0/1539103720 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048350456 0 0) 0x7f0ec015eea0 con 0x7f0ec00cbf20 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.333+0000 7f0ebffff640 1 --2- 172.21.15.37:0/1539103720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015b440 0x7f0ec00cb9e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097a0 tx=0x7f0eb002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875241f6b58a8b1a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.333+0000 7f0ebf7fe640 1 -- 172.21.15.37:0/1539103720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb002e070 con 0x7f0ec015b440 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.333+0000 7f0ebf7fe640 1 -- 172.21.15.37:0/1539103720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb00315a0 con 0x7f0ec015b440 2023-11-24T06:15:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.333+0000 7f0ebf7fe640 1 -- 172.21.15.37:0/1539103720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0031930 con 0x7f0ec015b440 2023-11-24T06:15:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.333+0000 7f0ec69e5640 1 -- 172.21.15.37:0/1539103720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015b440 msgr2=0x7f0ec00cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.333+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/1539103720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015b440 0x7f0ec00cb9e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097a0 tx=0x7f0eb002b840 comp rx=0 tx=0).stop 2023-11-24T06:15:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.334+0000 7f0ec69e5640 1 -- 172.21.15.37:0/1539103720 shutdown_connections 2023-11-24T06:15:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.334+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/1539103720 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec00c59b0 0x7f0ec006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.334+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/1539103720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec015b440 0x7f0ec00cb9e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.334+0000 7f0ec69e5640 1 -- 172.21.15.37:0/1539103720 >> 172.21.15.37:0/1539103720 conn(0x7f0ec00b0c50 msgr2=0x7f0ec00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.334+0000 7f0ec69e5640 1 -- 172.21.15.37:0/1539103720 shutdown_connections 2023-11-24T06:15:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.334+0000 7f0ec69e5640 1 -- 172.21.15.37:0/1539103720 wait complete. 2023-11-24T06:15:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.336+0000 7f0ec69e5640 1 Processor -- start 2023-11-24T06:15:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.336+0000 7f0ec69e5640 1 -- start start 2023-11-24T06:15:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ec69e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec00c59b0 0x7f0ec0156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ec69e5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec00cbf20 0x7f0ec0156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ec69e5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec015b440 0x7f0ec0157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ec69e5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00c7430 con 0x7f0ec00c59b0 2023-11-24T06:15:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ec69e5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec015c550 con 0x7f0ec00cbf20 2023-11-24T06:15:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ec69e5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec015c830 con 0x7f0ec015b440 2023-11-24T06:15:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec00c59b0 0x7f0ec0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec00c59b0 0x7f0ec0156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39426/0 (socket says 172.21.15.37:39426) 2023-11-24T06:15:45.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 -- 172.21.15.37:0/4242049530 learned_addr learned my addr 172.21.15.37:0/4242049530 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:45.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 -- 172.21.15.37:0/4242049530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec015b440 msgr2=0x7f0ec0157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec015b440 0x7f0ec0157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 -- 172.21.15.37:0/4242049530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec00cbf20 msgr2=0x7f0ec0156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec00cbf20 0x7f0ec0156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.337+0000 7f0ebffff640 1 -- 172.21.15.37:0/4242049530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009400 con 0x7f0ec00c59b0 2023-11-24T06:15:45.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.338+0000 7f0ebffff640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec00c59b0 0x7f0ec0156430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097a0 tx=0x7f0eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.338+0000 7f0ebd7fa640 1 -- 172.21.15.37:0/4242049530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0004230 con 0x7f0ec00c59b0 2023-11-24T06:15:45.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.338+0000 7f0ebd7fa640 1 -- 172.21.15.37:0/4242049530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0031f00 con 0x7f0ec00c59b0 2023-11-24T06:15:45.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.338+0000 7f0ebd7fa640 1 -- 172.21.15.37:0/4242049530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0032640 con 0x7f0ec00c59b0 2023-11-24T06:15:45.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.338+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec015cb10 con 0x7f0ec00c59b0 2023-11-24T06:15:45.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.338+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec015d030 con 0x7f0ec00c59b0 2023-11-24T06:15:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.339+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec015c380 con 0x7f0ec00c59b0 2023-11-24T06:15:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.340+0000 7f0ebd7fa640 1 -- 172.21.15.37:0/4242049530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0eb00327a0 con 0x7f0ec00c59b0 2023-11-24T06:15:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.341+0000 7f0ebd7fa640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0ea006aec0 0x7f0ea006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.341+0000 7f0ebd7fa640 1 -- 172.21.15.37:0/4242049530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0eb00ab6e0 con 0x7f0ec00c59b0 2023-11-24T06:15:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.341+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0ea006aec0 0x7f0ea006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.342+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0ea006aec0 0x7f0ea006d380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8007fd0 tx=0x7f0ea8007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.346+0000 7f0ebd7fa640 1 -- 172.21.15.37:0/4242049530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0eb00766e0 con 0x7f0ec00c59b0 2023-11-24T06:15:45.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.533+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ec006dc80 con 0x7f0ec00c59b0 2023-11-24T06:15:45.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.534+0000 7f0ebd7fa640 1 -- 172.21.15.37:0/4242049530 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0eb0079d00 con 0x7f0ec00c59b0 2023-11-24T06:15:45.537 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0ea006aec0 msgr2=0x7f0ea006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0ea006aec0 0x7f0ea006d380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8007fd0 tx=0x7f0ea8007920 comp rx=0 tx=0).stop 2023-11-24T06:15:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec00c59b0 msgr2=0x7f0ec0156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec00c59b0 0x7f0ec0156430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097a0 tx=0x7f0eb00046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 shutdown_connections 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0ea006aec0 0x7f0ea006d380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ec00cbf20 0x7f0ec0156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ec015b440 0x7f0ec0157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.536+0000 7f0ec69e5640 1 --2- 172.21.15.37:0/4242049530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec00c59b0 0x7f0ec0156430 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.537+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 >> 172.21.15.37:0/4242049530 conn(0x7f0ec00b0c50 msgr2=0x7f0ec0071400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.537+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 shutdown_connections 2023-11-24T06:15:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.537+0000 7f0ec69e5640 1 -- 172.21.15.37:0/4242049530 wait complete. 2023-11-24T06:15:45.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:15:45.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.777+0000 7f23d3e61640 1 Processor -- start 2023-11-24T06:15:45.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.778+0000 7f23d3e61640 1 -- start start 2023-11-24T06:15:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.779+0000 7f23d3e61640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23cc0d3a40 0x7f23cc06ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.779+0000 7f23d3e61640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0b1ed0 0x7f23cc06bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.779+0000 7f23d3e61640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc15db00 con 0x7f23cc15d720 2023-11-24T06:15:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.779+0000 7f23d3e61640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc0d0ce0 con 0x7f23cc0d3a40 2023-11-24T06:15:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.779+0000 7f23d3e61640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc06d400 con 0x7f23cc0b1ed0 2023-11-24T06:15:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.779+0000 7f23d13fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23cc0d3a40 0x7f23cc06ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d13fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23cc0d3a40 0x7f23cc06ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39442/0 (socket says 172.21.15.37:39442) 2023-11-24T06:15:45.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d13fc640 1 -- 172.21.15.37:0/1133992009 learned_addr learned my addr 172.21.15.37:0/1133992009 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:45.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d23fe640 1 --2- 172.21.15.37:0/1133992009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0b1ed0 0x7f23cc06bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d13fc640 1 -- 172.21.15.37:0/1133992009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0b1ed0 msgr2=0x7f23cc06bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:45.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d13fc640 1 --2- 172.21.15.37:0/1133992009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0b1ed0 0x7f23cc06bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d13fc640 1 -- 172.21.15.37:0/1133992009 >> v1:172.21.15.37:6789/0 conn(0x7f23cc15d720 legacy=0x7f23cc0d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d13fc640 1 -- 172.21.15.37:0/1133992009 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0b0100 con 0x7f23cc0d3a40 2023-11-24T06:15:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.780+0000 7f23d0bfb640 1 -- 172.21.15.37:0/1133992009 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119803904 0 0) 0x7f23cc15db00 con 0x7f23cc15d720 2023-11-24T06:15:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.782+0000 7f23d13fc640 1 --2- 172.21.15.37:0/1133992009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc0d3a40 0x7f23cc06ba80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0d0e80 tx=0x7f23bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bb842c48d760ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.782+0000 7f23d0bfb640 1 -- 172.21.15.37:0/1133992009 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc031640 con 0x7f23cc0d3a40 2023-11-24T06:15:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.782+0000 7f23d0bfb640 1 -- 172.21.15.37:0/1133992009 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc0317a0 con 0x7f23cc0d3a40 2023-11-24T06:15:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.782+0000 7f23d0bfb640 1 -- 172.21.15.37:0/1133992009 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc031b30 con 0x7f23cc0d3a40 2023-11-24T06:15:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.782+0000 7f23d3e61640 1 -- 172.21.15.37:0/1133992009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc0d3a40 msgr2=0x7f23cc06ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.782+0000 7f23d3e61640 1 --2- 172.21.15.37:0/1133992009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc0d3a40 0x7f23cc06ba80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0d0e80 tx=0x7f23bc02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.783+0000 7f23d3e61640 1 -- 172.21.15.37:0/1133992009 shutdown_connections 2023-11-24T06:15:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.783+0000 7f23d3e61640 1 --2- 172.21.15.37:0/1133992009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0b1ed0 0x7f23cc06bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.783+0000 7f23d3e61640 1 --2- 172.21.15.37:0/1133992009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc0d3a40 0x7f23cc06ba80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.783+0000 7f23d3e61640 1 -- 172.21.15.37:0/1133992009 >> 172.21.15.37:0/1133992009 conn(0x7f23cc08af60 msgr2=0x7f23cc09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.783+0000 7f23d3e61640 1 -- 172.21.15.37:0/1133992009 shutdown_connections 2023-11-24T06:15:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.783+0000 7f23d3e61640 1 -- 172.21.15.37:0/1133992009 wait complete. 2023-11-24T06:15:45.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.784+0000 7f23d3e61640 1 Processor -- start 2023-11-24T06:15:45.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.785+0000 7f23d3e61640 1 -- start start 2023-11-24T06:15:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.785+0000 7f23d3e61640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23cc0b1ed0 0x7f23cc0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.785+0000 7f23d3e61640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0d3a40 0x7f23cc15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d3e61640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc15d720 0x7f23cc1f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d3e61640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc15b2a0 con 0x7f23cc15d720 2023-11-24T06:15:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d3e61640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc15f2e0 con 0x7f23cc0b1ed0 2023-11-24T06:15:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d3e61640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc1f3660 con 0x7f23cc0d3a40 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc15d720 0x7f23cc1f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc15d720 0x7f23cc1f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39450/0 (socket says 172.21.15.37:39450) 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 -- 172.21.15.37:0/3360075622 learned_addr learned my addr 172.21.15.37:0/3360075622 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d1bfd640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23cc0b1ed0 0x7f23cc0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d13fc640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0d3a40 0x7f23cc15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 -- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0d3a40 msgr2=0x7f23cc15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0d3a40 0x7f23cc15ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 -- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23cc0b1ed0 msgr2=0x7f23cc0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23cc0b1ed0 0x7f23cc0cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.786+0000 7f23d23fe640 1 -- 172.21.15.37:0/3360075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0094d0 con 0x7f23cc15d720 2023-11-24T06:15:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.787+0000 7f23d23fe640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc15d720 0x7f23cc1f2da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f23c4007e60 tx=0x7f23c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.787+0000 7f23c27fc640 1 -- 172.21.15.37:0/3360075622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4014420 con 0x7f23cc15d720 2023-11-24T06:15:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.787+0000 7f23c27fc640 1 -- 172.21.15.37:0/3360075622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c40145a0 con 0x7f23cc15d720 2023-11-24T06:15:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.787+0000 7f23c27fc640 1 -- 172.21.15.37:0/3360075622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4014950 con 0x7f23cc15d720 2023-11-24T06:15:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.787+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc1f3940 con 0x7f23cc15d720 2023-11-24T06:15:45.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.787+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc15f580 con 0x7f23cc15d720 2023-11-24T06:15:45.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.788+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc15f770 con 0x7f23cc15d720 2023-11-24T06:15:45.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.789+0000 7f23c27fc640 1 -- 172.21.15.37:0/3360075622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f23c4014ab0 con 0x7f23cc15d720 2023-11-24T06:15:45.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.790+0000 7f23c27fc640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f23b006ae40 0x7f23b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:45.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.790+0000 7f23c27fc640 1 -- 172.21.15.37:0/3360075622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f23c408a090 con 0x7f23cc15d720 2023-11-24T06:15:45.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.791+0000 7f23d1bfd640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f23b006ae40 0x7f23b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:45.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.791+0000 7f23d1bfd640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f23b006ae40 0x7f23b006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000f60 tx=0x7f23c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.795+0000 7f23c27fc640 1 -- 172.21.15.37:0/3360075622 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23c4055010 con 0x7f23cc15d720 2023-11-24T06:15:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.989+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23cc0d1f30 con 0x7f23cc15d720 2023-11-24T06:15:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.990+0000 7f23c27fc640 1 -- 172.21.15.37:0/3360075622 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23c4058630 con 0x7f23cc15d720 2023-11-24T06:15:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:15:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.993+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f23b006ae40 msgr2=0x7f23b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.993+0000 7f23d3e61640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f23b006ae40 0x7f23b006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000f60 tx=0x7f23c8009040 comp rx=0 tx=0).stop 2023-11-24T06:15:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.993+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc15d720 msgr2=0x7f23cc1f2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.993+0000 7f23d3e61640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc15d720 0x7f23cc1f2da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f23c4007e60 tx=0x7f23c400e4b0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 shutdown_connections 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f23b006ae40 0x7f23b006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23cc15d720 0x7f23cc1f2da0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23cc0d3a40 0x7f23cc15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 --2- 172.21.15.37:0/3360075622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23cc0b1ed0 0x7f23cc0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 >> 172.21.15.37:0/3360075622 conn(0x7f23cc08af60 msgr2=0x7f23cc0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 shutdown_connections 2023-11-24T06:15:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:45.994+0000 7f23d3e61640 1 -- 172.21.15.37:0/3360075622 wait complete. 2023-11-24T06:15:46.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:15:46.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.241+0000 7f2a1359e640 1 Processor -- start 2023-11-24T06:15:46.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.241+0000 7f2a1359e640 1 -- start start 2023-11-24T06:15:46.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a1415d310 0x7f2a140ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a140b0b40 0x7f2a140b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1359e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140b14a0 con 0x7f2a14160f70 2023-11-24T06:15:46.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1359e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1406cd10 con 0x7f2a1415d310 2023-11-24T06:15:46.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140ae5d0 con 0x7f2a140b0b40 2023-11-24T06:15:46.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a1415d310 0x7f2a140ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a1415d310 0x7f2a140ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39458/0 (socket says 172.21.15.37:39458) 2023-11-24T06:15:46.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.243+0000 7f2a1259c640 1 -- 172.21.15.37:0/757957353 learned_addr learned my addr 172.21.15.37:0/757957353 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:46.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.244+0000 7f2a0bfff640 1 --2- 172.21.15.37:0/757957353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a140b0b40 0x7f2a140b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.244+0000 7f2a1259c640 1 -- 172.21.15.37:0/757957353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a140b0b40 msgr2=0x7f2a140b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:46.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.244+0000 7f2a1259c640 1 --2- 172.21.15.37:0/757957353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a140b0b40 0x7f2a140b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.244+0000 7f2a1259c640 1 -- 172.21.15.37:0/757957353 >> v1:172.21.15.188:6789/0 conn(0x7f2a14160f70 legacy=0x7f2a141613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:46.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.244+0000 7f2a1259c640 1 -- 172.21.15.37:0/757957353 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140ae8b0 con 0x7f2a1415d310 2023-11-24T06:15:46.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.245+0000 7f2a1259c640 1 --2- 172.21.15.37:0/757957353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415d310 0x7f2a140ca120 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009870 tx=0x7f2a0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e99aaf0bb002ba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:46.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.245+0000 7f2a11d9b640 1 -- 172.21.15.37:0/757957353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04031640 con 0x7f2a1415d310 2023-11-24T06:15:46.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a11d9b640 1 -- 172.21.15.37:0/757957353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a040317a0 con 0x7f2a1415d310 2023-11-24T06:15:46.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a11d9b640 1 -- 172.21.15.37:0/757957353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04031b30 con 0x7f2a1415d310 2023-11-24T06:15:46.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 -- 172.21.15.37:0/757957353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415d310 msgr2=0x7f2a140ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 --2- 172.21.15.37:0/757957353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415d310 0x7f2a140ca120 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009870 tx=0x7f2a0402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 -- 172.21.15.37:0/757957353 shutdown_connections 2023-11-24T06:15:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 --2- 172.21.15.37:0/757957353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a140b0b40 0x7f2a140b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 --2- 172.21.15.37:0/757957353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415d310 0x7f2a140ca120 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 -- 172.21.15.37:0/757957353 >> 172.21.15.37:0/757957353 conn(0x7f2a140cbb40 msgr2=0x7f2a140cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 -- 172.21.15.37:0/757957353 shutdown_connections 2023-11-24T06:15:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.246+0000 7f2a1359e640 1 -- 172.21.15.37:0/757957353 wait complete. 2023-11-24T06:15:46.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.248+0000 7f2a1359e640 1 Processor -- start 2023-11-24T06:15:46.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.248+0000 7f2a1359e640 1 -- start start 2023-11-24T06:15:46.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140b0b40 0x7f2a14156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a1415d310 0x7f2a14099be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a14160f70 0x7f2a140c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b1b20 con 0x7f2a140b0b40 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b2980 con 0x7f2a1415d310 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b1d70 con 0x7f2a14160f70 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140b0b40 0x7f2a14156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.249+0000 7f2a1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140b0b40 0x7f2a14156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39474/0 (socket says 172.21.15.37:39474) 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a1259c640 1 -- 172.21.15.37:0/360893676 learned_addr learned my addr 172.21.15.37:0/360893676 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a0bfff640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a1415d310 0x7f2a14099be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a1259c640 1 -- 172.21.15.37:0/360893676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a14160f70 msgr2=0x7f2a140c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a1259c640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a14160f70 0x7f2a140c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a1259c640 1 -- 172.21.15.37:0/360893676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a1415d310 msgr2=0x7f2a14099be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a1259c640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a1415d310 0x7f2a14099be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a1259c640 1 -- 172.21.15.37:0/360893676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040094d0 con 0x7f2a140b0b40 2023-11-24T06:15:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a1259c640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140b0b40 0x7f2a14156160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a04000c00 tx=0x7f2a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a0affd640 1 -- 172.21.15.37:0/360893676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0403ac60 con 0x7f2a140b0b40 2023-11-24T06:15:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a0affd640 1 -- 172.21.15.37:0/360893676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0403adc0 con 0x7f2a140b0b40 2023-11-24T06:15:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.250+0000 7f2a0affd640 1 -- 172.21.15.37:0/360893676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04044630 con 0x7f2a140b0b40 2023-11-24T06:15:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.251+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a140b2050 con 0x7f2a140b0b40 2023-11-24T06:15:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.251+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a140b2610 con 0x7f2a140b0b40 2023-11-24T06:15:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.252+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1404e840 con 0x7f2a140b0b40 2023-11-24T06:15:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.253+0000 7f2a0affd640 1 -- 172.21.15.37:0/360893676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a0402f050 con 0x7f2a140b0b40 2023-11-24T06:15:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.253+0000 7f2a0affd640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406ae40 0x7f29f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.254+0000 7f2a0affd640 1 -- 172.21.15.37:0/360893676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2a040ab650 con 0x7f2a140b0b40 2023-11-24T06:15:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.254+0000 7f2a0bfff640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406ae40 0x7f29f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.255+0000 7f2a0bfff640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406ae40 0x7f29f406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2a1415cab0 tx=0x7f29fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.258+0000 7f2a0affd640 1 -- 172.21.15.37:0/360893676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a040765d0 con 0x7f2a140b0b40 2023-11-24T06:15:46.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.455+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a1406e870 con 0x7f2a140b0b40 2023-11-24T06:15:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.455+0000 7f2a0affd640 1 -- 172.21.15.37:0/360893676 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a04031e60 con 0x7f2a140b0b40 2023-11-24T06:15:46.458 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:15:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406ae40 msgr2=0x7f29f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406ae40 0x7f29f406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2a1415cab0 tx=0x7f29fc008040 comp rx=0 tx=0).stop 2023-11-24T06:15:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140b0b40 msgr2=0x7f2a14156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140b0b40 0x7f2a14156160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a04000c00 tx=0x7f2a040046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 shutdown_connections 2023-11-24T06:15:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406ae40 0x7f29f406d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a1415d310 0x7f2a14099be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a14160f70 0x7f2a140c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 --2- 172.21.15.37:0/360893676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140b0b40 0x7f2a14156160 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 >> 172.21.15.37:0/360893676 conn(0x7f2a140cbb40 msgr2=0x7f2a140b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 shutdown_connections 2023-11-24T06:15:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.458+0000 7f2a1359e640 1 -- 172.21.15.37:0/360893676 wait complete. 2023-11-24T06:15:46.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.706+0000 7f7f760df640 1 Processor -- start 2023-11-24T06:15:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.706+0000 7f7f760df640 1 -- start start 2023-11-24T06:15:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.707+0000 7f7f760df640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7f70143870 0x7f7f70146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.707+0000 7f7f760df640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f70161510 con 0x7f7f70161080 2023-11-24T06:15:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.707+0000 7f7f760df640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f701617f0 con 0x7f7f700b1180 2023-11-24T06:15:46.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.707+0000 7f7f760df640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f70070460 con 0x7f7f70143870 2023-11-24T06:15:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.708+0000 7f7f748dc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f70161080 0x7f7f700b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36090/0 (socket says 172.21.15.37:36090) 2023-11-24T06:15:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.708+0000 7f7f748dc640 1 -- 172.21.15.37:0/208184366 learned_addr learned my addr 172.21.15.37:0/208184366 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.708+0000 7f7f750dd640 1 --2- 172.21.15.37:0/208184366 >> v2:172.21.15.188:3300/0 conn(0x7f7f70143870 0x7f7f70146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.708+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203471613 0 0) 0x7f7f70161510 con 0x7f7f70161080 2023-11-24T06:15:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.708+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f5c003520 con 0x7f7f70161080 2023-11-24T06:15:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537728308 0 0) 0x7f7f5c003520 con 0x7f7f70161080 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 >> v2:172.21.15.188:3300/0 conn(0x7f7f70143870 msgr2=0x7f7f70146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 --2- 172.21.15.37:0/208184366 >> v2:172.21.15.188:3300/0 conn(0x7f7f70143870 0x7f7f70146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 >> v1:172.21.15.188:6789/0 conn(0x7f7f700b1180 legacy=0x7f7f700cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70161ad0 con 0x7f7f70161080 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f7f60001670 con 0x7f7f70161080 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 >> v1:172.21.15.37:6789/0 conn(0x7f7f70161080 legacy=0x7f7f700b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0039c0 0x7f7f5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f5c0047c0 0x7f7f5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f5c0051d0 0x7f7f5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70070460 con 0x7f7f5c0047c0 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c00c100 con 0x7f7f5c0051d0 2023-11-24T06:15:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c00c2c0 con 0x7f7f5c0039c0 2023-11-24T06:15:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.709+0000 7f7f748dc640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f5c0047c0 0x7f7f5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.710+0000 7f7f748dc640 1 -- 172.21.15.37:0/208184366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0039c0 msgr2=0x7f7f5c003dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.710+0000 7f7f748dc640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0039c0 0x7f7f5c003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.710+0000 7f7f748dc640 1 -- 172.21.15.37:0/208184366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f5c0051d0 msgr2=0x7f7f5c00b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.710+0000 7f7f748dc640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f5c0051d0 0x7f7f5c00b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.710+0000 7f7f748dc640 1 -- 172.21.15.37:0/208184366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c003520 con 0x7f7f5c0047c0 2023-11-24T06:15:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.710+0000 7f7f758de640 1 -- 172.21.15.37:0/208184366 reap_dead start 2023-11-24T06:15:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.711+0000 7f7f748dc640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f5c0047c0 0x7f7f5c004c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000c160 tx=0x7f7f5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9233d6124989ba5c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.711+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60005ad0 con 0x7f7f5c0047c0 2023-11-24T06:15:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.711+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60005c30 con 0x7f7f5c0047c0 2023-11-24T06:15:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.711+0000 7f7f67fff640 1 -- 172.21.15.37:0/208184366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6002c7c0 con 0x7f7f5c0047c0 2023-11-24T06:15:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.712+0000 7f7f760df640 1 -- 172.21.15.37:0/208184366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f5c0047c0 msgr2=0x7f7f5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.712+0000 7f7f760df640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f5c0047c0 0x7f7f5c004c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000c160 tx=0x7f7f5c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.712+0000 7f7f760df640 1 -- 172.21.15.37:0/208184366 shutdown_connections 2023-11-24T06:15:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.712+0000 7f7f760df640 1 --2- 172.21.15.37:0/208184366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f5c0047c0 0x7f7f5c004c40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.712+0000 7f7f760df640 1 -- 172.21.15.37:0/208184366 >> 172.21.15.37:0/208184366 conn(0x7f7f700cb830 msgr2=0x7f7f700cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.712+0000 7f7f760df640 1 -- 172.21.15.37:0/208184366 shutdown_connections 2023-11-24T06:15:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.712+0000 7f7f760df640 1 -- 172.21.15.37:0/208184366 wait complete. 2023-11-24T06:15:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.714+0000 7f7f760df640 1 Processor -- start 2023-11-24T06:15:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.714+0000 7f7f760df640 1 -- start start 2023-11-24T06:15:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f760df640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0047c0 0x7f7f70145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f760df640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f700b3ab0 0x7f7f700b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f760df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f701f8700 0x7f7f701f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f760df640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70144df0 con 0x7f7f701f8700 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f760df640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70145750 con 0x7f7f700b3ab0 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f760df640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700b4470 con 0x7f7f5c0047c0 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f758de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f701f8700 0x7f7f701f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f758de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f701f8700 0x7f7f701f8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39506/0 (socket says 172.21.15.37:39506) 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.715+0000 7f7f758de640 1 -- 172.21.15.37:0/2335351121 learned_addr learned my addr 172.21.15.37:0/2335351121 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f748dc640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f700b3ab0 0x7f7f700b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f750dd640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0047c0 0x7f7f70145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f758de640 1 -- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0047c0 msgr2=0x7f7f70145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f758de640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0047c0 0x7f7f70145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f758de640 1 -- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f700b3ab0 msgr2=0x7f7f700b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f758de640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f700b3ab0 0x7f7f700b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f758de640 1 -- 172.21.15.37:0/2335351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70144170 con 0x7f7f701f8700 2023-11-24T06:15:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f750dd640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0047c0 0x7f7f70145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f758de640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f701f8700 0x7f7f701f8b80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7f700702c0 tx=0x7f7f6800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f65ffb640 1 -- 172.21.15.37:0/2335351121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680070d0 con 0x7f7f701f8700 2023-11-24T06:15:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f65ffb640 1 -- 172.21.15.37:0/2335351121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68007230 con 0x7f7f701f8700 2023-11-24T06:15:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f70144450 con 0x7f7f701f8700 2023-11-24T06:15:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.716+0000 7f7f65ffb640 1 -- 172.21.15.37:0/2335351121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680075e0 con 0x7f7f701f8700 2023-11-24T06:15:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.717+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f70144a10 con 0x7f7f701f8700 2023-11-24T06:15:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.718+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f70144f30 con 0x7f7f701f8700 2023-11-24T06:15:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.719+0000 7f7f65ffb640 1 -- 172.21.15.37:0/2335351121 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f68007740 con 0x7f7f701f8700 2023-11-24T06:15:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.720+0000 7f7f65ffb640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7f5406ae70 0x7f7f5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.720+0000 7f7f65ffb640 1 -- 172.21.15.37:0/2335351121 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7f68088b90 con 0x7f7f701f8700 2023-11-24T06:15:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.720+0000 7f7f750dd640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7f5406ae70 0x7f7f5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:46.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.721+0000 7f7f750dd640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7f5406ae70 0x7f7f5406d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006fd0 tx=0x7f7f6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.724+0000 7f7f65ffb640 1 -- 172.21.15.37:0/2335351121 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f70144f30 con 0x7f7f701f8700 2023-11-24T06:15:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.959+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f70144f30 con 0x7f7f701f8700 2023-11-24T06:15:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.959+0000 7f7f65ffb640 1 -- 172.21.15.37:0/2335351121 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f7f70144f30 con 0x7f7f701f8700 2023-11-24T06:15:46.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:46.962 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:15:46.963 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:15:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7f5406ae70 msgr2=0x7f7f5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7f5406ae70 0x7f7f5406d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006fd0 tx=0x7f7f6c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f701f8700 msgr2=0x7f7f701f8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f701f8700 0x7f7f701f8b80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7f700702c0 tx=0x7f7f6800c960 comp rx=0 tx=0).stop 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 shutdown_connections 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7f5406ae70 0x7f7f5406d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f700b3ab0 0x7f7f700b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f701f8700 0x7f7f701f8b80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 --2- 172.21.15.37:0/2335351121 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f5c0047c0 0x7f7f70145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 >> 172.21.15.37:0/2335351121 conn(0x7f7f700cb830 msgr2=0x7f7f70071940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.963+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 shutdown_connections 2023-11-24T06:15:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:46.964+0000 7f7f760df640 1 -- 172.21.15.37:0/2335351121 wait complete. 2023-11-24T06:15:46.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:47.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.208+0000 7faf17505640 1 Processor -- start 2023-11-24T06:15:47.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.208+0000 7faf17505640 1 -- start start 2023-11-24T06:15:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.209+0000 7faf17505640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf100cd3e0 0x7faf1006c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.209+0000 7faf17505640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faf1009a0e0 0x7faf10161050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.209+0000 7faf17505640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf100d0820 con 0x7faf100cf480 2023-11-24T06:15:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf17505640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100cfc10 con 0x7faf100cd3e0 2023-11-24T06:15:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf17505640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100cfef0 con 0x7faf1009a0e0 2023-11-24T06:15:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf152a1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf100cd3e0 0x7faf1006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf152a1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf100cd3e0 0x7faf1006c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39520/0 (socket says 172.21.15.37:39520) 2023-11-24T06:15:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf152a1640 1 -- 172.21.15.37:0/1761745962 learned_addr learned my addr 172.21.15.37:0/1761745962 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:47.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf152a1640 1 -- 172.21.15.37:0/1761745962 >> v2:172.21.15.188:3300/0 conn(0x7faf1009a0e0 msgr2=0x7faf10161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:47.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf152a1640 1 --2- 172.21.15.37:0/1761745962 >> v2:172.21.15.188:3300/0 conn(0x7faf1009a0e0 0x7faf10161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf152a1640 1 -- 172.21.15.37:0/1761745962 >> v1:172.21.15.37:6789/0 conn(0x7faf100cf480 legacy=0x7faf100999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.210+0000 7faf152a1640 1 -- 172.21.15.37:0/1761745962 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf100d01d0 con 0x7faf100cd3e0 2023-11-24T06:15:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.212+0000 7faf152a1640 1 --2- 172.21.15.37:0/1761745962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf1006c530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faf100b38c0 tx=0x7faf0c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ee8f56c24f4832 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.212+0000 7faf07fff640 1 -- 172.21.15.37:0/1761745962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c031880 con 0x7faf100cd3e0 2023-11-24T06:15:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.212+0000 7faf07fff640 1 -- 172.21.15.37:0/1761745962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0319e0 con 0x7faf100cd3e0 2023-11-24T06:15:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.212+0000 7faf07fff640 1 -- 172.21.15.37:0/1761745962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c031d70 con 0x7faf100cd3e0 2023-11-24T06:15:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 -- 172.21.15.37:0/1761745962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 msgr2=0x7faf1006c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 --2- 172.21.15.37:0/1761745962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf1006c530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faf100b38c0 tx=0x7faf0c02b920 comp rx=0 tx=0).stop 2023-11-24T06:15:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 -- 172.21.15.37:0/1761745962 shutdown_connections 2023-11-24T06:15:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 --2- 172.21.15.37:0/1761745962 >> v2:172.21.15.188:3300/0 conn(0x7faf1009a0e0 0x7faf10161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 --2- 172.21.15.37:0/1761745962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf1006c530 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 -- 172.21.15.37:0/1761745962 >> 172.21.15.37:0/1761745962 conn(0x7faf100b2d00 msgr2=0x7faf100b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 -- 172.21.15.37:0/1761745962 shutdown_connections 2023-11-24T06:15:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.213+0000 7faf17505640 1 -- 172.21.15.37:0/1761745962 wait complete. 2023-11-24T06:15:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.215+0000 7faf17505640 1 Processor -- start 2023-11-24T06:15:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.215+0000 7faf17505640 1 -- start start 2023-11-24T06:15:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf17505640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1009a0e0 0x7faf1014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf17505640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf101e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf17505640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf100cf480 0x7faf100c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf17505640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf101e8aa0 con 0x7faf100cd3e0 2023-11-24T06:15:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf17505640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf101e8d80 con 0x7faf1009a0e0 2023-11-24T06:15:47.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf17505640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf101e9060 con 0x7faf100cf480 2023-11-24T06:15:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf101e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf101e7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39530/0 (socket says 172.21.15.37:39530) 2023-11-24T06:15:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 -- 172.21.15.37:0/1474796299 learned_addr learned my addr 172.21.15.37:0/1474796299 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 -- 172.21.15.37:0/1474796299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf100cf480 msgr2=0x7faf100c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf100cf480 0x7faf100c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 -- 172.21.15.37:0/1474796299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1009a0e0 msgr2=0x7faf1014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1009a0e0 0x7faf1014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.216+0000 7faf14aa0640 1 -- 172.21.15.37:0/1474796299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0094d0 con 0x7faf100cd3e0 2023-11-24T06:15:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.217+0000 7faf14aa0640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf101e7fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faf0000c450 tx=0x7faf0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.217+0000 7faf05ffb640 1 -- 172.21.15.37:0/1474796299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000052d0 con 0x7faf100cd3e0 2023-11-24T06:15:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.217+0000 7faf05ffb640 1 -- 172.21.15.37:0/1474796299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00005430 con 0x7faf100cd3e0 2023-11-24T06:15:47.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.217+0000 7faf05ffb640 1 -- 172.21.15.37:0/1474796299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00012870 con 0x7faf100cd3e0 2023-11-24T06:15:47.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.217+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf101e9340 con 0x7faf100cd3e0 2023-11-24T06:15:47.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.217+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10160a60 con 0x7faf100cd3e0 2023-11-24T06:15:47.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.219+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1006cf80 con 0x7faf100cd3e0 2023-11-24T06:15:47.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.220+0000 7faf05ffb640 1 -- 172.21.15.37:0/1474796299 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf000129d0 con 0x7faf100cd3e0 2023-11-24T06:15:47.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.220+0000 7faf05ffb640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef406ae40 0x7faef406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.221+0000 7faf05ffb640 1 -- 172.21.15.37:0/1474796299 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7faf00089150 con 0x7faf100cd3e0 2023-11-24T06:15:47.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.221+0000 7faf152a1640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef406ae40 0x7faef406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.222+0000 7faf152a1640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef406ae40 0x7faef406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf0c036000 tx=0x7faf0c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:47.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.225+0000 7faf05ffb640 1 -- 172.21.15.37:0/1474796299 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf00054200 con 0x7faf100cd3e0 2023-11-24T06:15:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.423+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf101e9860 con 0x7faf100cd3e0 2023-11-24T06:15:47.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.425+0000 7faf05ffb640 1 -- 172.21.15.37:0/1474796299 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16764 (secure 0 0 0) 0x7faf101e9860 con 0x7faf100cd3e0 2023-11-24T06:15:47.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:47.428 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:32.729893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:47.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.427+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef406ae40 msgr2=0x7faef406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.427+0000 7faf17505640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef406ae40 0x7faef406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf0c036000 tx=0x7faf0c030000 comp rx=0 tx=0).stop 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.427+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 msgr2=0x7faf101e7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.427+0000 7faf17505640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf101e7fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faf0000c450 tx=0x7faf0000c910 comp rx=0 tx=0).stop 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 shutdown_connections 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faef406ae40 0x7faef406d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf100cf480 0x7faf100c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100cd3e0 0x7faf101e7fe0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 --2- 172.21.15.37:0/1474796299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf1009a0e0 0x7faf1014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 >> 172.21.15.37:0/1474796299 conn(0x7faf100b2d00 msgr2=0x7faf100cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 shutdown_connections 2023-11-24T06:15:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.428+0000 7faf17505640 1 -- 172.21.15.37:0/1474796299 wait complete. 2023-11-24T06:15:47.448 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:15:47.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:47.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.671+0000 7faaf731b640 1 Processor -- start 2023-11-24T06:15:47.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.671+0000 7faaf731b640 1 -- start start 2023-11-24T06:15:47.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.672+0000 7faaf731b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faaf00d0240 0x7faaf0168080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.672+0000 7faaf731b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf00ce990 con 0x7faaf015d4e0 2023-11-24T06:15:47.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.672+0000 7faaf731b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf00cec70 con 0x7faaf00d1e20 2023-11-24T06:15:47.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.672+0000 7faaf731b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf00d4110 con 0x7faaf00d0240 2023-11-24T06:15:47.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.673+0000 7faaf6b1a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faaf00d0240 0x7faaf0168080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.673+0000 7faaf6319640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faaf015d4e0 0x7faaf00d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36104/0 (socket says 172.21.15.37:36104) 2023-11-24T06:15:47.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.673+0000 7faaf6319640 1 -- 172.21.15.37:0/140566425 learned_addr learned my addr 172.21.15.37:0/140566425 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:47.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.673+0000 7faaf6b1a640 1 -- 172.21.15.37:0/140566425 >> v1:172.21.15.188:6789/0 conn(0x7faaf00d1e20 legacy=0x7faaf00cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:47.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.673+0000 7faaf6b1a640 1 -- 172.21.15.37:0/140566425 >> v1:172.21.15.37:6789/0 conn(0x7faaf015d4e0 legacy=0x7faaf00d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.673+0000 7faaf6b1a640 1 -- 172.21.15.37:0/140566425 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00cef50 con 0x7faaf00d0240 2023-11-24T06:15:47.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.673+0000 7faaf5317640 1 -- 172.21.15.37:0/140566425 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095724109 0 0) 0x7faaf00ce990 con 0x7faaf015d4e0 2023-11-24T06:15:47.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.675+0000 7faaf6b1a640 1 --2- 172.21.15.37:0/140566425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf0168080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faae80097a0 tx=0x7faae802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb01dc9342af1a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:47.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.675+0000 7faaf5317640 1 -- 172.21.15.37:0/140566425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8031830 con 0x7faaf00d0240 2023-11-24T06:15:47.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.675+0000 7faaf5317640 1 -- 172.21.15.37:0/140566425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8031990 con 0x7faaf00d0240 2023-11-24T06:15:47.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.675+0000 7faaf5317640 1 -- 172.21.15.37:0/140566425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8031d20 con 0x7faaf00d0240 2023-11-24T06:15:47.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.676+0000 7faaf731b640 1 -- 172.21.15.37:0/140566425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 msgr2=0x7faaf0168080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.676+0000 7faaf731b640 1 --2- 172.21.15.37:0/140566425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf0168080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faae80097a0 tx=0x7faae802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.676+0000 7faaf731b640 1 -- 172.21.15.37:0/140566425 shutdown_connections 2023-11-24T06:15:47.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.676+0000 7faaf731b640 1 --2- 172.21.15.37:0/140566425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf0168080 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.676+0000 7faaf731b640 1 -- 172.21.15.37:0/140566425 >> 172.21.15.37:0/140566425 conn(0x7faaf009c510 msgr2=0x7faaf00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:47.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.676+0000 7faaf731b640 1 -- 172.21.15.37:0/140566425 shutdown_connections 2023-11-24T06:15:47.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.676+0000 7faaf731b640 1 -- 172.21.15.37:0/140566425 wait complete. 2023-11-24T06:15:47.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.678+0000 7faaf731b640 1 Processor -- start 2023-11-24T06:15:47.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.678+0000 7faaf731b640 1 -- start start 2023-11-24T06:15:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf731b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf01f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf731b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaf00d1e20 0x7faaf01effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf731b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaf015d4e0 0x7faaf00c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf731b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00c7420 con 0x7faaf00d0240 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf731b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00c7700 con 0x7faaf015d4e0 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf731b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00c79e0 con 0x7faaf00d1e20 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf6319640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf01f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf6319640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf01f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39550/0 (socket says 172.21.15.37:39550) 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.679+0000 7faaf6319640 1 -- 172.21.15.37:0/2354337124 learned_addr learned my addr 172.21.15.37:0/2354337124 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf6b1a640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaf015d4e0 0x7faaf00c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf5b18640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaf00d1e20 0x7faaf01effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf6319640 1 -- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaf00d1e20 msgr2=0x7faaf01effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf6319640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaf00d1e20 0x7faaf01effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf6319640 1 -- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaf015d4e0 msgr2=0x7faaf00c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf6319640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaf015d4e0 0x7faaf00c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf6319640 1 -- 172.21.15.37:0/2354337124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8009400 con 0x7faaf00d0240 2023-11-24T06:15:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaf6319640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf01f3860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faae000c7c0 tx=0x7faae000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaeeffd640 1 -- 172.21.15.37:0/2354337124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae000a640 con 0x7faaf00d0240 2023-11-24T06:15:47.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.680+0000 7faaeeffd640 1 -- 172.21.15.37:0/2354337124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae000a7c0 con 0x7faaf00d0240 2023-11-24T06:15:47.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.681+0000 7faaeeffd640 1 -- 172.21.15.37:0/2354337124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae000ab70 con 0x7faaf00d0240 2023-11-24T06:15:47.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.681+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf00c7cc0 con 0x7faaf00d0240 2023-11-24T06:15:47.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.681+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf00c6fe0 con 0x7faaf00d0240 2023-11-24T06:15:47.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.682+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf004e840 con 0x7faaf00d0240 2023-11-24T06:15:47.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.683+0000 7faaeeffd640 1 -- 172.21.15.37:0/2354337124 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faae000acd0 con 0x7faaf00d0240 2023-11-24T06:15:47.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.684+0000 7faaeeffd640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faadc06ae40 0x7faadc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:47.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.684+0000 7faaeeffd640 1 -- 172.21.15.37:0/2354337124 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7faae0088bf0 con 0x7faaf00d0240 2023-11-24T06:15:47.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.684+0000 7faaf5b18640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faadc06ae40 0x7faadc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:47.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.685+0000 7faaf5b18640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faadc06ae40 0x7faadc06d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faaf00cdef0 tx=0x7faae4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:47.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.689+0000 7faaeeffd640 1 -- 172.21.15.37:0/2354337124 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faae0053ca0 con 0x7faaf00d0240 2023-11-24T06:15:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.921+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaf00c7560 con 0x7faaf00d0240 2023-11-24T06:15:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.922+0000 7faaeeffd640 1 -- 172.21.15.37:0/2354337124 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7faaf00c7560 con 0x7faaf00d0240 2023-11-24T06:15:47.925 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:47.925 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:15:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:15:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faadc06ae40 msgr2=0x7faadc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faadc06ae40 0x7faadc06d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faaf00cdef0 tx=0x7faae4009040 comp rx=0 tx=0).stop 2023-11-24T06:15:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 msgr2=0x7faaf01f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf01f3860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faae000c7c0 tx=0x7faae000cc80 comp rx=0 tx=0).stop 2023-11-24T06:15:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 shutdown_connections 2023-11-24T06:15:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faadc06ae40 0x7faadc06d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaf015d4e0 0x7faaf00c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaf00d1e20 0x7faaf01effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 --2- 172.21.15.37:0/2354337124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaf00d0240 0x7faaf01f3860 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.925+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 >> 172.21.15.37:0/2354337124 conn(0x7faaf009c510 msgr2=0x7faaf006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.926+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 shutdown_connections 2023-11-24T06:15:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:47.926+0000 7faaf731b640 1 -- 172.21.15.37:0/2354337124 wait complete. 2023-11-24T06:15:47.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.167+0000 7fb49e3cf640 1 Processor -- start 2023-11-24T06:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.167+0000 7fb49e3cf640 1 -- start start 2023-11-24T06:15:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.169+0000 7fb49e3cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb498144b30 0x7fb49815f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.169+0000 7fb49e3cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb49815c410 0x7fb4980b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.169+0000 7fb49e3cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb4980b1de0 0x7fb4980b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.169+0000 7fb49e3cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980b27b0 con 0x7fb49815c410 2023-11-24T06:15:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.169+0000 7fb49e3cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49815bf80 con 0x7fb4980b1de0 2023-11-24T06:15:48.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.169+0000 7fb49e3cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980b1560 con 0x7fb498144b30 2023-11-24T06:15:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb49815c410 0x7fb4980b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb49815c410 0x7fb4980b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39556/0 (socket says 172.21.15.37:39556) 2023-11-24T06:15:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 -- 172.21.15.37:0/281937070 learned_addr learned my addr 172.21.15.37:0/281937070 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49d3cd640 1 --2- 172.21.15.37:0/281937070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb498144b30 0x7fb49815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49dbce640 1 --2- 172.21.15.37:0/281937070 >> v2:172.21.15.188:3300/0 conn(0x7fb4980b1de0 0x7fb4980b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 -- 172.21.15.37:0/281937070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb498144b30 msgr2=0x7fb49815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 --2- 172.21.15.37:0/281937070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb498144b30 0x7fb49815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 -- 172.21.15.37:0/281937070 >> v2:172.21.15.188:3300/0 conn(0x7fb4980b1de0 msgr2=0x7fb4980b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:48.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 --2- 172.21.15.37:0/281937070 >> v2:172.21.15.188:3300/0 conn(0x7fb4980b1de0 0x7fb4980b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49cbcc640 1 -- 172.21.15.37:0/281937070 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980b0fb0 con 0x7fb49815c410 2023-11-24T06:15:48.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.170+0000 7fb49dbce640 1 --2- 172.21.15.37:0/281937070 >> v2:172.21.15.188:3300/0 conn(0x7fb4980b1de0 0x7fb4980b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.172+0000 7fb49cbcc640 1 --2- 172.21.15.37:0/281937070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb49815c410 0x7fb4980b0a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb49806dec0 tx=0x7fb48802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36e7d6de82357a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.172+0000 7fb48ffff640 1 -- 172.21.15.37:0/281937070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488031860 con 0x7fb49815c410 2023-11-24T06:15:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.172+0000 7fb48ffff640 1 -- 172.21.15.37:0/281937070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4880319c0 con 0x7fb49815c410 2023-11-24T06:15:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.172+0000 7fb48ffff640 1 -- 172.21.15.37:0/281937070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488031d50 con 0x7fb49815c410 2023-11-24T06:15:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 -- 172.21.15.37:0/281937070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb49815c410 msgr2=0x7fb4980b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/281937070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb49815c410 0x7fb4980b0a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb49806dec0 tx=0x7fb48802b900 comp rx=0 tx=0).stop 2023-11-24T06:15:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 -- 172.21.15.37:0/281937070 shutdown_connections 2023-11-24T06:15:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/281937070 >> v2:172.21.15.188:3300/0 conn(0x7fb4980b1de0 0x7fb4980b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/281937070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb49815c410 0x7fb4980b0a70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/281937070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb498144b30 0x7fb49815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 -- 172.21.15.37:0/281937070 >> 172.21.15.37:0/281937070 conn(0x7fb4980cb830 msgr2=0x7fb4980cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 -- 172.21.15.37:0/281937070 shutdown_connections 2023-11-24T06:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.173+0000 7fb49e3cf640 1 -- 172.21.15.37:0/281937070 wait complete. 2023-11-24T06:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.175+0000 7fb49e3cf640 1 Processor -- start 2023-11-24T06:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.175+0000 7fb49e3cf640 1 -- start start 2023-11-24T06:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.176+0000 7fb49e3cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4980b1de0 0x7fb4980ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.176+0000 7fb49e3cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb498144b30 0x7fb498165590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.176+0000 7fb49e3cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb49815c410 0x7fb498165ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.176+0000 7fb49e3cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815af00 con 0x7fb4980b1de0 2023-11-24T06:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.176+0000 7fb49e3cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981563b0 con 0x7fb498144b30 2023-11-24T06:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.176+0000 7fb49e3cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb498159e60 con 0x7fb49815c410 2023-11-24T06:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4980b1de0 0x7fb4980ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4980b1de0 0x7fb4980ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39570/0 (socket says 172.21.15.37:39570) 2023-11-24T06:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 -- 172.21.15.37:0/2324525859 learned_addr learned my addr 172.21.15.37:0/2324525859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49cbcc640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb498144b30 0x7fb498165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49dbce640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb49815c410 0x7fb498165ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 -- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb49815c410 msgr2=0x7fb498165ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb49815c410 0x7fb498165ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 -- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb498144b30 msgr2=0x7fb498165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb498144b30 0x7fb498165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.177+0000 7fb49d3cd640 1 -- 172.21.15.37:0/2324525859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880094d0 con 0x7fb4980b1de0 2023-11-24T06:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.178+0000 7fb49d3cd640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4980b1de0 0x7fb4980ca350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb49400d800 tx=0x7fb49400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.178+0000 7fb48dffb640 1 -- 172.21.15.37:0/2324525859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400b6c0 con 0x7fb4980b1de0 2023-11-24T06:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.178+0000 7fb48dffb640 1 -- 172.21.15.37:0/2324525859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49400b820 con 0x7fb4980b1de0 2023-11-24T06:15:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.178+0000 7fb48dffb640 1 -- 172.21.15.37:0/2324525859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400bbb0 con 0x7fb4980b1de0 2023-11-24T06:15:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.178+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49815a140 con 0x7fb4980b1de0 2023-11-24T06:15:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.178+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49815a700 con 0x7fb4980b1de0 2023-11-24T06:15:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.179+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49804e840 con 0x7fb4980b1de0 2023-11-24T06:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.180+0000 7fb48dffb640 1 -- 172.21.15.37:0/2324525859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb49400bd10 con 0x7fb4980b1de0 2023-11-24T06:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.181+0000 7fb48dffb640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb47c06ae40 0x7fb47c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.181+0000 7fb48dffb640 1 -- 172.21.15.37:0/2324525859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb494089ce0 con 0x7fb4980b1de0 2023-11-24T06:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.181+0000 7fb49cbcc640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb47c06ae40 0x7fb47c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.182+0000 7fb49cbcc640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb47c06ae40 0x7fb47c06d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb488036000 tx=0x7fb48803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.185+0000 7fb48dffb640 1 -- 172.21.15.37:0/2324525859 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb494054c60 con 0x7fb4980b1de0 2023-11-24T06:15:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.422+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb49806d860 con 0x7fb4980b1de0 2023-11-24T06:15:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.423+0000 7fb48dffb640 1 -- 172.21.15.37:0/2324525859 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fb494058280 con 0x7fb4980b1de0 2023-11-24T06:15:48.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:48.426 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/498106546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":498106546},{"type":"v1","addr":"172.21.15.188:6835","nonce":498106546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1769300724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1769300724},{"type":"v1","addr":"172.21.15.37:6835","nonce":1769300724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2758374561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2758374561},{"type":"v1","addr":"172.21.15.37:6837","nonce":2758374561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:50.152195+0000","modified":"2023-11-24T06:14:53.205981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6833/554885584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":554885584},{"type":"v1","addr":"172.21.15.188:6833","nonce":554885584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:15:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb47c06ae40 msgr2=0x7fb47c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb47c06ae40 0x7fb47c06d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb488036000 tx=0x7fb48803c040 comp rx=0 tx=0).stop 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4980b1de0 msgr2=0x7fb4980ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4980b1de0 0x7fb4980ca350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb49400d800 tx=0x7fb49400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 shutdown_connections 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb47c06ae40 0x7fb47c06d300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb498144b30 0x7fb498165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb49815c410 0x7fb498165ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 --2- 172.21.15.37:0/2324525859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4980b1de0 0x7fb4980ca350 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 >> 172.21.15.37:0/2324525859 conn(0x7fb4980cb830 msgr2=0x7fb49815ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:48.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 shutdown_connections 2023-11-24T06:15:48.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.426+0000 7fb49e3cf640 1 -- 172.21.15.37:0/2324525859 wait complete. 2023-11-24T06:15:48.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:48.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.674+0000 7f5762085640 1 Processor -- start 2023-11-24T06:15:48.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.674+0000 7f5762085640 1 -- start start 2023-11-24T06:15:48.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.676+0000 7f5762085640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 0x7f575c162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.676+0000 7f5762085640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c162eb0 con 0x7f575c0703f0 2023-11-24T06:15:48.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.676+0000 7f5762085640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c1654a0 con 0x7f575c0cd160 2023-11-24T06:15:48.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.676+0000 7f5762085640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0ccf00 con 0x7f575c14b100 2023-11-24T06:15:48.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.677+0000 7f5760882640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f575c0703f0 0x7f575c165c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36112/0 (socket says 172.21.15.37:36112) 2023-11-24T06:15:48.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.677+0000 7f5760882640 1 -- 172.21.15.37:0/2955195615 learned_addr learned my addr 172.21.15.37:0/2955195615 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:48.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.677+0000 7f5761083640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 0x7f575c162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.677+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077167290 0 0) 0x7f574c001110 con 0x7f575c0703f0 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.677+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5748003520 con 0x7f575c0703f0 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.677+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133334108 0 0) 0x7f5748003520 con 0x7f575c0703f0 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.677+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 msgr2=0x7f575c162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 0x7f575c162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 >> v1:172.21.15.188:6789/0 conn(0x7f575c0cd160 legacy=0x7f575c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c166320 con 0x7f575c0703f0 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f574c001800 con 0x7f575c0703f0 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 >> v1:172.21.15.37:6789/0 conn(0x7f575c0703f0 legacy=0x7f575c165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480039a0 0x7f5748003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57480047c0 0x7f5748004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 0x7f5748005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0ccf00 con 0x7f57480047c0 2023-11-24T06:15:48.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574800bb10 con 0x7f57480039a0 2023-11-24T06:15:48.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574800bcd0 con 0x7f575c14b100 2023-11-24T06:15:48.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5760882640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57480047c0 0x7f5748004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5761884640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 0x7f5748005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.678+0000 7f5761083640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480039a0 0x7f5748003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.679+0000 7f5760882640 1 -- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 msgr2=0x7f5748005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.679+0000 7f5760882640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c14b100 0x7f5748005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.679+0000 7f5760882640 1 -- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480039a0 msgr2=0x7f5748003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.679+0000 7f5760882640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480039a0 0x7f5748003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.679+0000 7f5760882640 1 -- 172.21.15.37:0/2955195615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748003520 con 0x7f57480047c0 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.679+0000 7f5761083640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480039a0 0x7f5748003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.680+0000 7f5760882640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57480047c0 0x7f5748004c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f574c007fc0 tx=0x7f57480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad371ee946ca9ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.680+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c005ad0 con 0x7f57480047c0 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.680+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c005c50 con 0x7f57480047c0 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.680+0000 7f5753fff640 1 -- 172.21.15.37:0/2955195615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c02c7e0 con 0x7f57480047c0 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.681+0000 7f5762085640 1 -- 172.21.15.37:0/2955195615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57480047c0 msgr2=0x7f5748004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.681+0000 7f5762085640 1 --2- 172.21.15.37:0/2955195615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57480047c0 0x7f5748004c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f574c007fc0 tx=0x7f57480057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.681+0000 7f5761884640 1 -- 172.21.15.37:0/2955195615 reap_dead start 2023-11-24T06:15:48.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.681+0000 7f5762085640 1 -- 172.21.15.37:0/2955195615 shutdown_connections 2023-11-24T06:15:48.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.681+0000 7f5762085640 1 -- 172.21.15.37:0/2955195615 >> 172.21.15.37:0/2955195615 conn(0x7f575c0cb830 msgr2=0x7f575c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:48.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.681+0000 7f5762085640 1 -- 172.21.15.37:0/2955195615 shutdown_connections 2023-11-24T06:15:48.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.681+0000 7f5762085640 1 -- 172.21.15.37:0/2955195615 wait complete. 2023-11-24T06:15:48.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.683+0000 7f5762085640 1 Processor -- start 2023-11-24T06:15:48.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.683+0000 7f5762085640 1 -- start start 2023-11-24T06:15:48.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5762085640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480047c0 0x7f575c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5762085640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c1ec540 0x7f575c1ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5762085640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c0ad7c0 0x7f575c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5762085640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0ae180 con 0x7f575c1ec540 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5762085640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c1eb4a0 con 0x7f57480047c0 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5762085640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c1eb780 con 0x7f575c0ad7c0 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5760882640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c1ec540 0x7f575c1ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5760882640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c1ec540 0x7f575c1ec9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39590/0 (socket says 172.21.15.37:39590) 2023-11-24T06:15:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5760882640 1 -- 172.21.15.37:0/3338496127 learned_addr learned my addr 172.21.15.37:0/3338496127 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5761083640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480047c0 0x7f575c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5760882640 1 -- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c0ad7c0 msgr2=0x7f575c0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5760882640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c0ad7c0 0x7f575c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.684+0000 7f5760882640 1 -- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480047c0 msgr2=0x7f575c0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5760882640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480047c0 0x7f575c0b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5760882640 1 -- 172.21.15.37:0/3338496127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c1eba60 con 0x7f575c1ec540 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5761083640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480047c0 0x7f575c0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5760882640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c1ec540 0x7f575c1ec9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c1a0 tx=0x7f574c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5751ffb640 1 -- 172.21.15.37:0/3338496127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c039070 con 0x7f575c1ec540 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5751ffb640 1 -- 172.21.15.37:0/3338496127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c02cbf0 con 0x7f575c1ec540 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5751ffb640 1 -- 172.21.15.37:0/3338496127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c000ed0 con 0x7f575c1ec540 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c1ebd40 con 0x7f575c1ec540 2023-11-24T06:15:48.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.685+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c0b27d0 con 0x7f575c1ec540 2023-11-24T06:15:48.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.687+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c1eb8c0 con 0x7f575c1ec540 2023-11-24T06:15:48.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.687+0000 7f5751ffb640 1 -- 172.21.15.37:0/3338496127 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f574c032070 con 0x7f575c1ec540 2023-11-24T06:15:48.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.688+0000 7f5751ffb640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f574006ae40 0x7f574006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:48.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.688+0000 7f5751ffb640 1 -- 172.21.15.37:0/3338496127 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f574c03c040 con 0x7f575c1ec540 2023-11-24T06:15:48.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.689+0000 7f5761083640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f574006ae40 0x7f574006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:48.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.689+0000 7f5761083640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f574006ae40 0x7f574006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5758009aa0 tx=0x7f5758008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:48.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.693+0000 7f5751ffb640 1 -- 172.21.15.37:0/3338496127 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f575c1eb8c0 con 0x7f575c1ec540 2023-11-24T06:15:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.889+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f575c162eb0 con 0x7f575c1ec540 2023-11-24T06:15:48.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.891+0000 7f5751ffb640 1 -- 172.21.15.37:0/3338496127 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16764 (secure 0 0 0) 0x7f575c162eb0 con 0x7f575c1ec540 2023-11-24T06:15:48.895 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:48.895 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:32.729893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:48.344099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:49.175438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:48.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.894+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f574006ae40 msgr2=0x7f574006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.894+0000 7f5762085640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f574006ae40 0x7f574006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5758009aa0 tx=0x7f5758008040 comp rx=0 tx=0).stop 2023-11-24T06:15:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c1ec540 msgr2=0x7f575c1ec9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c1ec540 0x7f575c1ec9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c1a0 tx=0x7f574c001ac0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 shutdown_connections 2023-11-24T06:15:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f574006ae40 0x7f574006d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f575c0ad7c0 0x7f575c0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c1ec540 0x7f575c1ec9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 --2- 172.21.15.37:0/3338496127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57480047c0 0x7f575c0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 >> 172.21.15.37:0/3338496127 conn(0x7f575c0cb830 msgr2=0x7f575c0ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 shutdown_connections 2023-11-24T06:15:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:48.895+0000 7f5762085640 1 -- 172.21.15.37:0/3338496127 wait complete. 2023-11-24T06:15:48.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:15:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.135+0000 7fc563fff640 1 Processor -- start 2023-11-24T06:15:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.136+0000 7fc563fff640 1 -- start start 2023-11-24T06:15:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc563fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc564070ea0 0x7fc5640b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc563fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc56406d640 0x7fc56406da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc563fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56406df90 con 0x7fc56415a1c0 2023-11-24T06:15:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc563fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640cd920 con 0x7fc564070ea0 2023-11-24T06:15:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc563fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56415e580 con 0x7fc56406d640 2023-11-24T06:15:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc55bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc564070ea0 0x7fc5640b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc55bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc564070ea0 0x7fc5640b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39606/0 (socket says 172.21.15.37:39606) 2023-11-24T06:15:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.138+0000 7fc55bfff640 1 -- 172.21.15.37:0/3064590586 learned_addr learned my addr 172.21.15.37:0/3064590586 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.139+0000 7fc55bfff640 1 -- 172.21.15.37:0/3064590586 >> v2:172.21.15.188:3300/0 conn(0x7fc56406d640 msgr2=0x7fc56406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.139+0000 7fc5637fe640 1 --2- 172.21.15.37:0/3064590586 >> v2:172.21.15.188:3300/0 conn(0x7fc56406d640 0x7fc56406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.139+0000 7fc55bfff640 1 --2- 172.21.15.37:0/3064590586 >> v2:172.21.15.188:3300/0 conn(0x7fc56406d640 0x7fc56406da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.139+0000 7fc55bfff640 1 -- 172.21.15.37:0/3064590586 >> v1:172.21.15.188:6789/0 conn(0x7fc56415a1c0 legacy=0x7fc56415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.139+0000 7fc55bfff640 1 -- 172.21.15.37:0/3064590586 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56415e860 con 0x7fc564070ea0 2023-11-24T06:15:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.140+0000 7fc55bfff640 1 --2- 172.21.15.37:0/3064590586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc564070ea0 0x7fc5640b15e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5640b5180 tx=0x7fc54c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d50155c34164b06 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.140+0000 7fc5627fc640 1 -- 172.21.15.37:0/3064590586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c030860 con 0x7fc564070ea0 2023-11-24T06:15:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.140+0000 7fc5627fc640 1 -- 172.21.15.37:0/3064590586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c0309c0 con 0x7fc564070ea0 2023-11-24T06:15:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.140+0000 7fc5627fc640 1 -- 172.21.15.37:0/3064590586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c030d50 con 0x7fc564070ea0 2023-11-24T06:15:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 -- 172.21.15.37:0/3064590586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc564070ea0 msgr2=0x7fc5640b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 --2- 172.21.15.37:0/3064590586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc564070ea0 0x7fc5640b15e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5640b5180 tx=0x7fc54c02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 -- 172.21.15.37:0/3064590586 shutdown_connections 2023-11-24T06:15:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 --2- 172.21.15.37:0/3064590586 >> v2:172.21.15.188:3300/0 conn(0x7fc56406d640 0x7fc56406da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 --2- 172.21.15.37:0/3064590586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc564070ea0 0x7fc5640b15e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 -- 172.21.15.37:0/3064590586 >> 172.21.15.37:0/3064590586 conn(0x7fc5640cbb40 msgr2=0x7fc5640cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 -- 172.21.15.37:0/3064590586 shutdown_connections 2023-11-24T06:15:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.141+0000 7fc563fff640 1 -- 172.21.15.37:0/3064590586 wait complete. 2023-11-24T06:15:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.143+0000 7fc563fff640 1 Processor -- start 2023-11-24T06:15:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.143+0000 7fc563fff640 1 -- start start 2023-11-24T06:15:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc563fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56406d640 0x7fc5640c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc563fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc564070ea0 0x7fc5640c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc563fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc56415a1c0 0x7fc5640c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc563fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640aee40 con 0x7fc56406d640 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc563fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640c56c0 con 0x7fc56415a1c0 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc563fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56409a890 con 0x7fc564070ea0 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc562ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56406d640 0x7fc5640c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc562ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56406d640 0x7fc5640c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39612/0 (socket says 172.21.15.37:39612) 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.144+0000 7fc562ffd640 1 -- 172.21.15.37:0/3857558919 learned_addr learned my addr 172.21.15.37:0/3857558919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc562ffd640 1 -- 172.21.15.37:0/3857558919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc564070ea0 msgr2=0x7fc5640c4c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:15:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc562ffd640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc564070ea0 0x7fc5640c4c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc562ffd640 1 -- 172.21.15.37:0/3857558919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc56415a1c0 msgr2=0x7fc5640c5180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:15:49.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc562ffd640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc56415a1c0 0x7fc5640c5180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc562ffd640 1 -- 172.21.15.37:0/3857558919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0094d0 con 0x7fc56406d640 2023-11-24T06:15:49.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc562ffd640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56406d640 0x7fc5640c1d00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc55400b410 tx=0x7fc55400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc560ff9640 1 -- 172.21.15.37:0/3857558919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554011830 con 0x7fc56406d640 2023-11-24T06:15:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc560ff9640 1 -- 172.21.15.37:0/3857558919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554011990 con 0x7fc56406d640 2023-11-24T06:15:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56409a2d0 con 0x7fc56406d640 2023-11-24T06:15:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.145+0000 7fc560ff9640 1 -- 172.21.15.37:0/3857558919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554011d40 con 0x7fc56406d640 2023-11-24T06:15:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.146+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5640aead0 con 0x7fc56406d640 2023-11-24T06:15:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.147+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56404e840 con 0x7fc56406d640 2023-11-24T06:15:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.148+0000 7fc560ff9640 1 -- 172.21.15.37:0/3857558919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc55401a400 con 0x7fc56406d640 2023-11-24T06:15:49.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.149+0000 7fc560ff9640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc54406ae40 0x7fc54406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.149+0000 7fc560ff9640 1 -- 172.21.15.37:0/3857558919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc5540899a0 con 0x7fc56406d640 2023-11-24T06:15:49.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.149+0000 7fc55bfff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc54406ae40 0x7fc54406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.150+0000 7fc55bfff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc54406ae40 0x7fc54406d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc54c036000 tx=0x7fc54c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.153+0000 7fc560ff9640 1 -- 172.21.15.37:0/3857558919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc554054890 con 0x7fc56406d640 2023-11-24T06:15:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.382+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc5640cd4d0 con 0x7fc56406d640 2023-11-24T06:15:49.386 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-11-24T06:15:49.384+0000 7fe7fc218640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:15:49.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.388+0000 7fc560ff9640 1 -- 172.21.15.37:0/3857558919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc554015070 con 0x7fc56406d640 2023-11-24T06:15:49.391 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:15:49.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc54406ae40 msgr2=0x7fc54406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc54406ae40 0x7fc54406d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc54c036000 tx=0x7fc54c03b040 comp rx=0 tx=0).stop 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56406d640 msgr2=0x7fc5640c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56406d640 0x7fc5640c1d00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc55400b410 tx=0x7fc55400b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 shutdown_connections 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc54406ae40 0x7fc54406d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc56415a1c0 0x7fc5640c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc564070ea0 0x7fc5640c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 --2- 172.21.15.37:0/3857558919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56406d640 0x7fc5640c1d00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 >> 172.21.15.37:0/3857558919 conn(0x7fc5640cbb40 msgr2=0x7fc5640713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:49.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 shutdown_connections 2023-11-24T06:15:49.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.391+0000 7fc563fff640 1 -- 172.21.15.37:0/3857558919 wait complete. 2023-11-24T06:15:49.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:15:49.433 INFO:tasks.ceph.mds.b.smithi188.stderr: -7455> 2023-11-24T06:14:56.254+0000 7f59dd083640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:15:49.524 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2023-11-24T06:15:49.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.633+0000 7f5b01147640 1 Processor -- start 2023-11-24T06:15:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.633+0000 7f5b01147640 1 -- start start 2023-11-24T06:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5b01147640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5afc0b1260 0x7f5afc0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5b01147640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc071e10 0x7f5afc142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5b01147640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc1450d0 con 0x7f5afc141b90 2023-11-24T06:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5b01147640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc1422b0 con 0x7f5afc0b1260 2023-11-24T06:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5b01147640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0725e0 con 0x7f5afc071e10 2023-11-24T06:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5af3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5afc0b1260 0x7f5afc0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5af3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5afc0b1260 0x7f5afc0718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39626/0 (socket says 172.21.15.37:39626) 2023-11-24T06:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.635+0000 7f5af3fff640 1 -- 172.21.15.37:0/4092632362 learned_addr learned my addr 172.21.15.37:0/4092632362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.636+0000 7f5b00946640 1 --2- 172.21.15.37:0/4092632362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc071e10 0x7f5afc142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.636+0000 7f5af3fff640 1 -- 172.21.15.37:0/4092632362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc071e10 msgr2=0x7f5afc142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.636+0000 7f5af3fff640 1 --2- 172.21.15.37:0/4092632362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc071e10 0x7f5afc142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.636+0000 7f5af3fff640 1 -- 172.21.15.37:0/4092632362 >> v1:172.21.15.188:6789/0 conn(0x7f5afc141b90 legacy=0x7f5afc0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.636+0000 7f5af3fff640 1 -- 172.21.15.37:0/4092632362 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc142520 con 0x7f5afc0b1260 2023-11-24T06:15:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.636+0000 7f5b00946640 1 --2- 172.21.15.37:0/4092632362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc071e10 0x7f5afc142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.637+0000 7f5af3fff640 1 --2- 172.21.15.37:0/4092632362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc0b1260 0x7f5afc0718d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009870 tx=0x7f5ae402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c689f298fb07c75e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.637+0000 7f5afb7fe640 1 -- 172.21.15.37:0/4092632362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40317c0 con 0x7f5afc0b1260 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.637+0000 7f5afb7fe640 1 -- 172.21.15.37:0/4092632362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4031920 con 0x7f5afc0b1260 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.637+0000 7f5afb7fe640 1 -- 172.21.15.37:0/4092632362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4031cb0 con 0x7f5afc0b1260 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 -- 172.21.15.37:0/4092632362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc0b1260 msgr2=0x7f5afc0718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 --2- 172.21.15.37:0/4092632362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc0b1260 0x7f5afc0718d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009870 tx=0x7f5ae402b860 comp rx=0 tx=0).stop 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 -- 172.21.15.37:0/4092632362 shutdown_connections 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 --2- 172.21.15.37:0/4092632362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc0b1260 0x7f5afc0718d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 --2- 172.21.15.37:0/4092632362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc071e10 0x7f5afc142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 -- 172.21.15.37:0/4092632362 >> 172.21.15.37:0/4092632362 conn(0x7f5afc06a500 msgr2=0x7f5afc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 -- 172.21.15.37:0/4092632362 shutdown_connections 2023-11-24T06:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.638+0000 7f5b01147640 1 -- 172.21.15.37:0/4092632362 wait complete. 2023-11-24T06:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.640+0000 7f5b01147640 1 Processor -- start 2023-11-24T06:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.640+0000 7f5b01147640 1 -- start start 2023-11-24T06:15:49.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5b01147640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc071e10 0x7f5afc0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5b01147640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc0b1260 0x7f5afc15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5b01147640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5afc141b90 0x7f5afc1357d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5b01147640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc15b630 con 0x7f5afc071e10 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5b01147640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc135d10 con 0x7f5afc141b90 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5b01147640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0b0300 con 0x7f5afc0b1260 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc071e10 0x7f5afc0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc071e10 0x7f5afc0afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39630/0 (socket says 172.21.15.37:39630) 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.641+0000 7f5afbfff640 1 -- 172.21.15.37:0/436307087 learned_addr learned my addr 172.21.15.37:0/436307087 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5b00946640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5afc141b90 0x7f5afc1357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5afbfff640 1 -- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc0b1260 msgr2=0x7f5afc15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:49.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5af3fff640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc0b1260 0x7f5afc15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5afbfff640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc0b1260 0x7f5afc15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5afbfff640 1 -- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5afc141b90 msgr2=0x7f5afc1357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5afbfff640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5afc141b90 0x7f5afc1357d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5afbfff640 1 -- 172.21.15.37:0/436307087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae40094d0 con 0x7f5afc071e10 2023-11-24T06:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5b00946640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5afc141b90 0x7f5afc1357d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5af3fff640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc0b1260 0x7f5afc15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5afbfff640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc071e10 0x7f5afc0afcb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c430 tx=0x7f5aec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5af97fa640 1 -- 172.21.15.37:0/436307087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec011790 con 0x7f5afc071e10 2023-11-24T06:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5af97fa640 1 -- 172.21.15.37:0/436307087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec0118f0 con 0x7f5afc071e10 2023-11-24T06:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5af97fa640 1 -- 172.21.15.37:0/436307087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec011ce0 con 0x7f5afc071e10 2023-11-24T06:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.642+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc0b05e0 con 0x7f5afc071e10 2023-11-24T06:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.643+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc0b0ba0 con 0x7f5afc071e10 2023-11-24T06:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.644+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc067de0 con 0x7f5afc071e10 2023-11-24T06:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.645+0000 7f5af97fa640 1 -- 172.21.15.37:0/436307087 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5aec01c460 con 0x7f5afc071e10 2023-11-24T06:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.646+0000 7f5af97fa640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5adc06ae70 0x7f5adc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.646+0000 7f5af97fa640 1 -- 172.21.15.37:0/436307087 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f5aec089600 con 0x7f5afc071e10 2023-11-24T06:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.646+0000 7f5af3fff640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5adc06ae70 0x7f5adc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.647+0000 7f5af3fff640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5adc06ae70 0x7f5adc06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4036000 tx=0x7f5ae403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.650+0000 7f5af97fa640 1 -- 172.21.15.37:0/436307087 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5aec054650 con 0x7f5afc071e10 2023-11-24T06:15:49.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:49.881+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5afc04e840 con 0x7f5afc071e10 2023-11-24T06:15:50.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.391+0000 7f5af97fa640 1 -- 172.21.15.37:0/436307087 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5aec087e60 con 0x7f5afc071e10 2023-11-24T06:15:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5adc06ae70 msgr2=0x7f5adc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5adc06ae70 0x7f5adc06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4036000 tx=0x7f5ae403d040 comp rx=0 tx=0).stop 2023-11-24T06:15:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc071e10 msgr2=0x7f5afc0afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc071e10 0x7f5afc0afcb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c430 tx=0x7f5aec00c8f0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 shutdown_connections 2023-11-24T06:15:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5adc06ae70 0x7f5adc06d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5afc141b90 0x7f5afc1357d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5afc0b1260 0x7f5afc15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 --2- 172.21.15.37:0/436307087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5afc071e10 0x7f5afc0afcb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 >> 172.21.15.37:0/436307087 conn(0x7f5afc06a500 msgr2=0x7f5afc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 shutdown_connections 2023-11-24T06:15:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.395+0000 7f5b01147640 1 -- 172.21.15.37:0/436307087 wait complete. 2023-11-24T06:15:50.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:15:50.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.602+0000 7fb3924dc640 1 Processor -- start 2023-11-24T06:15:50.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.602+0000 7fb3924dc640 1 -- start start 2023-11-24T06:15:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3924dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb38c143800 0x7fb38c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3924dc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb38c15b460 0x7fb38c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3924dc640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c0b3f40 con 0x7fb38c143be0 2023-11-24T06:15:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3924dc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c0b3c60 con 0x7fb38c143800 2023-11-24T06:15:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3924dc640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c15dde0 con 0x7fb38c15b460 2023-11-24T06:15:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3914da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb38c143800 0x7fb38c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3914da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb38c143800 0x7fb38c15e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39640/0 (socket says 172.21.15.37:39640) 2023-11-24T06:15:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3914da640 1 -- 172.21.15.37:0/31056178 learned_addr learned my addr 172.21.15.37:0/31056178 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb3914da640 1 -- 172.21.15.37:0/31056178 >> v2:172.21.15.188:3300/0 conn(0x7fb38c15b460 msgr2=0x7fb38c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.604+0000 7fb391cdb640 1 --2- 172.21.15.37:0/31056178 >> v2:172.21.15.188:3300/0 conn(0x7fb38c15b460 0x7fb38c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.605+0000 7fb3914da640 1 --2- 172.21.15.37:0/31056178 >> v2:172.21.15.188:3300/0 conn(0x7fb38c15b460 0x7fb38c0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.605+0000 7fb3914da640 1 -- 172.21.15.37:0/31056178 >> v1:172.21.15.188:6789/0 conn(0x7fb38c143be0 legacy=0x7fb38c0b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.605+0000 7fb3914da640 1 -- 172.21.15.37:0/31056178 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c15e0c0 con 0x7fb38c143800 2023-11-24T06:15:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.605+0000 7fb391cdb640 1 --2- 172.21.15.37:0/31056178 >> v2:172.21.15.188:3300/0 conn(0x7fb38c15b460 0x7fb38c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.606+0000 7fb3914da640 1 --2- 172.21.15.37:0/31056178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c15e8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb38c06e730 tx=0x7fb38802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a693a83335c36fcc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.606+0000 7fb383fff640 1 -- 172.21.15.37:0/31056178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880317e0 con 0x7fb38c143800 2023-11-24T06:15:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.606+0000 7fb383fff640 1 -- 172.21.15.37:0/31056178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388031940 con 0x7fb38c143800 2023-11-24T06:15:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.606+0000 7fb383fff640 1 -- 172.21.15.37:0/31056178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388031cd0 con 0x7fb38c143800 2023-11-24T06:15:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 -- 172.21.15.37:0/31056178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 msgr2=0x7fb38c15e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 --2- 172.21.15.37:0/31056178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c15e8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb38c06e730 tx=0x7fb38802b880 comp rx=0 tx=0).stop 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 -- 172.21.15.37:0/31056178 shutdown_connections 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 --2- 172.21.15.37:0/31056178 >> v2:172.21.15.188:3300/0 conn(0x7fb38c15b460 0x7fb38c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 --2- 172.21.15.37:0/31056178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c15e8c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 -- 172.21.15.37:0/31056178 >> 172.21.15.37:0/31056178 conn(0x7fb38c06dc30 msgr2=0x7fb38c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 -- 172.21.15.37:0/31056178 shutdown_connections 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.607+0000 7fb3924dc640 1 -- 172.21.15.37:0/31056178 wait complete. 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.609+0000 7fb3924dc640 1 Processor -- start 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.609+0000 7fb3924dc640 1 -- start start 2023-11-24T06:15:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3924dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3924dc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb38c143be0 0x7fb38c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3924dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb38c15b460 0x7fb38c14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3924dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c0ca860 con 0x7fb38c143800 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3924dc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c0c99b0 con 0x7fb38c15b460 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3924dc640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c0c9be0 con 0x7fb38c143be0 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3914da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3914da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c141c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39650/0 (socket says 172.21.15.37:39650) 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.610+0000 7fb3914da640 1 -- 172.21.15.37:0/1873949345 learned_addr learned my addr 172.21.15.37:0/1873949345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb390cd9640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb38c143be0 0x7fb38c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb391cdb640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb38c15b460 0x7fb38c14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb3914da640 1 -- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb38c143be0 msgr2=0x7fb38c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb3914da640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb38c143be0 0x7fb38c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb3914da640 1 -- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb38c15b460 msgr2=0x7fb38c14c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb3914da640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb38c15b460 0x7fb38c14c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb3914da640 1 -- 172.21.15.37:0/1873949345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880094d0 con 0x7fb38c143800 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb391cdb640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb38c15b460 0x7fb38c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb390cd9640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb38c143be0 0x7fb38c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb3914da640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c141c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb38802b8c0 tx=0x7fb3880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb381ffb640 1 -- 172.21.15.37:0/1873949345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880329c0 con 0x7fb38c143800 2023-11-24T06:15:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb381ffb640 1 -- 172.21.15.37:0/1873949345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388032b40 con 0x7fb38c143800 2023-11-24T06:15:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb381ffb640 1 -- 172.21.15.37:0/1873949345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880453f0 con 0x7fb38c143800 2023-11-24T06:15:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.611+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c0c9ec0 con 0x7fb38c143800 2023-11-24T06:15:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.612+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c0ca480 con 0x7fb38c143800 2023-11-24T06:15:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.613+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c04e840 con 0x7fb38c143800 2023-11-24T06:15:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.613+0000 7fb381ffb640 1 -- 172.21.15.37:0/1873949345 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb38804d3f0 con 0x7fb38c143800 2023-11-24T06:15:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.614+0000 7fb381ffb640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb37006ae70 0x7fb37006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.614+0000 7fb381ffb640 1 -- 172.21.15.37:0/1873949345 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fb3880ab6c0 con 0x7fb38c143800 2023-11-24T06:15:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.615+0000 7fb390cd9640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb37006ae70 0x7fb37006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.615+0000 7fb390cd9640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb37006ae70 0x7fb37006d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb38c1f64e0 tx=0x7fb37c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:50.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.618+0000 7fb381ffb640 1 -- 172.21.15.37:0/1873949345 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb388076690 con 0x7fb38c143800 2023-11-24T06:15:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:50.811+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb38c0714a0 con 0x7fb38c143800 2023-11-24T06:15:51.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.668+0000 7fb381ffb640 1 -- 172.21.15.37:0/1873949345 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb388079cb0 con 0x7fb38c143800 2023-11-24T06:15:51.671 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:15:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb37006ae70 msgr2=0x7fb37006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb37006ae70 0x7fb37006d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb38c1f64e0 tx=0x7fb37c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 msgr2=0x7fb38c141c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c141c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb38802b8c0 tx=0x7fb3880046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 shutdown_connections 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb37006ae70 0x7fb37006d330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb38c15b460 0x7fb38c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb38c143be0 0x7fb38c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 --2- 172.21.15.37:0/1873949345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb38c143800 0x7fb38c141c20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.672+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 >> 172.21.15.37:0/1873949345 conn(0x7fb38c06dc30 msgr2=0x7fb38c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.673+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 shutdown_connections 2023-11-24T06:15:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.673+0000 7fb3924dc640 1 -- 172.21.15.37:0/1873949345 wait complete. 2023-11-24T06:15:51.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:15:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.918+0000 7f720f59e640 1 Processor -- start 2023-11-24T06:15:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.918+0000 7f720f59e640 1 -- start start 2023-11-24T06:15:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.919+0000 7f720f59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7210160b00 0x7f72100d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.919+0000 7f720f59e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f72100d12e0 0x7f72100cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720f59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721015ea30 con 0x7f72100d0120 2023-11-24T06:15:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720f59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72100d0590 con 0x7f7210160b00 2023-11-24T06:15:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720f59e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721015de20 con 0x7f72100d12e0 2023-11-24T06:15:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7210160b00 0x7f72100d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f72100d0120 0x7f721015ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55024/0 (socket says 172.21.15.37:55024) 2023-11-24T06:15:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720ed9d640 1 -- 172.21.15.37:0/3782982622 learned_addr learned my addr 172.21.15.37:0/3782982622 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720e59c640 1 -- 172.21.15.37:0/3782982622 >> v2:172.21.15.188:3300/0 conn(0x7f72100d12e0 msgr2=0x7f72100cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720e59c640 1 --2- 172.21.15.37:0/3782982622 >> v2:172.21.15.188:3300/0 conn(0x7f72100d12e0 0x7f72100cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720e59c640 1 -- 172.21.15.37:0/3782982622 >> v1:172.21.15.37:6789/0 conn(0x7f72100d0120 legacy=0x7f721015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720e59c640 1 -- 172.21.15.37:0/3782982622 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721015e100 con 0x7f7210160b00 2023-11-24T06:15:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.920+0000 7f720d59a640 1 -- 172.21.15.37:0/3782982622 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61811697 0 0) 0x7f721015ea30 con 0x7f72100d0120 2023-11-24T06:15:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.922+0000 7f720e59c640 1 --2- 172.21.15.37:0/3782982622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7210160b00 0x7f72100d0da0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f721008bad0 tx=0x7f720002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb17e21bedd5f1b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.922+0000 7f720d59a640 1 -- 172.21.15.37:0/3782982622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200031830 con 0x7f7210160b00 2023-11-24T06:15:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.922+0000 7f720d59a640 1 -- 172.21.15.37:0/3782982622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7200031990 con 0x7f7210160b00 2023-11-24T06:15:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.922+0000 7f720d59a640 1 -- 172.21.15.37:0/3782982622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200031d20 con 0x7f7210160b00 2023-11-24T06:15:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.922+0000 7f720f59e640 1 -- 172.21.15.37:0/3782982622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7210160b00 msgr2=0x7f72100d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.922+0000 7f720f59e640 1 --2- 172.21.15.37:0/3782982622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7210160b00 0x7f72100d0da0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f721008bad0 tx=0x7f720002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.922+0000 7f720f59e640 1 -- 172.21.15.37:0/3782982622 shutdown_connections 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.923+0000 7f720f59e640 1 --2- 172.21.15.37:0/3782982622 >> v2:172.21.15.188:3300/0 conn(0x7f72100d12e0 0x7f72100cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.923+0000 7f720f59e640 1 --2- 172.21.15.37:0/3782982622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7210160b00 0x7f72100d0da0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.923+0000 7f720f59e640 1 -- 172.21.15.37:0/3782982622 >> 172.21.15.37:0/3782982622 conn(0x7f721009c510 msgr2=0x7f72100d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.923+0000 7f720f59e640 1 -- 172.21.15.37:0/3782982622 shutdown_connections 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.923+0000 7f720f59e640 1 -- 172.21.15.37:0/3782982622 wait complete. 2023-11-24T06:15:51.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.924+0000 7f720f59e640 1 Processor -- start 2023-11-24T06:15:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.924+0000 7f720f59e640 1 -- start start 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.925+0000 7f720f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72100d0120 0x7f72100cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.925+0000 7f720f59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72100d12e0 0x7f72100c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.925+0000 7f720f59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7210160b00 0x7f72101e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100cb2b0 con 0x7f72100d0120 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720f59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72101ea0f0 con 0x7f72100d12e0 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720f59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100c91a0 con 0x7f7210160b00 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72100d0120 0x7f72100cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72100d0120 0x7f72100cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51018/0 (socket says 172.21.15.37:51018) 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 -- 172.21.15.37:0/1224313645 learned_addr learned my addr 172.21.15.37:0/1224313645 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 -- 172.21.15.37:0/1224313645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7210160b00 msgr2=0x7f72101e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7210160b00 0x7f72101e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720dd9b640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72100d12e0 0x7f72100c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 -- 172.21.15.37:0/1224313645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72100d12e0 msgr2=0x7f72100c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72100d12e0 0x7f72100c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.926+0000 7f720e59c640 1 -- 172.21.15.37:0/1224313645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009400 con 0x7f72100d0120 2023-11-24T06:15:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.927+0000 7f720e59c640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72100d0120 0x7f72100cd0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7200000c00 tx=0x7f72000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.927+0000 7f7206ffd640 1 -- 172.21.15.37:0/1224313645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720003aa60 con 0x7f72100d0120 2023-11-24T06:15:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.927+0000 7f7206ffd640 1 -- 172.21.15.37:0/1224313645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720003abe0 con 0x7f72100d0120 2023-11-24T06:15:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.927+0000 7f7206ffd640 1 -- 172.21.15.37:0/1224313645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000443f0 con 0x7f72100d0120 2023-11-24T06:15:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.927+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72100c9480 con 0x7f72100d0120 2023-11-24T06:15:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.927+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72100c9a40 con 0x7f72100d0120 2023-11-24T06:15:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.928+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721004e840 con 0x7f72100d0120 2023-11-24T06:15:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.929+0000 7f7206ffd640 1 -- 172.21.15.37:0/1224313645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f720004d450 con 0x7f72100d0120 2023-11-24T06:15:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.930+0000 7f7206ffd640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f006ae40 0x7f71f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.931+0000 7f7206ffd640 1 -- 172.21.15.37:0/1224313645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f72000ab8c0 con 0x7f72100d0120 2023-11-24T06:15:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.931+0000 7f720dd9b640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f006ae40 0x7f71f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:51.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.931+0000 7f720dd9b640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f006ae40 0x7f71f006d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f721015ff40 tx=0x7f71f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:51.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:51.935+0000 7f7206ffd640 1 -- 172.21.15.37:0/1224313645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7200076910 con 0x7f72100d0120 2023-11-24T06:15:52.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.135+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72100d10c0 con 0x7f72100d0120 2023-11-24T06:15:52.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.671+0000 7f7206ffd640 1 -- 172.21.15.37:0/1224313645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7200035070 con 0x7f72100d0120 2023-11-24T06:15:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-11-24T06:15:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.675+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f006ae40 msgr2=0x7f71f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.675+0000 7f720f59e640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f006ae40 0x7f71f006d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f721015ff40 tx=0x7f71f8008040 comp rx=0 tx=0).stop 2023-11-24T06:15:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.675+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72100d0120 msgr2=0x7f72100cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.675+0000 7f720f59e640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72100d0120 0x7f72100cd0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7200000c00 tx=0x7f72000046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 shutdown_connections 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f006ae40 0x7f71f006d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72100d12e0 0x7f72100c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7210160b00 0x7f72101e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 --2- 172.21.15.37:0/1224313645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72100d0120 0x7f72100cd0e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 >> 172.21.15.37:0/1224313645 conn(0x7f721009c510 msgr2=0x7f72100d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 shutdown_connections 2023-11-24T06:15:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.676+0000 7f720f59e640 1 -- 172.21.15.37:0/1224313645 wait complete. 2023-11-24T06:15:52.708 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:15:52.708 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:15:52.708 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:15:52.708 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:52.708 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:15:52.709 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:15:52.709 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:15:52.709 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:52.709 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:15:52.709 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:15:52.709 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:15:52.709 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:52.710 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:15:52.710 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:15:52.710 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:15:52.710 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:52.729 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:15:52.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:15:52.731 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:15:52.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:15:52.732 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:15:52.732 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:15:52.733 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:15:52.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:15:52.778 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:15:52.779 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:52.781 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:15:52.781 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:52.785 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:15:52.785 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:52.787 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:15:52.787 DEBUG:teuthology.parallel:result is None 2023-11-24T06:15:52.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:15:52.943 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2023-11-24T06:15:53.024 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-11-24T06:15:53.025 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-11-24T06:15:53.028 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2023-11-24T06:15:53.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.979+0000 7f8e853ec640 1 Processor -- start 2023-11-24T06:15:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.980+0000 7f8e853ec640 1 -- start start 2023-11-24T06:15:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.981+0000 7f8e853ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e8015b440 0x7f8e800cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.981+0000 7f8e853ec640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8e800c59b0 0x7f8e8006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.981+0000 7f8e853ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e800c5dc0 con 0x7f8e800cbf20 2023-11-24T06:15:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.981+0000 7f8e853ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800cc3d0 con 0x7f8e8015b440 2023-11-24T06:15:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.981+0000 7f8e853ec640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8015b820 con 0x7f8e800c59b0 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e8015b440 0x7f8e800cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e77fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8e800cbf20 0x7f8e800c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55042/0 (socket says 172.21.15.37:55042) 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e77fff640 1 -- 172.21.15.37:0/354907493 learned_addr learned my addr 172.21.15.37:0/354907493 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7f7fe640 1 --2- 172.21.15.37:0/354907493 >> v2:172.21.15.188:3300/0 conn(0x7f8e800c59b0 0x7f8e8006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7e7fc640 1 -- 172.21.15.37:0/354907493 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867623824 0 0) 0x7f8e800c5dc0 con 0x7f8e800cbf20 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7e7fc640 1 -- 172.21.15.37:0/354907493 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e6c003520 con 0x7f8e800cbf20 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7effd640 1 -- 172.21.15.37:0/354907493 >> v2:172.21.15.188:3300/0 conn(0x7f8e800c59b0 msgr2=0x7f8e8006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7effd640 1 --2- 172.21.15.37:0/354907493 >> v2:172.21.15.188:3300/0 conn(0x7f8e800c59b0 0x7f8e8006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7effd640 1 -- 172.21.15.37:0/354907493 >> v1:172.21.15.37:6789/0 conn(0x7f8e800cbf20 legacy=0x7f8e800c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.982+0000 7f8e7effd640 1 -- 172.21.15.37:0/354907493 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8015eea0 con 0x7f8e8015b440 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.983+0000 7f8e7effd640 1 --2- 172.21.15.37:0/354907493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e8015b440 0x7f8e800cb9e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8e800cb910 tx=0x7f8e7002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203f7470caedde65 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.983+0000 7f8e7e7fc640 1 -- 172.21.15.37:0/354907493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7002e070 con 0x7f8e8015b440 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e7e7fc640 1 -- 172.21.15.37:0/354907493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e700315a0 con 0x7f8e8015b440 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e7e7fc640 1 -- 172.21.15.37:0/354907493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70031930 con 0x7f8e8015b440 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 -- 172.21.15.37:0/354907493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e8015b440 msgr2=0x7f8e800cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 --2- 172.21.15.37:0/354907493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e8015b440 0x7f8e800cb9e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8e800cb910 tx=0x7f8e7002b840 comp rx=0 tx=0).stop 2023-11-24T06:15:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 -- 172.21.15.37:0/354907493 shutdown_connections 2023-11-24T06:15:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 --2- 172.21.15.37:0/354907493 >> v2:172.21.15.188:3300/0 conn(0x7f8e800c59b0 0x7f8e8006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 --2- 172.21.15.37:0/354907493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e8015b440 0x7f8e800cb9e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 -- 172.21.15.37:0/354907493 >> 172.21.15.37:0/354907493 conn(0x7f8e800b0c50 msgr2=0x7f8e800b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 -- 172.21.15.37:0/354907493 shutdown_connections 2023-11-24T06:15:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.984+0000 7f8e853ec640 1 -- 172.21.15.37:0/354907493 wait complete. 2023-11-24T06:15:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.986+0000 7f8e853ec640 1 Processor -- start 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.986+0000 7f8e853ec640 1 -- start start 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e853ec640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e800c59b0 0x7f8e801f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e853ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800cbf20 0x7f8e80156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e853ec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8015b440 0x7f8e8009b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e853ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8009cff0 con 0x7f8e800cbf20 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e853ec640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8009aa70 con 0x7f8e8015b440 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e853ec640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800999d0 con 0x7f8e800c59b0 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800cbf20 0x7f8e80156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800cbf20 0x7f8e80156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51058/0 (socket says 172.21.15.37:51058) 2023-11-24T06:15:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e77fff640 1 -- 172.21.15.37:0/89428267 learned_addr learned my addr 172.21.15.37:0/89428267 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.987+0000 7f8e7f7fe640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8015b440 0x7f8e8009b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e7effd640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e800c59b0 0x7f8e801f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e77fff640 1 -- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e800c59b0 msgr2=0x7f8e801f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e77fff640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e800c59b0 0x7f8e801f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e77fff640 1 -- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8015b440 msgr2=0x7f8e8009b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e77fff640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8015b440 0x7f8e8009b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e77fff640 1 -- 172.21.15.37:0/89428267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e70009400 con 0x7f8e800cbf20 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e7effd640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e800c59b0 0x7f8e801f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.988+0000 7f8e77fff640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800cbf20 0x7f8e80156ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c500 tx=0x7f8e6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.989+0000 7f8e777fe640 1 -- 172.21.15.37:0/89428267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68005ce0 con 0x7f8e800cbf20 2023-11-24T06:15:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.989+0000 7f8e777fe640 1 -- 172.21.15.37:0/89428267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68005e40 con 0x7f8e800cbf20 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.989+0000 7f8e777fe640 1 -- 172.21.15.37:0/89428267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68007330 con 0x7f8e800cbf20 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.989+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e80099cb0 con 0x7f8e800cbf20 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.989+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8009a270 con 0x7f8e800cbf20 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.990+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8004e8b0 con 0x7f8e800cbf20 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.991+0000 7f8e777fe640 1 -- 172.21.15.37:0/89428267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e68007550 con 0x7f8e800cbf20 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.992+0000 7f8e777fe640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e6006ae40 0x7f8e6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.992+0000 7f8e777fe640 1 -- 172.21.15.37:0/89428267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e68088870 con 0x7f8e800cbf20 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.992+0000 7f8e7effd640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e6006ae40 0x7f8e6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.993+0000 7f8e7effd640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e6006ae40 0x7f8e6006d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e70036000 tx=0x7f8e7003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:52.997+0000 7f8e777fe640 1 -- 172.21.15.37:0/89428267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e68053e20 con 0x7f8e800cbf20 2023-11-24T06:15:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.201+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8e8006dc80 con 0x7f8e800cbf20 2023-11-24T06:15:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.709+0000 7f8e777fe640 1 -- 172.21.15.37:0/89428267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8e68017020 con 0x7f8e800cbf20 2023-11-24T06:15:53.712 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-11-24T06:15:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.714+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e6006ae40 msgr2=0x7f8e6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.714+0000 7f8e853ec640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e6006ae40 0x7f8e6006d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e70036000 tx=0x7f8e7003d040 comp rx=0 tx=0).stop 2023-11-24T06:15:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.714+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800cbf20 msgr2=0x7f8e80156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.714+0000 7f8e853ec640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800cbf20 0x7f8e80156ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c500 tx=0x7f8e6800c9c0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 shutdown_connections 2023-11-24T06:15:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e6006ae40 0x7f8e6006d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8015b440 0x7f8e8009b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800cbf20 0x7f8e80156ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 --2- 172.21.15.37:0/89428267 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e800c59b0 0x7f8e801f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 >> 172.21.15.37:0/89428267 conn(0x7f8e800b0c50 msgr2=0x7f8e8006c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 shutdown_connections 2023-11-24T06:15:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.715+0000 7f8e853ec640 1 -- 172.21.15.37:0/89428267 wait complete. 2023-11-24T06:15:53.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:15:53.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.954+0000 7f80d7b2c640 1 Processor -- start 2023-11-24T06:15:53.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.954+0000 7f80d7b2c640 1 -- start start 2023-11-24T06:15:53.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.956+0000 7f80d7b2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80d015b5e0 0x7f80d00b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.956+0000 7f80d7b2c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f80d00abf50 0x7f80d00b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.956+0000 7f80d7b2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d00711e0 con 0x7f80d00ccea0 2023-11-24T06:15:53.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.956+0000 7f80d7b2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d00b4540 con 0x7f80d015b5e0 2023-11-24T06:15:53.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.956+0000 7f80d7b2c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d00cdc80 con 0x7f80d00abf50 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.956+0000 7f80d58c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80d015b5e0 0x7f80d00b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.956+0000 7f80d60c9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f80d00ccea0 0x7f80d015f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55046/0 (socket says 172.21.15.37:55046) 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d60c9640 1 -- 172.21.15.37:0/3191511301 learned_addr learned my addr 172.21.15.37:0/3191511301 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d50c7640 1 --2- 172.21.15.37:0/3191511301 >> v2:172.21.15.188:3300/0 conn(0x7f80d00abf50 0x7f80d00b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d58c8640 1 -- 172.21.15.37:0/3191511301 >> v2:172.21.15.188:3300/0 conn(0x7f80d00abf50 msgr2=0x7f80d00b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d58c8640 1 --2- 172.21.15.37:0/3191511301 >> v2:172.21.15.188:3300/0 conn(0x7f80d00abf50 0x7f80d00b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d58c8640 1 -- 172.21.15.37:0/3191511301 >> v1:172.21.15.37:6789/0 conn(0x7f80d00ccea0 legacy=0x7f80d015f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d48c6640 1 -- 172.21.15.37:0/3191511301 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88545436 0 0) 0x7f80d00711e0 con 0x7f80d00ccea0 2023-11-24T06:15:53.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d58c8640 1 -- 172.21.15.37:0/3191511301 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d00705d0 con 0x7f80d015b5e0 2023-11-24T06:15:53.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.957+0000 7f80d50c7640 1 --2- 172.21.15.37:0/3191511301 >> v2:172.21.15.188:3300/0 conn(0x7f80d00abf50 0x7f80d00b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.958+0000 7f80d58c8640 1 --2- 172.21.15.37:0/3191511301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d00b3010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f80d006f8d0 tx=0x7f80cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1506b87c8481e53 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d48c6640 1 -- 172.21.15.37:0/3191511301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc031830 con 0x7f80d015b5e0 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d48c6640 1 -- 172.21.15.37:0/3191511301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc031990 con 0x7f80d015b5e0 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d48c6640 1 -- 172.21.15.37:0/3191511301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc031d20 con 0x7f80d015b5e0 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 -- 172.21.15.37:0/3191511301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 msgr2=0x7f80d00b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/3191511301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d00b3010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f80d006f8d0 tx=0x7f80cc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 -- 172.21.15.37:0/3191511301 shutdown_connections 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/3191511301 >> v2:172.21.15.188:3300/0 conn(0x7f80d00abf50 0x7f80d00b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/3191511301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d00b3010 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 -- 172.21.15.37:0/3191511301 >> 172.21.15.37:0/3191511301 conn(0x7f80d00b0c70 msgr2=0x7f80d00b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:53.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 -- 172.21.15.37:0/3191511301 shutdown_connections 2023-11-24T06:15:53.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.959+0000 7f80d7b2c640 1 -- 172.21.15.37:0/3191511301 wait complete. 2023-11-24T06:15:53.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.961+0000 7f80d7b2c640 1 Processor -- start 2023-11-24T06:15:53.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.961+0000 7f80d7b2c640 1 -- start start 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.962+0000 7f80d7b2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80d00abf50 0x7f80d0153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.962+0000 7f80d7b2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80d00ccea0 0x7f80d01f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.962+0000 7f80d7b2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.962+0000 7f80d7b2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d014f140 con 0x7f80d015b5e0 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.962+0000 7f80d7b2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d01f3280 con 0x7f80d00ccea0 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.962+0000 7f80d7b2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d014c9b0 con 0x7f80d00abf50 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51074/0 (socket says 172.21.15.37:51074) 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 -- 172.21.15.37:0/4231461917 learned_addr learned my addr 172.21.15.37:0/4231461917 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d58c8640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80d00abf50 0x7f80d0153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d50c7640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80d00ccea0 0x7f80d01f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 -- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80d00abf50 msgr2=0x7f80d0153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80d00abf50 0x7f80d0153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 -- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80d00ccea0 msgr2=0x7f80d01f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:53.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80d00ccea0 0x7f80d01f2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:53.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d60c9640 1 -- 172.21.15.37:0/4231461917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc009400 con 0x7f80d015b5e0 2023-11-24T06:15:53.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.963+0000 7f80d50c7640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80d00ccea0 0x7f80d01f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.964+0000 7f80d60c9640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d014c1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f80c800c810 tx=0x7f80c800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.964+0000 7f80c67fc640 1 -- 172.21.15.37:0/4231461917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800a640 con 0x7f80d015b5e0 2023-11-24T06:15:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.964+0000 7f80c67fc640 1 -- 172.21.15.37:0/4231461917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800a7c0 con 0x7f80d015b5e0 2023-11-24T06:15:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.964+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d014e850 con 0x7f80d015b5e0 2023-11-24T06:15:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.964+0000 7f80c67fc640 1 -- 172.21.15.37:0/4231461917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800ab70 con 0x7f80d015b5e0 2023-11-24T06:15:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.964+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d014eaf0 con 0x7f80d015b5e0 2023-11-24T06:15:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.965+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d014f2f0 con 0x7f80d015b5e0 2023-11-24T06:15:53.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.966+0000 7f80c67fc640 1 -- 172.21.15.37:0/4231461917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80c800acd0 con 0x7f80d015b5e0 2023-11-24T06:15:53.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.967+0000 7f80c67fc640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f80b406ae40 0x7f80b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:53.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.967+0000 7f80c67fc640 1 -- 172.21.15.37:0/4231461917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80c8088b50 con 0x7f80d015b5e0 2023-11-24T06:15:53.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.967+0000 7f80d58c8640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f80b406ae40 0x7f80b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:53.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.968+0000 7f80d58c8640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f80b406ae40 0x7f80b406d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80cc036000 tx=0x7f80cc03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:53.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:53.971+0000 7f80c67fc640 1 -- 172.21.15.37:0/4231461917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80d014f2f0 con 0x7f80d015b5e0 2023-11-24T06:15:54.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.234+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f80d014f2f0 con 0x7f80d015b5e0 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.235+0000 7f80c67fc640 1 -- 172.21.15.37:0/4231461917 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v3) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f80d014f2f0 con 0x7f80d015b5e0 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlgknvDhAAb5FktSscZfBXGBuKWouBXA==", 2023-11-24T06:15:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlJjg6MhAANLI6BPtnpgIn9G0CEPxTVQ==", 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2Bl9wrhIBAAp1rkuZvYeDseCqvLIHzS3g==", 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:15:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlurVTBxAAgadZStT24OMDy63I86vTUA==", 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdP2Blh/MmBRAAwJHTQ1wwlmIGG8B26AeHJw==", 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAgP2BlWl7zIBAAat/1A8KGpPpqC1cmaGGN6g==", 2023-11-24T06:15:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAjP2Bl4Rk7OxAAJ86tWyBRTgnF5nyjFqTOKA==", 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAnP2BlpK9fGRAANr9PMAxN1uBbcKllLiUluA==", 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAuP2Bl1izGHxAAXjn5+EnnFQOnKxiuDeg1Ug==", 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAxP2BlSpciKRAAG5p7jzKUX0CDLhPbPGpV2g==", 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1P2BlTZUKBxAAYSXZ0hoJrqzN5I6NkT4RrA==", 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA4P2Bluo2REBAAnUZSYi+3ENutNfPVGxF8oQ==", 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-11-24T06:15:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA==", 2023-11-24T06:15:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:15:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlhpPeLBAA+FETlJwFxw/Un58VF8KxtQ==", 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:15:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlLSTWIRAAntWBgOa+b6RFdEH4Jb9BjQ==", 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlIx2bNxAASM7PdeBoVMXV+iLedKvdfA==", 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-11-24T06:15:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAWP2BlJBINARAAYuCFdJsu598989ZBCaK/Xw==", 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBBP2Bl5U0qJRAAgu/8fHRmYZuMgr9pp/lrXQ==", 2023-11-24T06:15:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBBP2BljlkqJRAAMMrPie2ZF9sp2634cC4/EQ==", 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-11-24T06:15:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBBP2BlKGIqJRAAw9MGUp3rHM7zIZc0xhzsMA==", 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBBP2BlnGoqJRAAmMf29NRLlCHgwDmNoKopmA==", 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBBP2BlKnYqJRAASK8n1MIbaKGHxNGSm1g+Sg==", 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBBP2BlDX8qJRAAYTVEWMWdZlq6wVjfe+vI2A==", 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T06:15:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlCBlAAhAATR60ipjSv9JZI4d7vH8t9Q==", 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAWP2Bl+PLrMhAA6Gc/HfKd/LAjoPsOGI1O6w==", 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-11-24T06:15:54.259 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:15:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f80b406ae40 msgr2=0x7f80b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f80b406ae40 0x7f80b406d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f80cc036000 tx=0x7f80cc03c040 comp rx=0 tx=0).stop 2023-11-24T06:15:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 msgr2=0x7f80d014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d014c1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f80c800c810 tx=0x7f80c800ccd0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 shutdown_connections 2023-11-24T06:15:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f80b406ae40 0x7f80b406d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80d00ccea0 0x7f80d01f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d015b5e0 0x7f80d014c1a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 --2- 172.21.15.37:0/4231461917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80d00abf50 0x7f80d0153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 >> 172.21.15.37:0/4231461917 conn(0x7f80d00b0c70 msgr2=0x7f80d00aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 shutdown_connections 2023-11-24T06:15:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.238+0000 7f80d7b2c640 1 -- 172.21.15.37:0/4231461917 wait complete. 2023-11-24T06:15:54.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T06:15:54.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.490+0000 7f2811727640 1 Processor -- start 2023-11-24T06:15:54.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.490+0000 7f2811727640 1 -- start start 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2811727640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2811727640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f280c15d7b0 0x7f280c13da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2811727640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c13d140 con 0x7f280c0cf480 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2811727640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c15a700 con 0x7f280c15d7b0 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2811727640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15b190 con 0x7f280c0b25d0 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2810f26640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f280c15d7b0 0x7f280c13da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2810f26640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f280c15d7b0 0x7f280c13da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51088/0 (socket says 172.21.15.37:51088) 2023-11-24T06:15:54.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.492+0000 7f2810f26640 1 -- 172.21.15.37:0/210285751 learned_addr learned my addr 172.21.15.37:0/210285751 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:54.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.493+0000 7f280b7fe640 1 --2- 172.21.15.37:0/210285751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:54.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.493+0000 7f2810f26640 1 -- 172.21.15.37:0/210285751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 msgr2=0x7f280c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:54.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.493+0000 7f2810f26640 1 --2- 172.21.15.37:0/210285751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.493+0000 7f2810f26640 1 -- 172.21.15.37:0/210285751 >> v1:172.21.15.188:6789/0 conn(0x7f280c0cf480 legacy=0x7f280c0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:54.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.493+0000 7f2810f26640 1 -- 172.21.15.37:0/210285751 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c15a8f0 con 0x7f280c15d7b0 2023-11-24T06:15:54.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.494+0000 7f2810f26640 1 --2- 172.21.15.37:0/210285751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c13da40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2804009e50 tx=0x7f280402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db62ddbf021047bc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:54.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.495+0000 7f280affd640 1 -- 172.21.15.37:0/210285751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280402cb00 con 0x7f280c15d7b0 2023-11-24T06:15:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.495+0000 7f280affd640 1 -- 172.21.15.37:0/210285751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280402cc60 con 0x7f280c15d7b0 2023-11-24T06:15:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.495+0000 7f280affd640 1 -- 172.21.15.37:0/210285751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040343f0 con 0x7f280c15d7b0 2023-11-24T06:15:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.495+0000 7f2811727640 1 -- 172.21.15.37:0/210285751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 msgr2=0x7f280c13da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:54.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.495+0000 7f2811727640 1 --2- 172.21.15.37:0/210285751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c13da40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2804009e50 tx=0x7f280402bf60 comp rx=0 tx=0).stop 2023-11-24T06:15:54.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.496+0000 7f2811727640 1 -- 172.21.15.37:0/210285751 shutdown_connections 2023-11-24T06:15:54.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.496+0000 7f2811727640 1 --2- 172.21.15.37:0/210285751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c13da40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.496+0000 7f2811727640 1 --2- 172.21.15.37:0/210285751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.496+0000 7f2811727640 1 -- 172.21.15.37:0/210285751 >> 172.21.15.37:0/210285751 conn(0x7f280c06a500 msgr2=0x7f280c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:54.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.496+0000 7f2811727640 1 -- 172.21.15.37:0/210285751 shutdown_connections 2023-11-24T06:15:54.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.496+0000 7f2811727640 1 -- 172.21.15.37:0/210285751 wait complete. 2023-11-24T06:15:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.497+0000 7f2811727640 1 Processor -- start 2023-11-24T06:15:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.498+0000 7f2811727640 1 -- start start 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2811727640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c13c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2811727640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f280c0cf480 0x7f280c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2811727640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2811727640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0ce9a0 con 0x7f280c15d7b0 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2811727640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0ad3f0 con 0x7f280c0cf480 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2811727640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0ad6d0 con 0x7f280c0b25d0 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c1553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51094/0 (socket says 172.21.15.37:51094) 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 -- 172.21.15.37:0/270945630 learned_addr learned my addr 172.21.15.37:0/270945630 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f280bfff640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c13c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f280b7fe640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f280c0cf480 0x7f280c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 -- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 msgr2=0x7f280c13c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c13c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 -- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f280c0cf480 msgr2=0x7f280c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f280c0cf480 0x7f280c159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.499+0000 7f2810f26640 1 -- 172.21.15.37:0/270945630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2804009b30 con 0x7f280c15d7b0 2023-11-24T06:15:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.500+0000 7f2810f26640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c1553f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2804009e50 tx=0x7f2804004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.500+0000 7f2808ff9640 1 -- 172.21.15.37:0/270945630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804009510 con 0x7f280c15d7b0 2023-11-24T06:15:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.500+0000 7f2808ff9640 1 -- 172.21.15.37:0/270945630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280403e450 con 0x7f280c15d7b0 2023-11-24T06:15:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.500+0000 7f2808ff9640 1 -- 172.21.15.37:0/270945630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280403e800 con 0x7f280c15d7b0 2023-11-24T06:15:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.500+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c0ad9b0 con 0x7f280c15d7b0 2023-11-24T06:15:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.500+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c15a130 con 0x7f280c15d7b0 2023-11-24T06:15:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.501+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c0ad250 con 0x7f280c15d7b0 2023-11-24T06:15:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.502+0000 7f2808ff9640 1 -- 172.21.15.37:0/270945630 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f280403e960 con 0x7f280c15d7b0 2023-11-24T06:15:54.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.503+0000 7f2808ff9640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f27f806ae40 0x7f27f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:54.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.503+0000 7f2808ff9640 1 -- 172.21.15.37:0/270945630 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28040ac0e0 con 0x7f280c15d7b0 2023-11-24T06:15:54.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.504+0000 7f280bfff640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f27f806ae40 0x7f27f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.504+0000 7f280bfff640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f27f806ae40 0x7f27f806d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000f60 tx=0x7f27fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.508+0000 7f2808ff9640 1 -- 172.21.15.37:0/270945630 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f280c0ad250 con 0x7f280c15d7b0 2023-11-24T06:15:54.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.777+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f280c0ad250 con 0x7f280c15d7b0 2023-11-24T06:15:54.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.782+0000 7f2808ff9640 1 -- 172.21.15.37:0/270945630 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f280c0ad250 con 0x7f280c15d7b0 2023-11-24T06:15:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f27f806ae40 msgr2=0x7f27f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f27f806ae40 0x7f27f806d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000f60 tx=0x7f27fc009040 comp rx=0 tx=0).stop 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 msgr2=0x7f280c1553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c1553f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2804009e50 tx=0x7f2804004a40 comp rx=0 tx=0).stop 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 shutdown_connections 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f27f806ae40 0x7f27f806d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f280c0cf480 0x7f280c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f280c15d7b0 0x7f280c1553f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 --2- 172.21.15.37:0/270945630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f280c0b25d0 0x7f280c13c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 >> 172.21.15.37:0/270945630 conn(0x7f280c06a500 msgr2=0x7f280c0af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 shutdown_connections 2023-11-24T06:15:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:54.785+0000 7f2811727640 1 -- 172.21.15.37:0/270945630 wait complete. 2023-11-24T06:15:54.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T06:15:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.023+0000 7f8e61621640 1 Processor -- start 2023-11-24T06:15:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.023+0000 7f8e61621640 1 -- start start 2023-11-24T06:15:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.025+0000 7f8e61621640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8e5c0ccfa0 0x7f8e5c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.025+0000 7f8e61621640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0709c0 con 0x7f8e5c154980 2023-11-24T06:15:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.025+0000 7f8e61621640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0b0df0 con 0x7f8e5c072710 2023-11-24T06:15:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.025+0000 7f8e61621640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c15af40 con 0x7f8e5c0ccfa0 2023-11-24T06:15:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.025+0000 7f8e5bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8e5c154980 0x7f8e5c072000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55056/0 (socket says 172.21.15.37:55056) 2023-11-24T06:15:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.025+0000 7f8e5bfff640 1 -- 172.21.15.37:0/3297551977 learned_addr learned my addr 172.21.15.37:0/3297551977 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e60e20640 1 --2- 172.21.15.37:0/3297551977 >> v2:172.21.15.188:3300/0 conn(0x7f8e5c0ccfa0 0x7f8e5c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268273553 0 0) 0x7f8e5c0709c0 con 0x7f8e5c154980 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e48003520 con 0x7f8e5c154980 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3564467360 0 0) 0x7f8e48003520 con 0x7f8e5c154980 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 >> v2:172.21.15.188:3300/0 conn(0x7f8e5c0ccfa0 msgr2=0x7f8e5c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 --2- 172.21.15.37:0/3297551977 >> v2:172.21.15.188:3300/0 conn(0x7f8e5c0ccfa0 0x7f8e5c0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 >> v1:172.21.15.188:6789/0 conn(0x7f8e5c072710 legacy=0x7f8e5c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c15b220 con 0x7f8e5c154980 2023-11-24T06:15:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f8e4c001670 con 0x7f8e5c154980 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.026+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 >> v1:172.21.15.37:6789/0 conn(0x7f8e5c154980 legacy=0x7f8e5c072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e5b7fe640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e480039c0 0x7f8e48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e5b7fe640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e480047c0 0x7f8e48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e5b7fe640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c15af40 con 0x7f8e48005180 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4800c080 con 0x7f8e480039c0 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4800c240 con 0x7f8e480047c0 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e60e20640 1 --2- 172.21.15.37:0/3297551977 >> v2:172.21.15.188:3300/0 conn(0x7f8e5c0ccfa0 0x7f8e5c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e60e20640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e5bfff640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e480039c0 0x7f8e48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e53fff640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e480047c0 0x7f8e48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e60e20640 1 -- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e480047c0 msgr2=0x7f8e48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e60e20640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e480047c0 0x7f8e48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e60e20640 1 -- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e480039c0 msgr2=0x7f8e48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e60e20640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e480039c0 0x7f8e48003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.027+0000 7f8e60e20640 1 -- 172.21.15.37:0/3297551977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48003520 con 0x7f8e48005180 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.028+0000 7f8e60e20640 1 -- 172.21.15.37:0/3297551977 reap_dead start 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.029+0000 7f8e60e20640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e4800b980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400e350 tx=0x7f8e480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68a33f21c8bb97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.029+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5402cde0 con 0x7f8e48005180 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.029+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5400f040 con 0x7f8e48005180 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.029+0000 7f8e5b7fe640 1 -- 172.21.15.37:0/3297551977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54003bd0 con 0x7f8e48005180 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.029+0000 7f8e61621640 1 -- 172.21.15.37:0/3297551977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 msgr2=0x7f8e4800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.029+0000 7f8e61621640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e4800b980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400e350 tx=0x7f8e480057f0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.030+0000 7f8e61621640 1 -- 172.21.15.37:0/3297551977 shutdown_connections 2023-11-24T06:15:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.030+0000 7f8e61621640 1 --2- 172.21.15.37:0/3297551977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e4800b980 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.030+0000 7f8e61621640 1 -- 172.21.15.37:0/3297551977 >> 172.21.15.37:0/3297551977 conn(0x7f8e5c06a500 msgr2=0x7f8e5c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.030+0000 7f8e61621640 1 -- 172.21.15.37:0/3297551977 shutdown_connections 2023-11-24T06:15:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.030+0000 7f8e61621640 1 -- 172.21.15.37:0/3297551977 wait complete. 2023-11-24T06:15:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.032+0000 7f8e61621640 1 Processor -- start 2023-11-24T06:15:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.032+0000 7f8e61621640 1 -- start start 2023-11-24T06:15:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e61621640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e5c13d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e61621640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e5c159660 0x7f8e5c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e61621640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e5c13fd40 0x7f8e5c1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e61621640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c156970 con 0x7f8e48005180 2023-11-24T06:15:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e61621640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c15a020 con 0x7f8e5c159660 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e61621640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1526e0 con 0x7f8e5c13fd40 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e5c13d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e5c13d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51108/0 (socket says 172.21.15.37:51108) 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e5bfff640 1 -- 172.21.15.37:0/3751045222 learned_addr learned my addr 172.21.15.37:0/3751045222 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e53fff640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e5c159660 0x7f8e5c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.033+0000 7f8e60e20640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e5c13fd40 0x7f8e5c1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e5bfff640 1 -- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e5c13fd40 msgr2=0x7f8e5c1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e5bfff640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e5c13fd40 0x7f8e5c1401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e5bfff640 1 -- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e5c159660 msgr2=0x7f8e5c159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e5bfff640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e5c159660 0x7f8e5c159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e5bfff640 1 -- 172.21.15.37:0/3751045222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c140c60 con 0x7f8e48005180 2023-11-24T06:15:55.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e5bfff640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e5c13d450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00e700 tx=0x7f8e4c00eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:55.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e597fa640 1 -- 172.21.15.37:0/3751045222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00c620 con 0x7f8e48005180 2023-11-24T06:15:55.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e597fa640 1 -- 172.21.15.37:0/3751045222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00c7a0 con 0x7f8e48005180 2023-11-24T06:15:55.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e597fa640 1 -- 172.21.15.37:0/3751045222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00cb50 con 0x7f8e48005180 2023-11-24T06:15:55.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c155fd0 con 0x7f8e48005180 2023-11-24T06:15:55.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.034+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c156590 con 0x7f8e48005180 2023-11-24T06:15:55.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.036+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c06ae60 con 0x7f8e48005180 2023-11-24T06:15:55.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.036+0000 7f8e597fa640 1 -- 172.21.15.37:0/3751045222 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e4c00ccb0 con 0x7f8e48005180 2023-11-24T06:15:55.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.037+0000 7f8e597fa640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e3c06ae70 0x7f8e3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.037+0000 7f8e597fa640 1 -- 172.21.15.37:0/3751045222 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e4c088e90 con 0x7f8e48005180 2023-11-24T06:15:55.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.038+0000 7f8e53fff640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e3c06ae70 0x7f8e3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.038+0000 7f8e53fff640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e3c06ae70 0x7f8e3c06d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c152eb0 tx=0x7f8e44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.042+0000 7f8e597fa640 1 -- 172.21.15.37:0/3751045222 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e4c054280 con 0x7f8e48005180 2023-11-24T06:15:55.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.303+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8e5c156ab0 con 0x7f8e48005180 2023-11-24T06:15:55.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.307+0000 7f8e597fa640 1 -- 172.21.15.37:0/3751045222 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8e5c156ab0 con 0x7f8e48005180 2023-11-24T06:15:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e3c06ae70 msgr2=0x7f8e3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e3c06ae70 0x7f8e3c06d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c152eb0 tx=0x7f8e44009040 comp rx=0 tx=0).stop 2023-11-24T06:15:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 msgr2=0x7f8e5c13d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e5c13d450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00e700 tx=0x7f8e4c00eb00 comp rx=0 tx=0).stop 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 shutdown_connections 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8e3c06ae70 0x7f8e3c06d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e5c159660 0x7f8e5c159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e5c13fd40 0x7f8e5c1401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 --2- 172.21.15.37:0/3751045222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e48005180 0x7f8e5c13d450 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.310+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 >> 172.21.15.37:0/3751045222 conn(0x7f8e5c06a500 msgr2=0x7f8e5c0cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.311+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 shutdown_connections 2023-11-24T06:15:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.311+0000 7f8e61621640 1 -- 172.21.15.37:0/3751045222 wait complete. 2023-11-24T06:15:55.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T06:15:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.557+0000 7f1b78d47640 1 Processor -- start 2023-11-24T06:15:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.557+0000 7f1b78d47640 1 -- start start 2023-11-24T06:15:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.559+0000 7f1b78d47640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b7415e620 0x7f1b740ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.559+0000 7f1b78d47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b740ae670 0x7f1b740b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.559+0000 7f1b78d47640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b74072960 con 0x7f1b740b0b50 2023-11-24T06:15:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.559+0000 7f1b78d47640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7415dc10 con 0x7f1b7415e620 2023-11-24T06:15:55.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.559+0000 7f1b78d47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740cb0b0 con 0x7f1b740ae670 2023-11-24T06:15:55.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.560+0000 7f1b72ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b7415e620 0x7f1b740ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.560+0000 7f1b72ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b7415e620 0x7f1b740ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38364/0 (socket says 172.21.15.37:38364) 2023-11-24T06:15:55.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.560+0000 7f1b72ffd640 1 -- 172.21.15.37:0/4229587617 learned_addr learned my addr 172.21.15.37:0/4229587617 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:55.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.560+0000 7f1b73fff640 1 --2- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b740ae670 0x7f1b740b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.561+0000 7f1b72ffd640 1 -- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b740ae670 msgr2=0x7f1b740b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:55.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.561+0000 7f1b72ffd640 1 --2- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b740ae670 0x7f1b740b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.561+0000 7f1b72ffd640 1 -- 172.21.15.37:0/4229587617 >> v1:172.21.15.188:6789/0 conn(0x7f1b740b0b50 legacy=0x7f1b740b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.561+0000 7f1b72ffd640 1 -- 172.21.15.37:0/4229587617 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740cb390 con 0x7f1b7415e620 2023-11-24T06:15:55.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.562+0000 7f1b72ffd640 1 --2- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7415e620 0x7f1b740ae130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009870 tx=0x7f1b6802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b749750992394d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.562+0000 7f1b727fc640 1 -- 172.21.15.37:0/4229587617 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68030840 con 0x7f1b7415e620 2023-11-24T06:15:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.562+0000 7f1b727fc640 1 -- 172.21.15.37:0/4229587617 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b680309a0 con 0x7f1b7415e620 2023-11-24T06:15:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.562+0000 7f1b727fc640 1 -- 172.21.15.37:0/4229587617 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68030d30 con 0x7f1b7415e620 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 -- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7415e620 msgr2=0x7f1b740ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 --2- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7415e620 0x7f1b740ae130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009870 tx=0x7f1b6802b980 comp rx=0 tx=0).stop 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 -- 172.21.15.37:0/4229587617 shutdown_connections 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 --2- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7415e620 0x7f1b740ae130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 --2- 172.21.15.37:0/4229587617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b740ae670 0x7f1b740b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 -- 172.21.15.37:0/4229587617 >> 172.21.15.37:0/4229587617 conn(0x7f1b7406a500 msgr2=0x7f1b7406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 -- 172.21.15.37:0/4229587617 shutdown_connections 2023-11-24T06:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.563+0000 7f1b78d47640 1 -- 172.21.15.37:0/4229587617 wait complete. 2023-11-24T06:15:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.565+0000 7f1b78d47640 1 Processor -- start 2023-11-24T06:15:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.566+0000 7f1b78d47640 1 -- start start 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b78d47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b740ae670 0x7f1b7414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b78d47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740b0b50 0x7f1b74156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b78d47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7415e620 0x7f1b74157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b78d47640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415d200 con 0x7f1b740b0b50 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b78d47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74150fc0 con 0x7f1b740ae670 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b78d47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741512a0 con 0x7f1b7415e620 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740b0b50 0x7f1b74156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740b0b50 0x7f1b74156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51120/0 (socket says 172.21.15.37:51120) 2023-11-24T06:15:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.567+0000 7f1b72ffd640 1 -- 172.21.15.37:0/156737334 learned_addr learned my addr 172.21.15.37:0/156737334 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b73fff640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7415e620 0x7f1b74157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b737fe640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b740ae670 0x7f1b7414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b72ffd640 1 -- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7415e620 msgr2=0x7f1b74157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b72ffd640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7415e620 0x7f1b74157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b72ffd640 1 -- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b740ae670 msgr2=0x7f1b7414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b72ffd640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b740ae670 0x7f1b7414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b72ffd640 1 -- 172.21.15.37:0/156737334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680094d0 con 0x7f1b740b0b50 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b737fe640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b740ae670 0x7f1b7414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.568+0000 7f1b72ffd640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740b0b50 0x7f1b74156f00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1b6802b9c0 tx=0x7f1b680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.569+0000 7f1b5bfff640 1 -- 172.21.15.37:0/156737334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6803e070 con 0x7f1b740b0b50 2023-11-24T06:15:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.569+0000 7f1b5bfff640 1 -- 172.21.15.37:0/156737334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b68039a10 con 0x7f1b740b0b50 2023-11-24T06:15:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.569+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74151580 con 0x7f1b740b0b50 2023-11-24T06:15:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.569+0000 7f1b5bfff640 1 -- 172.21.15.37:0/156737334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68039de0 con 0x7f1b740b0b50 2023-11-24T06:15:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.569+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7414ced0 con 0x7f1b740b0b50 2023-11-24T06:15:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.570+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7404e840 con 0x7f1b740b0b50 2023-11-24T06:15:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.571+0000 7f1b5bfff640 1 -- 172.21.15.37:0/156737334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b6804b400 con 0x7f1b740b0b50 2023-11-24T06:15:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.572+0000 7f1b5bfff640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b6006ae40 0x7f1b6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.572+0000 7f1b5bfff640 1 -- 172.21.15.37:0/156737334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1b680ab830 con 0x7f1b740b0b50 2023-11-24T06:15:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.572+0000 7f1b737fe640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b6006ae40 0x7f1b6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.573+0000 7f1b737fe640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b6006ae40 0x7f1b6006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b64000f60 tx=0x7f1b64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.576+0000 7f1b5bfff640 1 -- 172.21.15.37:0/156737334 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b68076c30 con 0x7f1b740b0b50 2023-11-24T06:15:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.835+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1b740ac970 con 0x7f1b740b0b50 2023-11-24T06:15:55.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.839+0000 7f1b5bfff640 1 -- 172.21.15.37:0/156737334 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1b680340a0 con 0x7f1b740b0b50 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b6006ae40 msgr2=0x7f1b6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b6006ae40 0x7f1b6006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b64000f60 tx=0x7f1b64009040 comp rx=0 tx=0).stop 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740b0b50 msgr2=0x7f1b74156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740b0b50 0x7f1b74156f00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1b6802b9c0 tx=0x7f1b680046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 shutdown_connections 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b6006ae40 0x7f1b6006d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7415e620 0x7f1b74157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740b0b50 0x7f1b74156f00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 --2- 172.21.15.37:0/156737334 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b740ae670 0x7f1b7414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 >> 172.21.15.37:0/156737334 conn(0x7f1b7406a500 msgr2=0x7f1b740cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 shutdown_connections 2023-11-24T06:15:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:55.842+0000 7f1b78d47640 1 -- 172.21.15.37:0/156737334 wait complete. 2023-11-24T06:15:55.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T06:15:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.077+0000 7fb9fec91640 1 Processor -- start 2023-11-24T06:15:56.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.077+0000 7fb9fec91640 1 -- start start 2023-11-24T06:15:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.078+0000 7fb9fec91640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f815d5c0 0x7fb9f80b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.078+0000 7fb9fec91640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9f80d1610 0x7fb9f80d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fec91640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb9f80d06e0 0x7fb9f80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fec91640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80d0b50 con 0x7fb9f80d1610 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fec91640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80d1d80 con 0x7fb9f80d06e0 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fec91640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80d2060 con 0x7fb9f815d5c0 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fd48e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9f80d1610 0x7fb9f80d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fd48e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9f80d1610 0x7fb9f80d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51136/0 (socket says 172.21.15.37:51136) 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fd48e640 1 -- 172.21.15.37:0/3369680952 learned_addr learned my addr 172.21.15.37:0/3369680952 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fdc8f640 1 --2- 172.21.15.37:0/3369680952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f815d5c0 0x7fb9f80b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.079+0000 7fb9fe490640 1 --2- 172.21.15.37:0/3369680952 >> v2:172.21.15.188:3300/0 conn(0x7fb9f80d06e0 0x7fb9f80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.080+0000 7fb9fd48e640 1 -- 172.21.15.37:0/3369680952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f815d5c0 msgr2=0x7fb9f80b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.080+0000 7fb9fd48e640 1 --2- 172.21.15.37:0/3369680952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f815d5c0 0x7fb9f80b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.080+0000 7fb9fd48e640 1 -- 172.21.15.37:0/3369680952 >> v2:172.21.15.188:3300/0 conn(0x7fb9f80d06e0 msgr2=0x7fb9f80b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.080+0000 7fb9fd48e640 1 --2- 172.21.15.37:0/3369680952 >> v2:172.21.15.188:3300/0 conn(0x7fb9f80d06e0 0x7fb9f80b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.080+0000 7fb9fd48e640 1 -- 172.21.15.37:0/3369680952 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80d2340 con 0x7fb9f80d1610 2023-11-24T06:15:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.081+0000 7fb9fd48e640 1 --2- 172.21.15.37:0/3369680952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f80d1610 0x7fb9f80d01a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb9f808c530 tx=0x7fb9ec02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90b5e3aee84ccc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.081+0000 7fb9fcc8d640 1 -- 172.21.15.37:0/3369680952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0317d0 con 0x7fb9f80d1610 2023-11-24T06:15:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.081+0000 7fb9fcc8d640 1 -- 172.21.15.37:0/3369680952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec031930 con 0x7fb9f80d1610 2023-11-24T06:15:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.081+0000 7fb9fcc8d640 1 -- 172.21.15.37:0/3369680952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec031cc0 con 0x7fb9f80d1610 2023-11-24T06:15:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 -- 172.21.15.37:0/3369680952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f80d1610 msgr2=0x7fb9f80d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 --2- 172.21.15.37:0/3369680952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f80d1610 0x7fb9f80d01a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb9f808c530 tx=0x7fb9ec02b870 comp rx=0 tx=0).stop 2023-11-24T06:15:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 -- 172.21.15.37:0/3369680952 shutdown_connections 2023-11-24T06:15:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 --2- 172.21.15.37:0/3369680952 >> v2:172.21.15.188:3300/0 conn(0x7fb9f80d06e0 0x7fb9f80b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 --2- 172.21.15.37:0/3369680952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f80d1610 0x7fb9f80d01a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 --2- 172.21.15.37:0/3369680952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f815d5c0 0x7fb9f80b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 -- 172.21.15.37:0/3369680952 >> 172.21.15.37:0/3369680952 conn(0x7fb9f8061310 msgr2=0x7fb9f8061720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 -- 172.21.15.37:0/3369680952 shutdown_connections 2023-11-24T06:15:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.082+0000 7fb9fec91640 1 -- 172.21.15.37:0/3369680952 wait complete. 2023-11-24T06:15:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.084+0000 7fb9fec91640 1 Processor -- start 2023-11-24T06:15:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.084+0000 7fb9fec91640 1 -- start start 2023-11-24T06:15:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fec91640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f80d06e0 0x7fb9f80cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fec91640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9f80d1610 0x7fb9f80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fec91640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f815d5c0 0x7fb9f81592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fec91640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80b2290 con 0x7fb9f815d5c0 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fec91640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80ca310 con 0x7fb9f80d1610 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fec91640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80c9b70 con 0x7fb9f80d06e0 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f815d5c0 0x7fb9f81592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f815d5c0 0x7fb9f81592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51146/0 (socket says 172.21.15.37:51146) 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 -- 172.21.15.37:0/779885389 learned_addr learned my addr 172.21.15.37:0/779885389 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 -- 172.21.15.37:0/779885389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f80d06e0 msgr2=0x7fb9f80cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f80d06e0 0x7fb9f80cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 -- 172.21.15.37:0/779885389 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9f80d1610 msgr2=0x7fb9f80c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9f80d1610 0x7fb9f80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.085+0000 7fb9fe490640 1 -- 172.21.15.37:0/779885389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0094d0 con 0x7fb9f815d5c0 2023-11-24T06:15:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.086+0000 7fb9fe490640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f815d5c0 0x7fb9f81592f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000d5d0 tx=0x7fb9f000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.086+0000 7fb9f67fc640 1 -- 172.21.15.37:0/779885389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0014620 con 0x7fb9f815d5c0 2023-11-24T06:15:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.086+0000 7fb9f67fc640 1 -- 172.21.15.37:0/779885389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f00147a0 con 0x7fb9f815d5c0 2023-11-24T06:15:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.086+0000 7fb9f67fc640 1 -- 172.21.15.37:0/779885389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0014b50 con 0x7fb9f815d5c0 2023-11-24T06:15:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.086+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f80ce0f0 con 0x7fb9f815d5c0 2023-11-24T06:15:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.086+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f80ca520 con 0x7fb9f815d5c0 2023-11-24T06:15:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.088+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f804e840 con 0x7fb9f815d5c0 2023-11-24T06:15:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.088+0000 7fb9f67fc640 1 -- 172.21.15.37:0/779885389 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9f0014cb0 con 0x7fb9f815d5c0 2023-11-24T06:15:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.089+0000 7fb9f67fc640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9e406ae40 0x7fb9e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.089+0000 7fb9f67fc640 1 -- 172.21.15.37:0/779885389 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9f0089740 con 0x7fb9f815d5c0 2023-11-24T06:15:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.090+0000 7fb9fdc8f640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9e406ae40 0x7fb9e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.090+0000 7fb9fdc8f640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9e406ae40 0x7fb9e406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80070b0 tx=0x7fb9e8007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.094+0000 7fb9f67fc640 1 -- 172.21.15.37:0/779885389 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9f0054a10 con 0x7fb9f815d5c0 2023-11-24T06:15:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.358+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb9f806a500 con 0x7fb9f815d5c0 2023-11-24T06:15:56.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.363+0000 7fb9f67fc640 1 -- 172.21.15.37:0/779885389 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb9f00180a0 con 0x7fb9f815d5c0 2023-11-24T06:15:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9e406ae40 msgr2=0x7fb9e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9e406ae40 0x7fb9e406d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80070b0 tx=0x7fb9e8007040 comp rx=0 tx=0).stop 2023-11-24T06:15:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f815d5c0 msgr2=0x7fb9f81592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f815d5c0 0x7fb9f81592f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000d5d0 tx=0x7fb9f000da90 comp rx=0 tx=0).stop 2023-11-24T06:15:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 shutdown_connections 2023-11-24T06:15:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9e406ae40 0x7fb9e406d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9f80d1610 0x7fb9f80c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9f815d5c0 0x7fb9f81592f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 --2- 172.21.15.37:0/779885389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9f80d06e0 0x7fb9f80cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.365+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 >> 172.21.15.37:0/779885389 conn(0x7fb9f8061310 msgr2=0x7fb9f80b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:56.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.366+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 shutdown_connections 2023-11-24T06:15:56.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.366+0000 7fb9fec91640 1 -- 172.21.15.37:0/779885389 wait complete. 2023-11-24T06:15:56.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T06:15:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.614+0000 7f064b08c640 1 Processor -- start 2023-11-24T06:15:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.615+0000 7f064b08c640 1 -- start start 2023-11-24T06:15:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.616+0000 7f064b08c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f064415d490 0x7f06440cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.616+0000 7f064b08c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06440b63d0 0x7f06440d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.616+0000 7f064b08c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06440cea30 con 0x7f06440ce270 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.616+0000 7f064b08c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06440d0450 con 0x7f064415d490 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.616+0000 7f064b08c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06440d0bf0 con 0x7f06440b63d0 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.616+0000 7f064a08a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f064415d490 0x7f06440cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.616+0000 7f064a88b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06440ce270 0x7f0644160e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55060/0 (socket says 172.21.15.37:55060) 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.617+0000 7f064a88b640 1 -- 172.21.15.37:0/2362865747 learned_addr learned my addr 172.21.15.37:0/2362865747 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.617+0000 7f0649889640 1 --2- 172.21.15.37:0/2362865747 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06440b63d0 0x7f06440d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.617+0000 7f064a08a640 1 -- 172.21.15.37:0/2362865747 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06440b63d0 msgr2=0x7f06440d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.617+0000 7f064a08a640 1 --2- 172.21.15.37:0/2362865747 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06440b63d0 0x7f06440d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.617+0000 7f064a08a640 1 -- 172.21.15.37:0/2362865747 >> v1:172.21.15.37:6789/0 conn(0x7f06440ce270 legacy=0x7f0644160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.617+0000 7f064a08a640 1 -- 172.21.15.37:0/2362865747 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440d2260 con 0x7f064415d490 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.618+0000 7f064a08a640 1 --2- 172.21.15.37:0/2362865747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064415d490 0x7f06440cd8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f06400097a0 tx=0x7f064002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c51e7c7394de7f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.618+0000 7f0649088640 1 -- 172.21.15.37:0/2362865747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064002d040 con 0x7f064415d490 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.618+0000 7f0649088640 1 -- 172.21.15.37:0/2362865747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0640031810 con 0x7f064415d490 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.618+0000 7f0649088640 1 -- 172.21.15.37:0/2362865747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640031ba0 con 0x7f064415d490 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 -- 172.21.15.37:0/2362865747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064415d490 msgr2=0x7f06440cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 --2- 172.21.15.37:0/2362865747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064415d490 0x7f06440cd8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f06400097a0 tx=0x7f064002b8b0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 -- 172.21.15.37:0/2362865747 shutdown_connections 2023-11-24T06:15:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 --2- 172.21.15.37:0/2362865747 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06440b63d0 0x7f06440d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 --2- 172.21.15.37:0/2362865747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f064415d490 0x7f06440cd8f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 -- 172.21.15.37:0/2362865747 >> 172.21.15.37:0/2362865747 conn(0x7f0644061340 msgr2=0x7f0644061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 -- 172.21.15.37:0/2362865747 shutdown_connections 2023-11-24T06:15:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.619+0000 7f064b08c640 1 -- 172.21.15.37:0/2362865747 wait complete. 2023-11-24T06:15:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.621+0000 7f064b08c640 1 Processor -- start 2023-11-24T06:15:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.621+0000 7f064b08c640 1 -- start start 2023-11-24T06:15:56.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064b08c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06440ce270 0x7f0644151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064b08c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064415d490 0x7f06441611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064b08c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0644161730 0x7f06440c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064b08c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06440cbe70 con 0x7f06440ce270 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064b08c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644161bc0 con 0x7f0644161730 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064b08c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06440ca370 con 0x7f064415d490 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064a08a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06440ce270 0x7f0644151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064a08a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06440ce270 0x7f0644151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51160/0 (socket says 172.21.15.37:51160) 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.622+0000 7f064a08a640 1 -- 172.21.15.37:0/3193454991 learned_addr learned my addr 172.21.15.37:0/3193454991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f064a08a640 1 -- 172.21.15.37:0/3193454991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064415d490 msgr2=0x7f06441611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f064a08a640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064415d490 0x7f06441611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f064a08a640 1 -- 172.21.15.37:0/3193454991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0644161730 msgr2=0x7f06440c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f064a08a640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0644161730 0x7f06440c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f064a08a640 1 -- 172.21.15.37:0/3193454991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640009400 con 0x7f06440ce270 2023-11-24T06:15:56.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f064a08a640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06440ce270 0x7f0644151690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f06400098c0 tx=0x7f06400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f063affd640 1 -- 172.21.15.37:0/3193454991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064003ad60 con 0x7f06440ce270 2023-11-24T06:15:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f063affd640 1 -- 172.21.15.37:0/3193454991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06400423f0 con 0x7f06440ce270 2023-11-24T06:15:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f063affd640 1 -- 172.21.15.37:0/3193454991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06400427a0 con 0x7f06440ce270 2023-11-24T06:15:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.623+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06440caef0 con 0x7f06440ce270 2023-11-24T06:15:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.624+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06440ca8a0 con 0x7f06440ce270 2023-11-24T06:15:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.625+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064404e840 con 0x7f06440ce270 2023-11-24T06:15:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.626+0000 7f063affd640 1 -- 172.21.15.37:0/3193454991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06400393b0 con 0x7f06440ce270 2023-11-24T06:15:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.626+0000 7f063affd640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f062806ae40 0x7f062806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.627+0000 7f063affd640 1 -- 172.21.15.37:0/3193454991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06400aaf80 con 0x7f06440ce270 2023-11-24T06:15:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.627+0000 7f0649889640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f062806ae40 0x7f062806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.627+0000 7f0649889640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f062806ae40 0x7f062806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06440b6ae0 tx=0x7f0634008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:56.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.631+0000 7f063affd640 1 -- 172.21.15.37:0/3193454991 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0640076370 con 0x7f06440ce270 2023-11-24T06:15:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.901+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f064415c0f0 con 0x7f06440ce270 2023-11-24T06:15:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.906+0000 7f063affd640 1 -- 172.21.15.37:0/3193454991 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0640079990 con 0x7f06440ce270 2023-11-24T06:15:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f062806ae40 msgr2=0x7f062806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f062806ae40 0x7f062806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06440b6ae0 tx=0x7f0634008040 comp rx=0 tx=0).stop 2023-11-24T06:15:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06440ce270 msgr2=0x7f0644151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06440ce270 0x7f0644151690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f06400098c0 tx=0x7f06400046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 shutdown_connections 2023-11-24T06:15:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f062806ae40 0x7f062806d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0644161730 0x7f06440c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064415d490 0x7f06441611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 --2- 172.21.15.37:0/3193454991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06440ce270 0x7f0644151690 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 >> 172.21.15.37:0/3193454991 conn(0x7f0644061340 msgr2=0x7f06440b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.909+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 shutdown_connections 2023-11-24T06:15:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:56.910+0000 7f064b08c640 1 -- 172.21.15.37:0/3193454991 wait complete. 2023-11-24T06:15:56.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T06:15:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.150+0000 7fba2167c640 1 Processor -- start 2023-11-24T06:15:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.150+0000 7fba2167c640 1 -- start start 2023-11-24T06:15:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.152+0000 7fba2167c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.152+0000 7fba2167c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fba1c15b320 0x7fba1c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.152+0000 7fba2167c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c15e8b0 con 0x7fba1c070c40 2023-11-24T06:15:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.152+0000 7fba2167c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c15eb90 con 0x7fba1c15b320 2023-11-24T06:15:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.152+0000 7fba2167c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15e6a0 con 0x7fba1c15af40 2023-11-24T06:15:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.153+0000 7fba1affd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.153+0000 7fba13fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fba1c15b320 0x7fba1c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.153+0000 7fba13fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fba1c15b320 0x7fba1c0ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38390/0 (socket says 172.21.15.37:38390) 2023-11-24T06:15:57.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.153+0000 7fba13fff640 1 -- 172.21.15.37:0/1165621172 learned_addr learned my addr 172.21.15.37:0/1165621172 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:57.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.153+0000 7fba1affd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c06d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:43854/0 (socket says 172.21.15.37:43854) 2023-11-24T06:15:57.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.154+0000 7fba1a7fc640 1 -- 172.21.15.37:0/1165621172 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659335474 0 0) 0x7fba1c15e8b0 con 0x7fba1c070c40 2023-11-24T06:15:57.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.154+0000 7fba1a7fc640 1 -- 172.21.15.37:0/1165621172 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba08003520 con 0x7fba1c070c40 2023-11-24T06:15:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.154+0000 7fba1affd640 1 -- 172.21.15.37:0/1165621172 >> v2:172.21.15.188:3300/0 conn(0x7fba1c15b320 msgr2=0x7fba1c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.154+0000 7fba1affd640 1 --2- 172.21.15.37:0/1165621172 >> v2:172.21.15.188:3300/0 conn(0x7fba1c15b320 0x7fba1c0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.154+0000 7fba1affd640 1 -- 172.21.15.37:0/1165621172 >> v1:172.21.15.188:6789/0 conn(0x7fba1c070c40 legacy=0x7fba1c161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.154+0000 7fba1affd640 1 -- 172.21.15.37:0/1165621172 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c070180 con 0x7fba1c15af40 2023-11-24T06:15:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.154+0000 7fba13fff640 1 --2- 172.21.15.37:0/1165621172 >> v2:172.21.15.188:3300/0 conn(0x7fba1c15b320 0x7fba1c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:15:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.155+0000 7fba1affd640 1 --2- 172.21.15.37:0/1165621172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c06d220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0097a0 tx=0x7fba0c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=112faf2f5e6e4583 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba1a7fc640 1 -- 172.21.15.37:0/1165621172 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c02d040 con 0x7fba1c15af40 2023-11-24T06:15:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba1a7fc640 1 -- 172.21.15.37:0/1165621172 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c031810 con 0x7fba1c15af40 2023-11-24T06:15:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba1a7fc640 1 -- 172.21.15.37:0/1165621172 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c031ba0 con 0x7fba1c15af40 2023-11-24T06:15:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba2167c640 1 -- 172.21.15.37:0/1165621172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 msgr2=0x7fba1c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba2167c640 1 --2- 172.21.15.37:0/1165621172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c06d220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0097a0 tx=0x7fba0c02b8b0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba2167c640 1 -- 172.21.15.37:0/1165621172 shutdown_connections 2023-11-24T06:15:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba2167c640 1 --2- 172.21.15.37:0/1165621172 >> v2:172.21.15.188:3300/0 conn(0x7fba1c15b320 0x7fba1c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba2167c640 1 --2- 172.21.15.37:0/1165621172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c06d220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.156+0000 7fba2167c640 1 -- 172.21.15.37:0/1165621172 >> 172.21.15.37:0/1165621172 conn(0x7fba1c06e7f0 msgr2=0x7fba1c06ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.157+0000 7fba2167c640 1 -- 172.21.15.37:0/1165621172 shutdown_connections 2023-11-24T06:15:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.157+0000 7fba2167c640 1 -- 172.21.15.37:0/1165621172 wait complete. 2023-11-24T06:15:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.158+0000 7fba2167c640 1 Processor -- start 2023-11-24T06:15:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.159+0000 7fba2167c640 1 -- start start 2023-11-24T06:15:57.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.159+0000 7fba2167c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba1c070c40 0x7fba1c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.159+0000 7fba2167c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba2167c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba1c15b320 0x7fba1c0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba2167c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c155f80 con 0x7fba1c15b320 2023-11-24T06:15:57.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba2167c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0c6990 con 0x7fba1c070c40 2023-11-24T06:15:57.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba2167c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0c6c70 con 0x7fba1c15af40 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba1c15b320 0x7fba1c0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba1c15b320 0x7fba1c0b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51172/0 (socket says 172.21.15.37:51172) 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 -- 172.21.15.37:0/2031958208 learned_addr learned my addr 172.21.15.37:0/2031958208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1affd640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba1c070c40 0x7fba1c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba13fff640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 -- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 msgr2=0x7fba1c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 -- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba1c070c40 msgr2=0x7fba1c0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba1c070c40 0x7fba1c0c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba1b7fe640 1 -- 172.21.15.37:0/2031958208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040094d0 con 0x7fba1c15b320 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.160+0000 7fba13fff640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.161+0000 7fba1b7fe640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba1c15b320 0x7fba1c0b5ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fba1400c6e0 tx=0x7fba1400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.161+0000 7fba137fe640 1 -- 172.21.15.37:0/2031958208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14003b70 con 0x7fba1c15b320 2023-11-24T06:15:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.161+0000 7fba137fe640 1 -- 172.21.15.37:0/2031958208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14003cd0 con 0x7fba1c15b320 2023-11-24T06:15:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.161+0000 7fba137fe640 1 -- 172.21.15.37:0/2031958208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140052d0 con 0x7fba1c15b320 2023-11-24T06:15:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.161+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c009400 con 0x7fba1c15b320 2023-11-24T06:15:57.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.161+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c0c7230 con 0x7fba1c15b320 2023-11-24T06:15:57.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.162+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c0ce410 con 0x7fba1c15b320 2023-11-24T06:15:57.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.163+0000 7fba137fe640 1 -- 172.21.15.37:0/2031958208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba14005430 con 0x7fba1c15b320 2023-11-24T06:15:57.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.164+0000 7fba137fe640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9fc06ae40 0x7fb9fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.164+0000 7fba137fe640 1 -- 172.21.15.37:0/2031958208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba140890c0 con 0x7fba1c15b320 2023-11-24T06:15:57.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.165+0000 7fba1affd640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9fc06ae40 0x7fb9fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.165+0000 7fba1affd640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9fc06ae40 0x7fb9fc06d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba0c036000 tx=0x7fba0c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:57.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.169+0000 7fba137fe640 1 -- 172.21.15.37:0/2031958208 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba140544b0 con 0x7fba1c15b320 2023-11-24T06:15:57.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.430+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fba1c067470 con 0x7fba1c15b320 2023-11-24T06:15:57.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.435+0000 7fba137fe640 1 -- 172.21.15.37:0/2031958208 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fba14057ad0 con 0x7fba1c15b320 2023-11-24T06:15:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9fc06ae40 msgr2=0x7fb9fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9fc06ae40 0x7fb9fc06d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba0c036000 tx=0x7fba0c03c040 comp rx=0 tx=0).stop 2023-11-24T06:15:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba1c15b320 msgr2=0x7fba1c0b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba1c15b320 0x7fba1c0b5ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fba1400c6e0 tx=0x7fba1400cba0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 shutdown_connections 2023-11-24T06:15:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb9fc06ae40 0x7fb9fc06d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba1c15b320 0x7fba1c0b5ac0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba1c15af40 0x7fba1c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 --2- 172.21.15.37:0/2031958208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba1c070c40 0x7fba1c0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 >> 172.21.15.37:0/2031958208 conn(0x7fba1c06e7f0 msgr2=0x7fba1c15b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.438+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 shutdown_connections 2023-11-24T06:15:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.439+0000 7fba2167c640 1 -- 172.21.15.37:0/2031958208 wait complete. 2023-11-24T06:15:57.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:57.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.682+0000 7f2f27fff640 1 Processor -- start 2023-11-24T06:15:57.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.683+0000 7f2f27fff640 1 -- start start 2023-11-24T06:15:57.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.684+0000 7f2f27fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f2815d4e0 0x7f2f280d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.684+0000 7f2f27fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d0240 0x7f2f280b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.684+0000 7f2f27fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f280ce990 con 0x7f2f280d38e0 2023-11-24T06:15:57.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f27fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280d4110 con 0x7f2f2815d4e0 2023-11-24T06:15:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f27fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cec70 con 0x7f2f280d0240 2023-11-24T06:15:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f26ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f2815d4e0 0x7f2f280d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f267fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2f280d38e0 0x7f2f280cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55064/0 (socket says 172.21.15.37:55064) 2023-11-24T06:15:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f267fc640 1 -- 172.21.15.37:0/4254512141 learned_addr learned my addr 172.21.15.37:0/4254512141 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f277fe640 1 --2- 172.21.15.37:0/4254512141 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d0240 0x7f2f280b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f26ffd640 1 -- 172.21.15.37:0/4254512141 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d0240 msgr2=0x7f2f280b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f26ffd640 1 --2- 172.21.15.37:0/4254512141 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d0240 0x7f2f280b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f26ffd640 1 -- 172.21.15.37:0/4254512141 >> v1:172.21.15.37:6789/0 conn(0x7f2f280d38e0 legacy=0x7f2f280cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f26ffd640 1 -- 172.21.15.37:0/4254512141 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280cef50 con 0x7f2f2815d4e0 2023-11-24T06:15:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f25ffb640 1 -- 172.21.15.37:0/4254512141 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722599887 0 0) 0x7f2f280ce990 con 0x7f2f280d38e0 2023-11-24T06:15:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.685+0000 7f2f277fe640 1 --2- 172.21.15.37:0/4254512141 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d0240 0x7f2f280b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:57.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.687+0000 7f2f26ffd640 1 --2- 172.21.15.37:0/4254512141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280d1e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009d90 tx=0x7f2f1802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accc599b84ef37e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.687+0000 7f2f25ffb640 1 -- 172.21.15.37:0/4254512141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1802cc60 con 0x7f2f2815d4e0 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.687+0000 7f2f25ffb640 1 -- 172.21.15.37:0/4254512141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1802cdc0 con 0x7f2f2815d4e0 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.687+0000 7f2f25ffb640 1 -- 172.21.15.37:0/4254512141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18034660 con 0x7f2f2815d4e0 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 -- 172.21.15.37:0/4254512141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 msgr2=0x7f2f280d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 --2- 172.21.15.37:0/4254512141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280d1e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009d90 tx=0x7f2f1802beb0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 -- 172.21.15.37:0/4254512141 shutdown_connections 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 --2- 172.21.15.37:0/4254512141 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d0240 0x7f2f280b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 --2- 172.21.15.37:0/4254512141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280d1e20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 -- 172.21.15.37:0/4254512141 >> 172.21.15.37:0/4254512141 conn(0x7f2f2809c510 msgr2=0x7f2f280d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 -- 172.21.15.37:0/4254512141 shutdown_connections 2023-11-24T06:15:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.688+0000 7f2f27fff640 1 -- 172.21.15.37:0/4254512141 wait complete. 2023-11-24T06:15:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.690+0000 7f2f27fff640 1 Processor -- start 2023-11-24T06:15:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.690+0000 7f2f27fff640 1 -- start start 2023-11-24T06:15:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f27fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f280d0240 0x7f2f28152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f27fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d38e0 0x7f2f280c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f27fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f27fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cd0f0 con 0x7f2f2815d4e0 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f27fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cce10 con 0x7f2f280d0240 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f27fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280b6930 con 0x7f2f280d38e0 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51190/0 (socket says 172.21.15.37:51190) 2023-11-24T06:15:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.692+0000 7f2f277fe640 1 -- 172.21.15.37:0/3755746614 learned_addr learned my addr 172.21.15.37:0/3755746614 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f267fc640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d38e0 0x7f2f280c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f26ffd640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f280d0240 0x7f2f28152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f277fe640 1 -- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d38e0 msgr2=0x7f2f280c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f277fe640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d38e0 0x7f2f280c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f277fe640 1 -- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f280d0240 msgr2=0x7f2f28152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f277fe640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f280d0240 0x7f2f28152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f277fe640 1 -- 172.21.15.37:0/3755746614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18009a70 con 0x7f2f2815d4e0 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f277fe640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280c83a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000c7f0 tx=0x7f2f2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f1f7fe640 1 -- 172.21.15.37:0/3755746614 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20007820 con 0x7f2f2815d4e0 2023-11-24T06:15:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f1f7fe640 1 -- 172.21.15.37:0/3755746614 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20007980 con 0x7f2f2815d4e0 2023-11-24T06:15:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f280b6c10 con 0x7f2f2815d4e0 2023-11-24T06:15:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.693+0000 7f2f1f7fe640 1 -- 172.21.15.37:0/3755746614 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20007d70 con 0x7f2f2815d4e0 2023-11-24T06:15:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.694+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f280cca70 con 0x7f2f2815d4e0 2023-11-24T06:15:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.695+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f280b7130 con 0x7f2f2815d4e0 2023-11-24T06:15:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.696+0000 7f2f1f7fe640 1 -- 172.21.15.37:0/3755746614 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f200113f0 con 0x7f2f2815d4e0 2023-11-24T06:15:57.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.697+0000 7f2f1f7fe640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f0806ae40 0x7f2f0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:57.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.697+0000 7f2f1f7fe640 1 -- 172.21.15.37:0/3755746614 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f20089600 con 0x7f2f2815d4e0 2023-11-24T06:15:57.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.697+0000 7f2f26ffd640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f0806ae40 0x7f2f0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.698+0000 7f2f26ffd640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f0806ae40 0x7f2f0806d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f18036000 tx=0x7f2f18030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.701+0000 7f2f1f7fe640 1 -- 172.21.15.37:0/3755746614 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f280b7130 con 0x7f2f2815d4e0 2023-11-24T06:15:57.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.901+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f280b7130 con 0x7f2f2815d4e0 2023-11-24T06:15:57.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.902+0000 7f2f1f7fe640 1 -- 172.21.15.37:0/3755746614 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12821 (secure 0 0 0) 0x7f2f280b7130 con 0x7f2f2815d4e0 2023-11-24T06:15:57.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:57.905 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:15:53.728729+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f0806ae40 msgr2=0x7f2f0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f0806ae40 0x7f2f0806d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f18036000 tx=0x7f2f18030000 comp rx=0 tx=0).stop 2023-11-24T06:15:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 msgr2=0x7f2f280c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280c83a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000c7f0 tx=0x7f2f2000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 shutdown_connections 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f0806ae40 0x7f2f0806d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2815d4e0 0x7f2f280c83a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f280d38e0 0x7f2f280c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 --2- 172.21.15.37:0/3755746614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f280d0240 0x7f2f28152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.905+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 >> 172.21.15.37:0/3755746614 conn(0x7f2f2809c510 msgr2=0x7f2f2806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.906+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 shutdown_connections 2023-11-24T06:15:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:57.906+0000 7f2f27fff640 1 -- 172.21.15.37:0/3755746614 wait complete. 2023-11-24T06:15:57.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:15:57.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:15:58.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.142+0000 7efd2c7a9640 1 Processor -- start 2023-11-24T06:15:58.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.143+0000 7efd2c7a9640 1 -- start start 2023-11-24T06:15:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.145+0000 7efd2c7a9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd240b3c00 0x7efd240aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.145+0000 7efd2c7a9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd2406e6c0 0x7efd2406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.145+0000 7efd2c7a9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2415aef0 con 0x7efd240cf430 2023-11-24T06:15:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.145+0000 7efd2c7a9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2406e2a0 con 0x7efd2406e6c0 2023-11-24T06:15:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.145+0000 7efd2c7a9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd24159d70 con 0x7efd240b3c00 2023-11-24T06:15:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd2ad46640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd2406e6c0 0x7efd2406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd29d44640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd240b3c00 0x7efd240aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd2ad46640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd2406e6c0 0x7efd2406a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38414/0 (socket says 172.21.15.37:38414) 2023-11-24T06:15:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd2ad46640 1 -- 172.21.15.37:0/1754616648 learned_addr learned my addr 172.21.15.37:0/1754616648 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd29d44640 1 -- 172.21.15.37:0/1754616648 >> v2:172.21.15.188:3300/0 conn(0x7efd2406e6c0 msgr2=0x7efd2406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd29d44640 1 --2- 172.21.15.37:0/1754616648 >> v2:172.21.15.188:3300/0 conn(0x7efd2406e6c0 0x7efd2406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd29d44640 1 -- 172.21.15.37:0/1754616648 >> v1:172.21.15.188:6789/0 conn(0x7efd240cf430 legacy=0x7efd240b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.146+0000 7efd29d44640 1 -- 172.21.15.37:0/1754616648 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2406d900 con 0x7efd240b3c00 2023-11-24T06:15:58.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.148+0000 7efd29d44640 1 --2- 172.21.15.37:0/1754616648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd240b3c00 0x7efd240aef10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd14009790 tx=0x7efd1402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8078eef50574dd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:58.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.149+0000 7efd29543640 1 -- 172.21.15.37:0/1754616648 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140316f0 con 0x7efd240b3c00 2023-11-24T06:15:58.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.149+0000 7efd29543640 1 -- 172.21.15.37:0/1754616648 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14031850 con 0x7efd240b3c00 2023-11-24T06:15:58.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.149+0000 7efd29543640 1 -- 172.21.15.37:0/1754616648 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14031be0 con 0x7efd240b3c00 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 -- 172.21.15.37:0/1754616648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd240b3c00 msgr2=0x7efd240aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/1754616648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd240b3c00 0x7efd240aef10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd14009790 tx=0x7efd1402b790 comp rx=0 tx=0).stop 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 -- 172.21.15.37:0/1754616648 shutdown_connections 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/1754616648 >> v2:172.21.15.188:3300/0 conn(0x7efd2406e6c0 0x7efd2406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/1754616648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd240b3c00 0x7efd240aef10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 -- 172.21.15.37:0/1754616648 >> 172.21.15.37:0/1754616648 conn(0x7efd240cf900 msgr2=0x7efd240cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 -- 172.21.15.37:0/1754616648 shutdown_connections 2023-11-24T06:15:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.150+0000 7efd2c7a9640 1 -- 172.21.15.37:0/1754616648 wait complete. 2023-11-24T06:15:58.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.153+0000 7efd2c7a9640 1 Processor -- start 2023-11-24T06:15:58.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.153+0000 7efd2c7a9640 1 -- start start 2023-11-24T06:15:58.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.154+0000 7efd2c7a9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd2406e6c0 0x7efd24155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.154+0000 7efd2c7a9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd240b3c00 0x7efd2415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.154+0000 7efd2c7a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd240cf430 0x7efd2413a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.154+0000 7efd2c7a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24152400 con 0x7efd240cf430 2023-11-24T06:15:58.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.154+0000 7efd2c7a9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd241534f0 con 0x7efd240b3c00 2023-11-24T06:15:58.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.154+0000 7efd2c7a9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd24151800 con 0x7efd2406e6c0 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.155+0000 7efd2ad46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd240cf430 0x7efd2413a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.155+0000 7efd2ad46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd240cf430 0x7efd2413a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51202/0 (socket says 172.21.15.37:51202) 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.155+0000 7efd2ad46640 1 -- 172.21.15.37:0/278310791 learned_addr learned my addr 172.21.15.37:0/278310791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.155+0000 7efd29d44640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd240b3c00 0x7efd2415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.155+0000 7efd2a545640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd2406e6c0 0x7efd24155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.155+0000 7efd2ad46640 1 -- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd2406e6c0 msgr2=0x7efd24155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.155+0000 7efd2ad46640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd2406e6c0 0x7efd24155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd2ad46640 1 -- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd240b3c00 msgr2=0x7efd2415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd2ad46640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd240b3c00 0x7efd2415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd2ad46640 1 -- 172.21.15.37:0/278310791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd140093a0 con 0x7efd240cf430 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd2a545640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd2406e6c0 0x7efd24155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd2ad46640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd240cf430 0x7efd2413a1f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00efc0 tx=0x7efd1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd1affd640 1 -- 172.21.15.37:0/278310791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00cd20 con 0x7efd240cf430 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd1affd640 1 -- 172.21.15.37:0/278310791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c00f040 con 0x7efd240cf430 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd1affd640 1 -- 172.21.15.37:0/278310791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c003bd0 con 0x7efd240cf430 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd24151ad0 con 0x7efd240cf430 2023-11-24T06:15:58.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.156+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd24152090 con 0x7efd240cf430 2023-11-24T06:15:58.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.157+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2415a960 con 0x7efd240cf430 2023-11-24T06:15:58.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.158+0000 7efd1affd640 1 -- 172.21.15.37:0/278310791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd1c003d30 con 0x7efd240cf430 2023-11-24T06:15:58.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.159+0000 7efd1affd640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efd0806ae40 0x7efd0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.159+0000 7efd1affd640 1 -- 172.21.15.37:0/278310791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd1c089840 con 0x7efd240cf430 2023-11-24T06:15:58.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.160+0000 7efd2a545640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efd0806ae40 0x7efd0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.161+0000 7efd2a545640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efd0806ae40 0x7efd0806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd24159af0 tx=0x7efd20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:58.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.164+0000 7efd1affd640 1 -- 172.21.15.37:0/278310791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd2415a960 con 0x7efd240cf430 2023-11-24T06:15:58.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.356+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd2415a960 con 0x7efd240cf430 2023-11-24T06:15:58.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.358+0000 7efd1affd640 1 -- 172.21.15.37:0/278310791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd2415a960 con 0x7efd240cf430 2023-11-24T06:15:58.360 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:15:58.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efd0806ae40 msgr2=0x7efd0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efd0806ae40 0x7efd0806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd24159af0 tx=0x7efd20009040 comp rx=0 tx=0).stop 2023-11-24T06:15:58.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd240cf430 msgr2=0x7efd2413a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd240cf430 0x7efd2413a1f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00efc0 tx=0x7efd1c00c490 comp rx=0 tx=0).stop 2023-11-24T06:15:58.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 shutdown_connections 2023-11-24T06:15:58.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efd0806ae40 0x7efd0806d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd240b3c00 0x7efd2415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd240cf430 0x7efd2413a1f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 --2- 172.21.15.37:0/278310791 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd2406e6c0 0x7efd24155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.360+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 >> 172.21.15.37:0/278310791 conn(0x7efd240cf900 msgr2=0x7efd2415b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:58.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.361+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 shutdown_connections 2023-11-24T06:15:58.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.361+0000 7efd2c7a9640 1 -- 172.21.15.37:0/278310791 wait complete. 2023-11-24T06:15:58.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:15:58.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.607+0000 7fd33d189640 1 Processor -- start 2023-11-24T06:15:58.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.608+0000 7fd33d189640 1 -- start start 2023-11-24T06:15:58.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.609+0000 7fd33d189640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd33815c7f0 0x7fd33806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.609+0000 7fd33d189640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 0x7fd3380cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.609+0000 7fd33d189640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3380cdfb0 0x7fd3380ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.609+0000 7fd33d189640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd338156010 con 0x7fd3380cdfb0 2023-11-24T06:15:58.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.609+0000 7fd33d189640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33806ce30 con 0x7fd33815c7f0 2023-11-24T06:15:58.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.609+0000 7fd33d189640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380cfe10 con 0x7fd3380cf450 2023-11-24T06:15:58.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3380cdfb0 0x7fd3380ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3380cdfb0 0x7fd3380ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51214/0 (socket says 172.21.15.37:51214) 2023-11-24T06:15:58.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 -- 172.21.15.37:0/1565831372 learned_addr learned my addr 172.21.15.37:0/1565831372 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd336d9d640 1 --2- 172.21.15.37:0/1565831372 >> v2:172.21.15.188:3300/0 conn(0x7fd33815c7f0 0x7fd33806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 -- 172.21.15.37:0/1565831372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 msgr2=0x7fd3380cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 --2- 172.21.15.37:0/1565831372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 0x7fd3380cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 -- 172.21.15.37:0/1565831372 >> v2:172.21.15.188:3300/0 conn(0x7fd33815c7f0 msgr2=0x7fd33806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 --2- 172.21.15.37:0/1565831372 >> v2:172.21.15.188:3300/0 conn(0x7fd33815c7f0 0x7fd33806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd33759e640 1 -- 172.21.15.37:0/1565831372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380cece0 con 0x7fd3380cdfb0 2023-11-24T06:15:58.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.610+0000 7fd336d9d640 1 --2- 172.21.15.37:0/1565831372 >> v2:172.21.15.188:3300/0 conn(0x7fd33815c7f0 0x7fd33806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:58.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.611+0000 7fd33759e640 1 --2- 172.21.15.37:0/1565831372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd3380ce440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd3380d0130 tx=0x7fd33002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db8f3e63c45d445 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd335d9b640 1 -- 172.21.15.37:0/1565831372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330031870 con 0x7fd3380cdfb0 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd335d9b640 1 -- 172.21.15.37:0/1565831372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3300319d0 con 0x7fd3380cdfb0 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd335d9b640 1 -- 172.21.15.37:0/1565831372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330031d60 con 0x7fd3380cdfb0 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd33d189640 1 -- 172.21.15.37:0/1565831372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 msgr2=0x7fd3380ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd33d189640 1 --2- 172.21.15.37:0/1565831372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd3380ce440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd3380d0130 tx=0x7fd33002b910 comp rx=0 tx=0).stop 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd33d189640 1 -- 172.21.15.37:0/1565831372 shutdown_connections 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd33d189640 1 --2- 172.21.15.37:0/1565831372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd3380ce440 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd33d189640 1 --2- 172.21.15.37:0/1565831372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 0x7fd3380cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.612+0000 7fd33d189640 1 --2- 172.21.15.37:0/1565831372 >> v2:172.21.15.188:3300/0 conn(0x7fd33815c7f0 0x7fd33806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.613+0000 7fd33d189640 1 -- 172.21.15.37:0/1565831372 >> 172.21.15.37:0/1565831372 conn(0x7fd33806a920 msgr2=0x7fd33806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.613+0000 7fd33d189640 1 -- 172.21.15.37:0/1565831372 shutdown_connections 2023-11-24T06:15:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.613+0000 7fd33d189640 1 -- 172.21.15.37:0/1565831372 wait complete. 2023-11-24T06:15:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.614+0000 7fd33d189640 1 Processor -- start 2023-11-24T06:15:58.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.615+0000 7fd33d189640 1 -- start start 2023-11-24T06:15:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.615+0000 7fd33d189640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd33809a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd33d189640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 0x7fd33809c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd33d189640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd33815c7f0 0x7fd33814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd33d189640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33809b5e0 con 0x7fd3380cdfb0 2023-11-24T06:15:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd33d189640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33809cab0 con 0x7fd33815c7f0 2023-11-24T06:15:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd33d189640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33809a9d0 con 0x7fd3380cf450 2023-11-24T06:15:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd33809a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd33809a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51226/0 (socket says 172.21.15.37:51226) 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 -- 172.21.15.37:0/3837763111 learned_addr learned my addr 172.21.15.37:0/3837763111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd33759e640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd33815c7f0 0x7fd33814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 -- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 msgr2=0x7fd33809c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd33659c640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 0x7fd33809c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 0x7fd33809c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 -- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd33815c7f0 msgr2=0x7fd33814c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd33815c7f0 0x7fd33814c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.616+0000 7fd336d9d640 1 -- 172.21.15.37:0/3837763111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300094d0 con 0x7fd3380cdfb0 2023-11-24T06:15:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.617+0000 7fd336d9d640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd33809a2c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd32800ce30 tx=0x7fd32800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.617+0000 7fd31f7fe640 1 -- 172.21.15.37:0/3837763111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800f890 con 0x7fd3380cdfb0 2023-11-24T06:15:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.617+0000 7fd31f7fe640 1 -- 172.21.15.37:0/3837763111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800f9f0 con 0x7fd3380cdfb0 2023-11-24T06:15:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.617+0000 7fd31f7fe640 1 -- 172.21.15.37:0/3837763111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800fd80 con 0x7fd3380cdfb0 2023-11-24T06:15:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.617+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33809acb0 con 0x7fd3380cdfb0 2023-11-24T06:15:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.617+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33809b270 con 0x7fd3380cdfb0 2023-11-24T06:15:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.618+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd338067470 con 0x7fd3380cdfb0 2023-11-24T06:15:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.619+0000 7fd31f7fe640 1 -- 172.21.15.37:0/3837763111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd32800b040 con 0x7fd3380cdfb0 2023-11-24T06:15:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.620+0000 7fd31f7fe640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd32406ae40 0x7fd32406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.620+0000 7fd31f7fe640 1 -- 172.21.15.37:0/3837763111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd328089d70 con 0x7fd3380cdfb0 2023-11-24T06:15:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.620+0000 7fd33659c640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd32406ae40 0x7fd32406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.621+0000 7fd33659c640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd32406ae40 0x7fd32406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3380ae9c0 tx=0x7fd32c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.625+0000 7fd31f7fe640 1 -- 172.21.15.37:0/3837763111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3280550d0 con 0x7fd3380cdfb0 2023-11-24T06:15:58.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.825+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd3380cd730 con 0x7fd3380cdfb0 2023-11-24T06:15:58.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.825+0000 7fd31f7fe640 1 -- 172.21.15.37:0/3837763111 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd32801d020 con 0x7fd3380cdfb0 2023-11-24T06:15:58.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:15:58.828 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:15:58.828 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:15:58.829 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-11-24T06:15:58.829 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-11-24T06:15:58.829 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:15:58.829 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd32406ae40 msgr2=0x7fd32406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd32406ae40 0x7fd32406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3380ae9c0 tx=0x7fd32c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 msgr2=0x7fd33809a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd33809a2c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd32800ce30 tx=0x7fd32800a650 comp rx=0 tx=0).stop 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 shutdown_connections 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd32406ae40 0x7fd32406d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd33815c7f0 0x7fd33814c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3380cf450 0x7fd33809c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 --2- 172.21.15.37:0/3837763111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3380cdfb0 0x7fd33809a2c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 >> 172.21.15.37:0/3837763111 conn(0x7fd33806a920 msgr2=0x7fd33815e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 shutdown_connections 2023-11-24T06:15:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:58.828+0000 7fd33d189640 1 -- 172.21.15.37:0/3837763111 wait complete. 2023-11-24T06:15:58.851 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:15:58.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:15:59.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.084+0000 7ff752568640 1 Processor -- start 2023-11-24T06:15:59.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.084+0000 7ff752568640 1 -- start start 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff752568640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff74c144670 0x7ff74c15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff752568640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff74c06e5e0 0x7ff74c06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff752568640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c06ef00 con 0x7ff74c144f00 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff752568640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c15fe00 con 0x7ff74c06e5e0 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff752568640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0cc030 con 0x7ff74c144670 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff74b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff74c144f00 0x7ff74c0cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55072/0 (socket says 172.21.15.37:55072) 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff74b7fe640 1 -- 172.21.15.37:0/2527361173 learned_addr learned my addr 172.21.15.37:0/2527361173 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:15:59.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.086+0000 7ff750b05640 1 --2- 172.21.15.37:0/2527361173 >> v2:172.21.15.37:3300/0 conn(0x7ff74c06e5e0 0x7ff74c06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:59.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff74bfff640 1 --2- 172.21.15.37:0/2527361173 >> v2:172.21.15.188:3300/0 conn(0x7ff74c144670 0x7ff74c15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:59.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff74affd640 1 -- 172.21.15.37:0/2527361173 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199139641 0 0) 0x7ff74c06ef00 con 0x7ff74c144f00 2023-11-24T06:15:59.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff74affd640 1 -- 172.21.15.37:0/2527361173 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff734003520 con 0x7ff74c144f00 2023-11-24T06:15:59.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff750b05640 1 -- 172.21.15.37:0/2527361173 >> v2:172.21.15.188:3300/0 conn(0x7ff74c144670 msgr2=0x7ff74c15eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:59.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff750b05640 1 --2- 172.21.15.37:0/2527361173 >> v2:172.21.15.188:3300/0 conn(0x7ff74c144670 0x7ff74c15eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff750b05640 1 -- 172.21.15.37:0/2527361173 >> v1:172.21.15.37:6789/0 conn(0x7ff74c144f00 legacy=0x7ff74c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:59.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff750b05640 1 -- 172.21.15.37:0/2527361173 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c15f840 con 0x7ff74c06e5e0 2023-11-24T06:15:59.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.087+0000 7ff74bfff640 1 --2- 172.21.15.37:0/2527361173 >> v2:172.21.15.188:3300/0 conn(0x7ff74c144670 0x7ff74c15eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:59.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.088+0000 7ff750b05640 1 --2- 172.21.15.37:0/2527361173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06e5e0 0x7ff74c06e9c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff74c06b000 tx=0x7ff74402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcbde890fd12e10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:59.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff74affd640 1 -- 172.21.15.37:0/2527361173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74402e070 con 0x7ff74c06e5e0 2023-11-24T06:15:59.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff74affd640 1 -- 172.21.15.37:0/2527361173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7440315a0 con 0x7ff74c06e5e0 2023-11-24T06:15:59.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff74affd640 1 -- 172.21.15.37:0/2527361173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744031930 con 0x7ff74c06e5e0 2023-11-24T06:15:59.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff752568640 1 -- 172.21.15.37:0/2527361173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06e5e0 msgr2=0x7ff74c06e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:59.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff752568640 1 --2- 172.21.15.37:0/2527361173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06e5e0 0x7ff74c06e9c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff74c06b000 tx=0x7ff74402b840 comp rx=0 tx=0).stop 2023-11-24T06:15:59.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff752568640 1 -- 172.21.15.37:0/2527361173 shutdown_connections 2023-11-24T06:15:59.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff752568640 1 --2- 172.21.15.37:0/2527361173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06e5e0 0x7ff74c06e9c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff752568640 1 --2- 172.21.15.37:0/2527361173 >> v2:172.21.15.188:3300/0 conn(0x7ff74c144670 0x7ff74c15eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.089+0000 7ff752568640 1 -- 172.21.15.37:0/2527361173 >> 172.21.15.37:0/2527361173 conn(0x7ff74c0d12d0 msgr2=0x7ff74c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:59.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.090+0000 7ff752568640 1 -- 172.21.15.37:0/2527361173 shutdown_connections 2023-11-24T06:15:59.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.090+0000 7ff752568640 1 -- 172.21.15.37:0/2527361173 wait complete. 2023-11-24T06:15:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.091+0000 7ff752568640 1 Processor -- start 2023-11-24T06:15:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.092+0000 7ff752568640 1 -- start start 2023-11-24T06:15:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff752568640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff74c06e5e0 0x7ff74c15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff752568640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff74c144670 0x7ff74c0b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff752568640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c144f00 0x7ff74c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff752568640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c13f710 con 0x7ff74c144f00 2023-11-24T06:15:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff752568640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b4140 con 0x7ff74c06e5e0 2023-11-24T06:15:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff752568640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c1f2b60 con 0x7ff74c144670 2023-11-24T06:15:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff750b05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c144f00 0x7ff74c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff750b05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c144f00 0x7ff74c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51246/0 (socket says 172.21.15.37:51246) 2023-11-24T06:15:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff750b05640 1 -- 172.21.15.37:0/4083843246 learned_addr learned my addr 172.21.15.37:0/4083843246 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:15:59.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff74b7fe640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff74c144670 0x7ff74c0b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:59.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.093+0000 7ff74bfff640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff74c06e5e0 0x7ff74c15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:59.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff750b05640 1 -- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff74c144670 msgr2=0x7ff74c0b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:59.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff750b05640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff74c144670 0x7ff74c0b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff750b05640 1 -- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff74c06e5e0 msgr2=0x7ff74c15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:59.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff750b05640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff74c06e5e0 0x7ff74c15cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff750b05640 1 -- 172.21.15.37:0/4083843246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744009400 con 0x7ff74c144f00 2023-11-24T06:15:59.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff750b05640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c144f00 0x7ff74c0b5f70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff744009890 tx=0x7ff7440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:59.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff748ff9640 1 -- 172.21.15.37:0/4083843246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744032840 con 0x7ff74c144f00 2023-11-24T06:15:59.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff748ff9640 1 -- 172.21.15.37:0/4083843246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7440329a0 con 0x7ff74c144f00 2023-11-24T06:15:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c15d5d0 con 0x7ff74c144f00 2023-11-24T06:15:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff748ff9640 1 -- 172.21.15.37:0/4083843246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744032d30 con 0x7ff74c144f00 2023-11-24T06:15:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.094+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c15db90 con 0x7ff74c144f00 2023-11-24T06:15:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.095+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c06fc40 con 0x7ff74c144f00 2023-11-24T06:15:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.097+0000 7ff748ff9640 1 -- 172.21.15.37:0/4083843246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff74404e430 con 0x7ff74c144f00 2023-11-24T06:15:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.097+0000 7ff748ff9640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff73806ae40 0x7ff73806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.098+0000 7ff748ff9640 1 -- 172.21.15.37:0/4083843246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff7440ab190 con 0x7ff74c144f00 2023-11-24T06:15:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.098+0000 7ff74bfff640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff73806ae40 0x7ff73806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.098+0000 7ff74bfff640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff73806ae40 0x7ff73806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff73c003fd0 tx=0x7ff73c0039f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.102+0000 7ff748ff9640 1 -- 172.21.15.37:0/4083843246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff744076620 con 0x7ff74c144f00 2023-11-24T06:15:59.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.299+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff74c0b42b0 con 0x7ff74c144f00 2023-11-24T06:15:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.817+0000 7ff748ff9640 1 -- 172.21.15.37:0/4083843246 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff744080020 con 0x7ff74c144f00 2023-11-24T06:15:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff73806ae40 msgr2=0x7ff73806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff73806ae40 0x7ff73806d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff73c003fd0 tx=0x7ff73c0039f0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c144f00 msgr2=0x7ff74c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c144f00 0x7ff74c0b5f70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff744009890 tx=0x7ff7440046c0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 shutdown_connections 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff73806ae40 0x7ff73806d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c144f00 0x7ff74c0b5f70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff74c144670 0x7ff74c0b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 --2- 172.21.15.37:0/4083843246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff74c06e5e0 0x7ff74c15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.821+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 >> 172.21.15.37:0/4083843246 conn(0x7ff74c0d12d0 msgr2=0x7ff74c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.822+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 shutdown_connections 2023-11-24T06:15:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:15:59.822+0000 7ff752568640 1 -- 172.21.15.37:0/4083843246 wait complete. 2023-11-24T06:15:59.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:16:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.069+0000 7f50b29b3640 1 Processor -- start 2023-11-24T06:16:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.069+0000 7f50b29b3640 1 -- start start 2023-11-24T06:16:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.071+0000 7f50b29b3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50ac15d490 0x7f50ac0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.071+0000 7f50b29b3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac0cea30 con 0x7f50ac0d3940 2023-11-24T06:16:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.071+0000 7f50b29b3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac0ce750 con 0x7f50ac0b63d0 2023-11-24T06:16:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.071+0000 7f50b29b3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ac0d0450 con 0x7f50ac15d490 2023-11-24T06:16:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.071+0000 7f50b19b1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50ac15d490 0x7f50ac0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.071+0000 7f50b21b2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50ac0d3940 0x7f50ac0d1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55078/0 (socket says 172.21.15.37:55078) 2023-11-24T06:16:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.071+0000 7f50b21b2640 1 -- 172.21.15.37:0/3927366612 learned_addr learned my addr 172.21.15.37:0/3927366612 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.072+0000 7f50b19b1640 1 -- 172.21.15.37:0/3927366612 >> v1:172.21.15.188:6789/0 conn(0x7f50ac0b63d0 legacy=0x7f50ac0d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.072+0000 7f50b19b1640 1 -- 172.21.15.37:0/3927366612 >> v1:172.21.15.37:6789/0 conn(0x7f50ac0d3940 legacy=0x7f50ac0d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.072+0000 7f50b19b1640 1 -- 172.21.15.37:0/3927366612 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac0d0630 con 0x7f50ac15d490 2023-11-24T06:16:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.072+0000 7f50b09af640 1 -- 172.21.15.37:0/3927366612 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253529627 0 0) 0x7f50ac0cea30 con 0x7f50ac0d3940 2023-11-24T06:16:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.073+0000 7f50b19b1640 1 --2- 172.21.15.37:0/3927366612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0cd8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f50a80097a0 tx=0x7f50a802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9638170a203de7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.073+0000 7f50b09af640 1 -- 172.21.15.37:0/3927366612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8030610 con 0x7f50ac15d490 2023-11-24T06:16:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b09af640 1 -- 172.21.15.37:0/3927366612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a8030770 con 0x7f50ac15d490 2023-11-24T06:16:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b09af640 1 -- 172.21.15.37:0/3927366612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8030b00 con 0x7f50ac15d490 2023-11-24T06:16:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b29b3640 1 -- 172.21.15.37:0/3927366612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 msgr2=0x7f50ac0cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b29b3640 1 --2- 172.21.15.37:0/3927366612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0cd8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f50a80097a0 tx=0x7f50a802b960 comp rx=0 tx=0).stop 2023-11-24T06:16:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b29b3640 1 -- 172.21.15.37:0/3927366612 shutdown_connections 2023-11-24T06:16:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b29b3640 1 --2- 172.21.15.37:0/3927366612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0cd8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b29b3640 1 -- 172.21.15.37:0/3927366612 >> 172.21.15.37:0/3927366612 conn(0x7f50ac061340 msgr2=0x7f50ac061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b29b3640 1 -- 172.21.15.37:0/3927366612 shutdown_connections 2023-11-24T06:16:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.074+0000 7f50b29b3640 1 -- 172.21.15.37:0/3927366612 wait complete. 2023-11-24T06:16:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.076+0000 7f50b29b3640 1 Processor -- start 2023-11-24T06:16:00.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.076+0000 7f50b29b3640 1 -- start start 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.077+0000 7f50b29b3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50ac0d3940 0x7f50ac0b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.077+0000 7f50b29b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.077+0000 7f50b29b3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50ac0c8480 0x7f50ac157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.077+0000 7f50b29b3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac0d0bf0 con 0x7f50ac15d490 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.077+0000 7f50b29b3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac0cbe20 con 0x7f50ac0c8480 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.077+0000 7f50b29b3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac1f6370 con 0x7f50ac0d3940 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:00.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51270/0 (socket says 172.21.15.37:51270) 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 -- 172.21.15.37:0/2562878874 learned_addr learned my addr 172.21.15.37:0/2562878874 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b19b1640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50ac0d3940 0x7f50ac0b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b21b2640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50ac0c8480 0x7f50ac157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 -- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50ac0d3940 msgr2=0x7f50ac0b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50ac0d3940 0x7f50ac0b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 -- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50ac0c8480 msgr2=0x7f50ac157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50ac0c8480 0x7f50ac157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 -- 172.21.15.37:0/2562878874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8009400 con 0x7f50ac15d490 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b19b1640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50ac0d3940 0x7f50ac0b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b21b2640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50ac0c8480 0x7f50ac157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.078+0000 7f50b11b0640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0c7f40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50a000c450 tx=0x7f50a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.079+0000 7f509e7fc640 1 -- 172.21.15.37:0/2562878874 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a00052d0 con 0x7f50ac15d490 2023-11-24T06:16:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.079+0000 7f509e7fc640 1 -- 172.21.15.37:0/2562878874 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a0005430 con 0x7f50ac15d490 2023-11-24T06:16:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.079+0000 7f509e7fc640 1 -- 172.21.15.37:0/2562878874 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0012870 con 0x7f50ac15d490 2023-11-24T06:16:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.079+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac0c8910 con 0x7f50ac15d490 2023-11-24T06:16:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.079+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac1f68a0 con 0x7f50ac15d490 2023-11-24T06:16:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.080+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac04e840 con 0x7f50ac15d490 2023-11-24T06:16:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.082+0000 7f509e7fc640 1 -- 172.21.15.37:0/2562878874 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50a00129d0 con 0x7f50ac15d490 2023-11-24T06:16:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.082+0000 7f509e7fc640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509006ae70 0x7f509006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.082+0000 7f509e7fc640 1 -- 172.21.15.37:0/2562878874 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f50a0089ab0 con 0x7f50ac15d490 2023-11-24T06:16:00.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.083+0000 7f50b19b1640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509006ae70 0x7f509006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.084+0000 7f50b19b1640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509006ae70 0x7f509006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50a8036000 tx=0x7f50a803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:00.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.086+0000 7f509e7fc640 1 -- 172.21.15.37:0/2562878874 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50a0054d20 con 0x7f50ac15d490 2023-11-24T06:16:00.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.279+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f50ac15ccb0 con 0x7f50ac15d490 2023-11-24T06:16:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.823+0000 7f509e7fc640 1 -- 172.21.15.37:0/2562878874 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f50a0019300 con 0x7f50ac15d490 2023-11-24T06:16:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-11-24T06:16:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.827+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509006ae70 msgr2=0x7f509006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.827+0000 7f50b29b3640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509006ae70 0x7f509006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50a8036000 tx=0x7f50a803b040 comp rx=0 tx=0).stop 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.827+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 msgr2=0x7f50ac0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.827+0000 7f50b29b3640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0c7f40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50a000c450 tx=0x7f50a000c910 comp rx=0 tx=0).stop 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 shutdown_connections 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509006ae70 0x7f509006d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50ac0c8480 0x7f50ac157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ac15d490 0x7f50ac0c7f40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 --2- 172.21.15.37:0/2562878874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50ac0d3940 0x7f50ac0b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 >> 172.21.15.37:0/2562878874 conn(0x7f50ac061340 msgr2=0x7f50ac160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 shutdown_connections 2023-11-24T06:16:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:00.828+0000 7f50b29b3640 1 -- 172.21.15.37:0/2562878874 wait complete. 2023-11-24T06:16:00.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:16:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.055+0000 7f3d1e246640 1 Processor -- start 2023-11-24T06:16:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.055+0000 7f3d1e246640 1 -- start start 2023-11-24T06:16:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.057+0000 7f3d1e246640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d1815b440 0x7f3d180cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.057+0000 7f3d1e246640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3d180c59b0 0x7f3d1806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.057+0000 7f3d1e246640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180c5dc0 con 0x7f3d180cbf20 2023-11-24T06:16:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.057+0000 7f3d1e246640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d180cc3d0 con 0x7f3d1815b440 2023-11-24T06:16:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.057+0000 7f3d1e246640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1815b820 con 0x7f3d180c59b0 2023-11-24T06:16:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d177fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d1815b440 0x7f3d180cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d177fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d1815b440 0x7f3d180cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39926/0 (socket says 172.21.15.37:39926) 2023-11-24T06:16:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d177fe640 1 -- 172.21.15.37:0/1372098793 learned_addr learned my addr 172.21.15.37:0/1372098793 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:01.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d17fff640 1 --2- 172.21.15.37:0/1372098793 >> v2:172.21.15.188:3300/0 conn(0x7f3d180c59b0 0x7f3d1806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:01.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d177fe640 1 -- 172.21.15.37:0/1372098793 >> v2:172.21.15.188:3300/0 conn(0x7f3d180c59b0 msgr2=0x7f3d1806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:01.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d177fe640 1 --2- 172.21.15.37:0/1372098793 >> v2:172.21.15.188:3300/0 conn(0x7f3d180c59b0 0x7f3d1806c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d177fe640 1 -- 172.21.15.37:0/1372098793 >> v1:172.21.15.188:6789/0 conn(0x7f3d180cbf20 legacy=0x7f3d180c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:01.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d177fe640 1 -- 172.21.15.37:0/1372098793 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1815eea0 con 0x7f3d1815b440 2023-11-24T06:16:01.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.058+0000 7f3d17fff640 1 --2- 172.21.15.37:0/1372098793 >> v2:172.21.15.188:3300/0 conn(0x7f3d180c59b0 0x7f3d1806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:01.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.059+0000 7f3d177fe640 1 --2- 172.21.15.37:0/1372098793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180cb9e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3d180cb910 tx=0x7f3d0802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4b938c505a4c3c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:01.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.060+0000 7f3d16ffd640 1 -- 172.21.15.37:0/1372098793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0802c9f0 con 0x7f3d1815b440 2023-11-24T06:16:01.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.060+0000 7f3d16ffd640 1 -- 172.21.15.37:0/1372098793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0802cb50 con 0x7f3d1815b440 2023-11-24T06:16:01.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.060+0000 7f3d16ffd640 1 -- 172.21.15.37:0/1372098793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080343f0 con 0x7f3d1815b440 2023-11-24T06:16:01.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.060+0000 7f3d1e246640 1 -- 172.21.15.37:0/1372098793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 msgr2=0x7f3d180cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:01.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.060+0000 7f3d1e246640 1 --2- 172.21.15.37:0/1372098793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180cb9e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3d180cb910 tx=0x7f3d0802be50 comp rx=0 tx=0).stop 2023-11-24T06:16:01.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.061+0000 7f3d1e246640 1 -- 172.21.15.37:0/1372098793 shutdown_connections 2023-11-24T06:16:01.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.061+0000 7f3d1e246640 1 --2- 172.21.15.37:0/1372098793 >> v2:172.21.15.188:3300/0 conn(0x7f3d180c59b0 0x7f3d1806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.061+0000 7f3d1e246640 1 --2- 172.21.15.37:0/1372098793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180cb9e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.061+0000 7f3d1e246640 1 -- 172.21.15.37:0/1372098793 >> 172.21.15.37:0/1372098793 conn(0x7f3d180b0c50 msgr2=0x7f3d180b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:01.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.061+0000 7f3d1e246640 1 -- 172.21.15.37:0/1372098793 shutdown_connections 2023-11-24T06:16:01.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.061+0000 7f3d1e246640 1 -- 172.21.15.37:0/1372098793 wait complete. 2023-11-24T06:16:01.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.063+0000 7f3d1e246640 1 Processor -- start 2023-11-24T06:16:01.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.063+0000 7f3d1e246640 1 -- start start 2023-11-24T06:16:01.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d1e246640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d180c59b0 0x7f3d18152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:01.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d1e246640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d180cbf20 0x7f3d1809a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d1e246640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d1e246640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18152f80 con 0x7f3d1815b440 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d1e246640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18158b40 con 0x7f3d180cbf20 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d1e246640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1809b160 con 0x7f3d180c59b0 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39932/0 (socket says 172.21.15.37:39932) 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d17fff640 1 -- 172.21.15.37:0/3892477068 learned_addr learned my addr 172.21.15.37:0/3892477068 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d0effd640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d180cbf20 0x7f3d1809a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.065+0000 7f3d177fe640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d180c59b0 0x7f3d18152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d17fff640 1 -- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d180c59b0 msgr2=0x7f3d18152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d17fff640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d180c59b0 0x7f3d18152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d17fff640 1 -- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d180cbf20 msgr2=0x7f3d1809a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d17fff640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d180cbf20 0x7f3d1809a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d17fff640 1 -- 172.21.15.37:0/3892477068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009b30 con 0x7f3d1815b440 2023-11-24T06:16:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d0effd640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d180cbf20 0x7f3d1809a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d17fff640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180709d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c7f0 tx=0x7f3d1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d14ff9640 1 -- 172.21.15.37:0/3892477068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10007820 con 0x7f3d1815b440 2023-11-24T06:16:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d14ff9640 1 -- 172.21.15.37:0/3892477068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10007980 con 0x7f3d1815b440 2023-11-24T06:16:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d14ff9640 1 -- 172.21.15.37:0/3892477068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10007d70 con 0x7f3d1815b440 2023-11-24T06:16:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.066+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1809a8d0 con 0x7f3d1815b440 2023-11-24T06:16:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.067+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1809ae80 con 0x7f3d1815b440 2023-11-24T06:16:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.068+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d181589a0 con 0x7f3d1815b440 2023-11-24T06:16:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.069+0000 7f3d14ff9640 1 -- 172.21.15.37:0/3892477068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d100113f0 con 0x7f3d1815b440 2023-11-24T06:16:01.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.070+0000 7f3d14ff9640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cf806ae90 0x7f3cf806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:01.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.070+0000 7f3d14ff9640 1 -- 172.21.15.37:0/3892477068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3d100898a0 con 0x7f3d1815b440 2023-11-24T06:16:01.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.070+0000 7f3d177fe640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cf806ae90 0x7f3cf806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:01.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.071+0000 7f3d177fe640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cf806ae90 0x7f3cf806d350 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3d08035000 tx=0x7f3d08030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:01.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.075+0000 7f3d14ff9640 1 -- 172.21.15.37:0/3892477068 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d181589a0 con 0x7f3d1815b440 2023-11-24T06:16:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.305+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d181589a0 con 0x7f3d1815b440 2023-11-24T06:16:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.855+0000 7f3d14ff9640 1 -- 172.21.15.37:0/3892477068 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3d181589a0 con 0x7f3d1815b440 2023-11-24T06:16:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T06:16:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.864+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cf806ae90 msgr2=0x7f3cf806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.864+0000 7f3d1e246640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cf806ae90 0x7f3cf806d350 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3d08035000 tx=0x7f3d08030000 comp rx=0 tx=0).stop 2023-11-24T06:16:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.864+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 msgr2=0x7f3d180709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.864+0000 7f3d1e246640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180709d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c7f0 tx=0x7f3d1000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.865+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 shutdown_connections 2023-11-24T06:16:01.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.865+0000 7f3d1e246640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cf806ae90 0x7f3cf806d350 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.865+0000 7f3d1e246640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d180cbf20 0x7f3d1809a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.865+0000 7f3d1e246640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d1815b440 0x7f3d180709d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.865+0000 7f3d1e246640 1 --2- 172.21.15.37:0/3892477068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d180c59b0 0x7f3d18152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:01.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.865+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 >> 172.21.15.37:0/3892477068 conn(0x7f3d180b0c50 msgr2=0x7f3d180c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:01.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.866+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 shutdown_connections 2023-11-24T06:16:01.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:01.866+0000 7f3d1e246640 1 -- 172.21.15.37:0/3892477068 wait complete. 2023-11-24T06:16:01.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:02.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.082+0000 7fe370444640 1 Processor -- start 2023-11-24T06:16:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.082+0000 7fe370444640 1 -- start start 2023-11-24T06:16:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.084+0000 7fe370444640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3681461d0 0x7fe3680b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.084+0000 7fe370444640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36806d180 con 0x7fe3680b3a60 2023-11-24T06:16:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.084+0000 7fe370444640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36806ba70 con 0x7fe3680b4fe0 2023-11-24T06:16:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.084+0000 7fe370444640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36806bd50 con 0x7fe3681461d0 2023-11-24T06:16:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.084+0000 7fe36e1e0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3681461d0 0x7fe3680b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.084+0000 7fe36e9e1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe3680b3a60 0x7fe368167110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41110/0 (socket says 172.21.15.37:41110) 2023-11-24T06:16:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.084+0000 7fe36e9e1640 1 -- 172.21.15.37:0/183964857 learned_addr learned my addr 172.21.15.37:0/183964857 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.085+0000 7fe36e1e0640 1 -- 172.21.15.37:0/183964857 >> v1:172.21.15.188:6789/0 conn(0x7fe3680b4fe0 legacy=0x7fe3680b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.085+0000 7fe36e1e0640 1 -- 172.21.15.37:0/183964857 >> v1:172.21.15.37:6789/0 conn(0x7fe3680b3a60 legacy=0x7fe368167110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.085+0000 7fe36d1de640 1 -- 172.21.15.37:0/183964857 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951349180 0 0) 0x7fe36806d180 con 0x7fe3680b3a60 2023-11-24T06:16:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.085+0000 7fe36e1e0640 1 -- 172.21.15.37:0/183964857 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36806c030 con 0x7fe3681461d0 2023-11-24T06:16:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.086+0000 7fe36e1e0640 1 --2- 172.21.15.37:0/183964857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3681461d0 0x7fe3680b4aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe3640097d0 tx=0x7fe36402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2468b9f61da62c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.086+0000 7fe36d1de640 1 -- 172.21.15.37:0/183964857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36402e070 con 0x7fe3681461d0 2023-11-24T06:16:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.086+0000 7fe36d1de640 1 -- 172.21.15.37:0/183964857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3640315a0 con 0x7fe3681461d0 2023-11-24T06:16:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.086+0000 7fe36d1de640 1 -- 172.21.15.37:0/183964857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364031930 con 0x7fe3681461d0 2023-11-24T06:16:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.087+0000 7fe370444640 1 -- 172.21.15.37:0/183964857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3681461d0 msgr2=0x7fe3680b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.087+0000 7fe370444640 1 --2- 172.21.15.37:0/183964857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3681461d0 0x7fe3680b4aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe3640097d0 tx=0x7fe36402b840 comp rx=0 tx=0).stop 2023-11-24T06:16:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.087+0000 7fe370444640 1 -- 172.21.15.37:0/183964857 shutdown_connections 2023-11-24T06:16:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.087+0000 7fe370444640 1 --2- 172.21.15.37:0/183964857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3681461d0 0x7fe3680b4aa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.087+0000 7fe370444640 1 -- 172.21.15.37:0/183964857 >> 172.21.15.37:0/183964857 conn(0x7fe368061340 msgr2=0x7fe368061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.087+0000 7fe370444640 1 -- 172.21.15.37:0/183964857 shutdown_connections 2023-11-24T06:16:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.087+0000 7fe370444640 1 -- 172.21.15.37:0/183964857 wait complete. 2023-11-24T06:16:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.089+0000 7fe370444640 1 Processor -- start 2023-11-24T06:16:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.089+0000 7fe370444640 1 -- start start 2023-11-24T06:16:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe370444640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3680b3a60 0x7fe3681f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe370444640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3680b4fe0 0x7fe3680a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe370444640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3681461d0 0x7fe3680d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe370444640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3681f3960 con 0x7fe3680b3a60 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe370444640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680cfbc0 con 0x7fe3681461d0 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe370444640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680ced10 con 0x7fe3680b4fe0 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe36e1e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3680b3a60 0x7fe3681f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe36e1e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3680b3a60 0x7fe3681f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39954/0 (socket says 172.21.15.37:39954) 2023-11-24T06:16:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe36e1e0640 1 -- 172.21.15.37:0/2723055659 learned_addr learned my addr 172.21.15.37:0/2723055659 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.090+0000 7fe36e9e1640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3681461d0 0x7fe3680d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe36e1e0640 1 -- 172.21.15.37:0/2723055659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3680b4fe0 msgr2=0x7fe3680a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe36e1e0640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3680b4fe0 0x7fe3680a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe36e1e0640 1 -- 172.21.15.37:0/2723055659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3681461d0 msgr2=0x7fe3680d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe36e1e0640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3681461d0 0x7fe3680d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe36e1e0640 1 -- 172.21.15.37:0/2723055659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe364009400 con 0x7fe3680b3a60 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe36e1e0640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3680b3a60 0x7fe3681f3420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe364034040 tx=0x7fe3640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe35effd640 1 -- 172.21.15.37:0/2723055659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364032900 con 0x7fe3680b3a60 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe35effd640 1 -- 172.21.15.37:0/2723055659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364032a60 con 0x7fe3680b3a60 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe368146730 con 0x7fe3680b3a60 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe35effd640 1 -- 172.21.15.37:0/2723055659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364032dd0 con 0x7fe3680b3a60 2023-11-24T06:16:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.091+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3680cf570 con 0x7fe3680b3a60 2023-11-24T06:16:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.092+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe368067470 con 0x7fe3680b3a60 2023-11-24T06:16:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.094+0000 7fe35effd640 1 -- 172.21.15.37:0/2723055659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe36404d3f0 con 0x7fe3680b3a60 2023-11-24T06:16:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.094+0000 7fe35effd640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe34c06ae40 0x7fe34c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.095+0000 7fe35effd640 1 -- 172.21.15.37:0/2723055659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3640ab290 con 0x7fe3680b3a60 2023-11-24T06:16:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.095+0000 7fe36d9df640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe34c06ae40 0x7fe34c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.095+0000 7fe36d9df640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe34c06ae40 0x7fe34c06d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3680d1a80 tx=0x7fe3580079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.099+0000 7fe35effd640 1 -- 172.21.15.37:0/2723055659 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe364076340 con 0x7fe3680b3a60 2023-11-24T06:16:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.292+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3680cefb0 con 0x7fe3680b3a60 2023-11-24T06:16:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.294+0000 7fe35effd640 1 -- 172.21.15.37:0/2723055659 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16546 (secure 0 0 0) 0x7fe3680cefb0 con 0x7fe3680b3a60 2023-11-24T06:16:02.297 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:02.297 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:01.306666+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe34c06ae40 msgr2=0x7fe34c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe34c06ae40 0x7fe34c06d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3680d1a80 tx=0x7fe3580079b0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3680b3a60 msgr2=0x7fe3681f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3680b3a60 0x7fe3681f3420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe364034040 tx=0x7fe3640046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 shutdown_connections 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe34c06ae40 0x7fe34c06d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3681461d0 0x7fe3680d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.296+0000 7fe370444640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3680b4fe0 0x7fe3680a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.297+0000 7fe370444640 1 --2- 172.21.15.37:0/2723055659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3680b3a60 0x7fe3681f3420 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.297+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 >> 172.21.15.37:0/2723055659 conn(0x7fe368061340 msgr2=0x7fe36815d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:02.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.297+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 shutdown_connections 2023-11-24T06:16:02.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.297+0000 7fe370444640 1 -- 172.21.15.37:0/2723055659 wait complete. 2023-11-24T06:16:02.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.532+0000 7f951ac1a640 1 Processor -- start 2023-11-24T06:16:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.532+0000 7f951ac1a640 1 -- start start 2023-11-24T06:16:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.534+0000 7f951ac1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 0x7f951415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.534+0000 7f951ac1a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951415bf80 con 0x7f951415c410 2023-11-24T06:16:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.534+0000 7f951ac1a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95140b1560 con 0x7f95140b1de0 2023-11-24T06:16:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.534+0000 7f951ac1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95140b1280 con 0x7f9514144b30 2023-11-24T06:16:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.534+0000 7f9519417640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f951415c410 0x7f95140b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41126/0 (socket says 172.21.15.37:41126) 2023-11-24T06:16:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.534+0000 7f9519417640 1 -- 172.21.15.37:0/488485437 learned_addr learned my addr 172.21.15.37:0/488485437 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9519c18640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 0x7f951415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820865428 0 0) 0x7f951415bf80 con 0x7f951415c410 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94fc003520 con 0x7f951415c410 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 932985345 0 0) 0x7f94fc003520 con 0x7f951415c410 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 msgr2=0x7f951415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 0x7f951415f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 >> v1:172.21.15.188:6789/0 conn(0x7f95140b1de0 legacy=0x7f95140b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951415b930 con 0x7f951415c410 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f9508001670 con 0x7f951415c410 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 >> v1:172.21.15.37:6789/0 conn(0x7f951415c410 legacy=0x7f95140b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94fc0039a0 0x7f94fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f94fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 0x7f94fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140b1280 con 0x7f94fc0047c0 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc00bb10 con 0x7f94fc0039a0 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc00bcd0 con 0x7f9514144b30 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.535+0000 7f9519417640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f94fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.536+0000 7f951a419640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 0x7f94fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.536+0000 7f9519c18640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94fc0039a0 0x7f94fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.536+0000 7f9519417640 1 -- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 msgr2=0x7f94fc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.536+0000 7f9519417640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514144b30 0x7f94fc005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.536+0000 7f9519417640 1 -- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94fc0039a0 msgr2=0x7f94fc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.536+0000 7f9519417640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94fc0039a0 0x7f94fc003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.536+0000 7f9519417640 1 -- 172.21.15.37:0/488485437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc003520 con 0x7f94fc0047c0 2023-11-24T06:16:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.537+0000 7f9519417640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f94fc004c40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f950800c0e0 tx=0x7f94fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11009a42b91cf1d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.537+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508005ad0 con 0x7f94fc0047c0 2023-11-24T06:16:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.537+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508005c30 con 0x7f94fc0047c0 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.537+0000 7f9518c16640 1 -- 172.21.15.37:0/488485437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950802ca50 con 0x7f94fc0047c0 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.538+0000 7f951ac1a640 1 -- 172.21.15.37:0/488485437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 msgr2=0x7f94fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.538+0000 7f951ac1a640 1 --2- 172.21.15.37:0/488485437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f94fc004c40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f950800c0e0 tx=0x7f94fc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.538+0000 7f951a419640 1 -- 172.21.15.37:0/488485437 reap_dead start 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.538+0000 7f951ac1a640 1 -- 172.21.15.37:0/488485437 shutdown_connections 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.538+0000 7f951ac1a640 1 -- 172.21.15.37:0/488485437 >> 172.21.15.37:0/488485437 conn(0x7f95140cb830 msgr2=0x7f95140cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.538+0000 7f951ac1a640 1 -- 172.21.15.37:0/488485437 shutdown_connections 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.538+0000 7f951ac1a640 1 -- 172.21.15.37:0/488485437 wait complete. 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.540+0000 7f951ac1a640 1 Processor -- start 2023-11-24T06:16:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.540+0000 7f951ac1a640 1 -- start start 2023-11-24T06:16:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f951ac1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f95140ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f951ac1a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95141311b0 0x7f9514131610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f951ac1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514132a10 0x7f9514132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f951ac1a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140a8430 con 0x7f94fc0047c0 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f951ac1a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514131b50 con 0x7f95141311b0 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f951ac1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95141337b0 con 0x7f9514132a10 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f9519c18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f95140ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f9519c18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f95140ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39980/0 (socket says 172.21.15.37:39980) 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.541+0000 7f9519c18640 1 -- 172.21.15.37:0/3651383764 learned_addr learned my addr 172.21.15.37:0/3651383764 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f951a419640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514132a10 0x7f9514132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f9519c18640 1 -- 172.21.15.37:0/3651383764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514132a10 msgr2=0x7f9514132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f9519c18640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514132a10 0x7f9514132e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f9519c18640 1 -- 172.21.15.37:0/3651383764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95141311b0 msgr2=0x7f9514131610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:16:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f9519c18640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95141311b0 0x7f9514131610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f9519c18640 1 -- 172.21.15.37:0/3651383764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514133a90 con 0x7f94fc0047c0 2023-11-24T06:16:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f9519c18640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f95140ca5a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9504007ef0 tx=0x7f950400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.542+0000 7f95127fc640 1 -- 172.21.15.37:0/3651383764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95040145f0 con 0x7f94fc0047c0 2023-11-24T06:16:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.543+0000 7f95127fc640 1 -- 172.21.15.37:0/3651383764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504014750 con 0x7f94fc0047c0 2023-11-24T06:16:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.543+0000 7f95127fc640 1 -- 172.21.15.37:0/3651383764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504014b00 con 0x7f94fc0047c0 2023-11-24T06:16:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.543+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95140a8640 con 0x7f94fc0047c0 2023-11-24T06:16:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.543+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95141333d0 con 0x7f94fc0047c0 2023-11-24T06:16:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.544+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951404e840 con 0x7f94fc0047c0 2023-11-24T06:16:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.545+0000 7f95127fc640 1 -- 172.21.15.37:0/3651383764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9504014c60 con 0x7f94fc0047c0 2023-11-24T06:16:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.546+0000 7f95127fc640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f950006ae90 0x7f950006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.546+0000 7f95127fc640 1 -- 172.21.15.37:0/3651383764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f950408a400 con 0x7f94fc0047c0 2023-11-24T06:16:02.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.546+0000 7f9519417640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f950006ae90 0x7f950006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:02.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.547+0000 7f9519417640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f950006ae90 0x7f950006d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f950800c0e0 tx=0x7f9508009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:02.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.550+0000 7f95127fc640 1 -- 172.21.15.37:0/3651383764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9504055500 con 0x7f94fc0047c0 2023-11-24T06:16:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.747+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f951406d860 con 0x7f94fc0047c0 2023-11-24T06:16:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.750+0000 7f95127fc640 1 -- 172.21.15.37:0/3651383764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16546 (secure 0 0 0) 0x7f9504009a10 con 0x7f94fc0047c0 2023-11-24T06:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:01.306666+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:02.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.752+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f950006ae90 msgr2=0x7f950006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.752+0000 7f951ac1a640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f950006ae90 0x7f950006d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f950800c0e0 tx=0x7f9508009030 comp rx=0 tx=0).stop 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 msgr2=0x7f95140ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f95140ca5a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9504007ef0 tx=0x7f950400f520 comp rx=0 tx=0).stop 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 shutdown_connections 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f950006ae90 0x7f950006d350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95141311b0 0x7f9514131610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9514132a10 0x7f9514132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 --2- 172.21.15.37:0/3651383764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94fc0047c0 0x7f95140ca5a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 >> 172.21.15.37:0/3651383764 conn(0x7f95140cb830 msgr2=0x7f951415deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 shutdown_connections 2023-11-24T06:16:02.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:02.753+0000 7f951ac1a640 1 -- 172.21.15.37:0/3651383764 wait complete. 2023-11-24T06:16:02.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:16:03.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.007+0000 7f9aacfef640 1 Processor -- start 2023-11-24T06:16:03.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.007+0000 7f9aacfef640 1 -- start start 2023-11-24T06:16:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aacfef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9aa80b0b40 0x7f9aa80b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aacfef640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 0x7f9aa806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aacfef640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa815ed20 con 0x7f9aa815b260 2023-11-24T06:16:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aacfef640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa815b640 con 0x7f9aa80b0b40 2023-11-24T06:16:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aacfef640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80b14f0 con 0x7f9aa806c5b0 2023-11-24T06:16:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aa77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9aa815b260 0x7f9aa806e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41132/0 (socket says 172.21.15.37:41132) 2023-11-24T06:16:03.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aa77fe640 1 -- 172.21.15.37:0/410271950 learned_addr learned my addr 172.21.15.37:0/410271950 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307773770 0 0) 0x7f9aa815ed20 con 0x7f9aa815b260 2023-11-24T06:16:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.009+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a94003520 con 0x7f9aa815b260 2023-11-24T06:16:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa7fff640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 0x7f9aa806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9a9ffff640 1 --2- 172.21.15.37:0/410271950 >> v2:172.21.15.188:3300/0 conn(0x7f9aa80b0b40 0x7f9aa80b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3172289532 0 0) 0x7f9a94003520 con 0x7f9aa815b260 2023-11-24T06:16:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 msgr2=0x7f9aa806ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 0x7f9aa806ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 >> v2:172.21.15.188:3300/0 conn(0x7f9aa80b0b40 msgr2=0x7f9aa80b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 --2- 172.21.15.37:0/410271950 >> v2:172.21.15.188:3300/0 conn(0x7f9aa80b0b40 0x7f9aa80b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa815f8a0 con 0x7f9aa815b260 2023-11-24T06:16:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f9a98001670 con 0x7f9aa815b260 2023-11-24T06:16:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 >> v1:172.21.15.37:6789/0 conn(0x7f9aa815b260 legacy=0x7f9aa806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a940039a0 0x7f9a94003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 0x7f9a940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9a94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa815b640 con 0x7f9a94004d00 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80b14f0 con 0x7f9a940039a0 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.010+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9400bb60 con 0x7f9aa806c5b0 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9aa7fff640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9a94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9aa77fe640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a940039a0 0x7f9a94003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9a9ffff640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 0x7f9a940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9aa7fff640 1 -- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 msgr2=0x7f9a940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9aa7fff640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa806c5b0 0x7f9a940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9aa7fff640 1 -- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a940039a0 msgr2=0x7f9a94003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9aa7fff640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a940039a0 0x7f9a94003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.011+0000 7f9aa7fff640 1 -- 172.21.15.37:0/410271950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94003520 con 0x7f9a94004d00 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.012+0000 7f9aa7fff640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9a94005180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000e170 tx=0x7f9a940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23eda4577dcaeff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.012+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa002cbf0 con 0x7f9a94004d00 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.012+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa000f040 con 0x7f9a94004d00 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.012+0000 7f9aa6ffd640 1 -- 172.21.15.37:0/410271950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0034440 con 0x7f9a94004d00 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.013+0000 7f9aacfef640 1 -- 172.21.15.37:0/410271950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 msgr2=0x7f9a94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.013+0000 7f9aacfef640 1 --2- 172.21.15.37:0/410271950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9a94005180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000e170 tx=0x7f9a940057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.013+0000 7f9aa7fff640 1 -- 172.21.15.37:0/410271950 reap_dead start 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.013+0000 7f9aacfef640 1 -- 172.21.15.37:0/410271950 shutdown_connections 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.013+0000 7f9aacfef640 1 -- 172.21.15.37:0/410271950 >> 172.21.15.37:0/410271950 conn(0x7f9aa80cbb40 msgr2=0x7f9aa80cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.013+0000 7f9aacfef640 1 -- 172.21.15.37:0/410271950 shutdown_connections 2023-11-24T06:16:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.013+0000 7f9aacfef640 1 -- 172.21.15.37:0/410271950 wait complete. 2023-11-24T06:16:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.015+0000 7f9aacfef640 1 Processor -- start 2023-11-24T06:16:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.015+0000 7f9aacfef640 1 -- start start 2023-11-24T06:16:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.016+0000 7f9aacfef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9aa8152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.016+0000 7f9aacfef640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa81528c0 0x7f9aa815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.016+0000 7f9aacfef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80999d0 0x7f9aa8099e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.016+0000 7f9aacfef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa809a390 con 0x7f9a94004d00 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.016+0000 7f9aacfef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa815dd70 con 0x7f9aa80999d0 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.016+0000 7f9aacfef640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa815d250 con 0x7f9aa81528c0 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.016+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9aa8152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9aa8152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39986/0 (socket says 172.21.15.37:39986) 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 -- 172.21.15.37:0/1504352236 learned_addr learned my addr 172.21.15.37:0/1504352236 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 -- 172.21.15.37:0/1504352236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa81528c0 msgr2=0x7f9aa815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa81528c0 0x7f9aa815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 -- 172.21.15.37:0/1504352236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80999d0 msgr2=0x7f9aa8099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80999d0 0x7f9aa8099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 -- 172.21.15.37:0/1504352236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa815d4d0 con 0x7f9a94004d00 2023-11-24T06:16:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa77fe640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9aa8152240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800e700 tx=0x7f9a9800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa4ff9640 1 -- 172.21.15.37:0/1504352236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800ee10 con 0x7f9a94004d00 2023-11-24T06:16:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.017+0000 7f9aa4ff9640 1 -- 172.21.15.37:0/1504352236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800c7f0 con 0x7f9a94004d00 2023-11-24T06:16:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.018+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa815d7b0 con 0x7f9a94004d00 2023-11-24T06:16:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.018+0000 7f9aa4ff9640 1 -- 172.21.15.37:0/1504352236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800cb80 con 0x7f9a94004d00 2023-11-24T06:16:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.018+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa80c3620 con 0x7f9a94004d00 2023-11-24T06:16:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.019+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa804e840 con 0x7f9a94004d00 2023-11-24T06:16:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.020+0000 7f9aa4ff9640 1 -- 172.21.15.37:0/1504352236 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a9800cce0 con 0x7f9a94004d00 2023-11-24T06:16:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.021+0000 7f9aa4ff9640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9a8806ae40 0x7f9a8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.021+0000 7f9aa4ff9640 1 -- 172.21.15.37:0/1504352236 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a98089560 con 0x7f9a94004d00 2023-11-24T06:16:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.021+0000 7f9a9ffff640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9a8806ae40 0x7f9a8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.022+0000 7f9a9ffff640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9a8806ae40 0x7f9a8806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a90006a90 tx=0x7f9a90006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:03.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.025+0000 7f9aa4ff9640 1 -- 172.21.15.37:0/1504352236 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a98054570 con 0x7f9a94004d00 2023-11-24T06:16:03.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.260+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9aa80ce640 con 0x7f9a94004d00 2023-11-24T06:16:03.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.890+0000 7f9aa4ff9640 1 -- 172.21.15.37:0/1504352236 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9a98057b90 con 0x7f9a94004d00 2023-11-24T06:16:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9a8806ae40 msgr2=0x7f9a8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9a8806ae40 0x7f9a8806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a90006a90 tx=0x7f9a90006a20 comp rx=0 tx=0).stop 2023-11-24T06:16:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 msgr2=0x7f9aa8152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9aa8152240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800e700 tx=0x7f9a9800ebc0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 shutdown_connections 2023-11-24T06:16:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9a8806ae40 0x7f9a8806d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80999d0 0x7f9aa8099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa81528c0 0x7f9aa815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 --2- 172.21.15.37:0/1504352236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a94004d00 0x7f9aa8152240 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.894+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 >> 172.21.15.37:0/1504352236 conn(0x7f9aa80cbb40 msgr2=0x7f9aa806c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.895+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 shutdown_connections 2023-11-24T06:16:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:03.895+0000 7f9aacfef640 1 -- 172.21.15.37:0/1504352236 wait complete. 2023-11-24T06:16:03.919 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:16:03.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:16:04.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.144+0000 7f20eb213640 1 Processor -- start 2023-11-24T06:16:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.145+0000 7f20eb213640 1 -- start start 2023-11-24T06:16:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.146+0000 7f20eb213640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20e415d3f0 0x7f20e40d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.146+0000 7f20eb213640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f20e415d7d0 0x7f20e40d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20eb213640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e40d15e0 con 0x7f20e40d0e40 2023-11-24T06:16:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20eb213640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40d0280 con 0x7f20e415d3f0 2023-11-24T06:16:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20eb213640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40d1300 con 0x7f20e415d7d0 2023-11-24T06:16:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20ea211640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20e415d3f0 0x7f20e40d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20eaa12640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f20e40d0e40 0x7f20e40afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41138/0 (socket says 172.21.15.37:41138) 2023-11-24T06:16:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20eaa12640 1 -- 172.21.15.37:0/992726872 learned_addr learned my addr 172.21.15.37:0/992726872 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20e9a10640 1 --2- 172.21.15.37:0/992726872 >> v2:172.21.15.188:3300/0 conn(0x7f20e415d7d0 0x7f20e40d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.147+0000 7f20ea211640 1 -- 172.21.15.37:0/992726872 >> v2:172.21.15.188:3300/0 conn(0x7f20e415d7d0 msgr2=0x7f20e40d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.148+0000 7f20ea211640 1 --2- 172.21.15.37:0/992726872 >> v2:172.21.15.188:3300/0 conn(0x7f20e415d7d0 0x7f20e40d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.148+0000 7f20ea211640 1 -- 172.21.15.37:0/992726872 >> v1:172.21.15.37:6789/0 conn(0x7f20e40d0e40 legacy=0x7f20e40afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.148+0000 7f20ea211640 1 -- 172.21.15.37:0/992726872 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40cfc30 con 0x7f20e415d3f0 2023-11-24T06:16:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.148+0000 7f20e920f640 1 -- 172.21.15.37:0/992726872 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889394491 0 0) 0x7f20e40d15e0 con 0x7f20e40d0e40 2023-11-24T06:16:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.149+0000 7f20ea211640 1 --2- 172.21.15.37:0/992726872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d3f0 0x7f20e40d1830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f20e4067bd0 tx=0x7f20e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf454e424117781c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.149+0000 7f20e920f640 1 -- 172.21.15.37:0/992726872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0031830 con 0x7f20e415d3f0 2023-11-24T06:16:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.149+0000 7f20e920f640 1 -- 172.21.15.37:0/992726872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e0031990 con 0x7f20e415d3f0 2023-11-24T06:16:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.149+0000 7f20e920f640 1 -- 172.21.15.37:0/992726872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0031d20 con 0x7f20e415d3f0 2023-11-24T06:16:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 -- 172.21.15.37:0/992726872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d3f0 msgr2=0x7f20e40d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 --2- 172.21.15.37:0/992726872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d3f0 0x7f20e40d1830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f20e4067bd0 tx=0x7f20e002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 -- 172.21.15.37:0/992726872 shutdown_connections 2023-11-24T06:16:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 --2- 172.21.15.37:0/992726872 >> v2:172.21.15.188:3300/0 conn(0x7f20e415d7d0 0x7f20e40d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 --2- 172.21.15.37:0/992726872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d3f0 0x7f20e40d1830 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 -- 172.21.15.37:0/992726872 >> 172.21.15.37:0/992726872 conn(0x7f20e409c5b0 msgr2=0x7f20e40d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 -- 172.21.15.37:0/992726872 shutdown_connections 2023-11-24T06:16:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.150+0000 7f20eb213640 1 -- 172.21.15.37:0/992726872 wait complete. 2023-11-24T06:16:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.152+0000 7f20eb213640 1 Processor -- start 2023-11-24T06:16:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.152+0000 7f20eb213640 1 -- start start 2023-11-24T06:16:04.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eb213640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20e40d0e40 0x7f20e40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eb213640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20e415d3f0 0x7f20e40c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eb213640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d7d0 0x7f20e40cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eb213640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40c8460 con 0x7f20e415d7d0 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eb213640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40c8740 con 0x7f20e415d3f0 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eb213640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40c8a20 con 0x7f20e40d0e40 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eaa12640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d7d0 0x7f20e40cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eaa12640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d7d0 0x7f20e40cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40008/0 (socket says 172.21.15.37:40008) 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.153+0000 7f20eaa12640 1 -- 172.21.15.37:0/935434383 learned_addr learned my addr 172.21.15.37:0/935434383 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20ea211640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20e40d0e40 0x7f20e40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20eaa12640 1 -- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20e40d0e40 msgr2=0x7f20e40b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20eaa12640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20e40d0e40 0x7f20e40b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20eaa12640 1 -- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20e415d3f0 msgr2=0x7f20e40c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20eaa12640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20e415d3f0 0x7f20e40c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20eaa12640 1 -- 172.21.15.37:0/935434383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0009400 con 0x7f20e415d7d0 2023-11-24T06:16:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20ea211640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20e40d0e40 0x7f20e40b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20eaa12640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d7d0 0x7f20e40cb380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00c770 tx=0x7f20dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20daffd640 1 -- 172.21.15.37:0/935434383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00ce80 con 0x7f20e415d7d0 2023-11-24T06:16:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20daffd640 1 -- 172.21.15.37:0/935434383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc00a640 con 0x7f20e415d7d0 2023-11-24T06:16:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.154+0000 7f20daffd640 1 -- 172.21.15.37:0/935434383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00a9f0 con 0x7f20e415d7d0 2023-11-24T06:16:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.155+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e40c8d00 con 0x7f20e415d7d0 2023-11-24T06:16:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.155+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e40c8130 con 0x7f20e415d7d0 2023-11-24T06:16:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.156+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e40d06f0 con 0x7f20e415d7d0 2023-11-24T06:16:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.157+0000 7f20daffd640 1 -- 172.21.15.37:0/935434383 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f20dc00ab50 con 0x7f20e415d7d0 2023-11-24T06:16:04.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.158+0000 7f20daffd640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f20c806ae40 0x7f20c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:04.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.158+0000 7f20daffd640 1 -- 172.21.15.37:0/935434383 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20dc088be0 con 0x7f20e415d7d0 2023-11-24T06:16:04.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.158+0000 7f20ea211640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f20c806ae40 0x7f20c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.159+0000 7f20ea211640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f20c806ae40 0x7f20c806d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20e0036000 tx=0x7f20e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:04.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.162+0000 7f20daffd640 1 -- 172.21.15.37:0/935434383 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f20e40d06f0 con 0x7f20e415d7d0 2023-11-24T06:16:04.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.393+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f20e40c9220 con 0x7f20e415d7d0 2023-11-24T06:16:04.721 INFO:tasks.ceph.mds.d.smithi188.stderr:2023-11-24T06:16:04.717+0000 7fb2766dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:16:04.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.901+0000 7f20daffd640 1 -- 172.21.15.37:0/935434383 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f20e40c9220 con 0x7f20e415d7d0 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f20c806ae40 msgr2=0x7f20c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f20c806ae40 0x7f20c806d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20e0036000 tx=0x7f20e0008030 comp rx=0 tx=0).stop 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d7d0 msgr2=0x7f20e40cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d7d0 0x7f20e40cb380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00c770 tx=0x7f20dc00cc30 comp rx=0 tx=0).stop 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 shutdown_connections 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f20c806ae40 0x7f20c806d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20e415d3f0 0x7f20e40c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e415d7d0 0x7f20e40cb380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 --2- 172.21.15.37:0/935434383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20e40d0e40 0x7f20e40b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 >> 172.21.15.37:0/935434383 conn(0x7f20e409c5b0 msgr2=0x7f20e406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.905+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 shutdown_connections 2023-11-24T06:16:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:04.906+0000 7f20eb213640 1 -- 172.21.15.37:0/935434383 wait complete. 2023-11-24T06:16:04.929 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:16:04.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.154+0000 7fac0e5c5640 1 Processor -- start 2023-11-24T06:16:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.154+0000 7fac0e5c5640 1 -- start start 2023-11-24T06:16:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.156+0000 7fac0e5c5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 0x7fac0806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.156+0000 7fac0e5c5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080cece0 con 0x7fac080ce6c0 2023-11-24T06:16:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.156+0000 7fac0e5c5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0806d040 con 0x7fac080cf450 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.156+0000 7fac0e5c5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac08156010 con 0x7fac0815c7f0 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.156+0000 7fac0cb62640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac080ce6c0 0x7fac080714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41148/0 (socket says 172.21.15.37:41148) 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.156+0000 7fac0cb62640 1 -- 172.21.15.37:0/2113375746 learned_addr learned my addr 172.21.15.37:0/2113375746 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac07fff640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 0x7fac0806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840248392 0 0) 0x7fac080cece0 con 0x7fac080ce6c0 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf4003520 con 0x7fac080ce6c0 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311822050 0 0) 0x7fabf4003520 con 0x7fac080ce6c0 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 msgr2=0x7fac0806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 0x7fac0806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 >> v1:172.21.15.188:6789/0 conn(0x7fac080cf450 legacy=0x7fac080cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0806d320 con 0x7fac080ce6c0 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fac000019f0 con 0x7fac080ce6c0 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.157+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 >> v1:172.21.15.37:6789/0 conn(0x7fac080ce6c0 legacy=0x7fac080714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac077fe640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabf40039a0 0x7fabf4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac077fe640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabf4004350 0x7fabf4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac077fe640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 0x7fabf4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08156010 con 0x7fabf4004350 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf400b980 con 0x7fabf40039a0 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf400bb40 con 0x7fac0815c7f0 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fabfffff640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabf4004350 0x7fabf4004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac07fff640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabf40039a0 0x7fabf4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fac0cb62640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 0x7fabf4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fabfffff640 1 -- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 msgr2=0x7fabf4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fabfffff640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac0815c7f0 0x7fabf4005080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fabfffff640 1 -- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabf40039a0 msgr2=0x7fabf4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fabfffff640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fabf40039a0 0x7fabf4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.158+0000 7fabfffff640 1 -- 172.21.15.37:0/2113375746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4003520 con 0x7fabf4004350 2023-11-24T06:16:05.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.160+0000 7fabfffff640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabf4004350 0x7fabf4004820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fabf0001860 tx=0x7fabf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f1e09d13dd0495 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:05.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.160+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0033410 con 0x7fabf4004350 2023-11-24T06:16:05.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.160+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0033590 con 0x7fabf4004350 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.160+0000 7fac077fe640 1 -- 172.21.15.37:0/2113375746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0033940 con 0x7fabf4004350 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.161+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2113375746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabf4004350 msgr2=0x7fabf4004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.161+0000 7fac0e5c5640 1 --2- 172.21.15.37:0/2113375746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabf4004350 0x7fabf4004820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fabf0001860 tx=0x7fabf40057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.161+0000 7fac0cb62640 1 -- 172.21.15.37:0/2113375746 reap_dead start 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.161+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2113375746 shutdown_connections 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.161+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2113375746 >> 172.21.15.37:0/2113375746 conn(0x7fac0806a920 msgr2=0x7fac0806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.161+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2113375746 shutdown_connections 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.161+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2113375746 wait complete. 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.163+0000 7fac0e5c5640 1 Processor -- start 2023-11-24T06:16:05.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.163+0000 7fac0e5c5640 1 -- start start 2023-11-24T06:16:05.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fac0e5c5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabf4004350 0x7fac08145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fac0e5c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac081f7030 0x7fac0806da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fac0e5c5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0806df60 0x7fac08147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fac0e5c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac081f6c10 con 0x7fac081f7030 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fac0e5c5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0806e3e0 con 0x7fac0806df60 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fac0e5c5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac08145c90 con 0x7fabf4004350 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fabfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac081f7030 0x7fac0806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fabfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac081f7030 0x7fac0806da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40022/0 (socket says 172.21.15.37:40022) 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fabfffff640 1 -- 172.21.15.37:0/2070792846 learned_addr learned my addr 172.21.15.37:0/2070792846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.164+0000 7fac07fff640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabf4004350 0x7fac08145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fac0cb62640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0806df60 0x7fac08147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fabfffff640 1 -- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabf4004350 msgr2=0x7fac08145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fabfffff640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabf4004350 0x7fac08145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fabfffff640 1 -- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0806df60 msgr2=0x7fac08147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fabfffff640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0806df60 0x7fac08147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fabfffff640 1 -- 172.21.15.37:0/2070792846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac081f6570 con 0x7fac081f7030 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fabfffff640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac081f7030 0x7fac0806da20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fabf002bdd0 tx=0x7fabf0001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fac057fa640 1 -- 172.21.15.37:0/2070792846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0033410 con 0x7fac081f7030 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fac057fa640 1 -- 172.21.15.37:0/2070792846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0005070 con 0x7fac081f7030 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fac057fa640 1 -- 172.21.15.37:0/2070792846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0005400 con 0x7fac081f7030 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.165+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac08148cd0 con 0x7fac081f7030 2023-11-24T06:16:05.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.166+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac081484e0 con 0x7fac081f7030 2023-11-24T06:16:05.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.167+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac08067470 con 0x7fac081f7030 2023-11-24T06:16:05.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.168+0000 7fac057fa640 1 -- 172.21.15.37:0/2070792846 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabf003a050 con 0x7fac081f7030 2023-11-24T06:16:05.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.169+0000 7fac057fa640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fabe806ae70 0x7fabe806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.169+0000 7fac057fa640 1 -- 172.21.15.37:0/2070792846 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabf00aada0 con 0x7fac081f7030 2023-11-24T06:16:05.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.169+0000 7fac07fff640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fabe806ae70 0x7fabe806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.170+0000 7fac07fff640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fabe806ae70 0x7fabe806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009a10 tx=0x7fabf8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:05.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.175+0000 7fac057fa640 1 -- 172.21.15.37:0/2070792846 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabf0076010 con 0x7fac081f7030 2023-11-24T06:16:05.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.412+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac080ce0e0 con 0x7fac081f7030 2023-11-24T06:16:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.413+0000 7fac057fa640 1 -- 172.21.15.37:0/2070792846 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fabf0079630 con 0x7fac081f7030 2023-11-24T06:16:05.416 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:05.417 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/1178714141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1178714141},{"type":"v1","addr":"172.21.15.188:6834","nonce":1178714141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3045701683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":3045701683},{"type":"v1","addr":"172.21.15.37:6837","nonce":3045701683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3993737526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3993737526},{"type":"v1","addr":"172.21.15.37:6836","nonce":3993737526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:01.307209+0000","modified":"2023-11-24T06:16:04.395591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.188:6835/1936445066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1936445066},{"type":"v1","addr":"172.21.15.188:6835","nonce":1936445066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:16:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-11-24T06:16:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fabe806ae70 msgr2=0x7fabe806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fabe806ae70 0x7fabe806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009a10 tx=0x7fabf8008040 comp rx=0 tx=0).stop 2023-11-24T06:16:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac081f7030 msgr2=0x7fac0806da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac081f7030 0x7fac0806da20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fabf002bdd0 tx=0x7fabf0001230 comp rx=0 tx=0).stop 2023-11-24T06:16:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 shutdown_connections 2023-11-24T06:16:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fabe806ae70 0x7fabe806d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac0806df60 0x7fac08147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac081f7030 0x7fac0806da20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 --2- 172.21.15.37:0/2070792846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fabf4004350 0x7fac08145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 >> 172.21.15.37:0/2070792846 conn(0x7fac0806a920 msgr2=0x7fac080b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 shutdown_connections 2023-11-24T06:16:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.416+0000 7fac0e5c5640 1 -- 172.21.15.37:0/2070792846 wait complete. 2023-11-24T06:16:05.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.664+0000 7ff9bb5fc640 1 Processor -- start 2023-11-24T06:16:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.664+0000 7ff9bb5fc640 1 -- start start 2023-11-24T06:16:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.666+0000 7ff9bb5fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff9b415da20 0x7ff9b40d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.666+0000 7ff9bb5fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9b40d1fd0 0x7ff9b40cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.666+0000 7ff9bb5fc640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40ce0a0 con 0x7ff9b40cf2f0 2023-11-24T06:16:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.666+0000 7ff9bb5fc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40d0d70 con 0x7ff9b40d1fd0 2023-11-24T06:16:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.666+0000 7ff9bb5fc640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40d0a90 con 0x7ff9b415da20 2023-11-24T06:16:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.666+0000 7ff9b8b97640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9b40d1fd0 0x7ff9b40cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.667+0000 7ff9b8b97640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9b40d1fd0 0x7ff9b40cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40036/0 (socket says 172.21.15.37:40036) 2023-11-24T06:16:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.667+0000 7ff9b8b97640 1 -- 172.21.15.37:0/4115278322 learned_addr learned my addr 172.21.15.37:0/4115278322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.667+0000 7ff9b9398640 1 --2- 172.21.15.37:0/4115278322 >> v2:172.21.15.188:3300/0 conn(0x7ff9b415da20 0x7ff9b40d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.667+0000 7ff9b8b97640 1 -- 172.21.15.37:0/4115278322 >> v2:172.21.15.188:3300/0 conn(0x7ff9b415da20 msgr2=0x7ff9b40d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.667+0000 7ff9b8b97640 1 --2- 172.21.15.37:0/4115278322 >> v2:172.21.15.188:3300/0 conn(0x7ff9b415da20 0x7ff9b40d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.667+0000 7ff9b8b97640 1 -- 172.21.15.37:0/4115278322 >> v1:172.21.15.188:6789/0 conn(0x7ff9b40cf2f0 legacy=0x7ff9b406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.667+0000 7ff9b8b97640 1 -- 172.21.15.37:0/4115278322 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40ce2d0 con 0x7ff9b40d1fd0 2023-11-24T06:16:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.668+0000 7ff9b8b97640 1 --2- 172.21.15.37:0/4115278322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40d1fd0 0x7ff9b40cedb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40cda90 tx=0x7ff9a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce01869cd456a42f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.669+0000 7ff9a7fff640 1 -- 172.21.15.37:0/4115278322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8031870 con 0x7ff9b40d1fd0 2023-11-24T06:16:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.669+0000 7ff9a7fff640 1 -- 172.21.15.37:0/4115278322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a80319d0 con 0x7ff9b40d1fd0 2023-11-24T06:16:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.669+0000 7ff9a7fff640 1 -- 172.21.15.37:0/4115278322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8031d60 con 0x7ff9b40d1fd0 2023-11-24T06:16:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.669+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/4115278322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40d1fd0 msgr2=0x7ff9b40cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.669+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/4115278322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40d1fd0 0x7ff9b40cedb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40cda90 tx=0x7ff9a802b910 comp rx=0 tx=0).stop 2023-11-24T06:16:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.670+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/4115278322 shutdown_connections 2023-11-24T06:16:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.670+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/4115278322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40d1fd0 0x7ff9b40cedb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.670+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/4115278322 >> v2:172.21.15.188:3300/0 conn(0x7ff9b415da20 0x7ff9b40d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.670+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/4115278322 >> 172.21.15.37:0/4115278322 conn(0x7ff9b409c7e0 msgr2=0x7ff9b408af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.670+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/4115278322 shutdown_connections 2023-11-24T06:16:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.670+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/4115278322 wait complete. 2023-11-24T06:16:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.672+0000 7ff9bb5fc640 1 Processor -- start 2023-11-24T06:16:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.672+0000 7ff9bb5fc640 1 -- start start 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9bb5fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9b40d1fd0 0x7ff9b40b8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9bb5fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9b415da20 0x7ff9b4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9bb5fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40ccdf0 0x7ff9b415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9bb5fc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40ca560 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9bb5fc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4158130 con 0x7ff9b40d1fd0 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9bb5fc640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40ca7b0 con 0x7ff9b415da20 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9b9b99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40ccdf0 0x7ff9b415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9b9b99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40ccdf0 0x7ff9b415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40044/0 (socket says 172.21.15.37:40044) 2023-11-24T06:16:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9b9b99640 1 -- 172.21.15.37:0/178167848 learned_addr learned my addr 172.21.15.37:0/178167848 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9b9398640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9b40d1fd0 0x7ff9b40b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.674+0000 7ff9b8b97640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9b415da20 0x7ff9b4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9b9b99640 1 -- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9b415da20 msgr2=0x7ff9b4157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9b9b99640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9b415da20 0x7ff9b4157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9b9b99640 1 -- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9b40d1fd0 msgr2=0x7ff9b40b8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9b9b99640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9b40d1fd0 0x7ff9b40b8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9b9b99640 1 -- 172.21.15.37:0/178167848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80094d0 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9b9b99640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40ccdf0 0x7ff9b415e960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c7b0 tx=0x7ff9ac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9a5ffb640 1 -- 172.21.15.37:0/178167848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac004b60 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9a5ffb640 1 -- 172.21.15.37:0/178167848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac004cc0 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9a5ffb640 1 -- 172.21.15.37:0/178167848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00aa90 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b40caa90 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.675+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b40cb050 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.677+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b40d45e0 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.678+0000 7ff9a5ffb640 1 -- 172.21.15.37:0/178167848 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9ac00abf0 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.679+0000 7ff9a5ffb640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff99806ae40 0x7ff99806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.679+0000 7ff9a5ffb640 1 -- 172.21.15.37:0/178167848 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9ac089760 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.679+0000 7ff9b9398640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff99806ae40 0x7ff99806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.680+0000 7ff9b9398640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff99806ae40 0x7ff99806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0006fd0 tx=0x7ff9b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:05.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.684+0000 7ff9a5ffb640 1 -- 172.21.15.37:0/178167848 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9ac054800 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.881+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b40d2730 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.884+0000 7ff9a5ffb640 1 -- 172.21.15.37:0/178167848 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16533 (secure 0 0 0) 0x7ff9ac057e20 con 0x7ff9b40ccdf0 2023-11-24T06:16:05.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:05.887 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:02.852398+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff99806ae40 msgr2=0x7ff99806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff99806ae40 0x7ff99806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0006fd0 tx=0x7ff9b0008040 comp rx=0 tx=0).stop 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40ccdf0 msgr2=0x7ff9b415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40ccdf0 0x7ff9b415e960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c7b0 tx=0x7ff9ac00cc70 comp rx=0 tx=0).stop 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 shutdown_connections 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff99806ae40 0x7ff99806d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9b40ccdf0 0x7ff9b415e960 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9b415da20 0x7ff9b4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 --2- 172.21.15.37:0/178167848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9b40d1fd0 0x7ff9b40b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 >> 172.21.15.37:0/178167848 conn(0x7ff9b409c7e0 msgr2=0x7ff9b408af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 shutdown_connections 2023-11-24T06:16:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:05.887+0000 7ff9bb5fc640 1 -- 172.21.15.37:0/178167848 wait complete. 2023-11-24T06:16:05.912 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:16:05.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.118+0000 7f46df59e640 1 Processor -- start 2023-11-24T06:16:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.118+0000 7f46df59e640 1 -- start start 2023-11-24T06:16:06.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.120+0000 7f46df59e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f46e0143870 0x7f46e0146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.120+0000 7f46df59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e0161510 con 0x7f46e0161080 2023-11-24T06:16:06.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.120+0000 7f46df59e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e01617f0 con 0x7f46e00b1180 2023-11-24T06:16:06.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.120+0000 7f46df59e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e0070460 con 0x7f46e0143870 2023-11-24T06:16:06.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.121+0000 7f46d7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f46e0161080 0x7f46e00b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41156/0 (socket says 172.21.15.37:41156) 2023-11-24T06:16:06.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.121+0000 7f46d7fff640 1 -- 172.21.15.37:0/2764289702 learned_addr learned my addr 172.21.15.37:0/2764289702 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:06.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.121+0000 7f46de59c640 1 --2- 172.21.15.37:0/2764289702 >> v2:172.21.15.188:3300/0 conn(0x7f46e0143870 0x7f46e0146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.121+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39675176 0 0) 0x7f46e0161510 con 0x7f46e0161080 2023-11-24T06:16:06.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.121+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46cc003520 con 0x7f46e0161080 2023-11-24T06:16:06.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4016729219 0 0) 0x7f46cc003520 con 0x7f46e0161080 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 >> v2:172.21.15.188:3300/0 conn(0x7f46e0143870 msgr2=0x7f46e0146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 --2- 172.21.15.37:0/2764289702 >> v2:172.21.15.188:3300/0 conn(0x7f46e0143870 0x7f46e0146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 >> v1:172.21.15.188:6789/0 conn(0x7f46e00b1180 legacy=0x7f46e00cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0161ad0 con 0x7f46e0161080 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f46c8001670 con 0x7f46e0161080 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 >> v1:172.21.15.37:6789/0 conn(0x7f46e0161080 legacy=0x7f46e00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc0039c0 0x7f46cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46cc0047c0 0x7f46cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc005180 0x7f46cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0070460 con 0x7f46cc0039c0 2023-11-24T06:16:06.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc00c080 con 0x7f46cc0047c0 2023-11-24T06:16:06.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc00c240 con 0x7f46cc005180 2023-11-24T06:16:06.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.122+0000 7f46de59c640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc0039c0 0x7f46cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46d7fff640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46cc0047c0 0x7f46cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46ded9d640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc005180 0x7f46cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46de59c640 1 -- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc005180 msgr2=0x7f46cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:06.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46de59c640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc005180 0x7f46cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46de59c640 1 -- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46cc0047c0 msgr2=0x7f46cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:06.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46de59c640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46cc0047c0 0x7f46cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46de59c640 1 -- 172.21.15.37:0/2764289702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc003520 con 0x7f46cc0039c0 2023-11-24T06:16:06.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46ded9d640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc005180 0x7f46cc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:06.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.123+0000 7f46ded9d640 1 -- 172.21.15.37:0/2764289702 reap_dead start 2023-11-24T06:16:06.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.125+0000 7f46de59c640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc0039c0 0x7f46cc003de0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009ac0 tx=0x7f46cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f15edc85539dcb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:06.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d002c6b0 con 0x7f46cc0039c0 2023-11-24T06:16:06.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d002c810 con 0x7f46cc0039c0 2023-11-24T06:16:06.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46ddd9b640 1 -- 172.21.15.37:0/2764289702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d002cba0 con 0x7f46cc0039c0 2023-11-24T06:16:06.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46df59e640 1 -- 172.21.15.37:0/2764289702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc0039c0 msgr2=0x7f46cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46df59e640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc0039c0 0x7f46cc003de0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009ac0 tx=0x7f46cc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46df59e640 1 -- 172.21.15.37:0/2764289702 shutdown_connections 2023-11-24T06:16:06.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46df59e640 1 --2- 172.21.15.37:0/2764289702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc0039c0 0x7f46cc003de0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.126+0000 7f46df59e640 1 -- 172.21.15.37:0/2764289702 >> 172.21.15.37:0/2764289702 conn(0x7f46e00cb830 msgr2=0x7f46e00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:06.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.127+0000 7f46df59e640 1 -- 172.21.15.37:0/2764289702 shutdown_connections 2023-11-24T06:16:06.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.127+0000 7f46df59e640 1 -- 172.21.15.37:0/2764289702 wait complete. 2023-11-24T06:16:06.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.128+0000 7f46df59e640 1 Processor -- start 2023-11-24T06:16:06.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.129+0000 7f46df59e640 1 -- start start 2023-11-24T06:16:06.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46df59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc0039c0 0x7f46e013e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46df59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46e0070da0 0x7f46e0071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46df59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e01e6ef0 0x7f46e01e7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46df59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0071760 con 0x7f46e01e6ef0 2023-11-24T06:16:06.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46df59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e013e6f0 con 0x7f46e0070da0 2023-11-24T06:16:06.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46df59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e01e7c60 con 0x7f46cc0039c0 2023-11-24T06:16:06.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46ded9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e01e6ef0 0x7f46e01e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46ded9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e01e6ef0 0x7f46e01e7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40062/0 (socket says 172.21.15.37:40062) 2023-11-24T06:16:06.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46ded9d640 1 -- 172.21.15.37:0/4075282079 learned_addr learned my addr 172.21.15.37:0/4075282079 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:06.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46de59c640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc0039c0 0x7f46e013e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.130+0000 7f46d7fff640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46e0070da0 0x7f46e0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46ded9d640 1 -- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc0039c0 msgr2=0x7f46e013e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46ded9d640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc0039c0 0x7f46e013e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46ded9d640 1 -- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46e0070da0 msgr2=0x7f46e0071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46ded9d640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46e0070da0 0x7f46e0071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46ded9d640 1 -- 172.21.15.37:0/4075282079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e01e7f40 con 0x7f46e01e6ef0 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46ded9d640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e01e6ef0 0x7f46e01e7370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46d8007fd0 tx=0x7f46d800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46d6ffd640 1 -- 172.21.15.37:0/4075282079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800eed0 con 0x7f46e01e6ef0 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46d6ffd640 1 -- 172.21.15.37:0/4075282079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d8006b50 con 0x7f46e01e6ef0 2023-11-24T06:16:06.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e01e8220 con 0x7f46e01e6ef0 2023-11-24T06:16:06.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46d6ffd640 1 -- 172.21.15.37:0/4075282079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8003970 con 0x7f46e01e6ef0 2023-11-24T06:16:06.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.131+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e01e87e0 con 0x7f46e01e6ef0 2023-11-24T06:16:06.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.132+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e01e8a00 con 0x7f46e01e6ef0 2023-11-24T06:16:06.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.134+0000 7f46d6ffd640 1 -- 172.21.15.37:0/4075282079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46d8003ad0 con 0x7f46e01e6ef0 2023-11-24T06:16:06.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.134+0000 7f46d6ffd640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f46c006ae40 0x7f46c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.135+0000 7f46d6ffd640 1 -- 172.21.15.37:0/4075282079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46d8088d20 con 0x7f46e01e6ef0 2023-11-24T06:16:06.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.135+0000 7f46de59c640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f46c006ae40 0x7f46c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.136+0000 7f46de59c640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f46c006ae40 0x7f46c006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46d0036000 tx=0x7f46d0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:06.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.139+0000 7f46d6ffd640 1 -- 172.21.15.37:0/4075282079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46d8053dc0 con 0x7f46e01e6ef0 2023-11-24T06:16:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.334+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46e004e840 con 0x7f46c006ae40 2023-11-24T06:16:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.351+0000 7f46d6ffd640 1 -- 172.21.15.37:0/4075282079 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287045 (secure 0 0 0) 0x7f46e004e840 con 0x7f46c006ae40 2023-11-24T06:16:06.357 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:16:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f46c006ae40 msgr2=0x7f46c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f46c006ae40 0x7f46c006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46d0036000 tx=0x7f46d0030000 comp rx=0 tx=0).stop 2023-11-24T06:16:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e01e6ef0 msgr2=0x7f46e01e7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e01e6ef0 0x7f46e01e7370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46d8007fd0 tx=0x7f46d800eb90 comp rx=0 tx=0).stop 2023-11-24T06:16:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 shutdown_connections 2023-11-24T06:16:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f46c006ae40 0x7f46c006d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46e0070da0 0x7f46e0071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e01e6ef0 0x7f46e01e7370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 --2- 172.21.15.37:0/4075282079 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46cc0039c0 0x7f46e013e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 >> 172.21.15.37:0/4075282079 conn(0x7f46e00cb830 msgr2=0x7f46e01418d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 shutdown_connections 2023-11-24T06:16:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.358+0000 7f46df59e640 1 -- 172.21.15.37:0/4075282079 wait complete. 2023-11-24T06:16:06.381 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-11-24T06:16:04.837765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220276,"kb_used_data":4076,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754444,"statfs":{"total":773094113280,"available":772868550656,"internally_reserved":0,"allocated":4173824,"data_stored":2328088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016954"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805384+0000","last_change":"2023-11-24T06:16:01.868584+0000","last_active":"2023-11-24T06:16:03.805384+0000","last_peered":"2023-11-24T06:16:03.805384+0000","last_clean":"2023-11-24T06:16:03.805384+0000","last_became_active":"2023-11-24T06:16:01.868304+0000","last_became_peered":"2023-11-24T06:16:01.868304+0000","last_unstale":"2023-11-24T06:16:03.805384+0000","last_undegraded":"2023-11-24T06:16:03.805384+0000","last_fullsized":"2023-11-24T06:16:03.805384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876593+0000","last_change":"2023-11-24T06:16:01.870030+0000","last_active":"2023-11-24T06:16:01.876593+0000","last_peered":"2023-11-24T06:16:01.876593+0000","last_clean":"2023-11-24T06:16:01.876593+0000","last_became_active":"2023-11-24T06:16:01.869727+0000","last_became_peered":"2023-11-24T06:16:01.869727+0000","last_unstale":"2023-11-24T06:16:01.876593+0000","last_undegraded":"2023-11-24T06:16:01.876593+0000","last_fullsized":"2023-11-24T06:16:01.876593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877470+0000","last_change":"2023-11-24T06:16:01.863542+0000","last_active":"2023-11-24T06:16:01.877470+0000","last_peered":"2023-11-24T06:16:01.877470+0000","last_clean":"2023-11-24T06:16:01.877470+0000","last_became_active":"2023-11-24T06:16:01.863055+0000","last_became_peered":"2023-11-24T06:16:01.863055+0000","last_unstale":"2023-11-24T06:16:01.877470+0000","last_undegraded":"2023-11-24T06:16:01.877470+0000","last_fullsized":"2023-11-24T06:16:01.877470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862647+0000","last_change":"2023-11-24T06:16:01.866191+0000","last_active":"2023-11-24T06:16:02.862647+0000","last_peered":"2023-11-24T06:16:02.862647+0000","last_clean":"2023-11-24T06:16:02.862647+0000","last_became_active":"2023-11-24T06:16:01.865892+0000","last_became_peered":"2023-11-24T06:16:01.865892+0000","last_unstale":"2023-11-24T06:16:02.862647+0000","last_undegraded":"2023-11-24T06:16:02.862647+0000","last_fullsized":"2023-11-24T06:16:02.862647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.872498+0000","last_change":"2023-11-24T06:16:01.869412+0000","last_active":"2023-11-24T06:16:01.872498+0000","last_peered":"2023-11-24T06:16:01.872498+0000","last_clean":"2023-11-24T06:16:01.872498+0000","last_became_active":"2023-11-24T06:16:01.869118+0000","last_became_peered":"2023-11-24T06:16:01.869118+0000","last_unstale":"2023-11-24T06:16:01.872498+0000","last_undegraded":"2023-11-24T06:16:01.872498+0000","last_fullsized":"2023-11-24T06:16:01.872498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:53.611373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.873664+0000","last_change":"2023-11-24T06:16:01.864324+0000","last_active":"2023-11-24T06:16:01.873664+0000","last_peered":"2023-11-24T06:16:01.873664+0000","last_clean":"2023-11-24T06:16:01.873664+0000","last_became_active":"2023-11-24T06:16:01.864070+0000","last_became_peered":"2023-11-24T06:16:01.864070+0000","last_unstale":"2023-11-24T06:16:01.873664+0000","last_undegraded":"2023-11-24T06:16:01.873664+0000","last_fullsized":"2023-11-24T06:16:01.873664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875418+0000","last_change":"2023-11-24T06:16:01.871454+0000","last_active":"2023-11-24T06:16:01.875418+0000","last_peered":"2023-11-24T06:16:01.875418+0000","last_clean":"2023-11-24T06:16:01.875418+0000","last_became_active":"2023-11-24T06:16:01.871067+0000","last_became_peered":"2023-11-24T06:16:01.871067+0000","last_unstale":"2023-11-24T06:16:01.875418+0000","last_undegraded":"2023-11-24T06:16:01.875418+0000","last_fullsized":"2023-11-24T06:16:01.875418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.879880+0000","last_change":"2023-11-24T06:16:01.865364+0000","last_active":"2023-11-24T06:16:01.879880+0000","last_peered":"2023-11-24T06:16:01.879880+0000","last_clean":"2023-11-24T06:16:01.879880+0000","last_became_active":"2023-11-24T06:16:01.865059+0000","last_became_peered":"2023-11-24T06:16:01.865059+0000","last_unstale":"2023-11-24T06:16:01.879880+0000","last_undegraded":"2023-11-24T06:16:01.879880+0000","last_fullsized":"2023-11-24T06:16:01.879880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:38.536544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.864186+0000","last_change":"2023-11-24T06:16:01.878367+0000","last_active":"2023-11-24T06:16:02.864186+0000","last_peered":"2023-11-24T06:16:02.864186+0000","last_clean":"2023-11-24T06:16:02.864186+0000","last_became_active":"2023-11-24T06:16:01.878038+0000","last_became_peered":"2023-11-24T06:16:01.878038+0000","last_unstale":"2023-11-24T06:16:02.864186+0000","last_undegraded":"2023-11-24T06:16:02.864186+0000","last_fullsized":"2023-11-24T06:16:02.864186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863109+0000","last_change":"2023-11-24T06:16:01.864088+0000","last_active":"2023-11-24T06:16:02.863109+0000","last_peered":"2023-11-24T06:16:02.863109+0000","last_clean":"2023-11-24T06:16:02.863109+0000","last_became_active":"2023-11-24T06:16:01.863804+0000","last_became_peered":"2023-11-24T06:16:01.863804+0000","last_unstale":"2023-11-24T06:16:02.863109+0000","last_undegraded":"2023-11-24T06:16:02.863109+0000","last_fullsized":"2023-11-24T06:16:02.863109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:44.096615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.879482+0000","last_change":"2023-11-24T06:16:01.873678+0000","last_active":"2023-11-24T06:16:01.879482+0000","last_peered":"2023-11-24T06:16:01.879482+0000","last_clean":"2023-11-24T06:16:01.879482+0000","last_became_active":"2023-11-24T06:16:01.873404+0000","last_became_peered":"2023-11-24T06:16:01.873404+0000","last_unstale":"2023-11-24T06:16:01.879482+0000","last_undegraded":"2023-11-24T06:16:01.879482+0000","last_fullsized":"2023-11-24T06:16:01.879482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.865302+0000","last_change":"2023-11-24T06:16:01.859363+0000","last_active":"2023-11-24T06:16:01.865302+0000","last_peered":"2023-11-24T06:16:01.865302+0000","last_clean":"2023-11-24T06:16:01.865302+0000","last_became_active":"2023-11-24T06:16:01.859071+0000","last_became_peered":"2023-11-24T06:16:01.859071+0000","last_unstale":"2023-11-24T06:16:01.865302+0000","last_undegraded":"2023-11-24T06:16:01.865302+0000","last_fullsized":"2023-11-24T06:16:01.865302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:44.096615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.866146+0000","last_change":"2023-11-24T06:16:01.862377+0000","last_active":"2023-11-24T06:16:01.866146+0000","last_peered":"2023-11-24T06:16:01.866146+0000","last_clean":"2023-11-24T06:16:01.866146+0000","last_became_active":"2023-11-24T06:16:01.862105+0000","last_became_peered":"2023-11-24T06:16:01.862105+0000","last_unstale":"2023-11-24T06:16:01.866146+0000","last_undegraded":"2023-11-24T06:16:01.866146+0000","last_fullsized":"2023-11-24T06:16:01.866146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:13.268040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.873641+0000","last_change":"2023-11-24T06:16:01.864115+0000","last_active":"2023-11-24T06:16:01.873641+0000","last_peered":"2023-11-24T06:16:01.873641+0000","last_clean":"2023-11-24T06:16:01.873641+0000","last_became_active":"2023-11-24T06:16:01.862589+0000","last_became_peered":"2023-11-24T06:16:01.862589+0000","last_unstale":"2023-11-24T06:16:01.873641+0000","last_undegraded":"2023-11-24T06:16:01.873641+0000","last_fullsized":"2023-11-24T06:16:01.873641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876926+0000","last_change":"2023-11-24T06:16:01.867375+0000","last_active":"2023-11-24T06:16:01.876926+0000","last_peered":"2023-11-24T06:16:01.876926+0000","last_clean":"2023-11-24T06:16:01.876926+0000","last_became_active":"2023-11-24T06:16:01.866536+0000","last_became_peered":"2023-11-24T06:16:01.866536+0000","last_unstale":"2023-11-24T06:16:01.876926+0000","last_undegraded":"2023-11-24T06:16:01.876926+0000","last_fullsized":"2023-11-24T06:16:01.876926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882756+0000","last_change":"2023-11-24T06:16:01.879111+0000","last_active":"2023-11-24T06:16:01.882756+0000","last_peered":"2023-11-24T06:16:01.882756+0000","last_clean":"2023-11-24T06:16:01.882756+0000","last_became_active":"2023-11-24T06:16:01.872425+0000","last_became_peered":"2023-11-24T06:16:01.872425+0000","last_unstale":"2023-11-24T06:16:01.882756+0000","last_undegraded":"2023-11-24T06:16:01.882756+0000","last_fullsized":"2023-11-24T06:16:01.882756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882492+0000","last_change":"2023-11-24T06:16:01.878824+0000","last_active":"2023-11-24T06:16:01.882492+0000","last_peered":"2023-11-24T06:16:01.882492+0000","last_clean":"2023-11-24T06:16:01.882492+0000","last_became_active":"2023-11-24T06:16:01.876885+0000","last_became_peered":"2023-11-24T06:16:01.876885+0000","last_unstale":"2023-11-24T06:16:01.882492+0000","last_undegraded":"2023-11-24T06:16:01.882492+0000","last_fullsized":"2023-11-24T06:16:01.882492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.861153+0000","last_change":"2023-11-24T06:16:01.855416+0000","last_active":"2023-11-24T06:16:01.861153+0000","last_peered":"2023-11-24T06:16:01.861153+0000","last_clean":"2023-11-24T06:16:01.861153+0000","last_became_active":"2023-11-24T06:16:01.855084+0000","last_became_peered":"2023-11-24T06:16:01.855084+0000","last_unstale":"2023-11-24T06:16:01.861153+0000","last_undegraded":"2023-11-24T06:16:01.861153+0000","last_fullsized":"2023-11-24T06:16:01.861153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:53.411236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.860338+0000","last_change":"2023-11-24T06:16:01.855201+0000","last_active":"2023-11-24T06:16:01.860338+0000","last_peered":"2023-11-24T06:16:01.860338+0000","last_clean":"2023-11-24T06:16:01.860338+0000","last_became_active":"2023-11-24T06:16:01.854734+0000","last_became_peered":"2023-11-24T06:16:01.854734+0000","last_unstale":"2023-11-24T06:16:01.860338+0000","last_undegraded":"2023-11-24T06:16:01.860338+0000","last_fullsized":"2023-11-24T06:16:01.860338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.873483+0000","last_change":"2023-11-24T06:16:01.870419+0000","last_active":"2023-11-24T06:16:01.873483+0000","last_peered":"2023-11-24T06:16:01.873483+0000","last_clean":"2023-11-24T06:16:01.873483+0000","last_became_active":"2023-11-24T06:16:01.869644+0000","last_became_peered":"2023-11-24T06:16:01.869644+0000","last_unstale":"2023-11-24T06:16:01.873483+0000","last_undegraded":"2023-11-24T06:16:01.873483+0000","last_fullsized":"2023-11-24T06:16:01.873483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:27.084478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863170+0000","last_change":"2023-11-24T06:16:01.868607+0000","last_active":"2023-11-24T06:16:02.863170+0000","last_peered":"2023-11-24T06:16:02.863170+0000","last_clean":"2023-11-24T06:16:02.863170+0000","last_became_active":"2023-11-24T06:16:01.868343+0000","last_became_peered":"2023-11-24T06:16:01.868343+0000","last_unstale":"2023-11-24T06:16:02.863170+0000","last_undegraded":"2023-11-24T06:16:02.863170+0000","last_fullsized":"2023-11-24T06:16:02.863170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:01.920931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862915+0000","last_change":"2023-11-24T06:16:01.860034+0000","last_active":"2023-11-24T06:16:02.862915+0000","last_peered":"2023-11-24T06:16:02.862915+0000","last_clean":"2023-11-24T06:16:02.862915+0000","last_became_active":"2023-11-24T06:16:01.859732+0000","last_became_peered":"2023-11-24T06:16:01.859732+0000","last_unstale":"2023-11-24T06:16:02.862915+0000","last_undegraded":"2023-11-24T06:16:02.862915+0000","last_fullsized":"2023-11-24T06:16:02.862915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860853+0000","last_change":"2023-11-24T06:16:01.877334+0000","last_active":"2023-11-24T06:16:02.860853+0000","last_peered":"2023-11-24T06:16:02.860853+0000","last_clean":"2023-11-24T06:16:02.860853+0000","last_became_active":"2023-11-24T06:16:01.876349+0000","last_became_peered":"2023-11-24T06:16:01.876349+0000","last_unstale":"2023-11-24T06:16:02.860853+0000","last_undegraded":"2023-11-24T06:16:02.860853+0000","last_fullsized":"2023-11-24T06:16:02.860853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.870443+0000","last_change":"2023-11-24T06:16:01.861840+0000","last_active":"2023-11-24T06:16:01.870443+0000","last_peered":"2023-11-24T06:16:01.870443+0000","last_clean":"2023-11-24T06:16:01.870443+0000","last_became_active":"2023-11-24T06:16:01.861488+0000","last_became_peered":"2023-11-24T06:16:01.861488+0000","last_unstale":"2023-11-24T06:16:01.870443+0000","last_undegraded":"2023-11-24T06:16:01.870443+0000","last_fullsized":"2023-11-24T06:16:01.870443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863577+0000","last_change":"2023-11-24T06:16:01.860643+0000","last_active":"2023-11-24T06:16:02.863577+0000","last_peered":"2023-11-24T06:16:02.863577+0000","last_clean":"2023-11-24T06:16:02.863577+0000","last_became_active":"2023-11-24T06:16:01.860312+0000","last_became_peered":"2023-11-24T06:16:01.860312+0000","last_unstale":"2023-11-24T06:16:02.863577+0000","last_undegraded":"2023-11-24T06:16:02.863577+0000","last_fullsized":"2023-11-24T06:16:02.863577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:56.546783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.887620+0000","last_change":"2023-11-24T06:16:01.880736+0000","last_active":"2023-11-24T06:16:01.887620+0000","last_peered":"2023-11-24T06:16:01.887620+0000","last_clean":"2023-11-24T06:16:01.887620+0000","last_became_active":"2023-11-24T06:16:01.879459+0000","last_became_peered":"2023-11-24T06:16:01.879459+0000","last_unstale":"2023-11-24T06:16:01.887620+0000","last_undegraded":"2023-11-24T06:16:01.887620+0000","last_fullsized":"2023-11-24T06:16:01.887620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:19.857033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863226+0000","last_change":"2023-11-24T06:16:01.863138+0000","last_active":"2023-11-24T06:16:02.863226+0000","last_peered":"2023-11-24T06:16:02.863226+0000","last_clean":"2023-11-24T06:16:02.863226+0000","last_became_active":"2023-11-24T06:16:01.862639+0000","last_became_peered":"2023-11-24T06:16:01.862639+0000","last_unstale":"2023-11-24T06:16:02.863226+0000","last_undegraded":"2023-11-24T06:16:02.863226+0000","last_fullsized":"2023-11-24T06:16:02.863226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:37.031127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877708+0000","last_change":"2023-11-24T06:16:01.868203+0000","last_active":"2023-11-24T06:16:01.877708+0000","last_peered":"2023-11-24T06:16:01.877708+0000","last_clean":"2023-11-24T06:16:01.877708+0000","last_became_active":"2023-11-24T06:16:01.867934+0000","last_became_peered":"2023-11-24T06:16:01.867934+0000","last_unstale":"2023-11-24T06:16:01.877708+0000","last_undegraded":"2023-11-24T06:16:01.877708+0000","last_fullsized":"2023-11-24T06:16:01.877708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863244+0000","last_change":"2023-11-24T06:16:01.859996+0000","last_active":"2023-11-24T06:16:02.863244+0000","last_peered":"2023-11-24T06:16:02.863244+0000","last_clean":"2023-11-24T06:16:02.863244+0000","last_became_active":"2023-11-24T06:16:01.859722+0000","last_became_peered":"2023-11-24T06:16:01.859722+0000","last_unstale":"2023-11-24T06:16:02.863244+0000","last_undegraded":"2023-11-24T06:16:02.863244+0000","last_fullsized":"2023-11-24T06:16:02.863244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875345+0000","last_change":"2023-11-24T06:16:01.871272+0000","last_active":"2023-11-24T06:16:01.875345+0000","last_peered":"2023-11-24T06:16:01.875345+0000","last_clean":"2023-11-24T06:16:01.875345+0000","last_became_active":"2023-11-24T06:16:01.870918+0000","last_became_peered":"2023-11-24T06:16:01.870918+0000","last_unstale":"2023-11-24T06:16:01.875345+0000","last_undegraded":"2023-11-24T06:16:01.875345+0000","last_fullsized":"2023-11-24T06:16:01.875345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:01.920931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805392+0000","last_change":"2023-11-24T06:16:01.861878+0000","last_active":"2023-11-24T06:16:03.805392+0000","last_peered":"2023-11-24T06:16:03.805392+0000","last_clean":"2023-11-24T06:16:03.805392+0000","last_became_active":"2023-11-24T06:16:01.861570+0000","last_became_peered":"2023-11-24T06:16:01.861570+0000","last_unstale":"2023-11-24T06:16:03.805392+0000","last_undegraded":"2023-11-24T06:16:03.805392+0000","last_fullsized":"2023-11-24T06:16:03.805392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:38.536544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882459+0000","last_change":"2023-11-24T06:16:01.878475+0000","last_active":"2023-11-24T06:16:01.882459+0000","last_peered":"2023-11-24T06:16:01.882459+0000","last_clean":"2023-11-24T06:16:01.882459+0000","last_became_active":"2023-11-24T06:16:01.876314+0000","last_became_peered":"2023-11-24T06:16:01.876314+0000","last_unstale":"2023-11-24T06:16:01.882459+0000","last_undegraded":"2023-11-24T06:16:01.882459+0000","last_fullsized":"2023-11-24T06:16:01.882459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861433+0000","last_change":"2023-11-24T06:16:01.873697+0000","last_active":"2023-11-24T06:16:02.861433+0000","last_peered":"2023-11-24T06:16:02.861433+0000","last_clean":"2023-11-24T06:16:02.861433+0000","last_became_active":"2023-11-24T06:16:01.873402+0000","last_became_peered":"2023-11-24T06:16:01.873402+0000","last_unstale":"2023-11-24T06:16:02.861433+0000","last_undegraded":"2023-11-24T06:16:02.861433+0000","last_fullsized":"2023-11-24T06:16:02.861433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805623+0000","last_change":"2023-11-24T06:16:00.866396+0000","last_active":"2023-11-24T06:16:03.805623+0000","last_peered":"2023-11-24T06:16:03.805623+0000","last_clean":"2023-11-24T06:16:03.805623+0000","last_became_active":"2023-11-24T06:16:00.866108+0000","last_became_peered":"2023-11-24T06:16:00.866108+0000","last_unstale":"2023-11-24T06:16:03.805623+0000","last_undegraded":"2023-11-24T06:16:03.805623+0000","last_fullsized":"2023-11-24T06:16:03.805623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:20.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805453+0000","last_change":"2023-11-24T06:16:01.868555+0000","last_active":"2023-11-24T06:16:03.805453+0000","last_peered":"2023-11-24T06:16:03.805453+0000","last_clean":"2023-11-24T06:16:03.805453+0000","last_became_active":"2023-11-24T06:16:01.867961+0000","last_became_peered":"2023-11-24T06:16:01.867961+0000","last_unstale":"2023-11-24T06:16:03.805453+0000","last_undegraded":"2023-11-24T06:16:03.805453+0000","last_fullsized":"2023-11-24T06:16:03.805453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861481+0000","last_change":"2023-11-24T06:16:00.850960+0000","last_active":"2023-11-24T06:16:02.861481+0000","last_peered":"2023-11-24T06:16:02.861481+0000","last_clean":"2023-11-24T06:16:02.861481+0000","last_became_active":"2023-11-24T06:16:00.850660+0000","last_became_peered":"2023-11-24T06:16:00.850660+0000","last_unstale":"2023-11-24T06:16:02.861481+0000","last_undegraded":"2023-11-24T06:16:02.861481+0000","last_fullsized":"2023-11-24T06:16:02.861481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:06.596728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863669+0000","last_change":"2023-11-24T06:16:01.864017+0000","last_active":"2023-11-24T06:16:02.863669+0000","last_peered":"2023-11-24T06:16:02.863669+0000","last_clean":"2023-11-24T06:16:02.863669+0000","last_became_active":"2023-11-24T06:16:01.860270+0000","last_became_peered":"2023-11-24T06:16:01.860270+0000","last_unstale":"2023-11-24T06:16:02.863669+0000","last_undegraded":"2023-11-24T06:16:02.863669+0000","last_fullsized":"2023-11-24T06:16:02.863669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.889648+0000","last_change":"2023-11-24T06:16:00.853390+0000","last_active":"2023-11-24T06:16:01.889648+0000","last_peered":"2023-11-24T06:16:01.889648+0000","last_clean":"2023-11-24T06:16:01.889648+0000","last_became_active":"2023-11-24T06:16:00.853099+0000","last_became_peered":"2023-11-24T06:16:00.853099+0000","last_unstale":"2023-11-24T06:16:01.889648+0000","last_undegraded":"2023-11-24T06:16:01.889648+0000","last_fullsized":"2023-11-24T06:16:01.889648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:00.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863371+0000","last_change":"2023-11-24T06:16:01.862905+0000","last_active":"2023-11-24T06:16:02.863371+0000","last_peered":"2023-11-24T06:16:02.863371+0000","last_clean":"2023-11-24T06:16:02.863371+0000","last_became_active":"2023-11-24T06:16:01.862219+0000","last_became_peered":"2023-11-24T06:16:01.862219+0000","last_unstale":"2023-11-24T06:16:02.863371+0000","last_undegraded":"2023-11-24T06:16:02.863371+0000","last_fullsized":"2023-11-24T06:16:02.863371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:00.617715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.887172+0000","last_change":"2023-11-24T06:16:00.859519+0000","last_active":"2023-11-24T06:16:01.887172+0000","last_peered":"2023-11-24T06:16:01.887172+0000","last_clean":"2023-11-24T06:16:01.887172+0000","last_became_active":"2023-11-24T06:16:00.859216+0000","last_became_peered":"2023-11-24T06:16:00.859216+0000","last_unstale":"2023-11-24T06:16:01.887172+0000","last_undegraded":"2023-11-24T06:16:01.887172+0000","last_fullsized":"2023-11-24T06:16:01.887172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:50.400301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.880968+0000","last_change":"2023-11-24T06:16:01.875990+0000","last_active":"2023-11-24T06:16:01.880968+0000","last_peered":"2023-11-24T06:16:01.880968+0000","last_clean":"2023-11-24T06:16:01.880968+0000","last_became_active":"2023-11-24T06:16:01.875737+0000","last_became_peered":"2023-11-24T06:16:01.875737+0000","last_unstale":"2023-11-24T06:16:01.880968+0000","last_undegraded":"2023-11-24T06:16:01.880968+0000","last_fullsized":"2023-11-24T06:16:01.880968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863390+0000","last_change":"2023-11-24T06:16:00.857465+0000","last_active":"2023-11-24T06:16:02.863390+0000","last_peered":"2023-11-24T06:16:02.863390+0000","last_clean":"2023-11-24T06:16:02.863390+0000","last_became_active":"2023-11-24T06:16:00.857115+0000","last_became_peered":"2023-11-24T06:16:00.857115+0000","last_unstale":"2023-11-24T06:16:02.863390+0000","last_undegraded":"2023-11-24T06:16:02.863390+0000","last_fullsized":"2023-11-24T06:16:02.863390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:28.844115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877954+0000","last_change":"2023-11-24T06:16:01.875120+0000","last_active":"2023-11-24T06:16:01.877954+0000","last_peered":"2023-11-24T06:16:01.877954+0000","last_clean":"2023-11-24T06:16:01.877954+0000","last_became_active":"2023-11-24T06:16:01.871004+0000","last_became_peered":"2023-11-24T06:16:01.871004+0000","last_unstale":"2023-11-24T06:16:01.877954+0000","last_undegraded":"2023-11-24T06:16:01.877954+0000","last_fullsized":"2023-11-24T06:16:01.877954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:36.526994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862995+0000","last_change":"2023-11-24T06:16:00.853425+0000","last_active":"2023-11-24T06:16:02.862995+0000","last_peered":"2023-11-24T06:16:02.862995+0000","last_clean":"2023-11-24T06:16:02.862995+0000","last_became_active":"2023-11-24T06:16:00.853071+0000","last_became_peered":"2023-11-24T06:16:00.853071+0000","last_unstale":"2023-11-24T06:16:02.862995+0000","last_undegraded":"2023-11-24T06:16:02.862995+0000","last_fullsized":"2023-11-24T06:16:02.862995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:37.521483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862956+0000","last_change":"2023-11-24T06:16:01.870343+0000","last_active":"2023-11-24T06:16:02.862956+0000","last_peered":"2023-11-24T06:16:02.862956+0000","last_clean":"2023-11-24T06:16:02.862956+0000","last_became_active":"2023-11-24T06:16:01.866822+0000","last_became_peered":"2023-11-24T06:16:01.866822+0000","last_unstale":"2023-11-24T06:16:02.862956+0000","last_undegraded":"2023-11-24T06:16:02.862956+0000","last_fullsized":"2023-11-24T06:16:02.862956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.838303+0000","last_change":"2023-11-24T06:16:00.859142+0000","last_active":"2023-11-24T06:16:01.838303+0000","last_peered":"2023-11-24T06:16:01.838303+0000","last_clean":"2023-11-24T06:16:01.838303+0000","last_became_active":"2023-11-24T06:16:00.858853+0000","last_became_peered":"2023-11-24T06:16:00.858853+0000","last_unstale":"2023-11-24T06:16:01.838303+0000","last_undegraded":"2023-11-24T06:16:01.838303+0000","last_fullsized":"2023-11-24T06:16:01.838303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:36.016067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860369+0000","last_change":"2023-11-24T06:16:01.863972+0000","last_active":"2023-11-24T06:16:02.860369+0000","last_peered":"2023-11-24T06:16:02.860369+0000","last_clean":"2023-11-24T06:16:02.860369+0000","last_became_active":"2023-11-24T06:16:01.863630+0000","last_became_peered":"2023-11-24T06:16:01.863630+0000","last_unstale":"2023-11-24T06:16:02.860369+0000","last_undegraded":"2023-11-24T06:16:02.860369+0000","last_fullsized":"2023-11-24T06:16:02.860369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862590+0000","last_change":"2023-11-24T06:16:00.856448+0000","last_active":"2023-11-24T06:16:02.862590+0000","last_peered":"2023-11-24T06:16:02.862590+0000","last_clean":"2023-11-24T06:16:02.862590+0000","last_became_active":"2023-11-24T06:16:00.856125+0000","last_became_peered":"2023-11-24T06:16:00.856125+0000","last_unstale":"2023-11-24T06:16:02.862590+0000","last_undegraded":"2023-11-24T06:16:02.862590+0000","last_fullsized":"2023-11-24T06:16:02.862590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:20.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876678+0000","last_change":"2023-11-24T06:16:01.863539+0000","last_active":"2023-11-24T06:16:01.876678+0000","last_peered":"2023-11-24T06:16:01.876678+0000","last_clean":"2023-11-24T06:16:01.876678+0000","last_became_active":"2023-11-24T06:16:01.863247+0000","last_became_peered":"2023-11-24T06:16:01.863247+0000","last_unstale":"2023-11-24T06:16:01.876678+0000","last_undegraded":"2023-11-24T06:16:01.876678+0000","last_fullsized":"2023-11-24T06:16:01.876678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.836852+0000","last_change":"2023-11-24T06:16:00.863703+0000","last_active":"2023-11-24T06:16:01.836852+0000","last_peered":"2023-11-24T06:16:01.836852+0000","last_clean":"2023-11-24T06:16:01.836852+0000","last_became_active":"2023-11-24T06:16:00.863399+0000","last_became_peered":"2023-11-24T06:16:00.863399+0000","last_unstale":"2023-11-24T06:16:01.836852+0000","last_undegraded":"2023-11-24T06:16:01.836852+0000","last_fullsized":"2023-11-24T06:16:01.836852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:43.081555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.874384+0000","last_change":"2023-11-24T06:16:01.867600+0000","last_active":"2023-11-24T06:16:01.874384+0000","last_peered":"2023-11-24T06:16:01.874384+0000","last_clean":"2023-11-24T06:16:01.874384+0000","last_became_active":"2023-11-24T06:16:01.867314+0000","last_became_peered":"2023-11-24T06:16:01.867314+0000","last_unstale":"2023-11-24T06:16:01.874384+0000","last_undegraded":"2023-11-24T06:16:01.874384+0000","last_fullsized":"2023-11-24T06:16:01.874384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:00.617715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861717+0000","last_change":"2023-11-24T06:16:00.847447+0000","last_active":"2023-11-24T06:16:02.861717+0000","last_peered":"2023-11-24T06:16:02.861717+0000","last_clean":"2023-11-24T06:16:02.861717+0000","last_became_active":"2023-11-24T06:16:00.846701+0000","last_became_peered":"2023-11-24T06:16:00.846701+0000","last_unstale":"2023-11-24T06:16:02.861717+0000","last_undegraded":"2023-11-24T06:16:02.861717+0000","last_fullsized":"2023-11-24T06:16:02.861717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:20.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876787+0000","last_change":"2023-11-24T06:16:01.872316+0000","last_active":"2023-11-24T06:16:01.876787+0000","last_peered":"2023-11-24T06:16:01.876787+0000","last_clean":"2023-11-24T06:16:01.876787+0000","last_became_active":"2023-11-24T06:16:01.871928+0000","last_became_peered":"2023-11-24T06:16:01.871928+0000","last_unstale":"2023-11-24T06:16:01.876787+0000","last_undegraded":"2023-11-24T06:16:01.876787+0000","last_fullsized":"2023-11-24T06:16:01.876787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:56.546783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.886703+0000","last_change":"2023-11-24T06:16:00.866935+0000","last_active":"2023-11-24T06:16:01.886703+0000","last_peered":"2023-11-24T06:16:01.886703+0000","last_clean":"2023-11-24T06:16:01.886703+0000","last_became_active":"2023-11-24T06:16:00.866627+0000","last_became_peered":"2023-11-24T06:16:00.866627+0000","last_unstale":"2023-11-24T06:16:01.886703+0000","last_undegraded":"2023-11-24T06:16:01.886703+0000","last_fullsized":"2023-11-24T06:16:01.886703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:18.937431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877450+0000","last_change":"2023-11-24T06:16:01.863299+0000","last_active":"2023-11-24T06:16:01.877450+0000","last_peered":"2023-11-24T06:16:01.877450+0000","last_clean":"2023-11-24T06:16:01.877450+0000","last_became_active":"2023-11-24T06:16:01.862420+0000","last_became_peered":"2023-11-24T06:16:01.862420+0000","last_unstale":"2023-11-24T06:16:01.877450+0000","last_undegraded":"2023-11-24T06:16:01.877450+0000","last_fullsized":"2023-11-24T06:16:01.877450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.891880+0000","last_change":"2023-11-24T06:16:00.853633+0000","last_active":"2023-11-24T06:16:01.891880+0000","last_peered":"2023-11-24T06:16:01.891880+0000","last_clean":"2023-11-24T06:16:01.891880+0000","last_became_active":"2023-11-24T06:16:00.853282+0000","last_became_peered":"2023-11-24T06:16:00.853282+0000","last_unstale":"2023-11-24T06:16:01.891880+0000","last_undegraded":"2023-11-24T06:16:01.891880+0000","last_fullsized":"2023-11-24T06:16:01.891880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:26.342906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860517+0000","last_change":"2023-11-24T06:16:01.863447+0000","last_active":"2023-11-24T06:16:02.860517+0000","last_peered":"2023-11-24T06:16:02.860517+0000","last_clean":"2023-11-24T06:16:02.860517+0000","last_became_active":"2023-11-24T06:16:01.863178+0000","last_became_peered":"2023-11-24T06:16:01.863178+0000","last_unstale":"2023-11-24T06:16:02.860517+0000","last_undegraded":"2023-11-24T06:16:02.860517+0000","last_fullsized":"2023-11-24T06:16:02.860517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863515+0000","last_change":"2023-11-24T06:16:00.863211+0000","last_active":"2023-11-24T06:16:02.863515+0000","last_peered":"2023-11-24T06:16:02.863515+0000","last_clean":"2023-11-24T06:16:02.863515+0000","last_became_active":"2023-11-24T06:16:00.862670+0000","last_became_peered":"2023-11-24T06:16:00.862670+0000","last_unstale":"2023-11-24T06:16:02.863515+0000","last_undegraded":"2023-11-24T06:16:02.863515+0000","last_fullsized":"2023-11-24T06:16:02.863515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:27.118283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876136+0000","last_change":"2023-11-24T06:16:01.870042+0000","last_active":"2023-11-24T06:16:01.876136+0000","last_peered":"2023-11-24T06:16:01.876136+0000","last_clean":"2023-11-24T06:16:01.876136+0000","last_became_active":"2023-11-24T06:16:01.869671+0000","last_became_peered":"2023-11-24T06:16:01.869671+0000","last_unstale":"2023-11-24T06:16:01.876136+0000","last_undegraded":"2023-11-24T06:16:01.876136+0000","last_fullsized":"2023-11-24T06:16:01.876136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860695+0000","last_change":"2023-11-24T06:16:00.861546+0000","last_active":"2023-11-24T06:16:02.860695+0000","last_peered":"2023-11-24T06:16:02.860695+0000","last_clean":"2023-11-24T06:16:02.860695+0000","last_became_active":"2023-11-24T06:16:00.860890+0000","last_became_peered":"2023-11-24T06:16:00.860890+0000","last_unstale":"2023-11-24T06:16:02.860695+0000","last_undegraded":"2023-11-24T06:16:02.860695+0000","last_fullsized":"2023-11-24T06:16:02.860695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:35.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882738+0000","last_change":"2023-11-24T06:16:01.879302+0000","last_active":"2023-11-24T06:16:01.882738+0000","last_peered":"2023-11-24T06:16:01.882738+0000","last_clean":"2023-11-24T06:16:01.882738+0000","last_became_active":"2023-11-24T06:16:01.877057+0000","last_became_peered":"2023-11-24T06:16:01.877057+0000","last_unstale":"2023-11-24T06:16:01.882738+0000","last_undegraded":"2023-11-24T06:16:01.882738+0000","last_fullsized":"2023-11-24T06:16:01.882738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.835594+0000","last_change":"2023-11-24T06:16:00.866956+0000","last_active":"2023-11-24T06:16:01.835594+0000","last_peered":"2023-11-24T06:16:01.835594+0000","last_clean":"2023-11-24T06:16:01.835594+0000","last_became_active":"2023-11-24T06:16:00.866585+0000","last_became_peered":"2023-11-24T06:16:00.866585+0000","last_unstale":"2023-11-24T06:16:01.835594+0000","last_undegraded":"2023-11-24T06:16:01.835594+0000","last_fullsized":"2023-11-24T06:16:01.835594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:52.491262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805640+0000","last_change":"2023-11-24T06:16:01.863989+0000","last_active":"2023-11-24T06:16:03.805640+0000","last_peered":"2023-11-24T06:16:03.805640+0000","last_clean":"2023-11-24T06:16:03.805640+0000","last_became_active":"2023-11-24T06:16:01.863648+0000","last_became_peered":"2023-11-24T06:16:01.863648+0000","last_unstale":"2023-11-24T06:16:03.805640+0000","last_undegraded":"2023-11-24T06:16:03.805640+0000","last_fullsized":"2023-11-24T06:16:03.805640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.890500+0000","last_change":"2023-11-24T06:16:00.855584+0000","last_active":"2023-11-24T06:16:01.890500+0000","last_peered":"2023-11-24T06:16:01.890500+0000","last_clean":"2023-11-24T06:16:01.890500+0000","last_became_active":"2023-11-24T06:16:00.855255+0000","last_became_peered":"2023-11-24T06:16:00.855255+0000","last_unstale":"2023-11-24T06:16:01.890500+0000","last_undegraded":"2023-11-24T06:16:01.890500+0000","last_fullsized":"2023-11-24T06:16:01.890500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:37.521483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863689+0000","last_change":"2023-11-24T06:16:01.866626+0000","last_active":"2023-11-24T06:16:02.863689+0000","last_peered":"2023-11-24T06:16:02.863689+0000","last_clean":"2023-11-24T06:16:02.863689+0000","last_became_active":"2023-11-24T06:16:01.865100+0000","last_became_peered":"2023-11-24T06:16:01.865100+0000","last_unstale":"2023-11-24T06:16:02.863689+0000","last_undegraded":"2023-11-24T06:16:02.863689+0000","last_fullsized":"2023-11-24T06:16:02.863689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863495+0000","last_change":"2023-11-24T06:16:00.853616+0000","last_active":"2023-11-24T06:16:02.863495+0000","last_peered":"2023-11-24T06:16:02.863495+0000","last_clean":"2023-11-24T06:16:02.863495+0000","last_became_active":"2023-11-24T06:16:00.852894+0000","last_became_peered":"2023-11-24T06:16:00.852894+0000","last_unstale":"2023-11-24T06:16:02.863495+0000","last_undegraded":"2023-11-24T06:16:02.863495+0000","last_fullsized":"2023-11-24T06:16:02.863495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:26.342906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.868414+0000","last_change":"2023-11-24T06:16:01.862033+0000","last_active":"2023-11-24T06:16:01.868414+0000","last_peered":"2023-11-24T06:16:01.868414+0000","last_clean":"2023-11-24T06:16:01.868414+0000","last_became_active":"2023-11-24T06:16:01.861745+0000","last_became_peered":"2023-11-24T06:16:01.861745+0000","last_unstale":"2023-11-24T06:16:01.868414+0000","last_undegraded":"2023-11-24T06:16:01.868414+0000","last_fullsized":"2023-11-24T06:16:01.868414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863826+0000","last_change":"2023-11-24T06:16:00.862708+0000","last_active":"2023-11-24T06:16:02.863826+0000","last_peered":"2023-11-24T06:16:02.863826+0000","last_clean":"2023-11-24T06:16:02.863826+0000","last_became_active":"2023-11-24T06:16:00.862405+0000","last_became_peered":"2023-11-24T06:16:00.862405+0000","last_unstale":"2023-11-24T06:16:02.863826+0000","last_undegraded":"2023-11-24T06:16:02.863826+0000","last_fullsized":"2023-11-24T06:16:02.863826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:09.814859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862879+0000","last_change":"2023-11-24T06:16:01.857792+0000","last_active":"2023-11-24T06:16:02.862879+0000","last_peered":"2023-11-24T06:16:02.862879+0000","last_clean":"2023-11-24T06:16:02.862879+0000","last_became_active":"2023-11-24T06:16:01.856934+0000","last_became_peered":"2023-11-24T06:16:01.856934+0000","last_unstale":"2023-11-24T06:16:02.862879+0000","last_undegraded":"2023-11-24T06:16:02.862879+0000","last_fullsized":"2023-11-24T06:16:02.862879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863741+0000","last_change":"2023-11-24T06:16:00.860416+0000","last_active":"2023-11-24T06:16:02.863741+0000","last_peered":"2023-11-24T06:16:02.863741+0000","last_clean":"2023-11-24T06:16:02.863741+0000","last_became_active":"2023-11-24T06:16:00.859440+0000","last_became_peered":"2023-11-24T06:16:00.859440+0000","last_unstale":"2023-11-24T06:16:02.863741+0000","last_undegraded":"2023-11-24T06:16:02.863741+0000","last_fullsized":"2023-11-24T06:16:02.863741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:29.109694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.879242+0000","last_change":"2023-11-24T06:16:01.873965+0000","last_active":"2023-11-24T06:16:01.879242+0000","last_peered":"2023-11-24T06:16:01.879242+0000","last_clean":"2023-11-24T06:16:01.879242+0000","last_became_active":"2023-11-24T06:16:01.873258+0000","last_became_peered":"2023-11-24T06:16:01.873258+0000","last_unstale":"2023-11-24T06:16:01.879242+0000","last_undegraded":"2023-11-24T06:16:01.879242+0000","last_fullsized":"2023-11-24T06:16:01.879242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:31.777836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863561+0000","last_change":"2023-11-24T06:16:00.861403+0000","last_active":"2023-11-24T06:16:02.863561+0000","last_peered":"2023-11-24T06:16:02.863561+0000","last_clean":"2023-11-24T06:16:02.863561+0000","last_became_active":"2023-11-24T06:16:00.861099+0000","last_became_peered":"2023-11-24T06:16:00.861099+0000","last_unstale":"2023-11-24T06:16:02.863561+0000","last_undegraded":"2023-11-24T06:16:02.863561+0000","last_fullsized":"2023-11-24T06:16:02.863561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:06.596728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.864915+0000","last_change":"2023-11-24T06:16:01.861830+0000","last_active":"2023-11-24T06:16:01.864915+0000","last_peered":"2023-11-24T06:16:01.864915+0000","last_clean":"2023-11-24T06:16:01.864915+0000","last_became_active":"2023-11-24T06:16:01.861469+0000","last_became_peered":"2023-11-24T06:16:01.861469+0000","last_unstale":"2023-11-24T06:16:01.864915+0000","last_undegraded":"2023-11-24T06:16:01.864915+0000","last_fullsized":"2023-11-24T06:16:01.864915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:00:43.643777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862110+0000","last_change":"2023-11-24T06:16:00.838020+0000","last_active":"2023-11-24T06:16:02.862110+0000","last_peered":"2023-11-24T06:16:02.862110+0000","last_clean":"2023-11-24T06:16:02.862110+0000","last_became_active":"2023-11-24T06:16:00.837700+0000","last_became_peered":"2023-11-24T06:16:00.837700+0000","last_unstale":"2023-11-24T06:16:02.862110+0000","last_undegraded":"2023-11-24T06:16:02.862110+0000","last_fullsized":"2023-11-24T06:16:02.862110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:35.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.870608+0000","last_change":"2023-11-24T06:16:01.867934+0000","last_active":"2023-11-24T06:16:01.870608+0000","last_peered":"2023-11-24T06:16:01.870608+0000","last_clean":"2023-11-24T06:16:01.870608+0000","last_became_active":"2023-11-24T06:16:01.867630+0000","last_became_peered":"2023-11-24T06:16:01.867630+0000","last_unstale":"2023-11-24T06:16:01.870608+0000","last_undegraded":"2023-11-24T06:16:01.870608+0000","last_fullsized":"2023-11-24T06:16:01.870608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:41.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805073+0000","last_change":"2023-11-24T06:16:00.862060+0000","last_active":"2023-11-24T06:16:03.805073+0000","last_peered":"2023-11-24T06:16:03.805073+0000","last_clean":"2023-11-24T06:16:03.805073+0000","last_became_active":"2023-11-24T06:16:00.861685+0000","last_became_peered":"2023-11-24T06:16:00.861685+0000","last_unstale":"2023-11-24T06:16:03.805073+0000","last_undegraded":"2023-11-24T06:16:03.805073+0000","last_fullsized":"2023-11-24T06:16:03.805073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:27.118283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.870394+0000","last_change":"2023-11-24T06:16:01.866931+0000","last_active":"2023-11-24T06:16:01.870394+0000","last_peered":"2023-11-24T06:16:01.870394+0000","last_clean":"2023-11-24T06:16:01.870394+0000","last_became_active":"2023-11-24T06:16:01.866123+0000","last_became_peered":"2023-11-24T06:16:01.866123+0000","last_unstale":"2023-11-24T06:16:01.870394+0000","last_undegraded":"2023-11-24T06:16:01.870394+0000","last_fullsized":"2023-11-24T06:16:01.870394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:44.342676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862590+0000","last_change":"2023-11-24T06:16:00.855131+0000","last_active":"2023-11-24T06:16:02.862590+0000","last_peered":"2023-11-24T06:16:02.862590+0000","last_clean":"2023-11-24T06:16:02.862590+0000","last_became_active":"2023-11-24T06:16:00.854376+0000","last_became_peered":"2023-11-24T06:16:00.854376+0000","last_unstale":"2023-11-24T06:16:02.862590+0000","last_undegraded":"2023-11-24T06:16:02.862590+0000","last_fullsized":"2023-11-24T06:16:02.862590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:36.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875391+0000","last_change":"2023-11-24T06:16:01.871109+0000","last_active":"2023-11-24T06:16:01.875391+0000","last_peered":"2023-11-24T06:16:01.875391+0000","last_clean":"2023-11-24T06:16:01.875391+0000","last_became_active":"2023-11-24T06:16:01.870770+0000","last_became_peered":"2023-11-24T06:16:01.870770+0000","last_unstale":"2023-11-24T06:16:01.875391+0000","last_undegraded":"2023-11-24T06:16:01.875391+0000","last_fullsized":"2023-11-24T06:16:01.875391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:36.526994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.838716+0000","last_change":"2023-11-24T06:16:00.863490+0000","last_active":"2023-11-24T06:16:01.838716+0000","last_peered":"2023-11-24T06:16:01.838716+0000","last_clean":"2023-11-24T06:16:01.838716+0000","last_became_active":"2023-11-24T06:16:00.863177+0000","last_became_peered":"2023-11-24T06:16:00.863177+0000","last_unstale":"2023-11-24T06:16:01.838716+0000","last_undegraded":"2023-11-24T06:16:01.838716+0000","last_fullsized":"2023-11-24T06:16:01.838716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:00.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.880213+0000","last_change":"2023-11-24T06:16:01.877685+0000","last_active":"2023-11-24T06:16:01.880213+0000","last_peered":"2023-11-24T06:16:01.880213+0000","last_clean":"2023-11-24T06:16:01.880213+0000","last_became_active":"2023-11-24T06:16:01.874939+0000","last_became_peered":"2023-11-24T06:16:01.874939+0000","last_unstale":"2023-11-24T06:16:01.880213+0000","last_undegraded":"2023-11-24T06:16:01.880213+0000","last_fullsized":"2023-11-24T06:16:01.880213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:03.745391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863627+0000","last_change":"2023-11-24T06:16:00.859523+0000","last_active":"2023-11-24T06:16:02.863627+0000","last_peered":"2023-11-24T06:16:02.863627+0000","last_clean":"2023-11-24T06:16:02.863627+0000","last_became_active":"2023-11-24T06:16:00.859044+0000","last_became_peered":"2023-11-24T06:16:00.859044+0000","last_unstale":"2023-11-24T06:16:02.863627+0000","last_undegraded":"2023-11-24T06:16:02.863627+0000","last_fullsized":"2023-11-24T06:16:02.863627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:00.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.878636+0000","last_change":"2023-11-24T06:16:01.872677+0000","last_active":"2023-11-24T06:16:01.878636+0000","last_peered":"2023-11-24T06:16:01.878636+0000","last_clean":"2023-11-24T06:16:01.878636+0000","last_became_active":"2023-11-24T06:16:01.872400+0000","last_became_peered":"2023-11-24T06:16:01.872400+0000","last_unstale":"2023-11-24T06:16:01.878636+0000","last_undegraded":"2023-11-24T06:16:01.878636+0000","last_fullsized":"2023-11-24T06:16:01.878636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:38.536544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.956502+0000","last_change":"2023-11-24T06:16:00.839164+0000","last_active":"2023-11-24T06:16:02.956502+0000","last_peered":"2023-11-24T06:16:02.956502+0000","last_clean":"2023-11-24T06:16:02.956502+0000","last_became_active":"2023-11-24T06:16:00.838458+0000","last_became_peered":"2023-11-24T06:16:00.838458+0000","last_unstale":"2023-11-24T06:16:02.956502+0000","last_undegraded":"2023-11-24T06:16:02.956502+0000","last_fullsized":"2023-11-24T06:16:02.956502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:27.118283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861457+0000","last_change":"2023-11-24T06:16:01.870377+0000","last_active":"2023-11-24T06:16:02.861457+0000","last_peered":"2023-11-24T06:16:02.861457+0000","last_clean":"2023-11-24T06:16:02.861457+0000","last_became_active":"2023-11-24T06:16:01.868973+0000","last_became_peered":"2023-11-24T06:16:01.868973+0000","last_unstale":"2023-11-24T06:16:02.861457+0000","last_undegraded":"2023-11-24T06:16:02.861457+0000","last_fullsized":"2023-11-24T06:16:02.861457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862799+0000","last_change":"2023-11-24T06:16:00.856128+0000","last_active":"2023-11-24T06:16:02.862799+0000","last_peered":"2023-11-24T06:16:02.862799+0000","last_clean":"2023-11-24T06:16:02.862799+0000","last_became_active":"2023-11-24T06:16:00.855787+0000","last_became_peered":"2023-11-24T06:16:00.855787+0000","last_unstale":"2023-11-24T06:16:02.862799+0000","last_undegraded":"2023-11-24T06:16:02.862799+0000","last_fullsized":"2023-11-24T06:16:02.862799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:09.814859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.804919+0000","last_change":"2023-11-24T06:16:01.870314+0000","last_active":"2023-11-24T06:16:03.804919+0000","last_peered":"2023-11-24T06:16:03.804919+0000","last_clean":"2023-11-24T06:16:03.804919+0000","last_became_active":"2023-11-24T06:16:01.869953+0000","last_became_peered":"2023-11-24T06:16:01.869953+0000","last_unstale":"2023-11-24T06:16:03.804919+0000","last_undegraded":"2023-11-24T06:16:03.804919+0000","last_fullsized":"2023-11-24T06:16:03.804919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:36.526994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862431+0000","last_change":"2023-11-24T06:16:00.853025+0000","last_active":"2023-11-24T06:16:02.862431+0000","last_peered":"2023-11-24T06:16:02.862431+0000","last_clean":"2023-11-24T06:16:02.862431+0000","last_became_active":"2023-11-24T06:16:00.852695+0000","last_became_peered":"2023-11-24T06:16:00.852695+0000","last_unstale":"2023-11-24T06:16:02.862431+0000","last_undegraded":"2023-11-24T06:16:02.862431+0000","last_fullsized":"2023-11-24T06:16:02.862431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:09.814859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862151+0000","last_change":"2023-11-24T06:16:01.874902+0000","last_active":"2023-11-24T06:16:02.862151+0000","last_peered":"2023-11-24T06:16:02.862151+0000","last_clean":"2023-11-24T06:16:02.862151+0000","last_became_active":"2023-11-24T06:16:01.874602+0000","last_became_peered":"2023-11-24T06:16:01.874602+0000","last_unstale":"2023-11-24T06:16:02.862151+0000","last_undegraded":"2023-11-24T06:16:02.862151+0000","last_fullsized":"2023-11-24T06:16:02.862151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:01.920931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861257+0000","last_change":"2023-11-24T06:16:00.859373+0000","last_active":"2023-11-24T06:16:02.861257+0000","last_peered":"2023-11-24T06:16:02.861257+0000","last_clean":"2023-11-24T06:16:02.861257+0000","last_became_active":"2023-11-24T06:16:00.859110+0000","last_became_peered":"2023-11-24T06:16:00.859110+0000","last_unstale":"2023-11-24T06:16:02.861257+0000","last_undegraded":"2023-11-24T06:16:02.861257+0000","last_fullsized":"2023-11-24T06:16:02.861257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:07.332320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875296+0000","last_change":"2023-11-24T06:16:01.860114+0000","last_active":"2023-11-24T06:16:01.875296+0000","last_peered":"2023-11-24T06:16:01.875296+0000","last_clean":"2023-11-24T06:16:01.875296+0000","last_became_active":"2023-11-24T06:16:01.859791+0000","last_became_peered":"2023-11-24T06:16:01.859791+0000","last_unstale":"2023-11-24T06:16:01.875296+0000","last_undegraded":"2023-11-24T06:16:01.875296+0000","last_fullsized":"2023-11-24T06:16:01.875296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862835+0000","last_change":"2023-11-24T06:16:00.854030+0000","last_active":"2023-11-24T06:16:02.862835+0000","last_peered":"2023-11-24T06:16:02.862835+0000","last_clean":"2023-11-24T06:16:02.862835+0000","last_became_active":"2023-11-24T06:16:00.853057+0000","last_became_peered":"2023-11-24T06:16:00.853057+0000","last_unstale":"2023-11-24T06:16:02.862835+0000","last_undegraded":"2023-11-24T06:16:02.862835+0000","last_fullsized":"2023-11-24T06:16:02.862835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:00.541051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862688+0000","last_change":"2023-11-24T06:16:01.861645+0000","last_active":"2023-11-24T06:16:02.862688+0000","last_peered":"2023-11-24T06:16:02.862688+0000","last_clean":"2023-11-24T06:16:02.862688+0000","last_became_active":"2023-11-24T06:16:01.861348+0000","last_became_peered":"2023-11-24T06:16:01.861348+0000","last_unstale":"2023-11-24T06:16:02.862688+0000","last_undegraded":"2023-11-24T06:16:02.862688+0000","last_fullsized":"2023-11-24T06:16:02.862688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.833198+0000","last_change":"2023-11-24T06:16:00.863256+0000","last_active":"2023-11-24T06:16:01.833198+0000","last_peered":"2023-11-24T06:16:01.833198+0000","last_clean":"2023-11-24T06:16:01.833198+0000","last_became_active":"2023-11-24T06:16:00.862974+0000","last_became_peered":"2023-11-24T06:16:00.862974+0000","last_unstale":"2023-11-24T06:16:01.833198+0000","last_undegraded":"2023-11-24T06:16:01.833198+0000","last_fullsized":"2023-11-24T06:16:01.833198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:35.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875362+0000","last_change":"2023-11-24T06:16:01.867521+0000","last_active":"2023-11-24T06:16:01.875362+0000","last_peered":"2023-11-24T06:16:01.875362+0000","last_clean":"2023-11-24T06:16:01.875362+0000","last_became_active":"2023-11-24T06:16:01.867269+0000","last_became_peered":"2023-11-24T06:16:01.867269+0000","last_unstale":"2023-11-24T06:16:01.875362+0000","last_undegraded":"2023-11-24T06:16:01.875362+0000","last_fullsized":"2023-11-24T06:16:01.875362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.804963+0000","last_change":"2023-11-24T06:16:00.868631+0000","last_active":"2023-11-24T06:16:03.804963+0000","last_peered":"2023-11-24T06:16:03.804963+0000","last_clean":"2023-11-24T06:16:03.804963+0000","last_became_active":"2023-11-24T06:16:00.868207+0000","last_became_peered":"2023-11-24T06:16:00.868207+0000","last_unstale":"2023-11-24T06:16:03.804963+0000","last_undegraded":"2023-11-24T06:16:03.804963+0000","last_fullsized":"2023-11-24T06:16:03.804963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:06.596728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:16:00.857602+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:16:00.857602+0000","last_peered":"2023-11-24T06:16:00.857602+0000","last_clean":"2023-11-24T06:16:00.857602+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:16:00.857602+0000","last_undegraded":"2023-11-24T06:16:00.857602+0000","last_fullsized":"2023-11-24T06:16:00.857602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":730912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.385}]},{"osd":2,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.2749999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.3520000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.45},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.49},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.3220000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.042},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.95699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.401},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.4510000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.6419999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.9339999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.2509999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":2.0350000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.7430000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":4.0819999999999999,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.8520000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.1760000000000002,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":4.2709999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.9730000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":2}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.745}]},{"osd":1,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.0800000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.179}]},{"osd":3,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.129},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.4119999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.375},{"interface":"front","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.337}]},{"osd":7,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.5790000000000002,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.48},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.4410000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":146858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.643},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2270000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.5169999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.552}]},{"osd":5,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.3580000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":3.6539999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.7210000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.161},{"interface":"front","average":{"1min":1.73,"5min":1.73,"15min":1.73},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":3.7360000000000002,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.4630000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":142088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.626},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.746}]},{"osd":1,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":11.903,"5min":11.903,"15min":11.903},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":204.87899999999999,"5min":204.87899999999999,"15min":204.87899999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0939999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":3.157,"5min":3.157,"15min":3.157},"last":0.874}]},{"osd":7,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.244}]},{"osd":1,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.099},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.81999999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.2769999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.222},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.6080000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.339},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.4750000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.3480000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.054}]},{"osd":3,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.429},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.27}]},{"osd":4,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":4.8650000000000002,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.371}]},{"osd":5,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":1.681,"15min":1.681},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.466},{"interface":"front","average":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":4.7270000000000003,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.917,"5min":1.917,"15min":1.917},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":7.0990000000000002,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.099}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":737122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.079},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.1479999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.4379999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":5.5439999999999996,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.8859999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.77},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.538}]},{"osd":6,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":8.3689999999999998,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.871,"5min":1.871,"15min":1.871},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":8.7620000000000005,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":4.4790000000000001,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.659},{"interface":"front","average":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":5.8460000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.976}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:06.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:06.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.649+0000 7fc529267640 1 Processor -- start 2023-11-24T06:16:06.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.649+0000 7fc529267640 1 -- start start 2023-11-24T06:16:06.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.651+0000 7fc529267640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc52414b100 0x7fc524162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.651+0000 7fc529267640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc524162eb0 con 0x7fc5240cd160 2023-11-24T06:16:06.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.651+0000 7fc529267640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5241654a0 con 0x7fc5240703f0 2023-11-24T06:16:06.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.651+0000 7fc529267640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240ccf00 con 0x7fc52414b100 2023-11-24T06:16:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.651+0000 7fc523fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc52414b100 0x7fc524162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.651+0000 7fc523fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc52414b100 0x7fc524162970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40064/0 (socket says 172.21.15.37:40064) 2023-11-24T06:16:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.651+0000 7fc523fff640 1 -- 172.21.15.37:0/1787630624 learned_addr learned my addr 172.21.15.37:0/1787630624 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.652+0000 7fc523fff640 1 -- 172.21.15.37:0/1787630624 >> v1:172.21.15.188:6789/0 conn(0x7fc5240703f0 legacy=0x7fc524165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.652+0000 7fc523fff640 1 -- 172.21.15.37:0/1787630624 >> v1:172.21.15.37:6789/0 conn(0x7fc5240cd160 legacy=0x7fc5240b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.652+0000 7fc523fff640 1 -- 172.21.15.37:0/1787630624 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc524166320 con 0x7fc52414b100 2023-11-24T06:16:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.654+0000 7fc523fff640 1 --2- 172.21.15.37:0/1787630624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52414b100 0x7fc524162970 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc514009870 tx=0x7fc51402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449421f120316f9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:06.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.654+0000 7fc522ffd640 1 -- 172.21.15.37:0/1787630624 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514031870 con 0x7fc52414b100 2023-11-24T06:16:06.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.654+0000 7fc522ffd640 1 -- 172.21.15.37:0/1787630624 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140319d0 con 0x7fc52414b100 2023-11-24T06:16:06.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.654+0000 7fc522ffd640 1 -- 172.21.15.37:0/1787630624 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514031d60 con 0x7fc52414b100 2023-11-24T06:16:06.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.655+0000 7fc529267640 1 -- 172.21.15.37:0/1787630624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52414b100 msgr2=0x7fc524162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.655+0000 7fc529267640 1 --2- 172.21.15.37:0/1787630624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52414b100 0x7fc524162970 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc514009870 tx=0x7fc51402b910 comp rx=0 tx=0).stop 2023-11-24T06:16:06.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.655+0000 7fc529267640 1 -- 172.21.15.37:0/1787630624 shutdown_connections 2023-11-24T06:16:06.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.655+0000 7fc529267640 1 --2- 172.21.15.37:0/1787630624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52414b100 0x7fc524162970 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.655+0000 7fc529267640 1 -- 172.21.15.37:0/1787630624 >> 172.21.15.37:0/1787630624 conn(0x7fc5240cb830 msgr2=0x7fc5240cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:06.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.655+0000 7fc529267640 1 -- 172.21.15.37:0/1787630624 shutdown_connections 2023-11-24T06:16:06.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.655+0000 7fc529267640 1 -- 172.21.15.37:0/1787630624 wait complete. 2023-11-24T06:16:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.657+0000 7fc529267640 1 Processor -- start 2023-11-24T06:16:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.657+0000 7fc529267640 1 -- start start 2023-11-24T06:16:06.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc529267640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5240703f0 0x7fc524139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc529267640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5240cd160 0x7fc5241fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc529267640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc52414b100 0x7fc5240ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc529267640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240a8430 con 0x7fc5240703f0 2023-11-24T06:16:06.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc529267640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241f8c50 con 0x7fc52414b100 2023-11-24T06:16:06.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc529267640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240a86d0 con 0x7fc5240cd160 2023-11-24T06:16:06.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc523fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5240703f0 0x7fc524139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc523fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5240703f0 0x7fc524139d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40074/0 (socket says 172.21.15.37:40074) 2023-11-24T06:16:06.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.658+0000 7fc523fff640 1 -- 172.21.15.37:0/2366564904 learned_addr learned my addr 172.21.15.37:0/2366564904 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:06.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc523fff640 1 -- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5240cd160 msgr2=0x7fc5241fbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc5237fe640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5240cd160 0x7fc5241fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc528a66640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc52414b100 0x7fc5240ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc523fff640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5240cd160 0x7fc5241fbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc523fff640 1 -- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc52414b100 msgr2=0x7fc5240ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc523fff640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc52414b100 0x7fc5240ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc523fff640 1 -- 172.21.15.37:0/2366564904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140094d0 con 0x7fc5240703f0 2023-11-24T06:16:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc5237fe640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5240cd160 0x7fc5241fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.659+0000 7fc523fff640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5240703f0 0x7fc524139d10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc514009870 tx=0x7fc5140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.660+0000 7fc520ff9640 1 -- 172.21.15.37:0/2366564904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514031820 con 0x7fc5240703f0 2023-11-24T06:16:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.660+0000 7fc520ff9640 1 -- 172.21.15.37:0/2366564904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140443f0 con 0x7fc5240703f0 2023-11-24T06:16:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.660+0000 7fc520ff9640 1 -- 172.21.15.37:0/2366564904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5140447a0 con 0x7fc5240703f0 2023-11-24T06:16:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.660+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5240a89b0 con 0x7fc5240703f0 2023-11-24T06:16:06.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.660+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5241fc2b0 con 0x7fc5240703f0 2023-11-24T06:16:06.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.661+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5240a8ed0 con 0x7fc5240703f0 2023-11-24T06:16:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.662+0000 7fc520ff9640 1 -- 172.21.15.37:0/2366564904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc51404d450 con 0x7fc5240703f0 2023-11-24T06:16:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.663+0000 7fc520ff9640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc51006ae40 0x7fc51006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.663+0000 7fc520ff9640 1 -- 172.21.15.37:0/2366564904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc51402d040 con 0x7fc5240703f0 2023-11-24T06:16:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.663+0000 7fc5237fe640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc51006ae40 0x7fc51006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.664+0000 7fc5237fe640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc51006ae40 0x7fc51006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc524070820 tx=0x7fc518009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:06.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.668+0000 7fc520ff9640 1 -- 172.21.15.37:0/2366564904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5240a8ed0 con 0x7fc5240703f0 2023-11-24T06:16:06.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.859+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc524070eb0 con 0x7fc51006ae40 2023-11-24T06:16:06.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.884+0000 7fc520ff9640 1 -- 172.21.15.37:0/2366564904 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287045 (secure 0 0 0) 0x7fc518005030 con 0x7fc51006ae40 2023-11-24T06:16:06.891 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:06.892 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:16:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc51006ae40 msgr2=0x7fc51006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc51006ae40 0x7fc51006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc524070820 tx=0x7fc518009040 comp rx=0 tx=0).stop 2023-11-24T06:16:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5240703f0 msgr2=0x7fc524139d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5240703f0 0x7fc524139d10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc514009870 tx=0x7fc5140046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 shutdown_connections 2023-11-24T06:16:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc51006ae40 0x7fc51006d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc52414b100 0x7fc5240ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5240cd160 0x7fc5241fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 --2- 172.21.15.37:0/2366564904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5240703f0 0x7fc524139d10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 >> 172.21.15.37:0/2366564904 conn(0x7fc5240cb830 msgr2=0x7fc5240cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 shutdown_connections 2023-11-24T06:16:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:06.891+0000 7fc529267640 1 -- 172.21.15.37:0/2366564904 wait complete. 2023-11-24T06:16:06.914 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-24T06:16:06.838819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220276,"kb_used_data":4076,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754444,"statfs":{"total":773094113280,"available":772868550656,"internally_reserved":0,"allocated":4173824,"data_stored":2328088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.012419"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805384+0000","last_change":"2023-11-24T06:16:01.868584+0000","last_active":"2023-11-24T06:16:03.805384+0000","last_peered":"2023-11-24T06:16:03.805384+0000","last_clean":"2023-11-24T06:16:03.805384+0000","last_became_active":"2023-11-24T06:16:01.868304+0000","last_became_peered":"2023-11-24T06:16:01.868304+0000","last_unstale":"2023-11-24T06:16:03.805384+0000","last_undegraded":"2023-11-24T06:16:03.805384+0000","last_fullsized":"2023-11-24T06:16:03.805384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876593+0000","last_change":"2023-11-24T06:16:01.870030+0000","last_active":"2023-11-24T06:16:01.876593+0000","last_peered":"2023-11-24T06:16:01.876593+0000","last_clean":"2023-11-24T06:16:01.876593+0000","last_became_active":"2023-11-24T06:16:01.869727+0000","last_became_peered":"2023-11-24T06:16:01.869727+0000","last_unstale":"2023-11-24T06:16:01.876593+0000","last_undegraded":"2023-11-24T06:16:01.876593+0000","last_fullsized":"2023-11-24T06:16:01.876593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877470+0000","last_change":"2023-11-24T06:16:01.863542+0000","last_active":"2023-11-24T06:16:01.877470+0000","last_peered":"2023-11-24T06:16:01.877470+0000","last_clean":"2023-11-24T06:16:01.877470+0000","last_became_active":"2023-11-24T06:16:01.863055+0000","last_became_peered":"2023-11-24T06:16:01.863055+0000","last_unstale":"2023-11-24T06:16:01.877470+0000","last_undegraded":"2023-11-24T06:16:01.877470+0000","last_fullsized":"2023-11-24T06:16:01.877470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862647+0000","last_change":"2023-11-24T06:16:01.866191+0000","last_active":"2023-11-24T06:16:02.862647+0000","last_peered":"2023-11-24T06:16:02.862647+0000","last_clean":"2023-11-24T06:16:02.862647+0000","last_became_active":"2023-11-24T06:16:01.865892+0000","last_became_peered":"2023-11-24T06:16:01.865892+0000","last_unstale":"2023-11-24T06:16:02.862647+0000","last_undegraded":"2023-11-24T06:16:02.862647+0000","last_fullsized":"2023-11-24T06:16:02.862647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.872498+0000","last_change":"2023-11-24T06:16:01.869412+0000","last_active":"2023-11-24T06:16:01.872498+0000","last_peered":"2023-11-24T06:16:01.872498+0000","last_clean":"2023-11-24T06:16:01.872498+0000","last_became_active":"2023-11-24T06:16:01.869118+0000","last_became_peered":"2023-11-24T06:16:01.869118+0000","last_unstale":"2023-11-24T06:16:01.872498+0000","last_undegraded":"2023-11-24T06:16:01.872498+0000","last_fullsized":"2023-11-24T06:16:01.872498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:53.611373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.873664+0000","last_change":"2023-11-24T06:16:01.864324+0000","last_active":"2023-11-24T06:16:01.873664+0000","last_peered":"2023-11-24T06:16:01.873664+0000","last_clean":"2023-11-24T06:16:01.873664+0000","last_became_active":"2023-11-24T06:16:01.864070+0000","last_became_peered":"2023-11-24T06:16:01.864070+0000","last_unstale":"2023-11-24T06:16:01.873664+0000","last_undegraded":"2023-11-24T06:16:01.873664+0000","last_fullsized":"2023-11-24T06:16:01.873664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875418+0000","last_change":"2023-11-24T06:16:01.871454+0000","last_active":"2023-11-24T06:16:01.875418+0000","last_peered":"2023-11-24T06:16:01.875418+0000","last_clean":"2023-11-24T06:16:01.875418+0000","last_became_active":"2023-11-24T06:16:01.871067+0000","last_became_peered":"2023-11-24T06:16:01.871067+0000","last_unstale":"2023-11-24T06:16:01.875418+0000","last_undegraded":"2023-11-24T06:16:01.875418+0000","last_fullsized":"2023-11-24T06:16:01.875418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.879880+0000","last_change":"2023-11-24T06:16:01.865364+0000","last_active":"2023-11-24T06:16:01.879880+0000","last_peered":"2023-11-24T06:16:01.879880+0000","last_clean":"2023-11-24T06:16:01.879880+0000","last_became_active":"2023-11-24T06:16:01.865059+0000","last_became_peered":"2023-11-24T06:16:01.865059+0000","last_unstale":"2023-11-24T06:16:01.879880+0000","last_undegraded":"2023-11-24T06:16:01.879880+0000","last_fullsized":"2023-11-24T06:16:01.879880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:38.536544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.864186+0000","last_change":"2023-11-24T06:16:01.878367+0000","last_active":"2023-11-24T06:16:02.864186+0000","last_peered":"2023-11-24T06:16:02.864186+0000","last_clean":"2023-11-24T06:16:02.864186+0000","last_became_active":"2023-11-24T06:16:01.878038+0000","last_became_peered":"2023-11-24T06:16:01.878038+0000","last_unstale":"2023-11-24T06:16:02.864186+0000","last_undegraded":"2023-11-24T06:16:02.864186+0000","last_fullsized":"2023-11-24T06:16:02.864186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863109+0000","last_change":"2023-11-24T06:16:01.864088+0000","last_active":"2023-11-24T06:16:02.863109+0000","last_peered":"2023-11-24T06:16:02.863109+0000","last_clean":"2023-11-24T06:16:02.863109+0000","last_became_active":"2023-11-24T06:16:01.863804+0000","last_became_peered":"2023-11-24T06:16:01.863804+0000","last_unstale":"2023-11-24T06:16:02.863109+0000","last_undegraded":"2023-11-24T06:16:02.863109+0000","last_fullsized":"2023-11-24T06:16:02.863109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:44.096615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.879482+0000","last_change":"2023-11-24T06:16:01.873678+0000","last_active":"2023-11-24T06:16:01.879482+0000","last_peered":"2023-11-24T06:16:01.879482+0000","last_clean":"2023-11-24T06:16:01.879482+0000","last_became_active":"2023-11-24T06:16:01.873404+0000","last_became_peered":"2023-11-24T06:16:01.873404+0000","last_unstale":"2023-11-24T06:16:01.879482+0000","last_undegraded":"2023-11-24T06:16:01.879482+0000","last_fullsized":"2023-11-24T06:16:01.879482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.865302+0000","last_change":"2023-11-24T06:16:01.859363+0000","last_active":"2023-11-24T06:16:01.865302+0000","last_peered":"2023-11-24T06:16:01.865302+0000","last_clean":"2023-11-24T06:16:01.865302+0000","last_became_active":"2023-11-24T06:16:01.859071+0000","last_became_peered":"2023-11-24T06:16:01.859071+0000","last_unstale":"2023-11-24T06:16:01.865302+0000","last_undegraded":"2023-11-24T06:16:01.865302+0000","last_fullsized":"2023-11-24T06:16:01.865302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:44.096615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.866146+0000","last_change":"2023-11-24T06:16:01.862377+0000","last_active":"2023-11-24T06:16:01.866146+0000","last_peered":"2023-11-24T06:16:01.866146+0000","last_clean":"2023-11-24T06:16:01.866146+0000","last_became_active":"2023-11-24T06:16:01.862105+0000","last_became_peered":"2023-11-24T06:16:01.862105+0000","last_unstale":"2023-11-24T06:16:01.866146+0000","last_undegraded":"2023-11-24T06:16:01.866146+0000","last_fullsized":"2023-11-24T06:16:01.866146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:13.268040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.873641+0000","last_change":"2023-11-24T06:16:01.864115+0000","last_active":"2023-11-24T06:16:01.873641+0000","last_peered":"2023-11-24T06:16:01.873641+0000","last_clean":"2023-11-24T06:16:01.873641+0000","last_became_active":"2023-11-24T06:16:01.862589+0000","last_became_peered":"2023-11-24T06:16:01.862589+0000","last_unstale":"2023-11-24T06:16:01.873641+0000","last_undegraded":"2023-11-24T06:16:01.873641+0000","last_fullsized":"2023-11-24T06:16:01.873641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876926+0000","last_change":"2023-11-24T06:16:01.867375+0000","last_active":"2023-11-24T06:16:01.876926+0000","last_peered":"2023-11-24T06:16:01.876926+0000","last_clean":"2023-11-24T06:16:01.876926+0000","last_became_active":"2023-11-24T06:16:01.866536+0000","last_became_peered":"2023-11-24T06:16:01.866536+0000","last_unstale":"2023-11-24T06:16:01.876926+0000","last_undegraded":"2023-11-24T06:16:01.876926+0000","last_fullsized":"2023-11-24T06:16:01.876926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882756+0000","last_change":"2023-11-24T06:16:01.879111+0000","last_active":"2023-11-24T06:16:01.882756+0000","last_peered":"2023-11-24T06:16:01.882756+0000","last_clean":"2023-11-24T06:16:01.882756+0000","last_became_active":"2023-11-24T06:16:01.872425+0000","last_became_peered":"2023-11-24T06:16:01.872425+0000","last_unstale":"2023-11-24T06:16:01.882756+0000","last_undegraded":"2023-11-24T06:16:01.882756+0000","last_fullsized":"2023-11-24T06:16:01.882756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882492+0000","last_change":"2023-11-24T06:16:01.878824+0000","last_active":"2023-11-24T06:16:01.882492+0000","last_peered":"2023-11-24T06:16:01.882492+0000","last_clean":"2023-11-24T06:16:01.882492+0000","last_became_active":"2023-11-24T06:16:01.876885+0000","last_became_peered":"2023-11-24T06:16:01.876885+0000","last_unstale":"2023-11-24T06:16:01.882492+0000","last_undegraded":"2023-11-24T06:16:01.882492+0000","last_fullsized":"2023-11-24T06:16:01.882492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.861153+0000","last_change":"2023-11-24T06:16:01.855416+0000","last_active":"2023-11-24T06:16:01.861153+0000","last_peered":"2023-11-24T06:16:01.861153+0000","last_clean":"2023-11-24T06:16:01.861153+0000","last_became_active":"2023-11-24T06:16:01.855084+0000","last_became_peered":"2023-11-24T06:16:01.855084+0000","last_unstale":"2023-11-24T06:16:01.861153+0000","last_undegraded":"2023-11-24T06:16:01.861153+0000","last_fullsized":"2023-11-24T06:16:01.861153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:53.411236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.860338+0000","last_change":"2023-11-24T06:16:01.855201+0000","last_active":"2023-11-24T06:16:01.860338+0000","last_peered":"2023-11-24T06:16:01.860338+0000","last_clean":"2023-11-24T06:16:01.860338+0000","last_became_active":"2023-11-24T06:16:01.854734+0000","last_became_peered":"2023-11-24T06:16:01.854734+0000","last_unstale":"2023-11-24T06:16:01.860338+0000","last_undegraded":"2023-11-24T06:16:01.860338+0000","last_fullsized":"2023-11-24T06:16:01.860338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.873483+0000","last_change":"2023-11-24T06:16:01.870419+0000","last_active":"2023-11-24T06:16:01.873483+0000","last_peered":"2023-11-24T06:16:01.873483+0000","last_clean":"2023-11-24T06:16:01.873483+0000","last_became_active":"2023-11-24T06:16:01.869644+0000","last_became_peered":"2023-11-24T06:16:01.869644+0000","last_unstale":"2023-11-24T06:16:01.873483+0000","last_undegraded":"2023-11-24T06:16:01.873483+0000","last_fullsized":"2023-11-24T06:16:01.873483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:27.084478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863170+0000","last_change":"2023-11-24T06:16:01.868607+0000","last_active":"2023-11-24T06:16:02.863170+0000","last_peered":"2023-11-24T06:16:02.863170+0000","last_clean":"2023-11-24T06:16:02.863170+0000","last_became_active":"2023-11-24T06:16:01.868343+0000","last_became_peered":"2023-11-24T06:16:01.868343+0000","last_unstale":"2023-11-24T06:16:02.863170+0000","last_undegraded":"2023-11-24T06:16:02.863170+0000","last_fullsized":"2023-11-24T06:16:02.863170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:01.920931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862915+0000","last_change":"2023-11-24T06:16:01.860034+0000","last_active":"2023-11-24T06:16:02.862915+0000","last_peered":"2023-11-24T06:16:02.862915+0000","last_clean":"2023-11-24T06:16:02.862915+0000","last_became_active":"2023-11-24T06:16:01.859732+0000","last_became_peered":"2023-11-24T06:16:01.859732+0000","last_unstale":"2023-11-24T06:16:02.862915+0000","last_undegraded":"2023-11-24T06:16:02.862915+0000","last_fullsized":"2023-11-24T06:16:02.862915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860853+0000","last_change":"2023-11-24T06:16:01.877334+0000","last_active":"2023-11-24T06:16:02.860853+0000","last_peered":"2023-11-24T06:16:02.860853+0000","last_clean":"2023-11-24T06:16:02.860853+0000","last_became_active":"2023-11-24T06:16:01.876349+0000","last_became_peered":"2023-11-24T06:16:01.876349+0000","last_unstale":"2023-11-24T06:16:02.860853+0000","last_undegraded":"2023-11-24T06:16:02.860853+0000","last_fullsized":"2023-11-24T06:16:02.860853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.870443+0000","last_change":"2023-11-24T06:16:01.861840+0000","last_active":"2023-11-24T06:16:01.870443+0000","last_peered":"2023-11-24T06:16:01.870443+0000","last_clean":"2023-11-24T06:16:01.870443+0000","last_became_active":"2023-11-24T06:16:01.861488+0000","last_became_peered":"2023-11-24T06:16:01.861488+0000","last_unstale":"2023-11-24T06:16:01.870443+0000","last_undegraded":"2023-11-24T06:16:01.870443+0000","last_fullsized":"2023-11-24T06:16:01.870443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863577+0000","last_change":"2023-11-24T06:16:01.860643+0000","last_active":"2023-11-24T06:16:02.863577+0000","last_peered":"2023-11-24T06:16:02.863577+0000","last_clean":"2023-11-24T06:16:02.863577+0000","last_became_active":"2023-11-24T06:16:01.860312+0000","last_became_peered":"2023-11-24T06:16:01.860312+0000","last_unstale":"2023-11-24T06:16:02.863577+0000","last_undegraded":"2023-11-24T06:16:02.863577+0000","last_fullsized":"2023-11-24T06:16:02.863577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:56.546783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.887620+0000","last_change":"2023-11-24T06:16:01.880736+0000","last_active":"2023-11-24T06:16:01.887620+0000","last_peered":"2023-11-24T06:16:01.887620+0000","last_clean":"2023-11-24T06:16:01.887620+0000","last_became_active":"2023-11-24T06:16:01.879459+0000","last_became_peered":"2023-11-24T06:16:01.879459+0000","last_unstale":"2023-11-24T06:16:01.887620+0000","last_undegraded":"2023-11-24T06:16:01.887620+0000","last_fullsized":"2023-11-24T06:16:01.887620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:19.857033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863226+0000","last_change":"2023-11-24T06:16:01.863138+0000","last_active":"2023-11-24T06:16:02.863226+0000","last_peered":"2023-11-24T06:16:02.863226+0000","last_clean":"2023-11-24T06:16:02.863226+0000","last_became_active":"2023-11-24T06:16:01.862639+0000","last_became_peered":"2023-11-24T06:16:01.862639+0000","last_unstale":"2023-11-24T06:16:02.863226+0000","last_undegraded":"2023-11-24T06:16:02.863226+0000","last_fullsized":"2023-11-24T06:16:02.863226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:37.031127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877708+0000","last_change":"2023-11-24T06:16:01.868203+0000","last_active":"2023-11-24T06:16:01.877708+0000","last_peered":"2023-11-24T06:16:01.877708+0000","last_clean":"2023-11-24T06:16:01.877708+0000","last_became_active":"2023-11-24T06:16:01.867934+0000","last_became_peered":"2023-11-24T06:16:01.867934+0000","last_unstale":"2023-11-24T06:16:01.877708+0000","last_undegraded":"2023-11-24T06:16:01.877708+0000","last_fullsized":"2023-11-24T06:16:01.877708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863244+0000","last_change":"2023-11-24T06:16:01.859996+0000","last_active":"2023-11-24T06:16:02.863244+0000","last_peered":"2023-11-24T06:16:02.863244+0000","last_clean":"2023-11-24T06:16:02.863244+0000","last_became_active":"2023-11-24T06:16:01.859722+0000","last_became_peered":"2023-11-24T06:16:01.859722+0000","last_unstale":"2023-11-24T06:16:02.863244+0000","last_undegraded":"2023-11-24T06:16:02.863244+0000","last_fullsized":"2023-11-24T06:16:02.863244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875345+0000","last_change":"2023-11-24T06:16:01.871272+0000","last_active":"2023-11-24T06:16:01.875345+0000","last_peered":"2023-11-24T06:16:01.875345+0000","last_clean":"2023-11-24T06:16:01.875345+0000","last_became_active":"2023-11-24T06:16:01.870918+0000","last_became_peered":"2023-11-24T06:16:01.870918+0000","last_unstale":"2023-11-24T06:16:01.875345+0000","last_undegraded":"2023-11-24T06:16:01.875345+0000","last_fullsized":"2023-11-24T06:16:01.875345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:01.920931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805392+0000","last_change":"2023-11-24T06:16:01.861878+0000","last_active":"2023-11-24T06:16:03.805392+0000","last_peered":"2023-11-24T06:16:03.805392+0000","last_clean":"2023-11-24T06:16:03.805392+0000","last_became_active":"2023-11-24T06:16:01.861570+0000","last_became_peered":"2023-11-24T06:16:01.861570+0000","last_unstale":"2023-11-24T06:16:03.805392+0000","last_undegraded":"2023-11-24T06:16:03.805392+0000","last_fullsized":"2023-11-24T06:16:03.805392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:38.536544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882459+0000","last_change":"2023-11-24T06:16:01.878475+0000","last_active":"2023-11-24T06:16:01.882459+0000","last_peered":"2023-11-24T06:16:01.882459+0000","last_clean":"2023-11-24T06:16:01.882459+0000","last_became_active":"2023-11-24T06:16:01.876314+0000","last_became_peered":"2023-11-24T06:16:01.876314+0000","last_unstale":"2023-11-24T06:16:01.882459+0000","last_undegraded":"2023-11-24T06:16:01.882459+0000","last_fullsized":"2023-11-24T06:16:01.882459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861433+0000","last_change":"2023-11-24T06:16:01.873697+0000","last_active":"2023-11-24T06:16:02.861433+0000","last_peered":"2023-11-24T06:16:02.861433+0000","last_clean":"2023-11-24T06:16:02.861433+0000","last_became_active":"2023-11-24T06:16:01.873402+0000","last_became_peered":"2023-11-24T06:16:01.873402+0000","last_unstale":"2023-11-24T06:16:02.861433+0000","last_undegraded":"2023-11-24T06:16:02.861433+0000","last_fullsized":"2023-11-24T06:16:02.861433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805623+0000","last_change":"2023-11-24T06:16:00.866396+0000","last_active":"2023-11-24T06:16:03.805623+0000","last_peered":"2023-11-24T06:16:03.805623+0000","last_clean":"2023-11-24T06:16:03.805623+0000","last_became_active":"2023-11-24T06:16:00.866108+0000","last_became_peered":"2023-11-24T06:16:00.866108+0000","last_unstale":"2023-11-24T06:16:03.805623+0000","last_undegraded":"2023-11-24T06:16:03.805623+0000","last_fullsized":"2023-11-24T06:16:03.805623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:20.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805453+0000","last_change":"2023-11-24T06:16:01.868555+0000","last_active":"2023-11-24T06:16:03.805453+0000","last_peered":"2023-11-24T06:16:03.805453+0000","last_clean":"2023-11-24T06:16:03.805453+0000","last_became_active":"2023-11-24T06:16:01.867961+0000","last_became_peered":"2023-11-24T06:16:01.867961+0000","last_unstale":"2023-11-24T06:16:03.805453+0000","last_undegraded":"2023-11-24T06:16:03.805453+0000","last_fullsized":"2023-11-24T06:16:03.805453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861481+0000","last_change":"2023-11-24T06:16:00.850960+0000","last_active":"2023-11-24T06:16:02.861481+0000","last_peered":"2023-11-24T06:16:02.861481+0000","last_clean":"2023-11-24T06:16:02.861481+0000","last_became_active":"2023-11-24T06:16:00.850660+0000","last_became_peered":"2023-11-24T06:16:00.850660+0000","last_unstale":"2023-11-24T06:16:02.861481+0000","last_undegraded":"2023-11-24T06:16:02.861481+0000","last_fullsized":"2023-11-24T06:16:02.861481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:06.596728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863669+0000","last_change":"2023-11-24T06:16:01.864017+0000","last_active":"2023-11-24T06:16:02.863669+0000","last_peered":"2023-11-24T06:16:02.863669+0000","last_clean":"2023-11-24T06:16:02.863669+0000","last_became_active":"2023-11-24T06:16:01.860270+0000","last_became_peered":"2023-11-24T06:16:01.860270+0000","last_unstale":"2023-11-24T06:16:02.863669+0000","last_undegraded":"2023-11-24T06:16:02.863669+0000","last_fullsized":"2023-11-24T06:16:02.863669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.889648+0000","last_change":"2023-11-24T06:16:00.853390+0000","last_active":"2023-11-24T06:16:01.889648+0000","last_peered":"2023-11-24T06:16:01.889648+0000","last_clean":"2023-11-24T06:16:01.889648+0000","last_became_active":"2023-11-24T06:16:00.853099+0000","last_became_peered":"2023-11-24T06:16:00.853099+0000","last_unstale":"2023-11-24T06:16:01.889648+0000","last_undegraded":"2023-11-24T06:16:01.889648+0000","last_fullsized":"2023-11-24T06:16:01.889648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:00.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863371+0000","last_change":"2023-11-24T06:16:01.862905+0000","last_active":"2023-11-24T06:16:02.863371+0000","last_peered":"2023-11-24T06:16:02.863371+0000","last_clean":"2023-11-24T06:16:02.863371+0000","last_became_active":"2023-11-24T06:16:01.862219+0000","last_became_peered":"2023-11-24T06:16:01.862219+0000","last_unstale":"2023-11-24T06:16:02.863371+0000","last_undegraded":"2023-11-24T06:16:02.863371+0000","last_fullsized":"2023-11-24T06:16:02.863371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:00.617715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.887172+0000","last_change":"2023-11-24T06:16:00.859519+0000","last_active":"2023-11-24T06:16:01.887172+0000","last_peered":"2023-11-24T06:16:01.887172+0000","last_clean":"2023-11-24T06:16:01.887172+0000","last_became_active":"2023-11-24T06:16:00.859216+0000","last_became_peered":"2023-11-24T06:16:00.859216+0000","last_unstale":"2023-11-24T06:16:01.887172+0000","last_undegraded":"2023-11-24T06:16:01.887172+0000","last_fullsized":"2023-11-24T06:16:01.887172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:50.400301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.880968+0000","last_change":"2023-11-24T06:16:01.875990+0000","last_active":"2023-11-24T06:16:01.880968+0000","last_peered":"2023-11-24T06:16:01.880968+0000","last_clean":"2023-11-24T06:16:01.880968+0000","last_became_active":"2023-11-24T06:16:01.875737+0000","last_became_peered":"2023-11-24T06:16:01.875737+0000","last_unstale":"2023-11-24T06:16:01.880968+0000","last_undegraded":"2023-11-24T06:16:01.880968+0000","last_fullsized":"2023-11-24T06:16:01.880968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863390+0000","last_change":"2023-11-24T06:16:00.857465+0000","last_active":"2023-11-24T06:16:02.863390+0000","last_peered":"2023-11-24T06:16:02.863390+0000","last_clean":"2023-11-24T06:16:02.863390+0000","last_became_active":"2023-11-24T06:16:00.857115+0000","last_became_peered":"2023-11-24T06:16:00.857115+0000","last_unstale":"2023-11-24T06:16:02.863390+0000","last_undegraded":"2023-11-24T06:16:02.863390+0000","last_fullsized":"2023-11-24T06:16:02.863390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:28.844115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877954+0000","last_change":"2023-11-24T06:16:01.875120+0000","last_active":"2023-11-24T06:16:01.877954+0000","last_peered":"2023-11-24T06:16:01.877954+0000","last_clean":"2023-11-24T06:16:01.877954+0000","last_became_active":"2023-11-24T06:16:01.871004+0000","last_became_peered":"2023-11-24T06:16:01.871004+0000","last_unstale":"2023-11-24T06:16:01.877954+0000","last_undegraded":"2023-11-24T06:16:01.877954+0000","last_fullsized":"2023-11-24T06:16:01.877954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:36.526994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862995+0000","last_change":"2023-11-24T06:16:00.853425+0000","last_active":"2023-11-24T06:16:02.862995+0000","last_peered":"2023-11-24T06:16:02.862995+0000","last_clean":"2023-11-24T06:16:02.862995+0000","last_became_active":"2023-11-24T06:16:00.853071+0000","last_became_peered":"2023-11-24T06:16:00.853071+0000","last_unstale":"2023-11-24T06:16:02.862995+0000","last_undegraded":"2023-11-24T06:16:02.862995+0000","last_fullsized":"2023-11-24T06:16:02.862995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:37.521483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862956+0000","last_change":"2023-11-24T06:16:01.870343+0000","last_active":"2023-11-24T06:16:02.862956+0000","last_peered":"2023-11-24T06:16:02.862956+0000","last_clean":"2023-11-24T06:16:02.862956+0000","last_became_active":"2023-11-24T06:16:01.866822+0000","last_became_peered":"2023-11-24T06:16:01.866822+0000","last_unstale":"2023-11-24T06:16:02.862956+0000","last_undegraded":"2023-11-24T06:16:02.862956+0000","last_fullsized":"2023-11-24T06:16:02.862956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.838303+0000","last_change":"2023-11-24T06:16:00.859142+0000","last_active":"2023-11-24T06:16:01.838303+0000","last_peered":"2023-11-24T06:16:01.838303+0000","last_clean":"2023-11-24T06:16:01.838303+0000","last_became_active":"2023-11-24T06:16:00.858853+0000","last_became_peered":"2023-11-24T06:16:00.858853+0000","last_unstale":"2023-11-24T06:16:01.838303+0000","last_undegraded":"2023-11-24T06:16:01.838303+0000","last_fullsized":"2023-11-24T06:16:01.838303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:36.016067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860369+0000","last_change":"2023-11-24T06:16:01.863972+0000","last_active":"2023-11-24T06:16:02.860369+0000","last_peered":"2023-11-24T06:16:02.860369+0000","last_clean":"2023-11-24T06:16:02.860369+0000","last_became_active":"2023-11-24T06:16:01.863630+0000","last_became_peered":"2023-11-24T06:16:01.863630+0000","last_unstale":"2023-11-24T06:16:02.860369+0000","last_undegraded":"2023-11-24T06:16:02.860369+0000","last_fullsized":"2023-11-24T06:16:02.860369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:19:51.937045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862590+0000","last_change":"2023-11-24T06:16:00.856448+0000","last_active":"2023-11-24T06:16:02.862590+0000","last_peered":"2023-11-24T06:16:02.862590+0000","last_clean":"2023-11-24T06:16:02.862590+0000","last_became_active":"2023-11-24T06:16:00.856125+0000","last_became_peered":"2023-11-24T06:16:00.856125+0000","last_unstale":"2023-11-24T06:16:02.862590+0000","last_undegraded":"2023-11-24T06:16:02.862590+0000","last_fullsized":"2023-11-24T06:16:02.862590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:58:20.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876678+0000","last_change":"2023-11-24T06:16:01.863539+0000","last_active":"2023-11-24T06:16:01.876678+0000","last_peered":"2023-11-24T06:16:01.876678+0000","last_clean":"2023-11-24T06:16:01.876678+0000","last_became_active":"2023-11-24T06:16:01.863247+0000","last_became_peered":"2023-11-24T06:16:01.863247+0000","last_unstale":"2023-11-24T06:16:01.876678+0000","last_undegraded":"2023-11-24T06:16:01.876678+0000","last_fullsized":"2023-11-24T06:16:01.876678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.836852+0000","last_change":"2023-11-24T06:16:00.863703+0000","last_active":"2023-11-24T06:16:01.836852+0000","last_peered":"2023-11-24T06:16:01.836852+0000","last_clean":"2023-11-24T06:16:01.836852+0000","last_became_active":"2023-11-24T06:16:00.863399+0000","last_became_peered":"2023-11-24T06:16:00.863399+0000","last_unstale":"2023-11-24T06:16:01.836852+0000","last_undegraded":"2023-11-24T06:16:01.836852+0000","last_fullsized":"2023-11-24T06:16:01.836852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:32:43.081555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.874384+0000","last_change":"2023-11-24T06:16:01.867600+0000","last_active":"2023-11-24T06:16:01.874384+0000","last_peered":"2023-11-24T06:16:01.874384+0000","last_clean":"2023-11-24T06:16:01.874384+0000","last_became_active":"2023-11-24T06:16:01.867314+0000","last_became_peered":"2023-11-24T06:16:01.867314+0000","last_unstale":"2023-11-24T06:16:01.874384+0000","last_undegraded":"2023-11-24T06:16:01.874384+0000","last_fullsized":"2023-11-24T06:16:01.874384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:00.617715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861717+0000","last_change":"2023-11-24T06:16:00.847447+0000","last_active":"2023-11-24T06:16:02.861717+0000","last_peered":"2023-11-24T06:16:02.861717+0000","last_clean":"2023-11-24T06:16:02.861717+0000","last_became_active":"2023-11-24T06:16:00.846701+0000","last_became_peered":"2023-11-24T06:16:00.846701+0000","last_unstale":"2023-11-24T06:16:02.861717+0000","last_undegraded":"2023-11-24T06:16:02.861717+0000","last_fullsized":"2023-11-24T06:16:02.861717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:20.816191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876787+0000","last_change":"2023-11-24T06:16:01.872316+0000","last_active":"2023-11-24T06:16:01.876787+0000","last_peered":"2023-11-24T06:16:01.876787+0000","last_clean":"2023-11-24T06:16:01.876787+0000","last_became_active":"2023-11-24T06:16:01.871928+0000","last_became_peered":"2023-11-24T06:16:01.871928+0000","last_unstale":"2023-11-24T06:16:01.876787+0000","last_undegraded":"2023-11-24T06:16:01.876787+0000","last_fullsized":"2023-11-24T06:16:01.876787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:56.546783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.886703+0000","last_change":"2023-11-24T06:16:00.866935+0000","last_active":"2023-11-24T06:16:01.886703+0000","last_peered":"2023-11-24T06:16:01.886703+0000","last_clean":"2023-11-24T06:16:01.886703+0000","last_became_active":"2023-11-24T06:16:00.866627+0000","last_became_peered":"2023-11-24T06:16:00.866627+0000","last_unstale":"2023-11-24T06:16:01.886703+0000","last_undegraded":"2023-11-24T06:16:01.886703+0000","last_fullsized":"2023-11-24T06:16:01.886703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:18.937431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.877450+0000","last_change":"2023-11-24T06:16:01.863299+0000","last_active":"2023-11-24T06:16:01.877450+0000","last_peered":"2023-11-24T06:16:01.877450+0000","last_clean":"2023-11-24T06:16:01.877450+0000","last_became_active":"2023-11-24T06:16:01.862420+0000","last_became_peered":"2023-11-24T06:16:01.862420+0000","last_unstale":"2023-11-24T06:16:01.877450+0000","last_undegraded":"2023-11-24T06:16:01.877450+0000","last_fullsized":"2023-11-24T06:16:01.877450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.891880+0000","last_change":"2023-11-24T06:16:00.853633+0000","last_active":"2023-11-24T06:16:01.891880+0000","last_peered":"2023-11-24T06:16:01.891880+0000","last_clean":"2023-11-24T06:16:01.891880+0000","last_became_active":"2023-11-24T06:16:00.853282+0000","last_became_peered":"2023-11-24T06:16:00.853282+0000","last_unstale":"2023-11-24T06:16:01.891880+0000","last_undegraded":"2023-11-24T06:16:01.891880+0000","last_fullsized":"2023-11-24T06:16:01.891880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:26.342906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860517+0000","last_change":"2023-11-24T06:16:01.863447+0000","last_active":"2023-11-24T06:16:02.860517+0000","last_peered":"2023-11-24T06:16:02.860517+0000","last_clean":"2023-11-24T06:16:02.860517+0000","last_became_active":"2023-11-24T06:16:01.863178+0000","last_became_peered":"2023-11-24T06:16:01.863178+0000","last_unstale":"2023-11-24T06:16:02.860517+0000","last_undegraded":"2023-11-24T06:16:02.860517+0000","last_fullsized":"2023-11-24T06:16:02.860517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863515+0000","last_change":"2023-11-24T06:16:00.863211+0000","last_active":"2023-11-24T06:16:02.863515+0000","last_peered":"2023-11-24T06:16:02.863515+0000","last_clean":"2023-11-24T06:16:02.863515+0000","last_became_active":"2023-11-24T06:16:00.862670+0000","last_became_peered":"2023-11-24T06:16:00.862670+0000","last_unstale":"2023-11-24T06:16:02.863515+0000","last_undegraded":"2023-11-24T06:16:02.863515+0000","last_fullsized":"2023-11-24T06:16:02.863515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:27.118283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.876136+0000","last_change":"2023-11-24T06:16:01.870042+0000","last_active":"2023-11-24T06:16:01.876136+0000","last_peered":"2023-11-24T06:16:01.876136+0000","last_clean":"2023-11-24T06:16:01.876136+0000","last_became_active":"2023-11-24T06:16:01.869671+0000","last_became_peered":"2023-11-24T06:16:01.869671+0000","last_unstale":"2023-11-24T06:16:01.876136+0000","last_undegraded":"2023-11-24T06:16:01.876136+0000","last_fullsized":"2023-11-24T06:16:01.876136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:54:09.609575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.860695+0000","last_change":"2023-11-24T06:16:00.861546+0000","last_active":"2023-11-24T06:16:02.860695+0000","last_peered":"2023-11-24T06:16:02.860695+0000","last_clean":"2023-11-24T06:16:02.860695+0000","last_became_active":"2023-11-24T06:16:00.860890+0000","last_became_peered":"2023-11-24T06:16:00.860890+0000","last_unstale":"2023-11-24T06:16:02.860695+0000","last_undegraded":"2023-11-24T06:16:02.860695+0000","last_fullsized":"2023-11-24T06:16:02.860695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:35.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.882738+0000","last_change":"2023-11-24T06:16:01.879302+0000","last_active":"2023-11-24T06:16:01.882738+0000","last_peered":"2023-11-24T06:16:01.882738+0000","last_clean":"2023-11-24T06:16:01.882738+0000","last_became_active":"2023-11-24T06:16:01.877057+0000","last_became_peered":"2023-11-24T06:16:01.877057+0000","last_unstale":"2023-11-24T06:16:01.882738+0000","last_undegraded":"2023-11-24T06:16:01.882738+0000","last_fullsized":"2023-11-24T06:16:01.882738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.835594+0000","last_change":"2023-11-24T06:16:00.866956+0000","last_active":"2023-11-24T06:16:01.835594+0000","last_peered":"2023-11-24T06:16:01.835594+0000","last_clean":"2023-11-24T06:16:01.835594+0000","last_became_active":"2023-11-24T06:16:00.866585+0000","last_became_peered":"2023-11-24T06:16:00.866585+0000","last_unstale":"2023-11-24T06:16:01.835594+0000","last_undegraded":"2023-11-24T06:16:01.835594+0000","last_fullsized":"2023-11-24T06:16:01.835594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:52.491262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805640+0000","last_change":"2023-11-24T06:16:01.863989+0000","last_active":"2023-11-24T06:16:03.805640+0000","last_peered":"2023-11-24T06:16:03.805640+0000","last_clean":"2023-11-24T06:16:03.805640+0000","last_became_active":"2023-11-24T06:16:01.863648+0000","last_became_peered":"2023-11-24T06:16:01.863648+0000","last_unstale":"2023-11-24T06:16:03.805640+0000","last_undegraded":"2023-11-24T06:16:03.805640+0000","last_fullsized":"2023-11-24T06:16:03.805640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:08.347380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.890500+0000","last_change":"2023-11-24T06:16:00.855584+0000","last_active":"2023-11-24T06:16:01.890500+0000","last_peered":"2023-11-24T06:16:01.890500+0000","last_clean":"2023-11-24T06:16:01.890500+0000","last_became_active":"2023-11-24T06:16:00.855255+0000","last_became_peered":"2023-11-24T06:16:00.855255+0000","last_unstale":"2023-11-24T06:16:01.890500+0000","last_undegraded":"2023-11-24T06:16:01.890500+0000","last_fullsized":"2023-11-24T06:16:01.890500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:37.521483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863689+0000","last_change":"2023-11-24T06:16:01.866626+0000","last_active":"2023-11-24T06:16:02.863689+0000","last_peered":"2023-11-24T06:16:02.863689+0000","last_clean":"2023-11-24T06:16:02.863689+0000","last_became_active":"2023-11-24T06:16:01.865100+0000","last_became_peered":"2023-11-24T06:16:01.865100+0000","last_unstale":"2023-11-24T06:16:02.863689+0000","last_undegraded":"2023-11-24T06:16:02.863689+0000","last_fullsized":"2023-11-24T06:16:02.863689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863495+0000","last_change":"2023-11-24T06:16:00.853616+0000","last_active":"2023-11-24T06:16:02.863495+0000","last_peered":"2023-11-24T06:16:02.863495+0000","last_clean":"2023-11-24T06:16:02.863495+0000","last_became_active":"2023-11-24T06:16:00.852894+0000","last_became_peered":"2023-11-24T06:16:00.852894+0000","last_unstale":"2023-11-24T06:16:02.863495+0000","last_undegraded":"2023-11-24T06:16:02.863495+0000","last_fullsized":"2023-11-24T06:16:02.863495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:26.342906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.868414+0000","last_change":"2023-11-24T06:16:01.862033+0000","last_active":"2023-11-24T06:16:01.868414+0000","last_peered":"2023-11-24T06:16:01.868414+0000","last_clean":"2023-11-24T06:16:01.868414+0000","last_became_active":"2023-11-24T06:16:01.861745+0000","last_became_peered":"2023-11-24T06:16:01.861745+0000","last_unstale":"2023-11-24T06:16:01.868414+0000","last_undegraded":"2023-11-24T06:16:01.868414+0000","last_fullsized":"2023-11-24T06:16:01.868414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863826+0000","last_change":"2023-11-24T06:16:00.862708+0000","last_active":"2023-11-24T06:16:02.863826+0000","last_peered":"2023-11-24T06:16:02.863826+0000","last_clean":"2023-11-24T06:16:02.863826+0000","last_became_active":"2023-11-24T06:16:00.862405+0000","last_became_peered":"2023-11-24T06:16:00.862405+0000","last_unstale":"2023-11-24T06:16:02.863826+0000","last_undegraded":"2023-11-24T06:16:02.863826+0000","last_fullsized":"2023-11-24T06:16:02.863826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:09.814859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862879+0000","last_change":"2023-11-24T06:16:01.857792+0000","last_active":"2023-11-24T06:16:02.862879+0000","last_peered":"2023-11-24T06:16:02.862879+0000","last_clean":"2023-11-24T06:16:02.862879+0000","last_became_active":"2023-11-24T06:16:01.856934+0000","last_became_peered":"2023-11-24T06:16:01.856934+0000","last_unstale":"2023-11-24T06:16:02.862879+0000","last_undegraded":"2023-11-24T06:16:02.862879+0000","last_fullsized":"2023-11-24T06:16:02.862879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:19.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863741+0000","last_change":"2023-11-24T06:16:00.860416+0000","last_active":"2023-11-24T06:16:02.863741+0000","last_peered":"2023-11-24T06:16:02.863741+0000","last_clean":"2023-11-24T06:16:02.863741+0000","last_became_active":"2023-11-24T06:16:00.859440+0000","last_became_peered":"2023-11-24T06:16:00.859440+0000","last_unstale":"2023-11-24T06:16:02.863741+0000","last_undegraded":"2023-11-24T06:16:02.863741+0000","last_fullsized":"2023-11-24T06:16:02.863741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:29.109694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.879242+0000","last_change":"2023-11-24T06:16:01.873965+0000","last_active":"2023-11-24T06:16:01.879242+0000","last_peered":"2023-11-24T06:16:01.879242+0000","last_clean":"2023-11-24T06:16:01.879242+0000","last_became_active":"2023-11-24T06:16:01.873258+0000","last_became_peered":"2023-11-24T06:16:01.873258+0000","last_unstale":"2023-11-24T06:16:01.879242+0000","last_undegraded":"2023-11-24T06:16:01.879242+0000","last_fullsized":"2023-11-24T06:16:01.879242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:58:31.777836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863561+0000","last_change":"2023-11-24T06:16:00.861403+0000","last_active":"2023-11-24T06:16:02.863561+0000","last_peered":"2023-11-24T06:16:02.863561+0000","last_clean":"2023-11-24T06:16:02.863561+0000","last_became_active":"2023-11-24T06:16:00.861099+0000","last_became_peered":"2023-11-24T06:16:00.861099+0000","last_unstale":"2023-11-24T06:16:02.863561+0000","last_undegraded":"2023-11-24T06:16:02.863561+0000","last_fullsized":"2023-11-24T06:16:02.863561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:06.596728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.864915+0000","last_change":"2023-11-24T06:16:01.861830+0000","last_active":"2023-11-24T06:16:01.864915+0000","last_peered":"2023-11-24T06:16:01.864915+0000","last_clean":"2023-11-24T06:16:01.864915+0000","last_became_active":"2023-11-24T06:16:01.861469+0000","last_became_peered":"2023-11-24T06:16:01.861469+0000","last_unstale":"2023-11-24T06:16:01.864915+0000","last_undegraded":"2023-11-24T06:16:01.864915+0000","last_fullsized":"2023-11-24T06:16:01.864915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:00:43.643777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862110+0000","last_change":"2023-11-24T06:16:00.838020+0000","last_active":"2023-11-24T06:16:02.862110+0000","last_peered":"2023-11-24T06:16:02.862110+0000","last_clean":"2023-11-24T06:16:02.862110+0000","last_became_active":"2023-11-24T06:16:00.837700+0000","last_became_peered":"2023-11-24T06:16:00.837700+0000","last_unstale":"2023-11-24T06:16:02.862110+0000","last_undegraded":"2023-11-24T06:16:02.862110+0000","last_fullsized":"2023-11-24T06:16:02.862110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:35.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.870608+0000","last_change":"2023-11-24T06:16:01.867934+0000","last_active":"2023-11-24T06:16:01.870608+0000","last_peered":"2023-11-24T06:16:01.870608+0000","last_clean":"2023-11-24T06:16:01.870608+0000","last_became_active":"2023-11-24T06:16:01.867630+0000","last_became_peered":"2023-11-24T06:16:01.867630+0000","last_unstale":"2023-11-24T06:16:01.870608+0000","last_undegraded":"2023-11-24T06:16:01.870608+0000","last_fullsized":"2023-11-24T06:16:01.870608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:41.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.805073+0000","last_change":"2023-11-24T06:16:00.862060+0000","last_active":"2023-11-24T06:16:03.805073+0000","last_peered":"2023-11-24T06:16:03.805073+0000","last_clean":"2023-11-24T06:16:03.805073+0000","last_became_active":"2023-11-24T06:16:00.861685+0000","last_became_peered":"2023-11-24T06:16:00.861685+0000","last_unstale":"2023-11-24T06:16:03.805073+0000","last_undegraded":"2023-11-24T06:16:03.805073+0000","last_fullsized":"2023-11-24T06:16:03.805073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:27.118283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.870394+0000","last_change":"2023-11-24T06:16:01.866931+0000","last_active":"2023-11-24T06:16:01.870394+0000","last_peered":"2023-11-24T06:16:01.870394+0000","last_clean":"2023-11-24T06:16:01.870394+0000","last_became_active":"2023-11-24T06:16:01.866123+0000","last_became_peered":"2023-11-24T06:16:01.866123+0000","last_unstale":"2023-11-24T06:16:01.870394+0000","last_undegraded":"2023-11-24T06:16:01.870394+0000","last_fullsized":"2023-11-24T06:16:01.870394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:44.342676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862590+0000","last_change":"2023-11-24T06:16:00.855131+0000","last_active":"2023-11-24T06:16:02.862590+0000","last_peered":"2023-11-24T06:16:02.862590+0000","last_clean":"2023-11-24T06:16:02.862590+0000","last_became_active":"2023-11-24T06:16:00.854376+0000","last_became_peered":"2023-11-24T06:16:00.854376+0000","last_unstale":"2023-11-24T06:16:02.862590+0000","last_undegraded":"2023-11-24T06:16:02.862590+0000","last_fullsized":"2023-11-24T06:16:02.862590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:36.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875391+0000","last_change":"2023-11-24T06:16:01.871109+0000","last_active":"2023-11-24T06:16:01.875391+0000","last_peered":"2023-11-24T06:16:01.875391+0000","last_clean":"2023-11-24T06:16:01.875391+0000","last_became_active":"2023-11-24T06:16:01.870770+0000","last_became_peered":"2023-11-24T06:16:01.870770+0000","last_unstale":"2023-11-24T06:16:01.875391+0000","last_undegraded":"2023-11-24T06:16:01.875391+0000","last_fullsized":"2023-11-24T06:16:01.875391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:36.526994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.838716+0000","last_change":"2023-11-24T06:16:00.863490+0000","last_active":"2023-11-24T06:16:01.838716+0000","last_peered":"2023-11-24T06:16:01.838716+0000","last_clean":"2023-11-24T06:16:01.838716+0000","last_became_active":"2023-11-24T06:16:00.863177+0000","last_became_peered":"2023-11-24T06:16:00.863177+0000","last_unstale":"2023-11-24T06:16:01.838716+0000","last_undegraded":"2023-11-24T06:16:01.838716+0000","last_fullsized":"2023-11-24T06:16:01.838716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:00.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.880213+0000","last_change":"2023-11-24T06:16:01.877685+0000","last_active":"2023-11-24T06:16:01.880213+0000","last_peered":"2023-11-24T06:16:01.880213+0000","last_clean":"2023-11-24T06:16:01.880213+0000","last_became_active":"2023-11-24T06:16:01.874939+0000","last_became_peered":"2023-11-24T06:16:01.874939+0000","last_unstale":"2023-11-24T06:16:01.880213+0000","last_undegraded":"2023-11-24T06:16:01.880213+0000","last_fullsized":"2023-11-24T06:16:01.880213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:03.745391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.863627+0000","last_change":"2023-11-24T06:16:00.859523+0000","last_active":"2023-11-24T06:16:02.863627+0000","last_peered":"2023-11-24T06:16:02.863627+0000","last_clean":"2023-11-24T06:16:02.863627+0000","last_became_active":"2023-11-24T06:16:00.859044+0000","last_became_peered":"2023-11-24T06:16:00.859044+0000","last_unstale":"2023-11-24T06:16:02.863627+0000","last_undegraded":"2023-11-24T06:16:02.863627+0000","last_fullsized":"2023-11-24T06:16:02.863627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:00.905871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.878636+0000","last_change":"2023-11-24T06:16:01.872677+0000","last_active":"2023-11-24T06:16:01.878636+0000","last_peered":"2023-11-24T06:16:01.878636+0000","last_clean":"2023-11-24T06:16:01.878636+0000","last_became_active":"2023-11-24T06:16:01.872400+0000","last_became_peered":"2023-11-24T06:16:01.872400+0000","last_unstale":"2023-11-24T06:16:01.878636+0000","last_undegraded":"2023-11-24T06:16:01.878636+0000","last_fullsized":"2023-11-24T06:16:01.878636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:38.536544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.956502+0000","last_change":"2023-11-24T06:16:00.839164+0000","last_active":"2023-11-24T06:16:02.956502+0000","last_peered":"2023-11-24T06:16:02.956502+0000","last_clean":"2023-11-24T06:16:02.956502+0000","last_became_active":"2023-11-24T06:16:00.838458+0000","last_became_peered":"2023-11-24T06:16:00.838458+0000","last_unstale":"2023-11-24T06:16:02.956502+0000","last_undegraded":"2023-11-24T06:16:02.956502+0000","last_fullsized":"2023-11-24T06:16:02.956502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:51:27.118283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861457+0000","last_change":"2023-11-24T06:16:01.870377+0000","last_active":"2023-11-24T06:16:02.861457+0000","last_peered":"2023-11-24T06:16:02.861457+0000","last_clean":"2023-11-24T06:16:02.861457+0000","last_became_active":"2023-11-24T06:16:01.868973+0000","last_became_peered":"2023-11-24T06:16:01.868973+0000","last_unstale":"2023-11-24T06:16:02.861457+0000","last_undegraded":"2023-11-24T06:16:02.861457+0000","last_fullsized":"2023-11-24T06:16:02.861457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:19:27.357967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862799+0000","last_change":"2023-11-24T06:16:00.856128+0000","last_active":"2023-11-24T06:16:02.862799+0000","last_peered":"2023-11-24T06:16:02.862799+0000","last_clean":"2023-11-24T06:16:02.862799+0000","last_became_active":"2023-11-24T06:16:00.855787+0000","last_became_peered":"2023-11-24T06:16:00.855787+0000","last_unstale":"2023-11-24T06:16:02.862799+0000","last_undegraded":"2023-11-24T06:16:02.862799+0000","last_fullsized":"2023-11-24T06:16:02.862799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:09.814859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.804919+0000","last_change":"2023-11-24T06:16:01.870314+0000","last_active":"2023-11-24T06:16:03.804919+0000","last_peered":"2023-11-24T06:16:03.804919+0000","last_clean":"2023-11-24T06:16:03.804919+0000","last_became_active":"2023-11-24T06:16:01.869953+0000","last_became_peered":"2023-11-24T06:16:01.869953+0000","last_unstale":"2023-11-24T06:16:03.804919+0000","last_undegraded":"2023-11-24T06:16:03.804919+0000","last_fullsized":"2023-11-24T06:16:03.804919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:36.526994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862431+0000","last_change":"2023-11-24T06:16:00.853025+0000","last_active":"2023-11-24T06:16:02.862431+0000","last_peered":"2023-11-24T06:16:02.862431+0000","last_clean":"2023-11-24T06:16:02.862431+0000","last_became_active":"2023-11-24T06:16:00.852695+0000","last_became_peered":"2023-11-24T06:16:00.852695+0000","last_unstale":"2023-11-24T06:16:02.862431+0000","last_undegraded":"2023-11-24T06:16:02.862431+0000","last_fullsized":"2023-11-24T06:16:02.862431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:09.814859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862151+0000","last_change":"2023-11-24T06:16:01.874902+0000","last_active":"2023-11-24T06:16:02.862151+0000","last_peered":"2023-11-24T06:16:02.862151+0000","last_clean":"2023-11-24T06:16:02.862151+0000","last_became_active":"2023-11-24T06:16:01.874602+0000","last_became_peered":"2023-11-24T06:16:01.874602+0000","last_unstale":"2023-11-24T06:16:02.862151+0000","last_undegraded":"2023-11-24T06:16:02.862151+0000","last_fullsized":"2023-11-24T06:16:02.862151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:01.920931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.861257+0000","last_change":"2023-11-24T06:16:00.859373+0000","last_active":"2023-11-24T06:16:02.861257+0000","last_peered":"2023-11-24T06:16:02.861257+0000","last_clean":"2023-11-24T06:16:02.861257+0000","last_became_active":"2023-11-24T06:16:00.859110+0000","last_became_peered":"2023-11-24T06:16:00.859110+0000","last_unstale":"2023-11-24T06:16:02.861257+0000","last_undegraded":"2023-11-24T06:16:02.861257+0000","last_fullsized":"2023-11-24T06:16:02.861257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:42:07.332320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875296+0000","last_change":"2023-11-24T06:16:01.860114+0000","last_active":"2023-11-24T06:16:01.875296+0000","last_peered":"2023-11-24T06:16:01.875296+0000","last_clean":"2023-11-24T06:16:01.875296+0000","last_became_active":"2023-11-24T06:16:01.859791+0000","last_became_peered":"2023-11-24T06:16:01.859791+0000","last_unstale":"2023-11-24T06:16:01.875296+0000","last_undegraded":"2023-11-24T06:16:01.875296+0000","last_fullsized":"2023-11-24T06:16:01.875296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:10.829919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862835+0000","last_change":"2023-11-24T06:16:00.854030+0000","last_active":"2023-11-24T06:16:02.862835+0000","last_peered":"2023-11-24T06:16:02.862835+0000","last_clean":"2023-11-24T06:16:02.862835+0000","last_became_active":"2023-11-24T06:16:00.853057+0000","last_became_peered":"2023-11-24T06:16:00.853057+0000","last_unstale":"2023-11-24T06:16:02.862835+0000","last_undegraded":"2023-11-24T06:16:02.862835+0000","last_fullsized":"2023-11-24T06:16:02.862835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:00.541051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:02.862688+0000","last_change":"2023-11-24T06:16:01.861645+0000","last_active":"2023-11-24T06:16:02.862688+0000","last_peered":"2023-11-24T06:16:02.862688+0000","last_clean":"2023-11-24T06:16:02.862688+0000","last_became_active":"2023-11-24T06:16:01.861348+0000","last_became_peered":"2023-11-24T06:16:01.861348+0000","last_unstale":"2023-11-24T06:16:02.862688+0000","last_undegraded":"2023-11-24T06:16:02.862688+0000","last_fullsized":"2023-11-24T06:16:02.862688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:19.922072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.833198+0000","last_change":"2023-11-24T06:16:00.863256+0000","last_active":"2023-11-24T06:16:01.833198+0000","last_peered":"2023-11-24T06:16:01.833198+0000","last_clean":"2023-11-24T06:16:01.833198+0000","last_became_active":"2023-11-24T06:16:00.862974+0000","last_became_peered":"2023-11-24T06:16:00.862974+0000","last_unstale":"2023-11-24T06:16:01.833198+0000","last_undegraded":"2023-11-24T06:16:01.833198+0000","last_fullsized":"2023-11-24T06:16:01.833198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:57:35.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:16:01.875362+0000","last_change":"2023-11-24T06:16:01.867521+0000","last_active":"2023-11-24T06:16:01.875362+0000","last_peered":"2023-11-24T06:16:01.875362+0000","last_clean":"2023-11-24T06:16:01.875362+0000","last_became_active":"2023-11-24T06:16:01.867269+0000","last_became_peered":"2023-11-24T06:16:01.867269+0000","last_unstale":"2023-11-24T06:16:01.875362+0000","last_undegraded":"2023-11-24T06:16:01.875362+0000","last_fullsized":"2023-11-24T06:16:01.875362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:00.817871+0000","last_clean_scrub_stamp":"2023-11-24T06:16:00.817871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:53.506322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:16:03.804963+0000","last_change":"2023-11-24T06:16:00.868631+0000","last_active":"2023-11-24T06:16:03.804963+0000","last_peered":"2023-11-24T06:16:03.804963+0000","last_clean":"2023-11-24T06:16:03.804963+0000","last_became_active":"2023-11-24T06:16:00.868207+0000","last_became_peered":"2023-11-24T06:16:00.868207+0000","last_unstale":"2023-11-24T06:16:03.804963+0000","last_undegraded":"2023-11-24T06:16:03.804963+0000","last_fullsized":"2023-11-24T06:16:03.804963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:15:59.802811+0000","last_clean_scrub_stamp":"2023-11-24T06:15:59.802811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:14:06.596728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-24T06:16:00.857602+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:16:00.857602+0000","last_peered":"2023-11-24T06:16:00.857602+0000","last_clean":"2023-11-24T06:16:00.857602+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:16:00.857602+0000","last_undegraded":"2023-11-24T06:16:00.857602+0000","last_fullsized":"2023-11-24T06:16:00.857602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":730912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.385}]},{"osd":2,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.2749999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.3520000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.45},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.49},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.3220000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.042},{"interface":"front","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.95699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.401},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.4510000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.6419999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.9339999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.2509999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":2.0350000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.7430000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":4.0819999999999999,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.8520000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.1760000000000002,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":4.2709999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.9730000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:41 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":2}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.745}]},{"osd":1,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.0800000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.179}]},{"osd":3,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.129},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.4119999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.375},{"interface":"front","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.337}]},{"osd":7,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.5790000000000002,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.48},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.4410000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":146858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.643},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2270000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.5169999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.552}]},{"osd":5,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.3580000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":3.6539999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.7210000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.161},{"interface":"front","average":{"1min":1.73,"5min":1.73,"15min":1.73},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":3.7360000000000002,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.4630000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":142088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.626},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.746}]},{"osd":1,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":11.903,"5min":11.903,"15min":11.903},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":204.87899999999999,"5min":204.87899999999999,"15min":204.87899999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.9569999999999999,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0939999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":3.157,"5min":3.157,"15min":3.157},"last":0.874}]},{"osd":7,"last update":"Fri Nov 24 06:15:38 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":3.6589999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.244}]},{"osd":1,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.099},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.81999999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.2769999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.222},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":1.6080000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":1.103,"5min":1.103,"15min":1.103},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.339},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.4750000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.3480000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.5339999999999998,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.054}]},{"osd":3,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.429},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.27}]},{"osd":4,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":4.8650000000000002,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.371}]},{"osd":5,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.681,"5min":1.681,"15min":1.681},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.466},{"interface":"front","average":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":4.7270000000000003,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.917,"5min":1.917,"15min":1.917},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":7.0990000000000002,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:15:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":5.2519999999999998,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.099}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":737122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.079},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.0469999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.1479999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.4379999999999997,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":5.5439999999999996,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.8859999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.77},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.538}]},{"osd":6,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":8.3689999999999998,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.871,"5min":1.871,"15min":1.871},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":8.7620000000000005,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:15:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":4.4790000000000001,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.659},{"interface":"front","average":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":5.8460000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.976}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:06.919 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:16:06.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:16:07.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.196+0000 7fcaeb311640 1 Processor -- start 2023-11-24T06:16:07.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.196+0000 7fcaeb311640 1 -- start start 2023-11-24T06:16:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcaeb311640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcae415d5f0 0x7fcae40ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcaeb311640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcae406d080 0x7fcae40ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcaeb311640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae40cdf70 con 0x7fcae40ac840 2023-11-24T06:16:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcaeb311640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae40cb3d0 con 0x7fcae415d5f0 2023-11-24T06:16:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcaeb311640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae40cbfa0 con 0x7fcae406d080 2023-11-24T06:16:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcae9b0e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcae40ac840 0x7fcae406c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41164/0 (socket says 172.21.15.37:41164) 2023-11-24T06:16:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcae9b0e640 1 -- 172.21.15.37:0/2783051605 learned_addr learned my addr 172.21.15.37:0/2783051605 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.198+0000 7fcaea30f640 1 --2- 172.21.15.37:0/2783051605 >> v2:172.21.15.37:3300/0 conn(0x7fcae415d5f0 0x7fcae40ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.199+0000 7fcaeab10640 1 --2- 172.21.15.37:0/2783051605 >> v2:172.21.15.188:3300/0 conn(0x7fcae406d080 0x7fcae40ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.199+0000 7fcae930d640 1 -- 172.21.15.37:0/2783051605 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707390691 0 0) 0x7fcae40cdf70 con 0x7fcae40ac840 2023-11-24T06:16:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.199+0000 7fcae930d640 1 -- 172.21.15.37:0/2783051605 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad0003520 con 0x7fcae40ac840 2023-11-24T06:16:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.199+0000 7fcaea30f640 1 -- 172.21.15.37:0/2783051605 >> v2:172.21.15.188:3300/0 conn(0x7fcae406d080 msgr2=0x7fcae40ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.199+0000 7fcaea30f640 1 --2- 172.21.15.37:0/2783051605 >> v2:172.21.15.188:3300/0 conn(0x7fcae406d080 0x7fcae40ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.199+0000 7fcaea30f640 1 -- 172.21.15.37:0/2783051605 >> v1:172.21.15.37:6789/0 conn(0x7fcae40ac840 legacy=0x7fcae406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.199+0000 7fcaea30f640 1 -- 172.21.15.37:0/2783051605 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40cc280 con 0x7fcae415d5f0 2023-11-24T06:16:07.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.200+0000 7fcaea30f640 1 --2- 172.21.15.37:0/2783051605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae40ae020 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcae406b430 tx=0x7fcae002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d775304942c732 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcae930d640 1 -- 172.21.15.37:0/2783051605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae002cbf0 con 0x7fcae415d5f0 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcae930d640 1 -- 172.21.15.37:0/2783051605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae002cd50 con 0x7fcae415d5f0 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcae930d640 1 -- 172.21.15.37:0/2783051605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0034660 con 0x7fcae415d5f0 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 -- 172.21.15.37:0/2783051605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 msgr2=0x7fcae40ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 --2- 172.21.15.37:0/2783051605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae40ae020 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcae406b430 tx=0x7fcae002be40 comp rx=0 tx=0).stop 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 -- 172.21.15.37:0/2783051605 shutdown_connections 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 --2- 172.21.15.37:0/2783051605 >> v2:172.21.15.188:3300/0 conn(0x7fcae406d080 0x7fcae40ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 --2- 172.21.15.37:0/2783051605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae40ae020 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 -- 172.21.15.37:0/2783051605 >> 172.21.15.37:0/2783051605 conn(0x7fcae406a500 msgr2=0x7fcae406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:07.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 -- 172.21.15.37:0/2783051605 shutdown_connections 2023-11-24T06:16:07.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.201+0000 7fcaeb311640 1 -- 172.21.15.37:0/2783051605 wait complete. 2023-11-24T06:16:07.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.203+0000 7fcaeb311640 1 Processor -- start 2023-11-24T06:16:07.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.203+0000 7fcaeb311640 1 -- start start 2023-11-24T06:16:07.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.204+0000 7fcaeb311640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcae406d080 0x7fcae415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.204+0000 7fcaeb311640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcae40ac840 0x7fcae4160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.204+0000 7fcaeb311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.204+0000 7fcaeb311640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4160690 con 0x7fcae415d5f0 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.204+0000 7fcaeb311640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae415fcc0 con 0x7fcae406d080 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.204+0000 7fcaeb311640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4157d90 con 0x7fcae40ac840 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae4157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40082/0 (socket says 172.21.15.37:40082) 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 -- 172.21.15.37:0/3378103207 learned_addr learned my addr 172.21.15.37:0/3378103207 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcae9b0e640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcae40ac840 0x7fcae4160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaea30f640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcae406d080 0x7fcae415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 -- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcae40ac840 msgr2=0x7fcae4160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcae40ac840 0x7fcae4160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 -- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcae406d080 msgr2=0x7fcae415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcae406d080 0x7fcae415ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.205+0000 7fcaeab10640 1 -- 172.21.15.37:0/3378103207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0009a70 con 0x7fcae415d5f0 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.206+0000 7fcaeab10640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae4157850 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00e850 tx=0x7fcadc00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.206+0000 7fcadaffd640 1 -- 172.21.15.37:0/3378103207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc009630 con 0x7fcae415d5f0 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.206+0000 7fcadaffd640 1 -- 172.21.15.37:0/3378103207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc00c940 con 0x7fcae415d5f0 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.206+0000 7fcadaffd640 1 -- 172.21.15.37:0/3378103207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00ccf0 con 0x7fcae415d5f0 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.206+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae415f0b0 con 0x7fcae415d5f0 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.206+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae415f670 con 0x7fcae415d5f0 2023-11-24T06:16:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.207+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae404e840 con 0x7fcae415d5f0 2023-11-24T06:16:07.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.208+0000 7fcadaffd640 1 -- 172.21.15.37:0/3378103207 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcadc013470 con 0x7fcae415d5f0 2023-11-24T06:16:07.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.209+0000 7fcadaffd640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcac806ae40 0x7fcac806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.209+0000 7fcadaffd640 1 -- 172.21.15.37:0/3378103207 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcadc0898f0 con 0x7fcae415d5f0 2023-11-24T06:16:07.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.210+0000 7fcaea30f640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcac806ae40 0x7fcac806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.210+0000 7fcaea30f640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcac806ae40 0x7fcac806d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcae0036000 tx=0x7fcae0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:07.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.214+0000 7fcadaffd640 1 -- 172.21.15.37:0/3378103207 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcadc054870 con 0x7fcae415d5f0 2023-11-24T06:16:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.476+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcae415fe00 con 0x7fcae415d5f0 2023-11-24T06:16:07.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.481+0000 7fcadaffd640 1 -- 172.21.15.37:0/3378103207 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7fcadc0210e0 con 0x7fcae415d5f0 2023-11-24T06:16:07.483 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-11-24T06:16:07.484 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA== 2023-11-24T06:16:07.484 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-11-24T06:16:07.484 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-11-24T06:16:07.484 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:16:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.483+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcac806ae40 msgr2=0x7fcac806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.483+0000 7fcaeb311640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcac806ae40 0x7fcac806d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcae0036000 tx=0x7fcae0030000 comp rx=0 tx=0).stop 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 msgr2=0x7fcae4157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae4157850 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00e850 tx=0x7fcadc00ed10 comp rx=0 tx=0).stop 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 shutdown_connections 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcac806ae40 0x7fcac806d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae415d5f0 0x7fcae4157850 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcae40ac840 0x7fcae4160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 --2- 172.21.15.37:0/3378103207 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcae406d080 0x7fcae415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 >> 172.21.15.37:0/3378103207 conn(0x7fcae406a500 msgr2=0x7fcae415c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 shutdown_connections 2023-11-24T06:16:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.484+0000 7fcaeb311640 1 -- 172.21.15.37:0/3378103207 wait complete. 2023-11-24T06:16:07.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:07.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.724+0000 7fd70759e640 1 Processor -- start 2023-11-24T06:16:07.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.724+0000 7fd70759e640 1 -- start start 2023-11-24T06:16:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.726+0000 7fd70759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd708143870 0x7fd708146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.726+0000 7fd70759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd7080b1180 0x7fd7080cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.726+0000 7fd70759e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd708161510 con 0x7fd708161080 2023-11-24T06:16:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.726+0000 7fd70759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd708070460 con 0x7fd708143870 2023-11-24T06:16:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.726+0000 7fd70759e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7081617f0 con 0x7fd7080b1180 2023-11-24T06:16:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.726+0000 7fd70659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd708143870 0x7fd708146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.726+0000 7fd6fffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd708161080 0x7fd7080b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41174/0 (socket says 172.21.15.37:41174) 2023-11-24T06:16:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd6fffff640 1 -- 172.21.15.37:0/3346027637 learned_addr learned my addr 172.21.15.37:0/3346027637 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd706d9d640 1 --2- 172.21.15.37:0/3346027637 >> v2:172.21.15.188:3300/0 conn(0x7fd7080b1180 0x7fd7080cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd705d9b640 1 -- 172.21.15.37:0/3346027637 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241853521 0 0) 0x7fd708161510 con 0x7fd708161080 2023-11-24T06:16:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd70659c640 1 -- 172.21.15.37:0/3346027637 >> v2:172.21.15.188:3300/0 conn(0x7fd7080b1180 msgr2=0x7fd7080cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:07.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd70659c640 1 --2- 172.21.15.37:0/3346027637 >> v2:172.21.15.188:3300/0 conn(0x7fd7080b1180 0x7fd7080cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd70659c640 1 -- 172.21.15.37:0/3346027637 >> v1:172.21.15.37:6789/0 conn(0x7fd708161080 legacy=0x7fd7080b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd70659c640 1 -- 172.21.15.37:0/3346027637 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708161ad0 con 0x7fd708143870 2023-11-24T06:16:07.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.727+0000 7fd706d9d640 1 --2- 172.21.15.37:0/3346027637 >> v2:172.21.15.188:3300/0 conn(0x7fd7080b1180 0x7fd7080cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:07.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.729+0000 7fd70659c640 1 --2- 172.21.15.37:0/3346027637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd708143870 0x7fd708146970 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd7080ae9e0 tx=0x7fd6f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb17797797f451ca server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:07.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.729+0000 7fd705d9b640 1 -- 172.21.15.37:0/3346027637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8031830 con 0x7fd708143870 2023-11-24T06:16:07.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.729+0000 7fd705d9b640 1 -- 172.21.15.37:0/3346027637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8031990 con 0x7fd708143870 2023-11-24T06:16:07.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.729+0000 7fd705d9b640 1 -- 172.21.15.37:0/3346027637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8031d20 con 0x7fd708143870 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 -- 172.21.15.37:0/3346027637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd708143870 msgr2=0x7fd708146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 --2- 172.21.15.37:0/3346027637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd708143870 0x7fd708146970 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd7080ae9e0 tx=0x7fd6f802b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 -- 172.21.15.37:0/3346027637 shutdown_connections 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 --2- 172.21.15.37:0/3346027637 >> v2:172.21.15.188:3300/0 conn(0x7fd7080b1180 0x7fd7080cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 --2- 172.21.15.37:0/3346027637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd708143870 0x7fd708146970 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 -- 172.21.15.37:0/3346027637 >> 172.21.15.37:0/3346027637 conn(0x7fd7080cb830 msgr2=0x7fd7080cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 -- 172.21.15.37:0/3346027637 shutdown_connections 2023-11-24T06:16:07.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.730+0000 7fd70759e640 1 -- 172.21.15.37:0/3346027637 wait complete. 2023-11-24T06:16:07.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.732+0000 7fd70759e640 1 Processor -- start 2023-11-24T06:16:07.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.732+0000 7fd70759e640 1 -- start start 2023-11-24T06:16:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd70759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7080b1180 0x7fd7080ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd70759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7080b2790 0x7fd7081f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd70759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7080b1dd0 0x7fd70813eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd70759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081f7d00 con 0x7fd7080b1dd0 2023-11-24T06:16:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd70759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081f6d70 con 0x7fd7080b2790 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd70759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080b2f00 con 0x7fd7080b1180 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd706d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7080b1dd0 0x7fd70813eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd706d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7080b1dd0 0x7fd70813eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40108/0 (socket says 172.21.15.37:40108) 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.733+0000 7fd706d9d640 1 -- 172.21.15.37:0/2592271908 learned_addr learned my addr 172.21.15.37:0/2592271908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd70659c640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7080b1180 0x7fd7080ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd706d9d640 1 -- 172.21.15.37:0/2592271908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7080b1180 msgr2=0x7fd7080ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd706d9d640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7080b1180 0x7fd7080ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd706d9d640 1 -- 172.21.15.37:0/2592271908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7080b2790 msgr2=0x7fd7081f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd706d9d640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7080b2790 0x7fd7081f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd706d9d640 1 -- 172.21.15.37:0/2592271908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8009400 con 0x7fd7080b1dd0 2023-11-24T06:16:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd706d9d640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7080b1dd0 0x7fd70813eed0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd700007ec0 tx=0x7fd70000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd6feffd640 1 -- 172.21.15.37:0/2592271908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700015600 con 0x7fd7080b1dd0 2023-11-24T06:16:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd6feffd640 1 -- 172.21.15.37:0/2592271908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000f040 con 0x7fd7080b1dd0 2023-11-24T06:16:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd6feffd640 1 -- 172.21.15.37:0/2592271908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000159a0 con 0x7fd7080b1dd0 2023-11-24T06:16:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.734+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7080b31e0 con 0x7fd7080b1dd0 2023-11-24T06:16:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.735+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7081f72a0 con 0x7fd7080b1dd0 2023-11-24T06:16:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.736+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7081f74c0 con 0x7fd7080b1dd0 2023-11-24T06:16:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.737+0000 7fd6feffd640 1 -- 172.21.15.37:0/2592271908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd70001e3b0 con 0x7fd7080b1dd0 2023-11-24T06:16:07.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.738+0000 7fd6feffd640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd6e806ae70 0x7fd6e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.738+0000 7fd6feffd640 1 -- 172.21.15.37:0/2592271908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd700089880 con 0x7fd7080b1dd0 2023-11-24T06:16:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.738+0000 7fd70659c640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd6e806ae70 0x7fd6e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.739+0000 7fd70659c640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd6e806ae70 0x7fd6e806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8036000 tx=0x7fd6f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.742+0000 7fd6feffd640 1 -- 172.21.15.37:0/2592271908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7000549c0 con 0x7fd7080b1dd0 2023-11-24T06:16:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.978+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7080ce4a0 con 0x7fd7080b1dd0 2023-11-24T06:16:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.979+0000 7fd6feffd640 1 -- 172.21.15.37:0/2592271908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fd70001a090 con 0x7fd7080b1dd0 2023-11-24T06:16:07.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:07.982 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/1178714141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1178714141},{"type":"v1","addr":"172.21.15.188:6834","nonce":1178714141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3045701683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":3045701683},{"type":"v1","addr":"172.21.15.37:6837","nonce":3045701683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3993737526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3993737526},{"type":"v1","addr":"172.21.15.37:6836","nonce":3993737526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:01.307209+0000","modified":"2023-11-24T06:16:04.395591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.188:6835/1936445066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1936445066},{"type":"v1","addr":"172.21.15.188:6835","nonce":1936445066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:16:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-11-24T06:16:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.981+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd6e806ae70 msgr2=0x7fd6e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.981+0000 7fd70759e640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd6e806ae70 0x7fd6e806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8036000 tx=0x7fd6f8008030 comp rx=0 tx=0).stop 2023-11-24T06:16:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.981+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7080b1dd0 msgr2=0x7fd70813eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.981+0000 7fd70759e640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7080b1dd0 0x7fd70813eed0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd700007ec0 tx=0x7fd70000d4a0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 shutdown_connections 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd6e806ae70 0x7fd6e806d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7080b2790 0x7fd7081f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7080b1dd0 0x7fd70813eed0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 --2- 172.21.15.37:0/2592271908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7080b1180 0x7fd7080ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 >> 172.21.15.37:0/2592271908 conn(0x7fd7080cb830 msgr2=0x7fd7080aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 shutdown_connections 2023-11-24T06:16:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:07.982+0000 7fd70759e640 1 -- 172.21.15.37:0/2592271908 wait complete. 2023-11-24T06:16:08.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:16:01.307209+0000', 'modified': '2023-11-24T06:16:04.395591+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5073}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5073': {'gid': 5073, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.188:6835/1936445066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6833', 'nonce': 1936445066}, {'type': 'v1', 'addr': '172.21.15.188:6835', 'nonce': 1936445066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:16:08.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:16:08.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T06:16:08.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.641+0000 7fa28efb3640 1 Processor -- start 2023-11-24T06:16:08.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.641+0000 7fa28efb3640 1 -- start start 2023-11-24T06:16:08.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.642+0000 7fa28efb3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa288070550 0x7fa2880b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28efb3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2880b1080 0x7fa28815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28efb3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2880ca0e0 con 0x7fa28815b1d0 2023-11-24T06:16:08.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28efb3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2880b14a0 con 0x7fa2880b1080 2023-11-24T06:16:08.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28efb3640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa288072800 con 0x7fa288070550 2023-11-24T06:16:08.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28dfb1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa28815b1d0 0x7fa288071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41178/0 (socket says 172.21.15.37:41178) 2023-11-24T06:16:08.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28dfb1640 1 -- 172.21.15.37:0/4098121216 learned_addr learned my addr 172.21.15.37:0/4098121216 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:08.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/4098121216 >> v2:172.21.15.37:3300/0 conn(0x7fa2880b1080 0x7fa28815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28cfaf640 1 -- 172.21.15.37:0/4098121216 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748754284 0 0) 0x7fa2880ca0e0 con 0x7fa28815b1d0 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28cfaf640 1 -- 172.21.15.37:0/4098121216 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa274003520 con 0x7fa28815b1d0 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.643+0000 7fa28d7b0640 1 --2- 172.21.15.37:0/4098121216 >> v2:172.21.15.188:3300/0 conn(0x7fa288070550 0x7fa2880b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.644+0000 7fa28e7b2640 1 -- 172.21.15.37:0/4098121216 >> v2:172.21.15.188:3300/0 conn(0x7fa288070550 msgr2=0x7fa2880b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.644+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/4098121216 >> v2:172.21.15.188:3300/0 conn(0x7fa288070550 0x7fa2880b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.644+0000 7fa28cfaf640 1 -- 172.21.15.37:0/4098121216 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 545597764 0 0) 0x7fa274003520 con 0x7fa28815b1d0 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.644+0000 7fa28e7b2640 1 -- 172.21.15.37:0/4098121216 >> v1:172.21.15.37:6789/0 conn(0x7fa28815b1d0 legacy=0x7fa288071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.644+0000 7fa28e7b2640 1 -- 172.21.15.37:0/4098121216 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880c97b0 con 0x7fa2880b1080 2023-11-24T06:16:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.645+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/4098121216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2880b1080 0x7fa28815edd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa2880cef60 tx=0x7fa28002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12534317e7670163 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.645+0000 7fa28cfaf640 1 -- 172.21.15.37:0/4098121216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284001670 con 0x7fa2880b1080 2023-11-24T06:16:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.645+0000 7fa28cfaf640 1 -- 172.21.15.37:0/4098121216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28002c8c0 con 0x7fa2880b1080 2023-11-24T06:16:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.645+0000 7fa28cfaf640 1 -- 172.21.15.37:0/4098121216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28002cc50 con 0x7fa2880b1080 2023-11-24T06:16:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 -- 172.21.15.37:0/4098121216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2880b1080 msgr2=0x7fa28815edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 --2- 172.21.15.37:0/4098121216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2880b1080 0x7fa28815edd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa2880cef60 tx=0x7fa28002bd90 comp rx=0 tx=0).stop 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 -- 172.21.15.37:0/4098121216 shutdown_connections 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 --2- 172.21.15.37:0/4098121216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2880b1080 0x7fa28815edd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 --2- 172.21.15.37:0/4098121216 >> v2:172.21.15.188:3300/0 conn(0x7fa288070550 0x7fa2880b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 -- 172.21.15.37:0/4098121216 >> 172.21.15.37:0/4098121216 conn(0x7fa2880cbb40 msgr2=0x7fa2880cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 -- 172.21.15.37:0/4098121216 shutdown_connections 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.646+0000 7fa28efb3640 1 -- 172.21.15.37:0/4098121216 wait complete. 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.648+0000 7fa28efb3640 1 Processor -- start 2023-11-24T06:16:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.648+0000 7fa28efb3640 1 -- start start 2023-11-24T06:16:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28efb3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa288070550 0x7fa28815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28efb3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2880b1080 0x7fa2880999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28efb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28815b1d0 0x7fa2880ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28efb3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28809a420 con 0x7fa28815b1d0 2023-11-24T06:16:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28efb3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28809a700 con 0x7fa288070550 2023-11-24T06:16:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28efb3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28809a9e0 con 0x7fa2880b1080 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28e7b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28815b1d0 0x7fa2880ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28e7b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28815b1d0 0x7fa2880ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40118/0 (socket says 172.21.15.37:40118) 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.649+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1497763913 learned_addr learned my addr 172.21.15.37:0/1497763913 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1497763913 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2880b1080 msgr2=0x7fa2880999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2880b1080 0x7fa2880999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1497763913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa288070550 msgr2=0x7fa28815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa288070550 0x7fa28815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1497763913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280009a70 con 0x7fa28815b1d0 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28815b1d0 0x7fa2880ad660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa280037040 tx=0x7fa280004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa27e7fc640 1 -- 172.21.15.37:0/1497763913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280034e50 con 0x7fa28815b1d0 2023-11-24T06:16:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa27e7fc640 1 -- 172.21.15.37:0/1497763913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa280009450 con 0x7fa28815b1d0 2023-11-24T06:16:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28809acc0 con 0x7fa28815b1d0 2023-11-24T06:16:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.650+0000 7fa27e7fc640 1 -- 172.21.15.37:0/1497763913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280040690 con 0x7fa28815b1d0 2023-11-24T06:16:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.651+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2880b3c90 con 0x7fa28815b1d0 2023-11-24T06:16:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.653+0000 7fa27e7fc640 1 -- 172.21.15.37:0/1497763913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2800407f0 con 0x7fa28815b1d0 2023-11-24T06:16:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.653+0000 7fa27e7fc640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa26c06ae40 0x7fa26c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.654+0000 7fa27e7fc640 1 -- 172.21.15.37:0/1497763913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2800ac100 con 0x7fa28815b1d0 2023-11-24T06:16:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.654+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa26c06ae40 0x7fa26c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.654+0000 7fa292dad740 1 Processor -- start 2023-11-24T06:16:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.654+0000 7fa292dad740 1 -- start start 2023-11-24T06:16:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.655+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa26c06ae40 0x7fa26c06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa284001eb0 tx=0x7fa284001980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.655+0000 7fa292dad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df19a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.655+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df194d70 0x5595df199270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.655+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df1997b0 0x5595df1dd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.655+0000 7fa292dad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595df0f8880 con 0x5595df19a070 2023-11-24T06:16:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.655+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595df107ae0 con 0x5595df194d70 2023-11-24T06:16:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.655+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595df1051d0 con 0x5595df1997b0 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40124/0 (socket says 172.21.15.37:40124) 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 -- 172.21.15.37:0/2457071885 learned_addr learned my addr 172.21.15.37:0/2457071885 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 -- 172.21.15.37:0/2457071885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df1997b0 msgr2=0x5595df1dd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/2457071885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df1997b0 0x5595df1dd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 -- 172.21.15.37:0/2457071885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df194d70 msgr2=0x5595df199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/2457071885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df194d70 0x5595df199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 -- 172.21.15.37:0/2457071885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595df0c8860 con 0x5595df19a070 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/2457071885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df19a450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa284005bf0 tx=0x7fa28400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc81029e81a5b275 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa26b7fe640 1 -- 172.21.15.37:0/2457071885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28401b070 con 0x5595df19a070 2023-11-24T06:16:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa26b7fe640 1 -- 172.21.15.37:0/2457071885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284007750 con 0x5595df19a070 2023-11-24T06:16:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.656+0000 7fa26b7fe640 1 -- 172.21.15.37:0/2457071885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28400cb90 con 0x5595df19a070 2023-11-24T06:16:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 -- 172.21.15.37:0/2457071885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 msgr2=0x5595df19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 --2- 172.21.15.37:0/2457071885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df19a450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa284005bf0 tx=0x7fa28400f000 comp rx=0 tx=0).stop 2023-11-24T06:16:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 -- 172.21.15.37:0/2457071885 shutdown_connections 2023-11-24T06:16:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 --2- 172.21.15.37:0/2457071885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df194d70 0x5595df199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 --2- 172.21.15.37:0/2457071885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df1997b0 0x5595df1dd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 --2- 172.21.15.37:0/2457071885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df19a450 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 -- 172.21.15.37:0/2457071885 >> 172.21.15.37:0/2457071885 conn(0x5595df15bc70 msgr2=0x5595df1dfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 -- 172.21.15.37:0/2457071885 shutdown_connections 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.657+0000 7fa292dad740 1 -- 172.21.15.37:0/2457071885 wait complete. 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.658+0000 7fa292dad740 1 -- start start 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.658+0000 7fa292dad740 1 Processor -- start 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.659+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.659+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.659+0000 7fa292dad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.659+0000 7fa292dad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595df100ac0 con 0x5595df19a070 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.659+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595df09d2f0 con 0x5595df1997b0 2023-11-24T06:16:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.659+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595df0bac70 con 0x5595df194d70 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.659+0000 7fa292dad740 10 client.0 _ll_register_callbacks cb 0x5595df0bf3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1e15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40132/0 (socket says 172.21.15.37:40132) 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1644391394 learned_addr learned my addr 172.21.15.37:0/1644391394 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28d7b0640 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 msgr2=0x5595df1bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1bb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 msgr2=0x5595df1ddf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1ddf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1644391394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2840058d0 con 0x5595df19a070 2023-11-24T06:16:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1e15c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa28002bdd0 tx=0x7fa28007b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce87e6333e18082 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.660+0000 7fa268ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:16:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa268ff9640 1 -- 172.21.15.37:0/1644391394 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280083160 con 0x5595df19a070 2023-11-24T06:16:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa268ff9640 1 -- 172.21.15.37:0/1644391394 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa28007d030 con 0x5595df19a070 2023-11-24T06:16:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595df0f9aa0 con 0x5595df19a070 2023-11-24T06:16:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa268ff9640 1 -- 172.21.15.37:0/1644391394 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa280077570 con 0x5595df19a070 2023-11-24T06:16:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 10 client.5256 fetch_fsmap learned FSMap version 17 2023-11-24T06:16:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5595df0ff140 con 0x5595df19a070 2023-11-24T06:16:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa268ff9640 1 -- 172.21.15.37:0/1644391394 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa280096080 con 0x5595df19a070 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa268ff9640 1 -- 172.21.15.37:0/1644391394 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa280050020 con 0x5595df19a070 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 10 client.5256 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 10 client.5256 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 20 client.5256 populate_metadata read hostname 'smithi037' 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1b56d0 0x5595df1fce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 4 client.5256 mds_command: new command op to 5073 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.661+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 --> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595df0f97c0 con 0x5595df1b56d0 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.662+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1b56d0 0x5595df1fce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.663+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1b56d0 0x5595df1fce80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1928846b01796363 server_cookie=14bf458ddfe21bfb in_seq=0 out_seq=0 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.663+0000 7fa268ff9640 10 client.5256 ms_handle_connect on v2:172.21.15.188:6833/1936445066 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa268ff9640 1 -- 172.21.15.37:0/1644391394 <== mds.0 v2:172.21.15.188:6833/1936445066 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5595df0f97c0 con 0x5595df1b56d0 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa268ff9640 10 client.5256 handle_command_reply: tid=0 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 client.5256 shutdown 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 msgr2=0x5595df1e15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1e15c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa28002bdd0 tx=0x7fa28007b6a0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 shutdown_connections 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1b56d0 0x5595df1fce80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1e15c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 --2- 172.21.15.37:0/1644391394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa268ff9640 0 client.5256 ms_handle_reset on v2:172.21.15.188:6833/1936445066 2023-11-24T06:16:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 >> 172.21.15.37:0/1644391394 conn(0x5595df15bc70 msgr2=0x5595df1dfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 shutdown_connections 2023-11-24T06:16:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.665+0000 7fa292dad740 1 -- 172.21.15.37:0/1644391394 wait complete. 2023-11-24T06:16:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.666+0000 7fa292dad740 20 client.5256 trim_cache size 0 max 16384 2023-11-24T06:16:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.682+0000 7fa292dad740 1 Processor -- start 2023-11-24T06:16:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.683+0000 7fa292dad740 1 -- start start 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.683+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.683+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.683+0000 7fa292dad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.683+0000 7fa292dad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595dee63f20 con 0x5595df19a070 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595df1092f0 con 0x5595df1997b0 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595df199650 con 0x5595df194d70 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1df3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40146/0 (socket says 172.21.15.37:40146) 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1072958688 learned_addr learned my addr 172.21.15.37:0/1072958688 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28d7b0640 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1deeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 msgr2=0x5595df1c1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1c1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 msgr2=0x5595df1deeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1deeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28e7b2640 1 -- 172.21.15.37:0/1072958688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595df09cb80 con 0x5595df19a070 2023-11-24T06:16:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.684+0000 7fa28d7b0640 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1df3f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa2800791b0 tx=0x7fa28004a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe3b4107cfa56e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa26bfff640 1 -- 172.21.15.37:0/1072958688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280083160 con 0x5595df19a070 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa26bfff640 1 -- 172.21.15.37:0/1072958688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595df0f9aa0 con 0x5595df19a070 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa26bfff640 1 -- 172.21.15.37:0/1072958688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2800aa4d0 con 0x5595df19a070 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa292dad740 1 -- 172.21.15.37:0/1072958688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 msgr2=0x5595df1df3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa292dad740 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1df3f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa2800791b0 tx=0x7fa28004a000 comp rx=0 tx=0).stop 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa292dad740 1 -- 172.21.15.37:0/1072958688 shutdown_connections 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa292dad740 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df1997b0 0x5595df1deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa292dad740 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df19a070 0x5595df1df3f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa292dad740 1 --2- 172.21.15.37:0/1072958688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df1c1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.685+0000 7fa292dad740 1 -- 172.21.15.37:0/1072958688 >> 172.21.15.37:0/1072958688 conn(0x5595df15bc70 msgr2=0x5595df19a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.686+0000 7fa292dad740 1 -- 172.21.15.37:0/1072958688 shutdown_connections 2023-11-24T06:16:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.686+0000 7fa292dad740 1 -- 172.21.15.37:0/1072958688 wait complete. 2023-11-24T06:16:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.686+0000 7fa292dad740 1 -- start start 2023-11-24T06:16:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.686+0000 7fa292dad740 1 Processor -- start 2023-11-24T06:16:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.687+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df200ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.687+0000 7fa292dad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df1997b0 0x5595df1bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.687+0000 7fa292dad740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df19a070 0x5595df1dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.687+0000 7fa292dad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595df1bbcb0 con 0x5595df1997b0 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.687+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595df201990 con 0x5595df19a070 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.687+0000 7fa292dad740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595df1ddee0 con 0x5595df194d70 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa292dad740 10 client.0 _ll_register_callbacks cb 0x7fa28007a7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df1997b0 0x5595df1bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df1997b0 0x5595df1bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40156/0 (socket says 172.21.15.37:40156) 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 -- 172.21.15.37:0/3370960115 learned_addr learned my addr 172.21.15.37:0/3370960115 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df200ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df19a070 0x5595df1dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 -- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 msgr2=0x5595df200ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df200ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 -- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df19a070 msgr2=0x5595df1dd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df19a070 0x5595df1dd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28d7b0640 1 -- 172.21.15.37:0/3370960115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595df0ff140 con 0x5595df1997b0 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.688+0000 7fa28e7b2640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df19a070 0x5595df1dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa28d7b0640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df1997b0 0x5595df1bfb70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa278012320 tx=0x7fa2780127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aac26442d96fc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa268ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa268ff9640 1 -- 172.21.15.37:0/3370960115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278015860 con 0x5595df1997b0 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa268ff9640 1 -- 172.21.15.37:0/3370960115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2780159c0 con 0x5595df1997b0 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa284007750 con 0x5595df1997b0 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa268ff9640 1 -- 172.21.15.37:0/3370960115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa278015b80 con 0x5595df1997b0 2023-11-24T06:16:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 10 client.5262 fetch_fsmap learned FSMap version 17 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5595df0c2170 con 0x5595df1997b0 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa268ff9640 1 -- 172.21.15.37:0/3370960115 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284007750 con 0x5595df1997b0 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa268ff9640 1 -- 172.21.15.37:0/3370960115 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa278015ce0 con 0x5595df1997b0 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 10 client.5262 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 10 client.5262 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 20 client.5262 populate_metadata read hostname 'smithi037' 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1dd670 0x5595df1d54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.689+0000 7fa292dad740 4 client.5262 mds_command: new command op to 5073 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.690+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 --> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5595dee016c0 con 0x5595df1dd670 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.690+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1dd670 0x5595df1d54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.691+0000 7fa28dfb1640 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1dd670 0x5595df1d54f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=182b7655ba1e914e server_cookie=d1686d68782f80ff in_seq=0 out_seq=0 2023-11-24T06:16:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.691+0000 7fa268ff9640 10 client.5262 ms_handle_connect on v2:172.21.15.188:6833/1936445066 2023-11-24T06:16:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa268ff9640 1 -- 172.21.15.37:0/3370960115 <== mds.0 v2:172.21.15.188:6833/1936445066 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5595dee016c0 con 0x5595df1dd670 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa268ff9640 10 client.5262 handle_command_reply: tid=0 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 client.5262 shutdown 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df1997b0 msgr2=0x5595df1bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df1997b0 0x5595df1bfb70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa278012320 tx=0x7fa2780127e0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 shutdown_connections 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:6833/1936445066,v1:172.21.15.188:6835/1936445066] conn(0x5595df1dd670 0x5595df1d54f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5595df19a070 0x5595df1dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5595df1997b0 0x5595df1bfb70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 --2- 172.21.15.37:0/3370960115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5595df194d70 0x5595df200ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa268ff9640 0 client.5262 ms_handle_reset on v2:172.21.15.188:6833/1936445066 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 >> 172.21.15.37:0/3370960115 conn(0x5595df15bc70 msgr2=0x5595df1c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 shutdown_connections 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 1 -- 172.21.15.37:0/3370960115 wait complete. 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.692+0000 7fa292dad740 20 client.5262 trim_cache size 0 max 16384 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3", 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5073, 2023-11-24T06:16:08.699 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 6.834035954, 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 17, 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 33, 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 33, 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.744207622999999 2023-11-24T06:16:08.700 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa26c06ae40 msgr2=0x7fa26c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa26c06ae40 0x7fa26c06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa284001eb0 tx=0x7fa284001980 comp rx=0 tx=0).stop 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28815b1d0 msgr2=0x7fa2880ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28815b1d0 0x7fa2880ad660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa280037040 tx=0x7fa280004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 shutdown_connections 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa26c06ae40 0x7fa26c06d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28815b1d0 0x7fa2880ad660 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2880b1080 0x7fa2880999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 --2- 172.21.15.37:0/1497763913 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa288070550 0x7fa28815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 >> 172.21.15.37:0/1497763913 conn(0x7fa2880cbb40 msgr2=0x7fa2880b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 shutdown_connections 2023-11-24T06:16:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.693+0000 7fa28efb3640 1 -- 172.21.15.37:0/1497763913 wait complete. 2023-11-24T06:16:08.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:16:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.922+0000 7efe0d28c640 1 Processor -- start 2023-11-24T06:16:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.922+0000 7efe0d28c640 1 -- start start 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.923+0000 7efe0d28c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe0806a500 0x7efe0806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.923+0000 7efe0d28c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080b2ed0 con 0x7efe08144880 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.923+0000 7efe0d28c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0806e250 con 0x7efe080d0ae0 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.923+0000 7efe0d28c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0806aed0 con 0x7efe0806a500 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.923+0000 7efe0ca8b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe0806a500 0x7efe0806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.924+0000 7efe07fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efe08144880 0x7efe0806f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41190/0 (socket says 172.21.15.37:41190) 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.924+0000 7efe07fff640 1 -- 172.21.15.37:0/2901835268 learned_addr learned my addr 172.21.15.37:0/2901835268 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.924+0000 7efe0ca8b640 1 -- 172.21.15.37:0/2901835268 >> v1:172.21.15.188:6789/0 conn(0x7efe080d0ae0 legacy=0x7efe0806db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.924+0000 7efe0ca8b640 1 -- 172.21.15.37:0/2901835268 >> v1:172.21.15.37:6789/0 conn(0x7efe08144880 legacy=0x7efe0806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.924+0000 7efe0ca8b640 1 -- 172.21.15.37:0/2901835268 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080b3120 con 0x7efe0806a500 2023-11-24T06:16:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.924+0000 7efe06ffd640 1 -- 172.21.15.37:0/2901835268 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201119964 0 0) 0x7efe080b2ed0 con 0x7efe08144880 2023-11-24T06:16:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.925+0000 7efe0ca8b640 1 --2- 172.21.15.37:0/2901835268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe0806a500 0x7efe0806a990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe00009dc0 tx=0x7efe0002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c962d47fc974a90 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.925+0000 7efe06ffd640 1 -- 172.21.15.37:0/2901835268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0002cc40 con 0x7efe0806a500 2023-11-24T06:16:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.925+0000 7efe06ffd640 1 -- 172.21.15.37:0/2901835268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0002cda0 con 0x7efe0806a500 2023-11-24T06:16:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.925+0000 7efe06ffd640 1 -- 172.21.15.37:0/2901835268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00034660 con 0x7efe0806a500 2023-11-24T06:16:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.926+0000 7efe0d28c640 1 -- 172.21.15.37:0/2901835268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe0806a500 msgr2=0x7efe0806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.926+0000 7efe0d28c640 1 --2- 172.21.15.37:0/2901835268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe0806a500 0x7efe0806a990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe00009dc0 tx=0x7efe0002be90 comp rx=0 tx=0).stop 2023-11-24T06:16:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.926+0000 7efe0d28c640 1 -- 172.21.15.37:0/2901835268 shutdown_connections 2023-11-24T06:16:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.926+0000 7efe0d28c640 1 --2- 172.21.15.37:0/2901835268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe0806a500 0x7efe0806a990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.926+0000 7efe0d28c640 1 -- 172.21.15.37:0/2901835268 >> 172.21.15.37:0/2901835268 conn(0x7efe080cfea0 msgr2=0x7efe080d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.926+0000 7efe0d28c640 1 -- 172.21.15.37:0/2901835268 shutdown_connections 2023-11-24T06:16:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.926+0000 7efe0d28c640 1 -- 172.21.15.37:0/2901835268 wait complete. 2023-11-24T06:16:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.928+0000 7efe0d28c640 1 Processor -- start 2023-11-24T06:16:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.928+0000 7efe0d28c640 1 -- start start 2023-11-24T06:16:08.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0d28c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe0806a500 0x7efe08141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0d28c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe08144880 0x7efe08139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0d28c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe080ceda0 0x7efe08155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0d28c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080ce980 con 0x7efe080ceda0 2023-11-24T06:16:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0d28c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080cdfe0 con 0x7efe08144880 2023-11-24T06:16:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0d28c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080ce2c0 con 0x7efe0806a500 2023-11-24T06:16:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0ca8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe080ceda0 0x7efe08155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0ca8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe080ceda0 0x7efe08155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40174/0 (socket says 172.21.15.37:40174) 2023-11-24T06:16:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.929+0000 7efe0ca8b640 1 -- 172.21.15.37:0/692331655 learned_addr learned my addr 172.21.15.37:0/692331655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe07fff640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe0806a500 0x7efe08141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe0ca8b640 1 -- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe0806a500 msgr2=0x7efe08141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe0ca8b640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe0806a500 0x7efe08141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe0ca8b640 1 -- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe08144880 msgr2=0x7efe08139fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe077fe640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe08144880 0x7efe08139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe0ca8b640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe08144880 0x7efe08139fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe0ca8b640 1 -- 172.21.15.37:0/692331655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009a70 con 0x7efe080ceda0 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe07fff640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe0806a500 0x7efe08141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe077fe640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe08144880 0x7efe08139fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe0ca8b640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe080ceda0 0x7efe08155f00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efe00009ee0 tx=0x7efe00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.930+0000 7efe04ff9640 1 -- 172.21.15.37:0/692331655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0003f420 con 0x7efe080ceda0 2023-11-24T06:16:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.931+0000 7efe04ff9640 1 -- 172.21.15.37:0/692331655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0003f580 con 0x7efe080ceda0 2023-11-24T06:16:08.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.931+0000 7efe04ff9640 1 -- 172.21.15.37:0/692331655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0003f910 con 0x7efe080ceda0 2023-11-24T06:16:08.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.931+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe080ce5a0 con 0x7efe080ceda0 2023-11-24T06:16:08.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.931+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0813a650 con 0x7efe080ceda0 2023-11-24T06:16:08.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.932+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe080ceac0 con 0x7efe080ceda0 2023-11-24T06:16:08.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.933+0000 7efe04ff9640 1 -- 172.21.15.37:0/692331655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe0003fa70 con 0x7efe080ceda0 2023-11-24T06:16:08.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.933+0000 7efe04ff9640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efdf406ae40 0x7efdf406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:08.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.934+0000 7efe04ff9640 1 -- 172.21.15.37:0/692331655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe000abfb0 con 0x7efe080ceda0 2023-11-24T06:16:08.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.934+0000 7efe07fff640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efdf406ae40 0x7efdf406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:08.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.934+0000 7efe07fff640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efdf406ae40 0x7efdf406d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efdf8000f60 tx=0x7efdf8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:08.938+0000 7efe04ff9640 1 -- 172.21.15.37:0/692331655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe080ceac0 con 0x7efe080ceda0 2023-11-24T06:16:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.174+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe080ceac0 con 0x7efe080ceda0 2023-11-24T06:16:09.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.174+0000 7efe04ff9640 1 -- 172.21.15.37:0/692331655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7efe080ceac0 con 0x7efe080ceda0 2023-11-24T06:16:09.177 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:16:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.177+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efdf406ae40 msgr2=0x7efdf406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.177+0000 7efe0d28c640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efdf406ae40 0x7efdf406d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efdf8000f60 tx=0x7efdf8009040 comp rx=0 tx=0).stop 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.177+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe080ceda0 msgr2=0x7efe08155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.177+0000 7efe0d28c640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe080ceda0 0x7efe08155f00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efe00009ee0 tx=0x7efe00004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 shutdown_connections 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efdf406ae40 0x7efdf406d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe08144880 0x7efe08139fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe080ceda0 0x7efe08155f00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 --2- 172.21.15.37:0/692331655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe0806a500 0x7efe08141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 >> 172.21.15.37:0/692331655 conn(0x7efe080cfea0 msgr2=0x7efe080b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 shutdown_connections 2023-11-24T06:16:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:09.178+0000 7efe0d28c640 1 -- 172.21.15.37:0/692331655 wait complete. 2023-11-24T06:16:09.199 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:16:09.200 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:16:09.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:09.200 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-11-24T06:16:09.251 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:16:09.251 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-11-24T06:16:09.252 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42290sec preferred_lft 42290sec 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:16:09.253 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::40b6:eeff:fe98:3c34/64 scope link 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a462:2eff:fec6:6249/64 scope link 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether d2:91:7f:1d:c0:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d091:7fff:fe1d:c078/64 scope link 2023-11-24T06:16:09.254 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:09.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:09.256 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:16:09.343 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-11-24T06:16:09.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:09.347 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-11-24T06:16:09.397 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-11-24T06:16:09.397 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:16:09.397 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:16:09.397 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:16:09.397 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:16:09.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:09.398 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:16:09.398 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:16:09.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:16:09.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:16:09.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:16:09.398 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:16:09.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:09.455 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:09.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:09.572 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:16:09.618 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:16:09.618 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:16:09.619 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:16:09.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:09.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-11-24T06:16:09.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:09.759 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:09.805 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:16:09.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:09.806 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:09.894 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:16:09.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:09.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:16:10.017 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:16:10.017 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:16:10.050 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:16:10.050 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:16:10.050 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:16:10.050 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:16:10.050 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:16:10.052 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-24T06:16:10.052 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:16:10.052 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:16:10.052 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:16:10.052 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:16:10.056 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:16:10.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:10.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:10.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:10.135 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:16:10.205 INFO:teuthology.orchestra.run.smithi037.stdout:client5274 2023-11-24T06:16:10.206 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:16:10.206 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:10.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:16:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.502+0000 7f525ca83640 1 Processor -- start 2023-11-24T06:16:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.502+0000 7f525ca83640 1 -- start start 2023-11-24T06:16:10.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f525ca83640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f52580d1e20 0x7f52580cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:10.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f525ca83640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52580d0070 0x7f52580b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:10.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f525ca83640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52580d04b0 con 0x7f525815d4e0 2023-11-24T06:16:10.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f525ca83640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580d4110 con 0x7f52580d0070 2023-11-24T06:16:10.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f525ca83640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580ce990 con 0x7f52580d1e20 2023-11-24T06:16:10.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f52577fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f525815d4e0 0x7f52580d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41200/0 (socket says 172.21.15.37:41200) 2023-11-24T06:16:10.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f52577fe640 1 -- 172.21.15.37:0/1540272891 learned_addr learned my addr 172.21.15.37:0/1540272891 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:10.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f5257fff640 1 --2- 172.21.15.37:0/1540272891 >> v2:172.21.15.37:3300/0 conn(0x7f52580d0070 0x7f52580b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:10.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.505+0000 7f5257fff640 1 -- 172.21.15.37:0/1540272891 >> v2:172.21.15.188:3300/0 conn(0x7f52580d1e20 msgr2=0x7f52580cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:10.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.504+0000 7f5256ffd640 1 --2- 172.21.15.37:0/1540272891 >> v2:172.21.15.188:3300/0 conn(0x7f52580d1e20 0x7f52580cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:10.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.505+0000 7f52567fc640 1 -- 172.21.15.37:0/1540272891 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649981490 0 0) 0x7f52580d04b0 con 0x7f525815d4e0 2023-11-24T06:16:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.505+0000 7f5257fff640 1 --2- 172.21.15.37:0/1540272891 >> v2:172.21.15.188:3300/0 conn(0x7f52580d1e20 0x7f52580cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.505+0000 7f5257fff640 1 -- 172.21.15.37:0/1540272891 >> v1:172.21.15.37:6789/0 conn(0x7f525815d4e0 legacy=0x7f52580d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.505+0000 7f5257fff640 1 -- 172.21.15.37:0/1540272891 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580cec70 con 0x7f52580d0070 2023-11-24T06:16:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.505+0000 7f5256ffd640 1 --2- 172.21.15.37:0/1540272891 >> v2:172.21.15.188:3300/0 conn(0x7f52580d1e20 0x7f52580cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.506+0000 7f5257fff640 1 --2- 172.21.15.37:0/1540272891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580b2e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f52580b9280 tx=0x7f525002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4299fcd38ce49a8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.506+0000 7f52567fc640 1 -- 172.21.15.37:0/1540272891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525002cc70 con 0x7f52580d0070 2023-11-24T06:16:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.506+0000 7f52567fc640 1 -- 172.21.15.37:0/1540272891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525002cdd0 con 0x7f52580d0070 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.506+0000 7f52567fc640 1 -- 172.21.15.37:0/1540272891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250034660 con 0x7f52580d0070 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 -- 172.21.15.37:0/1540272891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 msgr2=0x7f52580b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 --2- 172.21.15.37:0/1540272891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580b2e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f52580b9280 tx=0x7f525002bec0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 -- 172.21.15.37:0/1540272891 shutdown_connections 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 --2- 172.21.15.37:0/1540272891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580b2e50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 --2- 172.21.15.37:0/1540272891 >> v2:172.21.15.188:3300/0 conn(0x7f52580d1e20 0x7f52580cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 -- 172.21.15.37:0/1540272891 >> 172.21.15.37:0/1540272891 conn(0x7f525809c510 msgr2=0x7f52580d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 -- 172.21.15.37:0/1540272891 shutdown_connections 2023-11-24T06:16:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.507+0000 7f525ca83640 1 -- 172.21.15.37:0/1540272891 wait complete. 2023-11-24T06:16:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.508+0000 7f525ca83640 1 Processor -- start 2023-11-24T06:16:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.509+0000 7f525ca83640 1 -- start start 2023-11-24T06:16:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.509+0000 7f525ca83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.509+0000 7f525ca83640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52580d1e20 0x7f52581f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.509+0000 7f525ca83640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f525815d4e0 0x7f525815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f525ca83640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52580c7a00 con 0x7f52580d0070 2023-11-24T06:16:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f525ca83640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52580cd230 con 0x7f525815d4e0 2023-11-24T06:16:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f525ca83640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52580c6e30 con 0x7f52580d1e20 2023-11-24T06:16:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40188/0 (socket says 172.21.15.37:40188) 2023-11-24T06:16:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 -- 172.21.15.37:0/3208030878 learned_addr learned my addr 172.21.15.37:0/3208030878 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 -- 172.21.15.37:0/3208030878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52580d1e20 msgr2=0x7f52581f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52580d1e20 0x7f52581f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 -- 172.21.15.37:0/3208030878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f525815d4e0 msgr2=0x7f525815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f525815d4e0 0x7f525815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 -- 172.21.15.37:0/3208030878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250009a70 con 0x7f52580d0070 2023-11-24T06:16:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.510+0000 7f52577fe640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580c9370 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f524800c430 tx=0x7f524800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.511+0000 7f523ffff640 1 -- 172.21.15.37:0/3208030878 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480074e0 con 0x7f52580d0070 2023-11-24T06:16:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.511+0000 7f523ffff640 1 -- 172.21.15.37:0/3208030878 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248007660 con 0x7f52580d0070 2023-11-24T06:16:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.511+0000 7f523ffff640 1 -- 172.21.15.37:0/3208030878 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248004a20 con 0x7f52580d0070 2023-11-24T06:16:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.511+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52580c70d0 con 0x7f52580d0070 2023-11-24T06:16:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.511+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52580c7690 con 0x7f52580d0070 2023-11-24T06:16:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.512+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525804e840 con 0x7f52580d0070 2023-11-24T06:16:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.513+0000 7f523ffff640 1 -- 172.21.15.37:0/3208030878 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5248004b80 con 0x7f52580d0070 2023-11-24T06:16:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.514+0000 7f523ffff640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524406ae40 0x7f524406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.514+0000 7f523ffff640 1 -- 172.21.15.37:0/3208030878 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52480893b0 con 0x7f52580d0070 2023-11-24T06:16:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.514+0000 7f5256ffd640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524406ae40 0x7f524406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.515+0000 7f5256ffd640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524406ae40 0x7f524406d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f524c006fd0 tx=0x7f524c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:10.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.518+0000 7f523ffff640 1 -- 172.21.15.37:0/3208030878 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52480544f0 con 0x7f52580d0070 2023-11-24T06:16:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.748+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5258160a70 con 0x7f52580d0070 2023-11-24T06:16:10.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.749+0000 7f523ffff640 1 -- 172.21.15.37:0/3208030878 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5248057b10 con 0x7f52580d0070 2023-11-24T06:16:10.752 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:16:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524406ae40 msgr2=0x7f524406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524406ae40 0x7f524406d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f524c006fd0 tx=0x7f524c008040 comp rx=0 tx=0).stop 2023-11-24T06:16:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 msgr2=0x7f52580c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580c9370 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f524800c430 tx=0x7f524800c8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 shutdown_connections 2023-11-24T06:16:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524406ae40 0x7f524406d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f525815d4e0 0x7f525815ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52580d1e20 0x7f52581f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 --2- 172.21.15.37:0/3208030878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52580d0070 0x7f52580c9370 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.751+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 >> 172.21.15.37:0/3208030878 conn(0x7f525809c510 msgr2=0x7f525806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.752+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 shutdown_connections 2023-11-24T06:16:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:10.752+0000 7f525ca83640 1 -- 172.21.15.37:0/3208030878 wait complete. 2023-11-24T06:16:10.773 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:16:10.773 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:16:10.773 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-11-24T06:16:10.773 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:16:10.773 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:10.774 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:16:10.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:16:10.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:16:10.774 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:16:10.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:10.774 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-11-24T06:16:10.834 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:16:10.835 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:16:10.835 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:16:10.835 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:10.835 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-11-24T06:16:10.835 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:10.836 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:10.836 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:10.836 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2023-11-24T06:16:10.836 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:10.836 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:10.837 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2023-11-24T06:16:10.837 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:16:10.837 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:10.837 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:16:10.837 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:10.837 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:16:10.838 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42296sec preferred_lft 42296sec 2023-11-24T06:16:10.838 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2023-11-24T06:16:10.838 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:10.838 INFO:teuthology.orchestra.run.smithi188.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:16:10.838 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff 2023-11-24T06:16:10.839 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:16:10.839 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:10.839 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9460:4eff:fe42:69c0/64 scope link 2023-11-24T06:16:10.839 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:10.839 INFO:teuthology.orchestra.run.smithi188.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:10.839 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:16:10.839 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::88b7:c8ff:fef4:7a4d/64 scope link 2023-11-24T06:16:10.840 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:10.840 INFO:teuthology.orchestra.run.smithi188.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:16:10.840 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 92:37:27:cd:69:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:16:10.840 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9037:27ff:fecd:694e/64 scope link 2023-11-24T06:16:10.840 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:16:10.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:10.841 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:16:10.934 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-11-24T06:16:10.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:10.939 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-11-24T06:16:10.992 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-11-24T06:16:10.993 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:16:10.993 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:16:10.993 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:16:10.993 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:16:10.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:10.993 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:16:10.993 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:16:10.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:16:10.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:16:10.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:16:10.994 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:16:11.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:11.175 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:16:11.226 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:16:11.226 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:16:11.227 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:16:11.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:11.228 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2023-11-24T06:16:11.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:11.326 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:11.379 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:16:11.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:16:11.380 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:11.428 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:16:11.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:11.429 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:16:11.559 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:16:11.559 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:16:11.596 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:16:11.597 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:16:11.597 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:16:11.597 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with new device syntax: 1@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:16:11.597 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:16:11.598 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-24T06:16:11.598 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:16:11.599 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:16:11.599 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:16:11.599 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:16:11.603 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:16:11.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:11.604 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:11.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:11.682 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:16:11.732 INFO:teuthology.orchestra.run.smithi188.stdout:client5286 2023-11-24T06:16:11.732 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:16:11.732 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:11.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:16:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.064+0000 7fe1217ce640 1 Processor -- start 2023-11-24T06:16:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.064+0000 7fe1217ce640 1 -- start start 2023-11-24T06:16:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.066+0000 7fe1217ce640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c0b35f0 0x7fe11c140950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.066+0000 7fe1217ce640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe11c140e90 0x7fe11c13dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.066+0000 7fe1217ce640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c13e8c0 con 0x7fe11c0b39d0 2023-11-24T06:16:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.066+0000 7fe1217ce640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c1413d0 con 0x7fe11c140e90 2023-11-24T06:16:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.066+0000 7fe1217ce640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1416b0 con 0x7fe11c0b35f0 2023-11-24T06:16:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.067+0000 7fe113fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe11c140e90 0x7fe11c13dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.067+0000 7fe11affd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c0b35f0 0x7fe11c140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.067+0000 7fe113fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe11c140e90 0x7fe11c13dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:55042/0 (socket says 172.21.15.37:55042) 2023-11-24T06:16:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.067+0000 7fe113fff640 1 -- 172.21.15.37:0/151139336 learned_addr learned my addr 172.21.15.37:0/151139336 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.068+0000 7fe11affd640 1 -- 172.21.15.37:0/151139336 >> v2:172.21.15.188:3300/0 conn(0x7fe11c140e90 msgr2=0x7fe11c13dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.068+0000 7fe11affd640 1 --2- 172.21.15.37:0/151139336 >> v2:172.21.15.188:3300/0 conn(0x7fe11c140e90 0x7fe11c13dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.068+0000 7fe11affd640 1 -- 172.21.15.37:0/151139336 >> v1:172.21.15.188:6789/0 conn(0x7fe11c0b39d0 legacy=0x7fe11c15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.068+0000 7fe11affd640 1 -- 172.21.15.37:0/151139336 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c13eb10 con 0x7fe11c0b35f0 2023-11-24T06:16:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.068+0000 7fe113fff640 1 --2- 172.21.15.37:0/151139336 >> v2:172.21.15.188:3300/0 conn(0x7fe11c140e90 0x7fe11c13dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.069+0000 7fe11affd640 1 --2- 172.21.15.37:0/151139336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c0b35f0 0x7fe11c140950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0097d0 tx=0x7fe10c02b650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ca47224ee19caa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe11a7fc640 1 -- 172.21.15.37:0/151139336 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c030710 con 0x7fe11c0b35f0 2023-11-24T06:16:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe11a7fc640 1 -- 172.21.15.37:0/151139336 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c02e050 con 0x7fe11c0b35f0 2023-11-24T06:16:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe11a7fc640 1 -- 172.21.15.37:0/151139336 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c030a90 con 0x7fe11c0b35f0 2023-11-24T06:16:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe1217ce640 1 -- 172.21.15.37:0/151139336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c0b35f0 msgr2=0x7fe11c140950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe1217ce640 1 --2- 172.21.15.37:0/151139336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c0b35f0 0x7fe11c140950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0097d0 tx=0x7fe10c02b650 comp rx=0 tx=0).stop 2023-11-24T06:16:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe1217ce640 1 -- 172.21.15.37:0/151139336 shutdown_connections 2023-11-24T06:16:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe1217ce640 1 --2- 172.21.15.37:0/151139336 >> v2:172.21.15.188:3300/0 conn(0x7fe11c140e90 0x7fe11c13dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe1217ce640 1 --2- 172.21.15.37:0/151139336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c0b35f0 0x7fe11c140950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.070+0000 7fe1217ce640 1 -- 172.21.15.37:0/151139336 >> 172.21.15.37:0/151139336 conn(0x7fe11c061340 msgr2=0x7fe11c061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.071+0000 7fe1217ce640 1 -- 172.21.15.37:0/151139336 shutdown_connections 2023-11-24T06:16:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.071+0000 7fe1217ce640 1 -- 172.21.15.37:0/151139336 wait complete. 2023-11-24T06:16:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.072+0000 7fe1217ce640 1 Processor -- start 2023-11-24T06:16:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.073+0000 7fe1217ce640 1 -- start start 2023-11-24T06:16:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.073+0000 7fe1217ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe11c0b35f0 0x7fe11c151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe1217ce640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe11c0b39d0 0x7fe11c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe1217ce640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c140e90 0x7fe11c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe1217ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c06b610 con 0x7fe11c0b35f0 2023-11-24T06:16:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe1217ce640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1f3480 con 0x7fe11c0b39d0 2023-11-24T06:16:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe1217ce640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1f3760 con 0x7fe11c140e90 2023-11-24T06:16:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe113fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe11c0b39d0 0x7fe11c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe11affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe11c0b35f0 0x7fe11c151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe113fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe11c0b39d0 0x7fe11c0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:55056/0 (socket says 172.21.15.37:55056) 2023-11-24T06:16:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe113fff640 1 -- 172.21.15.37:0/1877277561 learned_addr learned my addr 172.21.15.37:0/1877277561 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.074+0000 7fe11b7fe640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c140e90 0x7fe11c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe11b7fe640 1 -- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe11c0b39d0 msgr2=0x7fe11c0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe11b7fe640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe11c0b39d0 0x7fe11c0b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe11b7fe640 1 -- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe11c0b35f0 msgr2=0x7fe11c151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe11b7fe640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe11c0b35f0 0x7fe11c151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe11b7fe640 1 -- 172.21.15.37:0/1877277561 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040094d0 con 0x7fe11c140e90 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe11affd640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe11c0b35f0 0x7fe11c151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe113fff640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe11c0b39d0 0x7fe11c0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe11b7fe640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c140e90 0x7fe11c0b5060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c8a0 tx=0x7fe11400cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe1137fe640 1 -- 172.21.15.37:0/1877277561 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114003da0 con 0x7fe11c140e90 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe1137fe640 1 -- 172.21.15.37:0/1877277561 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114005070 con 0x7fe11c140e90 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.075+0000 7fe1137fe640 1 -- 172.21.15.37:0/1877277561 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114005460 con 0x7fe11c140e90 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.076+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c009400 con 0x7fe11c140e90 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.076+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c1f3d20 con 0x7fe11c140e90 2023-11-24T06:16:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.077+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c06b810 con 0x7fe11c140e90 2023-11-24T06:16:12.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.078+0000 7fe1137fe640 1 -- 172.21.15.37:0/1877277561 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1140055c0 con 0x7fe11c140e90 2023-11-24T06:16:12.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.079+0000 7fe1137fe640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0fc06ae40 0x7fe0fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.079+0000 7fe1137fe640 1 -- 172.21.15.37:0/1877277561 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe114089080 con 0x7fe11c140e90 2023-11-24T06:16:12.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.079+0000 7fe11affd640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0fc06ae40 0x7fe0fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.080+0000 7fe11affd640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0fc06ae40 0x7fe0fc06d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe10c034000 tx=0x7fe10c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.086+0000 7fe1137fe640 1 -- 172.21.15.37:0/1877277561 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1140542c0 con 0x7fe11c140e90 2023-11-24T06:16:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.316+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe11c067470 con 0x7fe11c140e90 2023-11-24T06:16:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.696+0000 7fe1137fe640 1 -- 172.21.15.37:0/1877277561 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7fe1140578e0 con 0x7fe11c140e90 2023-11-24T06:16:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0fc06ae40 msgr2=0x7fe0fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0fc06ae40 0x7fe0fc06d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe10c034000 tx=0x7fe10c008030 comp rx=0 tx=0).stop 2023-11-24T06:16:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c140e90 msgr2=0x7fe11c0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c140e90 0x7fe11c0b5060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c8a0 tx=0x7fe11400cd60 comp rx=0 tx=0).stop 2023-11-24T06:16:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 shutdown_connections 2023-11-24T06:16:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe0fc06ae40 0x7fe0fc06d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe11c0b39d0 0x7fe11c0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe11c140e90 0x7fe11c0b5060 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 --2- 172.21.15.37:0/1877277561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe11c0b35f0 0x7fe11c151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 >> 172.21.15.37:0/1877277561 conn(0x7fe11c061340 msgr2=0x7fe11c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 shutdown_connections 2023-11-24T06:16:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.700+0000 7fe1217ce640 1 -- 172.21.15.37:0/1877277561 wait complete. 2023-11-24T06:16:12.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:16:12.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.950+0000 7fadba705640 1 Processor -- start 2023-11-24T06:16:12.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.951+0000 7fadba705640 1 -- start start 2023-11-24T06:16:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.952+0000 7fadba705640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fadb40999d0 0x7fadb40b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.952+0000 7fadba705640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb40b5430 0x7fadb4167280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadba705640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb40b37b0 con 0x7fadb415d620 2023-11-24T06:16:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadba705640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb406f9b0 con 0x7fadb40999d0 2023-11-24T06:16:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadba705640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb406d900 con 0x7fadb40b5430 2023-11-24T06:16:12.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadb3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fadb415d620 0x7fadb40b4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45426/0 (socket says 172.21.15.37:45426) 2023-11-24T06:16:12.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadb3fff640 1 -- 172.21.15.37:0/3607727590 learned_addr learned my addr 172.21.15.37:0/3607727590 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:12.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadb8ca2640 1 --2- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb40b5430 0x7fadb4167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadb37fe640 1 --2- 172.21.15.37:0/3607727590 >> v2:172.21.15.188:3300/0 conn(0x7fadb40999d0 0x7fadb40b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.953+0000 7fadb2ffd640 1 -- 172.21.15.37:0/3607727590 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795035876 0 0) 0x7fada4001490 con 0x7fadb415d620 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.954+0000 7fadb2ffd640 1 -- 172.21.15.37:0/3607727590 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad9c003520 con 0x7fadb415d620 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.954+0000 7fadb37fe640 1 -- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb40b5430 msgr2=0x7fadb4167280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.954+0000 7fadb37fe640 1 --2- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb40b5430 0x7fadb4167280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.954+0000 7fadb37fe640 1 -- 172.21.15.37:0/3607727590 >> v1:172.21.15.37:6789/0 conn(0x7fadb415d620 legacy=0x7fadb40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.954+0000 7fadb2ffd640 1 -- 172.21.15.37:0/3607727590 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3745844657 0 0) 0x7fad9c003520 con 0x7fadb415d620 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.954+0000 7fadb37fe640 1 -- 172.21.15.37:0/3607727590 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb406dbe0 con 0x7fadb40999d0 2023-11-24T06:16:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.954+0000 7fadb8ca2640 1 --2- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb40b5430 0x7fadb4167280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.955+0000 7fadb37fe640 1 --2- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40999d0 0x7fadb40b3270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fada80097a0 tx=0x7fada802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a013f94cfe5ae700 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.955+0000 7fadb2ffd640 1 -- 172.21.15.37:0/3607727590 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4001ba0 con 0x7fadb40999d0 2023-11-24T06:16:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.955+0000 7fadb2ffd640 1 -- 172.21.15.37:0/3607727590 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada802e050 con 0x7fadb40999d0 2023-11-24T06:16:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.955+0000 7fadb2ffd640 1 -- 172.21.15.37:0/3607727590 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8030730 con 0x7fadb40999d0 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 -- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40999d0 msgr2=0x7fadb40b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 --2- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40999d0 0x7fadb40b3270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fada80097a0 tx=0x7fada802b790 comp rx=0 tx=0).stop 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 -- 172.21.15.37:0/3607727590 shutdown_connections 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 --2- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb40b5430 0x7fadb4167280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 --2- 172.21.15.37:0/3607727590 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40999d0 0x7fadb40b3270 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 -- 172.21.15.37:0/3607727590 >> 172.21.15.37:0/3607727590 conn(0x7fadb406c090 msgr2=0x7fadb40b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 -- 172.21.15.37:0/3607727590 shutdown_connections 2023-11-24T06:16:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.956+0000 7fadba705640 1 -- 172.21.15.37:0/3607727590 wait complete. 2023-11-24T06:16:12.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.958+0000 7fadba705640 1 Processor -- start 2023-11-24T06:16:12.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.958+0000 7fadba705640 1 -- start start 2023-11-24T06:16:12.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadba705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb40999d0 0x7fadb40ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadba705640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40b5430 0x7fadb40cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadba705640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb415d620 0x7fadb414ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadba705640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40cfa10 con 0x7fadb40999d0 2023-11-24T06:16:12.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadba705640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb414d360 con 0x7fadb40b5430 2023-11-24T06:16:12.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadba705640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40caf30 con 0x7fadb415d620 2023-11-24T06:16:12.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb40999d0 0x7fadb40ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb40999d0 0x7fadb40ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42806/0 (socket says 172.21.15.37:42806) 2023-11-24T06:16:12.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadb3fff640 1 -- 172.21.15.37:0/2290841605 learned_addr learned my addr 172.21.15.37:0/2290841605 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:12.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.959+0000 7fadb8ca2640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb415d620 0x7fadb414ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb37fe640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40b5430 0x7fadb40cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb3fff640 1 -- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb415d620 msgr2=0x7fadb414ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb3fff640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb415d620 0x7fadb414ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb3fff640 1 -- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40b5430 msgr2=0x7fadb40cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb3fff640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40b5430 0x7fadb40cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb3fff640 1 -- 172.21.15.37:0/2290841605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac009400 con 0x7fadb40999d0 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb37fe640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40b5430 0x7fadb40cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb3fff640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb40999d0 0x7fadb40ca000 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fada400caa0 tx=0x7fada400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb0ff9640 1 -- 172.21.15.37:0/2290841605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400a6d0 con 0x7fadb40999d0 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb0ff9640 1 -- 172.21.15.37:0/2290841605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada400a850 con 0x7fadb40999d0 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadb0ff9640 1 -- 172.21.15.37:0/2290841605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400ac00 con 0x7fadb40999d0 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.960+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada8009400 con 0x7fadb40999d0 2023-11-24T06:16:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.961+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb40ca970 con 0x7fadb40999d0 2023-11-24T06:16:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.962+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb404e8b0 con 0x7fadb40999d0 2023-11-24T06:16:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.963+0000 7fadb0ff9640 1 -- 172.21.15.37:0/2290841605 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fada40070d0 con 0x7fadb40999d0 2023-11-24T06:16:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.964+0000 7fadb0ff9640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fada006ae40 0x7fada006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.964+0000 7fadb0ff9640 1 -- 172.21.15.37:0/2290841605 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fada4088b50 con 0x7fadb40999d0 2023-11-24T06:16:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.965+0000 7fadb37fe640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fada006ae40 0x7fada006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.965+0000 7fadb37fe640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fada006ae40 0x7fada006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fada8034000 tx=0x7fada802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:12.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:12.969+0000 7fadb0ff9640 1 -- 172.21.15.37:0/2290841605 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fada4053c90 con 0x7fadb40999d0 2023-11-24T06:16:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.186+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fadb406e480 con 0x7fada006ae40 2023-11-24T06:16:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.187+0000 7fadb0ff9640 1 -- 172.21.15.37:0/2290841605 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fada8042080 con 0x7fada006ae40 2023-11-24T06:16:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:16:13.190 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:13.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-11-24T06:16:13.191 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:16:13.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fada006ae40 msgr2=0x7fada006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fada006ae40 0x7fada006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fada8034000 tx=0x7fada802f000 comp rx=0 tx=0).stop 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb40999d0 msgr2=0x7fadb40ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb40999d0 0x7fadb40ca000 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fada400caa0 tx=0x7fada400cf60 comp rx=0 tx=0).stop 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 shutdown_connections 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fada006ae40 0x7fada006d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fadb40b5430 0x7fadb40cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.190+0000 7fadba705640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fadb415d620 0x7fadb414ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.191+0000 7fadba705640 1 --2- 172.21.15.37:0/2290841605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb40999d0 0x7fadb40ca000 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.191+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 >> 172.21.15.37:0/2290841605 conn(0x7fadb406c090 msgr2=0x7fadb415a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.191+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 shutdown_connections 2023-11-24T06:16:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.191+0000 7fadba705640 1 -- 172.21.15.37:0/2290841605 wait complete. 2023-11-24T06:16:13.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:16:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.422+0000 7f047d259640 1 Processor -- start 2023-11-24T06:16:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.422+0000 7f047d259640 1 -- start start 2023-11-24T06:16:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.423+0000 7f047d259640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04780d0360 0x7f04780d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.423+0000 7f047d259640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780b6090 con 0x7f04780d0e10 2023-11-24T06:16:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.423+0000 7f047d259640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780cf0b0 con 0x7f047815d3c0 2023-11-24T06:16:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.423+0000 7f047d259640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780d1c80 con 0x7f04780d0360 2023-11-24T06:16:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.424+0000 7f04777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04780d0360 0x7f04780d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.424+0000 7f04777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04780d0360 0x7f04780d15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42812/0 (socket says 172.21.15.37:42812) 2023-11-24T06:16:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.424+0000 7f04777fe640 1 -- 172.21.15.37:0/2840306436 learned_addr learned my addr 172.21.15.37:0/2840306436 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.424+0000 7f04777fe640 1 -- 172.21.15.37:0/2840306436 >> v1:172.21.15.188:6789/0 conn(0x7f047815d3c0 legacy=0x7f04780cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.424+0000 7f04777fe640 1 -- 172.21.15.37:0/2840306436 >> v1:172.21.15.37:6789/0 conn(0x7f04780d0e10 legacy=0x7f04780b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.424+0000 7f04777fe640 1 -- 172.21.15.37:0/2840306436 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04780d1f60 con 0x7f04780d0360 2023-11-24T06:16:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.425+0000 7f04777fe640 1 --2- 172.21.15.37:0/2840306436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04780d0360 0x7f04780d15f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0460009870 tx=0x7f046002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ac178dddcd346d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f0476ffd640 1 -- 172.21.15.37:0/2840306436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460030860 con 0x7f04780d0360 2023-11-24T06:16:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f0476ffd640 1 -- 172.21.15.37:0/2840306436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04600309c0 con 0x7f04780d0360 2023-11-24T06:16:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f0476ffd640 1 -- 172.21.15.37:0/2840306436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460030d50 con 0x7f04780d0360 2023-11-24T06:16:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f047d259640 1 -- 172.21.15.37:0/2840306436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04780d0360 msgr2=0x7f04780d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f047d259640 1 --2- 172.21.15.37:0/2840306436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04780d0360 0x7f04780d15f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0460009870 tx=0x7f046002b9a0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f047d259640 1 -- 172.21.15.37:0/2840306436 shutdown_connections 2023-11-24T06:16:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f047d259640 1 --2- 172.21.15.37:0/2840306436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04780d0360 0x7f04780d15f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f047d259640 1 -- 172.21.15.37:0/2840306436 >> 172.21.15.37:0/2840306436 conn(0x7f047809c570 msgr2=0x7f04780d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.426+0000 7f047d259640 1 -- 172.21.15.37:0/2840306436 shutdown_connections 2023-11-24T06:16:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.427+0000 7f047d259640 1 -- 172.21.15.37:0/2840306436 wait complete. 2023-11-24T06:16:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.428+0000 7f047d259640 1 Processor -- start 2023-11-24T06:16:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.429+0000 7f047d259640 1 -- start start 2023-11-24T06:16:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.429+0000 7f047d259640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04780d0360 0x7f04780c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.429+0000 7f047d259640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04780d0e10 0x7f04780ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047d259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f047815d3c0 0x7f04780b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047d259640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c7dd0 con 0x7f047815d3c0 2023-11-24T06:16:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047d259640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c9c50 con 0x7f04780d0360 2023-11-24T06:16:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047d259640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04781f34f0 con 0x7f04780d0e10 2023-11-24T06:16:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047ca58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f047815d3c0 0x7f04780b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047ca58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f047815d3c0 0x7f04780b8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42826/0 (socket says 172.21.15.37:42826) 2023-11-24T06:16:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047ca58640 1 -- 172.21.15.37:0/799565478 learned_addr learned my addr 172.21.15.37:0/799565478 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f0477fff640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04780d0360 0x7f04780c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f04777fe640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04780d0e10 0x7f04780ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047ca58640 1 -- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04780d0e10 msgr2=0x7f04780ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047ca58640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04780d0e10 0x7f04780ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047ca58640 1 -- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04780d0360 msgr2=0x7f04780c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.430+0000 7f047ca58640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04780d0360 0x7f04780c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f047ca58640 1 -- 172.21.15.37:0/799565478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600094d0 con 0x7f047815d3c0 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f0477fff640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04780d0360 0x7f04780c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f047ca58640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f047815d3c0 0x7f04780b8040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0470001eb0 tx=0x7f047000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f0474ff9640 1 -- 172.21.15.37:0/799565478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04700052d0 con 0x7f047815d3c0 2023-11-24T06:16:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f0474ff9640 1 -- 172.21.15.37:0/799565478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470005430 con 0x7f047815d3c0 2023-11-24T06:16:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f0474ff9640 1 -- 172.21.15.37:0/799565478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470003810 con 0x7f047815d3c0 2023-11-24T06:16:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04781f37d0 con 0x7f047815d3c0 2023-11-24T06:16:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.431+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04781f3d90 con 0x7f047815d3c0 2023-11-24T06:16:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.432+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04780c6ad0 con 0x7f047815d3c0 2023-11-24T06:16:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.433+0000 7f0474ff9640 1 -- 172.21.15.37:0/799565478 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0470003970 con 0x7f047815d3c0 2023-11-24T06:16:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.434+0000 7f0474ff9640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae40 0x7f045806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.434+0000 7f0474ff9640 1 -- 172.21.15.37:0/799565478 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0470088bf0 con 0x7f047815d3c0 2023-11-24T06:16:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.435+0000 7f0477fff640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae40 0x7f045806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.435+0000 7f0477fff640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae40 0x7f045806d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04780b8990 tx=0x7f0468009590 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.439+0000 7f0474ff9640 1 -- 172.21.15.37:0/799565478 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0470053c90 con 0x7f047815d3c0 2023-11-24T06:16:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.631+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f047804e840 con 0x7f047815d3c0 2023-11-24T06:16:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.632+0000 7f0474ff9640 1 -- 172.21.15.37:0/799565478 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04700170c0 con 0x7f047815d3c0 2023-11-24T06:16:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae40 msgr2=0x7f045806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae40 0x7f045806d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04780b8990 tx=0x7f0468009590 comp rx=0 tx=0).stop 2023-11-24T06:16:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f047815d3c0 msgr2=0x7f04780b8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f047815d3c0 0x7f04780b8040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0470001eb0 tx=0x7f047000c890 comp rx=0 tx=0).stop 2023-11-24T06:16:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 shutdown_connections 2023-11-24T06:16:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae40 0x7f045806d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f047815d3c0 0x7f04780b8040 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04780d0e10 0x7f04780ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 --2- 172.21.15.37:0/799565478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04780d0360 0x7f04780c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.635+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 >> 172.21.15.37:0/799565478 conn(0x7f047809c570 msgr2=0x7f0478159980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.636+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 shutdown_connections 2023-11-24T06:16:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.636+0000 7f047d259640 1 -- 172.21.15.37:0/799565478 wait complete. 2023-11-24T06:16:13.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create vol1689 2023-11-24T06:16:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.886+0000 7f26988ce640 1 Processor -- start 2023-11-24T06:16:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.886+0000 7f26988ce640 1 -- start start 2023-11-24T06:16:13.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.887+0000 7f26988ce640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f26941609f0 0x7f26940d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.887+0000 7f26988ce640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f26940d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.888+0000 7f26988ce640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26940b41b0 con 0x7f26940b2050 2023-11-24T06:16:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.888+0000 7f26988ce640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26940b4490 con 0x7f26941609f0 2023-11-24T06:16:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.888+0000 7f26988ce640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26940b0090 con 0x7f2694160dd0 2023-11-24T06:16:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.888+0000 7f268bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f26940d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.888+0000 7f2692d9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f26941609f0 0x7f26940d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.888+0000 7f268bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f26940d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:33576/0 (socket says 172.21.15.37:33576) 2023-11-24T06:16:13.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.888+0000 7f268bfff640 1 -- 172.21.15.37:0/3619511434 learned_addr learned my addr 172.21.15.37:0/3619511434 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:13.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.889+0000 7f268bfff640 1 -- 172.21.15.37:0/3619511434 >> v2:172.21.15.188:3300/0 conn(0x7f26941609f0 msgr2=0x7f26940d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:13.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.889+0000 7f268bfff640 1 --2- 172.21.15.37:0/3619511434 >> v2:172.21.15.188:3300/0 conn(0x7f26941609f0 0x7f26940d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.889+0000 7f268bfff640 1 -- 172.21.15.37:0/3619511434 >> v1:172.21.15.188:6789/0 conn(0x7f26940b2050 legacy=0x7f26940b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.889+0000 7f268bfff640 1 -- 172.21.15.37:0/3619511434 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940b0370 con 0x7f2694160dd0 2023-11-24T06:16:13.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.889+0000 7f2692d9d640 1 --2- 172.21.15.37:0/3619511434 >> v2:172.21.15.188:3300/0 conn(0x7f26941609f0 0x7f26940d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:13.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.891+0000 7f268bfff640 1 --2- 172.21.15.37:0/3619511434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f26940d1830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f267c009870 tx=0x7f267c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a4cfb6e3efba3c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:13.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f269259c640 1 -- 172.21.15.37:0/3619511434 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c030840 con 0x7f2694160dd0 2023-11-24T06:16:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f269259c640 1 -- 172.21.15.37:0/3619511434 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c0309a0 con 0x7f2694160dd0 2023-11-24T06:16:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f269259c640 1 -- 172.21.15.37:0/3619511434 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c030d30 con 0x7f2694160dd0 2023-11-24T06:16:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f26988ce640 1 -- 172.21.15.37:0/3619511434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 msgr2=0x7f26940d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f26988ce640 1 --2- 172.21.15.37:0/3619511434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f26940d1830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f267c009870 tx=0x7f267c02b980 comp rx=0 tx=0).stop 2023-11-24T06:16:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f26988ce640 1 -- 172.21.15.37:0/3619511434 shutdown_connections 2023-11-24T06:16:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f26988ce640 1 --2- 172.21.15.37:0/3619511434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f26940d1830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f26988ce640 1 --2- 172.21.15.37:0/3619511434 >> v2:172.21.15.188:3300/0 conn(0x7f26941609f0 0x7f26940d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.892+0000 7f26988ce640 1 -- 172.21.15.37:0/3619511434 >> 172.21.15.37:0/3619511434 conn(0x7f269409c5b0 msgr2=0x7f26940d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.893+0000 7f26988ce640 1 -- 172.21.15.37:0/3619511434 shutdown_connections 2023-11-24T06:16:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.893+0000 7f26988ce640 1 -- 172.21.15.37:0/3619511434 wait complete. 2023-11-24T06:16:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.894+0000 7f26988ce640 1 Processor -- start 2023-11-24T06:16:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.895+0000 7f26988ce640 1 -- start start 2023-11-24T06:16:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.895+0000 7f26988ce640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26940b2050 0x7f26940c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f26988ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26941609f0 0x7f26941585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f26988ce640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f2694156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f26988ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940c64a0 con 0x7f26941609f0 2023-11-24T06:16:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f26988ce640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940cb3a0 con 0x7f26940b2050 2023-11-24T06:16:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f26988ce640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26941590c0 con 0x7f2694160dd0 2023-11-24T06:16:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f268bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26941609f0 0x7f26941585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f268bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26941609f0 0x7f26941585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42842/0 (socket says 172.21.15.37:42842) 2023-11-24T06:16:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f268bfff640 1 -- 172.21.15.37:0/2071287067 learned_addr learned my addr 172.21.15.37:0/2071287067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f2692d9d640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26940b2050 0x7f26940c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f269359e640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f2694156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f268bfff640 1 -- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 msgr2=0x7f2694156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f268bfff640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f2694156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f268bfff640 1 -- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26940b2050 msgr2=0x7f26940c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.896+0000 7f268bfff640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26940b2050 0x7f26940c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f268bfff640 1 -- 172.21.15.37:0/2071287067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684009400 con 0x7f26941609f0 2023-11-24T06:16:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f269359e640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f2694156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f268bfff640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26941609f0 0x7f26941585e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f267c009870 tx=0x7f267c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f268b7fe640 1 -- 172.21.15.37:0/2071287067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c039a90 con 0x7f26941609f0 2023-11-24T06:16:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f268b7fe640 1 -- 172.21.15.37:0/2071287067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c039bf0 con 0x7f26941609f0 2023-11-24T06:16:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f268b7fe640 1 -- 172.21.15.37:0/2071287067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0433f0 con 0x7f26941609f0 2023-11-24T06:16:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c0094d0 con 0x7f26941609f0 2023-11-24T06:16:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.897+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2694159680 con 0x7f26941609f0 2023-11-24T06:16:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.898+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269404e840 con 0x7f26941609f0 2023-11-24T06:16:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.900+0000 7f268b7fe640 1 -- 172.21.15.37:0/2071287067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f267c042390 con 0x7f26941609f0 2023-11-24T06:16:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.900+0000 7f268b7fe640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f267406ae70 0x7f267406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.900+0000 7f268b7fe640 1 -- 172.21.15.37:0/2071287067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f267c0ab6a0 con 0x7f26941609f0 2023-11-24T06:16:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.901+0000 7f2692d9d640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f267406ae70 0x7f267406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.901+0000 7f2692d9d640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f267406ae70 0x7f267406d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f26941f64f0 tx=0x7f2684008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:13.905+0000 7f268b7fe640 1 -- 172.21.15.37:0/2071287067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f267c076750 con 0x7f26941609f0 2023-11-24T06:16:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:14.124+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "vol1689", "target": ["mon-mgr", ""]}) v1 -- 0x7f26940b26c0 con 0x7f267406ae70 2023-11-24T06:16:16.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.718+0000 7f268b7fe640 1 -- 172.21.15.37:0/2071287067 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f26940b26c0 con 0x7f267406ae70 2023-11-24T06:16:16.721 INFO:teuthology.orchestra.run.smithi037.stderr:Volume created successfully (no MDS daemons created) 2023-11-24T06:16:16.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f267406ae70 msgr2=0x7f267406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f267406ae70 0x7f267406d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f26941f64f0 tx=0x7f2684008040 comp rx=0 tx=0).stop 2023-11-24T06:16:16.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26941609f0 msgr2=0x7f26941585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26941609f0 0x7f26941585e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f267c009870 tx=0x7f267c004730 comp rx=0 tx=0).stop 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 shutdown_connections 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f267406ae70 0x7f267406d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2694160dd0 0x7f2694156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26941609f0 0x7f26941585e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.722+0000 7f26988ce640 1 --2- 172.21.15.37:0/2071287067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26940b2050 0x7f26940c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.723+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 >> 172.21.15.37:0/2071287067 conn(0x7f269409c5b0 msgr2=0x7f26940b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.723+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 shutdown_connections 2023-11-24T06:16:16.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.723+0000 7f26988ce640 1 -- 172.21.15.37:0/2071287067 wait complete. 2023-11-24T06:16:16.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:16:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.955+0000 7fae91cbb640 1 Processor -- start 2023-11-24T06:16:16.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.955+0000 7fae91cbb640 1 -- start start 2023-11-24T06:16:16.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.956+0000 7fae91cbb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 0x7fae8c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.956+0000 7fae91cbb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae8c0cbf20 0x7fae8c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.956+0000 7fae91cbb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c0cc3a0 con 0x7fae8c0c57e0 2023-11-24T06:16:16.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.956+0000 7fae91cbb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c15b820 con 0x7fae8c0cbf20 2023-11-24T06:16:16.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.956+0000 7fae91cbb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c15eea0 con 0x7fae8c15b440 2023-11-24T06:16:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae8c0cbf20 0x7fae8c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae8c0cbf20 0x7fae8c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42852/0 (socket says 172.21.15.37:42852) 2023-11-24T06:16:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8affd640 1 -- 172.21.15.37:0/3514164715 learned_addr learned my addr 172.21.15.37:0/3514164715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8b7fe640 1 --2- 172.21.15.37:0/3514164715 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 0x7fae8c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8affd640 1 -- 172.21.15.37:0/3514164715 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 msgr2=0x7fae8c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8affd640 1 --2- 172.21.15.37:0/3514164715 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 0x7fae8c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8affd640 1 -- 172.21.15.37:0/3514164715 >> v1:172.21.15.188:6789/0 conn(0x7fae8c0c57e0 legacy=0x7fae8c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.957+0000 7fae8affd640 1 -- 172.21.15.37:0/3514164715 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c06d600 con 0x7fae8c0cbf20 2023-11-24T06:16:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.959+0000 7fae8affd640 1 --2- 172.21.15.37:0/3514164715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c0c52a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009e50 tx=0x7fae7c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883c0e749cc42276 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.959+0000 7fae8a7fc640 1 -- 172.21.15.37:0/3514164715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c02c9e0 con 0x7fae8c0cbf20 2023-11-24T06:16:16.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.959+0000 7fae8a7fc640 1 -- 172.21.15.37:0/3514164715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c02cb40 con 0x7fae8c0cbf20 2023-11-24T06:16:16.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.959+0000 7fae8a7fc640 1 -- 172.21.15.37:0/3514164715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0343f0 con 0x7fae8c0cbf20 2023-11-24T06:16:16.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.959+0000 7fae91cbb640 1 -- 172.21.15.37:0/3514164715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 msgr2=0x7fae8c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.959+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3514164715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c0c52a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009e50 tx=0x7fae7c02be40 comp rx=0 tx=0).stop 2023-11-24T06:16:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.960+0000 7fae91cbb640 1 -- 172.21.15.37:0/3514164715 shutdown_connections 2023-11-24T06:16:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.960+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3514164715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c0c52a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.960+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3514164715 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 0x7fae8c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.960+0000 7fae91cbb640 1 -- 172.21.15.37:0/3514164715 >> 172.21.15.37:0/3514164715 conn(0x7fae8c0b0c50 msgr2=0x7fae8c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.960+0000 7fae91cbb640 1 -- 172.21.15.37:0/3514164715 shutdown_connections 2023-11-24T06:16:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.960+0000 7fae91cbb640 1 -- 172.21.15.37:0/3514164715 wait complete. 2023-11-24T06:16:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.962+0000 7fae91cbb640 1 Processor -- start 2023-11-24T06:16:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.962+0000 7fae91cbb640 1 -- start start 2023-11-24T06:16:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae91cbb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae8c0c57e0 0x7fae8c0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae91cbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae91cbb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 0x7fae8c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae91cbb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0b4040 con 0x7fae8c0cbf20 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae91cbb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0b4bc0 con 0x7fae8c0c57e0 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae91cbb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0b33c0 con 0x7fae8c15b440 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae8affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae8affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42856/0 (socket says 172.21.15.37:42856) 2023-11-24T06:16:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae8affd640 1 -- 172.21.15.37:0/3129261966 learned_addr learned my addr 172.21.15.37:0/3129261966 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae8affd640 1 -- 172.21.15.37:0/3129261966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 msgr2=0x7fae8c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.963+0000 7fae8affd640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 0x7fae8c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae8affd640 1 -- 172.21.15.37:0/3129261966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae8c0c57e0 msgr2=0x7fae8c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae8b7fe640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae8c0c57e0 0x7fae8c0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae8affd640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae8c0c57e0 0x7fae8c0b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae8affd640 1 -- 172.21.15.37:0/3129261966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c009b30 con 0x7fae8c0cbf20 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae8affd640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c153ce0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fae7c036040 tx=0x7fae7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae83fff640 1 -- 172.21.15.37:0/3129261966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c009510 con 0x7fae8c0cbf20 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae83fff640 1 -- 172.21.15.37:0/3129261966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c03e450 con 0x7fae8c0cbf20 2023-11-24T06:16:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae83fff640 1 -- 172.21.15.37:0/3129261966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c03e800 con 0x7fae8c0cbf20 2023-11-24T06:16:16.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c0b36a0 con 0x7fae8c0cbf20 2023-11-24T06:16:16.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.964+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c0b3c60 con 0x7fae8c0cbf20 2023-11-24T06:16:16.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.965+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c0b4180 con 0x7fae8c0cbf20 2023-11-24T06:16:16.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.967+0000 7fae83fff640 1 -- 172.21.15.37:0/3129261966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae7c03e960 con 0x7fae8c0cbf20 2023-11-24T06:16:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.967+0000 7fae83fff640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fae6c06ae40 0x7fae6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.968+0000 7fae83fff640 1 -- 172.21.15.37:0/3129261966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6543+0+0 (secure 0 0 0) 0x7fae7c0ac6b0 con 0x7fae8c0cbf20 2023-11-24T06:16:16.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.968+0000 7fae8b7fe640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fae6c06ae40 0x7fae6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.969+0000 7fae8b7fe640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fae6c06ae40 0x7fae6c06d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae74006fd0 tx=0x7fae74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:16.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:16.973+0000 7fae83fff640 1 -- 172.21.15.37:0/3129261966 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae8c0b4180 con 0x7fae8c0cbf20 2023-11-24T06:16:17.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.186+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fae8c15f3d0 con 0x7fae6c06ae40 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.189+0000 7fae83fff640 1 -- 172.21.15.37:0/3129261966 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+80 (secure 0 0 0) 0x7fae7400e4b0 con 0x7fae6c06ae40 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "vol1689" 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:17.192 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:16:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fae6c06ae40 msgr2=0x7fae6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fae6c06ae40 0x7fae6c06d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae74006fd0 tx=0x7fae74008040 comp rx=0 tx=0).stop 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 msgr2=0x7fae8c153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c153ce0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fae7c036040 tx=0x7fae7c004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 shutdown_connections 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fae6c06ae40 0x7fae6c06d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae8c15b440 0x7fae8c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae8c0cbf20 0x7fae8c153ce0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 --2- 172.21.15.37:0/3129261966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae8c0c57e0 0x7fae8c0b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 >> 172.21.15.37:0/3129261966 conn(0x7fae8c0b0c50 msgr2=0x7fae8c1548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 shutdown_connections 2023-11-24T06:16:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.192+0000 7fae91cbb640 1 -- 172.21.15.37:0/3129261966 wait complete. 2023-11-24T06:16:17.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2023-11-24T06:16:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.419+0000 7f7a5492c640 1 Processor -- start 2023-11-24T06:16:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.419+0000 7f7a5492c640 1 -- start start 2023-11-24T06:16:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.420+0000 7f7a5492c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a501660b0 0x7f7a50162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a5492c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a50166510 con 0x7f7a500ccbd0 2023-11-24T06:16:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a5492c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a501655f0 con 0x7f7a50162540 2023-11-24T06:16:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a5492c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500cc380 con 0x7f7a501660b0 2023-11-24T06:16:17.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a4e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7a500ccbd0 0x7f7a500ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45452/0 (socket says 172.21.15.37:45452) 2023-11-24T06:16:17.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a4e59c640 1 -- 172.21.15.37:0/636076776 learned_addr learned my addr 172.21.15.37:0/636076776 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a501660b0 0x7f7a50162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109996515 0 0) 0x7f7a40001110 con 0x7f7a500ccbd0 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.421+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a3c003520 con 0x7f7a500ccbd0 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3245405020 0 0) 0x7f7a3c003520 con 0x7f7a500ccbd0 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a501660b0 msgr2=0x7f7a50162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a501660b0 0x7f7a50162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 >> v1:172.21.15.188:6789/0 conn(0x7f7a50162540 legacy=0x7f7a500c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50162b30 con 0x7f7a500ccbd0 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f7a40001800 con 0x7f7a500ccbd0 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 >> v1:172.21.15.37:6789/0 conn(0x7f7a500ccbd0 legacy=0x7f7a500ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a3c0039a0 0x7f7a3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a3c0047c0 0x7f7a3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c005180 0x7f7a3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500cc380 con 0x7f7a3c0047c0 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c00c0b0 con 0x7f7a3c005180 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c00c270 con 0x7f7a3c0039a0 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a501660b0 0x7f7a50162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.422+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a3c0047c0 0x7f7a3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.423+0000 7f7a4e59c640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a3c0039a0 0x7f7a3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.423+0000 7f7a4ed9d640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c005180 0x7f7a3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.423+0000 7f7a4dd9b640 1 -- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a3c0039a0 msgr2=0x7f7a3c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.423+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a3c0039a0 0x7f7a3c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.423+0000 7f7a4dd9b640 1 -- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c005180 msgr2=0x7f7a3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.423+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c005180 0x7f7a3c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.423+0000 7f7a4dd9b640 1 -- 172.21.15.37:0/636076776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c003520 con 0x7f7a3c0047c0 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.424+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a3c0047c0 0x7f7a3c004c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7a500aeb90 tx=0x7f7a3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bdae2fa6fa714e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.424+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3802cc80 con 0x7f7a3c0047c0 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.424+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3802cde0 con 0x7f7a3c0047c0 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.424+0000 7f7a4d59a640 1 -- 172.21.15.37:0/636076776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38003bb0 con 0x7f7a3c0047c0 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.425+0000 7f7a5492c640 1 -- 172.21.15.37:0/636076776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a3c0047c0 msgr2=0x7f7a3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.425+0000 7f7a5492c640 1 --2- 172.21.15.37:0/636076776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a3c0047c0 0x7f7a3c004c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7a500aeb90 tx=0x7f7a3c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.425+0000 7f7a4ed9d640 1 -- 172.21.15.37:0/636076776 reap_dead start 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.425+0000 7f7a5492c640 1 -- 172.21.15.37:0/636076776 shutdown_connections 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.425+0000 7f7a5492c640 1 -- 172.21.15.37:0/636076776 >> 172.21.15.37:0/636076776 conn(0x7f7a500b0c50 msgr2=0x7f7a500b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.425+0000 7f7a5492c640 1 -- 172.21.15.37:0/636076776 shutdown_connections 2023-11-24T06:16:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.425+0000 7f7a5492c640 1 -- 172.21.15.37:0/636076776 wait complete. 2023-11-24T06:16:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.427+0000 7f7a5492c640 1 Processor -- start 2023-11-24T06:16:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.427+0000 7f7a5492c640 1 -- start start 2023-11-24T06:16:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a5492c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c0047c0 0x7f7a50163050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a5492c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a500999d0 0x7f7a5014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a5492c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a50165030 0x7f7a501609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a5492c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a501638a0 con 0x7f7a500999d0 2023-11-24T06:16:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a5492c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50163b80 con 0x7f7a3c0047c0 2023-11-24T06:16:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a5492c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50163e60 con 0x7f7a50165030 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a4dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a500999d0 0x7f7a5014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a4dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a500999d0 0x7f7a5014b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42870/0 (socket says 172.21.15.37:42870) 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.428+0000 7f7a4dd9b640 1 -- 172.21.15.37:0/1105208177 learned_addr learned my addr 172.21.15.37:0/1105208177 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4e59c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c0047c0 0x7f7a50163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4ed9d640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a50165030 0x7f7a501609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4dd9b640 1 -- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a50165030 msgr2=0x7f7a501609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a50165030 0x7f7a501609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4dd9b640 1 -- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c0047c0 msgr2=0x7f7a50163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c0047c0 0x7f7a50163050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4dd9b640 1 -- 172.21.15.37:0/1105208177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50164140 con 0x7f7a500999d0 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a4dd9b640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a500999d0 0x7f7a5014b400 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7a3802bd30 tx=0x7f7a38004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.429+0000 7f7a46ffd640 1 -- 172.21.15.37:0/1105208177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3803c070 con 0x7f7a500999d0 2023-11-24T06:16:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.430+0000 7f7a46ffd640 1 -- 172.21.15.37:0/1105208177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a38004630 con 0x7f7a500999d0 2023-11-24T06:16:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.430+0000 7f7a46ffd640 1 -- 172.21.15.37:0/1105208177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38037460 con 0x7f7a500999d0 2023-11-24T06:16:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.430+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a50163590 con 0x7f7a500999d0 2023-11-24T06:16:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.430+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5014b940 con 0x7f7a500999d0 2023-11-24T06:16:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.431+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5004e8b0 con 0x7f7a500999d0 2023-11-24T06:16:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.432+0000 7f7a46ffd640 1 -- 172.21.15.37:0/1105208177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a380375c0 con 0x7f7a500999d0 2023-11-24T06:16:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.433+0000 7f7a46ffd640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a3006aec0 0x7f7a3006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.433+0000 7f7a46ffd640 1 -- 172.21.15.37:0/1105208177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6543+0+0 (secure 0 0 0) 0x7f7a380ab4f0 con 0x7f7a500999d0 2023-11-24T06:16:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.433+0000 7f7a4e59c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a3006aec0 0x7f7a3006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.434+0000 7f7a4e59c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a3006aec0 0x7f7a3006d380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a40001050 tx=0x7f7a40001e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.438+0000 7f7a46ffd640 1 -- 172.21.15.37:0/1105208177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a38076260 con 0x7f7a500999d0 2023-11-24T06:16:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.624+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f7a5012c1b0 con 0x7f7a500999d0 2023-11-24T06:16:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.627+0000 7f7a46ffd640 1 -- 172.21.15.37:0/1105208177 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v37) v1 ==== 97+0+9120 (secure 0 0 0) 0x7f7a38079880 con 0x7f7a500999d0 2023-11-24T06:16:17.629 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a3006aec0 msgr2=0x7f7a3006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a3006aec0 0x7f7a3006d380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a40001050 tx=0x7f7a40001e40 comp rx=0 tx=0).stop 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a500999d0 msgr2=0x7f7a5014b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a500999d0 0x7f7a5014b400 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7a3802bd30 tx=0x7f7a38004ab0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 shutdown_connections 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a3006aec0 0x7f7a3006d380 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a50165030 0x7f7a501609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a500999d0 0x7f7a5014b400 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 --2- 172.21.15.37:0/1105208177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a3c0047c0 0x7f7a50163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 >> 172.21.15.37:0/1105208177 conn(0x7f7a500b0c50 msgr2=0x7f7a500afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 shutdown_connections 2023-11-24T06:16:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.629+0000 7f7a5492c640 1 -- 172.21.15.37:0/1105208177 wait complete. 2023-11-24T06:16:17.649 INFO:teuthology.orchestra.run.smithi037.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":6,"pool_name":"cephfs.vol1689.meta","create_time":"2023-11-24T06:16:14.184335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"vol1689"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool_id":7,"pool_name":"cephfs.vol1689.data","create_time":"2023-11-24T06:16:14.778302+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"vol1689"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}] 2023-11-24T06:16:17.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get vol1689 --format=json 2023-11-24T06:16:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.862+0000 7f95c8fdb640 1 Processor -- start 2023-11-24T06:16:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.862+0000 7f95c8fdb640 1 -- start start 2023-11-24T06:16:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c8fdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95c40b63d0 0x7f95c40d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c8fdb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40cea30 con 0x7f95c415d490 2023-11-24T06:16:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c8fdb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40ce750 con 0x7f95c40ce270 2023-11-24T06:16:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c8fdb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40d0450 con 0x7f95c40b63d0 2023-11-24T06:16:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f95c415d490 0x7f95c40cd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45456/0 (socket says 172.21.15.37:45456) 2023-11-24T06:16:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c37fe640 1 -- 172.21.15.37:0/1351210372 learned_addr learned my addr 172.21.15.37:0/1351210372 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c2ffd640 1 --2- 172.21.15.37:0/1351210372 >> v2:172.21.15.37:3300/0 conn(0x7f95c40b63d0 0x7f95c40d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.864+0000 7f95c27fc640 1 -- 172.21.15.37:0/1351210372 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268005814 0 0) 0x7f95c40cea30 con 0x7f95c415d490 2023-11-24T06:16:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.865+0000 7f95c27fc640 1 -- 172.21.15.37:0/1351210372 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ac003520 con 0x7f95c415d490 2023-11-24T06:16:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.865+0000 7f95c2ffd640 1 -- 172.21.15.37:0/1351210372 >> v1:172.21.15.188:6789/0 conn(0x7f95c40ce270 legacy=0x7f95c40d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.865+0000 7f95c2ffd640 1 -- 172.21.15.37:0/1351210372 >> v1:172.21.15.37:6789/0 conn(0x7f95c415d490 legacy=0x7f95c40cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.865+0000 7f95c27fc640 1 -- 172.21.15.37:0/1351210372 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2798370433 0 0) 0x7f95ac003520 con 0x7f95c415d490 2023-11-24T06:16:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.865+0000 7f95c2ffd640 1 -- 172.21.15.37:0/1351210372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40d0630 con 0x7f95c40b63d0 2023-11-24T06:16:17.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.867+0000 7f95c2ffd640 1 --2- 172.21.15.37:0/1351210372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c40b63d0 0x7f95c40d3230 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097a0 tx=0x7f95b802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c35dc2a5755faf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.867+0000 7f95c27fc640 1 -- 172.21.15.37:0/1351210372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b802f050 con 0x7f95c40b63d0 2023-11-24T06:16:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.867+0000 7f95c27fc640 1 -- 172.21.15.37:0/1351210372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b8031500 con 0x7f95c40b63d0 2023-11-24T06:16:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.867+0000 7f95c27fc640 1 -- 172.21.15.37:0/1351210372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4001670 con 0x7f95c40b63d0 2023-11-24T06:16:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.868+0000 7f95c8fdb640 1 -- 172.21.15.37:0/1351210372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c40b63d0 msgr2=0x7f95c40d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.868+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/1351210372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c40b63d0 0x7f95c40d3230 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097a0 tx=0x7f95b802b820 comp rx=0 tx=0).stop 2023-11-24T06:16:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.868+0000 7f95c8fdb640 1 -- 172.21.15.37:0/1351210372 shutdown_connections 2023-11-24T06:16:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.868+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/1351210372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c40b63d0 0x7f95c40d3230 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.868+0000 7f95c8fdb640 1 -- 172.21.15.37:0/1351210372 >> 172.21.15.37:0/1351210372 conn(0x7f95c4061340 msgr2=0x7f95c4061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.868+0000 7f95c8fdb640 1 -- 172.21.15.37:0/1351210372 shutdown_connections 2023-11-24T06:16:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.868+0000 7f95c8fdb640 1 -- 172.21.15.37:0/1351210372 wait complete. 2023-11-24T06:16:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.870+0000 7f95c8fdb640 1 Processor -- start 2023-11-24T06:16:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.870+0000 7f95c8fdb640 1 -- start start 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.871+0000 7f95c8fdb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c40ce270 0x7f95c414b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.871+0000 7f95c8fdb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c415d490 0x7f95c414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.871+0000 7f95c8fdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c415d900 0x7f95c415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.871+0000 7f95c8fdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40d0bf0 con 0x7f95c415d900 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.871+0000 7f95c8fdb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40cc1a0 con 0x7f95c415d490 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.871+0000 7f95c8fdb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c414b6d0 con 0x7f95c40ce270 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.871+0000 7f95c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c415d900 0x7f95c415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c415d900 0x7f95c415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42878/0 (socket says 172.21.15.37:42878) 2023-11-24T06:16:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 -- 172.21.15.37:0/2623182937 learned_addr learned my addr 172.21.15.37:0/2623182937 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c2ffd640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c415d490 0x7f95c414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 -- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c40ce270 msgr2=0x7f95c414b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c40ce270 0x7f95c414b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 -- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c415d490 msgr2=0x7f95c414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c415d490 0x7f95c414a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 -- 172.21.15.37:0/2623182937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009400 con 0x7f95c415d900 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c2ffd640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c415d490 0x7f95c414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.872+0000 7f95c3fff640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c415d900 0x7f95c415e280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c760 tx=0x7f95bc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.873+0000 7f95abfff640 1 -- 172.21.15.37:0/2623182937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc003b70 con 0x7f95c415d900 2023-11-24T06:16:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.873+0000 7f95abfff640 1 -- 172.21.15.37:0/2623182937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc003cd0 con 0x7f95c415d900 2023-11-24T06:16:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.873+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c40cb520 con 0x7f95c415d900 2023-11-24T06:16:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.873+0000 7f95abfff640 1 -- 172.21.15.37:0/2623182937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00aa90 con 0x7f95c415d900 2023-11-24T06:16:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.873+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c40cbae0 con 0x7f95c415d900 2023-11-24T06:16:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.874+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c40cc2e0 con 0x7f95c415d900 2023-11-24T06:16:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.875+0000 7f95abfff640 1 -- 172.21.15.37:0/2623182937 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95bc00abf0 con 0x7f95c415d900 2023-11-24T06:16:17.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.876+0000 7f95abfff640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95b006ae40 0x7f95b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:17.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.876+0000 7f95abfff640 1 -- 172.21.15.37:0/2623182937 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6543+0+0 (secure 0 0 0) 0x7f95bc089730 con 0x7f95c415d900 2023-11-24T06:16:17.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.877+0000 7f95c37fe640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95b006ae40 0x7f95b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:17.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.877+0000 7f95c37fe640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95b006ae40 0x7f95b006d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001de0 tx=0x7f95b40010a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:17.881+0000 7f95abfff640 1 -- 172.21.15.37:0/2623182937 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95c40cc2e0 con 0x7f95c415d900 2023-11-24T06:16:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.108+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "vol1689", "format": "json"} v 0) v1 -- 0x7f95c40cc2e0 con 0x7f95c415d900 2023-11-24T06:16:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.109+0000 7f95abfff640 1 -- 172.21.15.37:0/2623182937 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "vol1689", "format": "json"}]=0 v21) v1 ==== 94+0+2008 (secure 0 0 0) 0x7f95c40cc2e0 con 0x7f95c415d900 2023-11-24T06:16:18.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:18.114 INFO:teuthology.orchestra.run.smithi037.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:15.723229+0000","modified":"2023-11-24T06:16:16.748540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5064},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5064":{"gid":5064,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.37:6836/3993737526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3993737526},{"type":"v1","addr":"172.21.15.37:6836","nonce":3993737526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"vol1689","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":3} 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.111+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95b006ae40 msgr2=0x7f95b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.111+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95b006ae40 0x7f95b006d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001de0 tx=0x7f95b40010a0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.111+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c415d900 msgr2=0x7f95c415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.111+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c415d900 0x7f95c415e280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c760 tx=0x7f95bc00cc20 comp rx=0 tx=0).stop 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 shutdown_connections 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95b006ae40 0x7f95b006d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c415d490 0x7f95c414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c415d900 0x7f95c415e280 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 --2- 172.21.15.37:0/2623182937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c40ce270 0x7f95c414b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 >> 172.21.15.37:0/2623182937 conn(0x7f95c4061340 msgr2=0x7f95c4160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 shutdown_connections 2023-11-24T06:16:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.112+0000 7f95c8fdb640 1 -- 172.21.15.37:0/2623182937 wait complete. 2023-11-24T06:16:18.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm vol1689 --yes-i-really-mean-it 2023-11-24T06:16:18.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.354+0000 7fd5a9861640 1 Processor -- start 2023-11-24T06:16:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.354+0000 7fd5a9861640 1 -- start start 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a9861640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd5a40cc0f0 0x7fd5a40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a9861640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5a40c57e0 0x7fd5a406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a9861640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a415eea0 con 0x7fd5a415b440 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a9861640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a415b820 con 0x7fd5a40c57e0 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a9861640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a40abf30 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5a40c57e0 0x7fd5a406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5a40c57e0 0x7fd5a406c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42884/0 (socket says 172.21.15.37:42884) 2023-11-24T06:16:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.356+0000 7fd5a37fe640 1 -- 172.21.15.37:0/299529115 learned_addr learned my addr 172.21.15.37:0/299529115 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.357+0000 7fd5a27fc640 1 --2- 172.21.15.37:0/299529115 >> v2:172.21.15.188:3300/0 conn(0x7fd5a40cc0f0 0x7fd5a40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.357+0000 7fd5a37fe640 1 -- 172.21.15.37:0/299529115 >> v2:172.21.15.188:3300/0 conn(0x7fd5a40cc0f0 msgr2=0x7fd5a40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.357+0000 7fd5a37fe640 1 --2- 172.21.15.37:0/299529115 >> v2:172.21.15.188:3300/0 conn(0x7fd5a40cc0f0 0x7fd5a40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.357+0000 7fd5a37fe640 1 -- 172.21.15.37:0/299529115 >> v1:172.21.15.188:6789/0 conn(0x7fd5a415b440 legacy=0x7fd5a40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:18.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.357+0000 7fd5a37fe640 1 -- 172.21.15.37:0/299529115 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a415f0f0 con 0x7fd5a40c57e0 2023-11-24T06:16:18.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.357+0000 7fd5a27fc640 1 --2- 172.21.15.37:0/299529115 >> v2:172.21.15.188:3300/0 conn(0x7fd5a40cc0f0 0x7fd5a40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:18.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.358+0000 7fd5a37fe640 1 --2- 172.21.15.37:0/299529115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40c57e0 0x7fd5a406c5f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd5a406e720 tx=0x7fd59c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92da032802a712a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a1ffb640 1 -- 172.21.15.37:0/299529115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0317e0 con 0x7fd5a40c57e0 2023-11-24T06:16:18.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a1ffb640 1 -- 172.21.15.37:0/299529115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c031940 con 0x7fd5a40c57e0 2023-11-24T06:16:18.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a1ffb640 1 -- 172.21.15.37:0/299529115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c031cd0 con 0x7fd5a40c57e0 2023-11-24T06:16:18.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a9861640 1 -- 172.21.15.37:0/299529115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40c57e0 msgr2=0x7fd5a406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a9861640 1 --2- 172.21.15.37:0/299529115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40c57e0 0x7fd5a406c5f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd5a406e720 tx=0x7fd59c02b880 comp rx=0 tx=0).stop 2023-11-24T06:16:18.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a9861640 1 -- 172.21.15.37:0/299529115 shutdown_connections 2023-11-24T06:16:18.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a9861640 1 --2- 172.21.15.37:0/299529115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40c57e0 0x7fd5a406c5f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a9861640 1 --2- 172.21.15.37:0/299529115 >> v2:172.21.15.188:3300/0 conn(0x7fd5a40cc0f0 0x7fd5a40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.359+0000 7fd5a9861640 1 -- 172.21.15.37:0/299529115 >> 172.21.15.37:0/299529115 conn(0x7fd5a40b0c50 msgr2=0x7fd5a40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:18.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.360+0000 7fd5a9861640 1 -- 172.21.15.37:0/299529115 shutdown_connections 2023-11-24T06:16:18.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.360+0000 7fd5a9861640 1 -- 172.21.15.37:0/299529115 wait complete. 2023-11-24T06:16:18.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.361+0000 7fd5a9861640 1 Processor -- start 2023-11-24T06:16:18.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.362+0000 7fd5a9861640 1 -- start start 2023-11-24T06:16:18.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.362+0000 7fd5a9861640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5a40c57e0 0x7fd5a415bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a9861640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40cc0f0 0x7fd5a40af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a9861640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5a415b440 0x7fd5a40aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a9861640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a415e910 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a9861640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41509d0 con 0x7fd5a40c57e0 2023-11-24T06:16:18.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a9861640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a415e630 con 0x7fd5a415b440 2023-11-24T06:16:18.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40cc0f0 0x7fd5a40af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40cc0f0 0x7fd5a40af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42900/0 (socket says 172.21.15.37:42900) 2023-11-24T06:16:18.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 -- 172.21.15.37:0/3534586858 learned_addr learned my addr 172.21.15.37:0/3534586858 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:18.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 -- 172.21.15.37:0/3534586858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5a415b440 msgr2=0x7fd5a40aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5a415b440 0x7fd5a40aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a2ffd640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5a40c57e0 0x7fd5a415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 -- 172.21.15.37:0/3534586858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5a40c57e0 msgr2=0x7fd5a415bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5a40c57e0 0x7fd5a415bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.363+0000 7fd5a27fc640 1 -- 172.21.15.37:0/3534586858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0094d0 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.364+0000 7fd5a27fc640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40cc0f0 0x7fd5a40af9c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00cf60 tx=0x7fd58c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.364+0000 7fd59bfff640 1 -- 172.21.15.37:0/3534586858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00d840 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.364+0000 7fd59bfff640 1 -- 172.21.15.37:0/3534586858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c00d9a0 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.364+0000 7fd59bfff640 1 -- 172.21.15.37:0/3534586858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00dd30 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.364+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a41f6900 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.364+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a41f6ec0 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.365+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a41f6760 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.366+0000 7fd59bfff640 1 -- 172.21.15.37:0/3534586858 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd58c015440 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.367+0000 7fd59bfff640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd58406ae40 0x7fd58406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.367+0000 7fd59bfff640 1 -- 172.21.15.37:0/3534586858 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6543+0+0 (secure 0 0 0) 0x7fd58c08a380 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.368+0000 7fd5a2ffd640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd58406ae40 0x7fd58406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.368+0000 7fd5a2ffd640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd58406ae40 0x7fd58406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd59400a750 tx=0x7fd594008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:18.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.372+0000 7fd59bfff640 1 -- 172.21.15.37:0/3534586858 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5a41f6760 con 0x7fd5a40cc0f0 2023-11-24T06:16:18.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:18.589+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "vol1689", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5a415f990 con 0x7fd58406ae40 2023-11-24T06:16:18.598 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-11-24T06:16:18.596+0000 7fe7fc218640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:16:18.658 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-11-24T06:16:21.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.620+0000 7fd59bfff640 1 -- 172.21.15.37:0/3534586858 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7fd59400c520 con 0x7fd58406ae40 2023-11-24T06:16:21.624 INFO:teuthology.orchestra.run.smithi037.stdout:metadata pool: cephfs.vol1689.meta data pool: ['cephfs.vol1689.data'] removed 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd58406ae40 msgr2=0x7fd58406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd58406ae40 0x7fd58406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd59400a750 tx=0x7fd594008040 comp rx=0 tx=0).stop 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40cc0f0 msgr2=0x7fd5a40af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40cc0f0 0x7fd5a40af9c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00cf60 tx=0x7fd58c00cf90 comp rx=0 tx=0).stop 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 shutdown_connections 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd58406ae40 0x7fd58406d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5a415b440 0x7fd5a40aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5a40cc0f0 0x7fd5a40af9c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 --2- 172.21.15.37:0/3534586858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5a40c57e0 0x7fd5a415bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 >> 172.21.15.37:0/3534586858 conn(0x7fd5a40b0c50 msgr2=0x7fd5a40c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 shutdown_connections 2023-11-24T06:16:21.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:21.625+0000 7fd5a9861640 1 -- 172.21.15.37:0/3534586858 wait complete. 2023-11-24T06:16:21.652 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:16:21.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:21.776 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:21.897 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:16:21.898 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:16:21.898 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:21.961 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:16:21.961 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:22.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.247+0000 7f2fb1fe6640 1 Processor -- start 2023-11-24T06:16:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.247+0000 7f2fb1fe6640 1 -- start start 2023-11-24T06:16:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb1fe6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2fac144b30 0x7f2fac15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb1fe6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2fac0b1de0 0x7f2fac0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb1fe6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac15bf80 con 0x7f2fac15c410 2023-11-24T06:16:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb1fe6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac0b27b0 con 0x7f2fac0b1de0 2023-11-24T06:16:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb1fe6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac0b1560 con 0x7f2fac144b30 2023-11-24T06:16:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb17e5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2fac0b1de0 0x7f2fac0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb17e5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2fac0b1de0 0x7f2fac0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49480/0 (socket says 172.21.15.37:49480) 2023-11-24T06:16:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.249+0000 7f2fb17e5640 1 -- 172.21.15.37:0/1741883261 learned_addr learned my addr 172.21.15.37:0/1741883261 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.250+0000 7f2fb0fe4640 1 --2- 172.21.15.37:0/1741883261 >> v2:172.21.15.188:3300/0 conn(0x7f2fac144b30 0x7f2fac15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.250+0000 7f2fb17e5640 1 -- 172.21.15.37:0/1741883261 >> v2:172.21.15.188:3300/0 conn(0x7f2fac144b30 msgr2=0x7f2fac15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.250+0000 7f2fb17e5640 1 --2- 172.21.15.37:0/1741883261 >> v2:172.21.15.188:3300/0 conn(0x7f2fac144b30 0x7f2fac15f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.250+0000 7f2fb17e5640 1 -- 172.21.15.37:0/1741883261 >> v1:172.21.15.188:6789/0 conn(0x7f2fac15c410 legacy=0x7f2fac0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.250+0000 7f2fb17e5640 1 -- 172.21.15.37:0/1741883261 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0b1280 con 0x7f2fac0b1de0 2023-11-24T06:16:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.251+0000 7f2fb17e5640 1 --2- 172.21.15.37:0/1741883261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0b2270 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2fac06f690 tx=0x7f2fa402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e01a5eca48a2c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fab7fe640 1 -- 172.21.15.37:0/1741883261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa402ca80 con 0x7f2fac0b1de0 2023-11-24T06:16:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fab7fe640 1 -- 172.21.15.37:0/1741883261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa402cbe0 con 0x7f2fac0b1de0 2023-11-24T06:16:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fab7fe640 1 -- 172.21.15.37:0/1741883261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40343f0 con 0x7f2fac0b1de0 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/1741883261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 msgr2=0x7f2fac0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/1741883261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0b2270 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2fac06f690 tx=0x7f2fa402bee0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/1741883261 shutdown_connections 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/1741883261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0b2270 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/1741883261 >> v2:172.21.15.188:3300/0 conn(0x7f2fac144b30 0x7f2fac15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.252+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/1741883261 >> 172.21.15.37:0/1741883261 conn(0x7f2fac0cb830 msgr2=0x7f2fac0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.253+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/1741883261 shutdown_connections 2023-11-24T06:16:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.253+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/1741883261 wait complete. 2023-11-24T06:16:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.255+0000 7f2fb1fe6640 1 Processor -- start 2023-11-24T06:16:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.255+0000 7f2fb1fe6640 1 -- start start 2023-11-24T06:16:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.256+0000 7f2fb1fe6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.256+0000 7f2fb1fe6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fac144b30 0x7f2fac13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.256+0000 7f2fb1fe6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fac15c410 0x7f2fac13f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.256+0000 7f2fb1fe6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac140c20 con 0x7f2fac0b1de0 2023-11-24T06:16:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.256+0000 7f2fb1fe6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac140e90 con 0x7f2fac144b30 2023-11-24T06:16:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.256+0000 7f2fb1fe6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac141170 con 0x7f2fac15c410 2023-11-24T06:16:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49488/0 (socket says 172.21.15.37:49488) 2023-11-24T06:16:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 -- 172.21.15.37:0/783408278 learned_addr learned my addr 172.21.15.37:0/783408278 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fabfff640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fac144b30 0x7f2fac13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb17e5640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fac15c410 0x7f2fac13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 -- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fac15c410 msgr2=0x7f2fac13f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fac15c410 0x7f2fac13f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 -- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fac144b30 msgr2=0x7f2fac13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fac144b30 0x7f2fac13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 -- 172.21.15.37:0/783408278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4009b30 con 0x7f2fac0b1de0 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb17e5640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fac15c410 0x7f2fac13f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.257+0000 7f2fb0fe4640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0ca5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c7f0 tx=0x7f2fa000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.258+0000 7f2fa97fa640 1 -- 172.21.15.37:0/783408278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0004220 con 0x7f2fac0b1de0 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.258+0000 7f2fa97fa640 1 -- 172.21.15.37:0/783408278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa00043a0 con 0x7f2fac0b1de0 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.258+0000 7f2fa97fa640 1 -- 172.21.15.37:0/783408278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0007860 con 0x7f2fac0b1de0 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.258+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac141450 con 0x7f2fac0b1de0 2023-11-24T06:16:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.258+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac0caae0 con 0x7f2fac0b1de0 2023-11-24T06:16:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.259+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fac0cacd0 con 0x7f2fac0b1de0 2023-11-24T06:16:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.260+0000 7f2fa97fa640 1 -- 172.21.15.37:0/783408278 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fa0007bd0 con 0x7f2fac0b1de0 2023-11-24T06:16:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.261+0000 7f2fa97fa640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f9006ae40 0x7f2f9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.261+0000 7f2fa97fa640 1 -- 172.21.15.37:0/783408278 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2fa0089600 con 0x7f2fac0b1de0 2023-11-24T06:16:22.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.261+0000 7f2fabfff640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f9006ae40 0x7f2f9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.262+0000 7f2fabfff640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f9006ae40 0x7f2f9006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f98006fd0 tx=0x7f2f98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.266+0000 7f2fa97fa640 1 -- 172.21.15.37:0/783408278 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2fa0054640 con 0x7f2fac0b1de0 2023-11-24T06:16:22.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.458+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fac04e840 con 0x7f2fac0b1de0 2023-11-24T06:16:22.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.462+0000 7f2fa97fa640 1 -- 172.21.15.37:0/783408278 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f2fa0057c60 con 0x7f2fac0b1de0 2023-11-24T06:16:22.465 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:21.608455+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6836/3993737526":"2023-11-25T06:16:18.597206+0000","172.21.15.37:6834/3993737526":"2023-11-25T06:16:18.597206+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f9006ae40 msgr2=0x7f2f9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f9006ae40 0x7f2f9006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f98006fd0 tx=0x7f2f98008040 comp rx=0 tx=0).stop 2023-11-24T06:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 msgr2=0x7f2fac0ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0ca5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c7f0 tx=0x7f2fa000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 shutdown_connections 2023-11-24T06:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2f9006ae40 0x7f2f9006d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fac144b30 0x7f2fac13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fac15c410 0x7f2fac13f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 --2- 172.21.15.37:0/783408278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fac0b1de0 0x7f2fac0ca5a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.464+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 >> 172.21.15.37:0/783408278 conn(0x7f2fac0cb830 msgr2=0x7f2fac15c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.465+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 shutdown_connections 2023-11-24T06:16:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.465+0000 7f2fb1fe6640 1 -- 172.21.15.37:0/783408278 wait complete. 2023-11-24T06:16:22.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:15:59.353546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:00.332854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:22.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.717+0000 7f2cd8061640 1 Processor -- start 2023-11-24T06:16:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.717+0000 7f2cd8061640 1 -- start start 2023-11-24T06:16:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.718+0000 7f2cd8061640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cd00b3790 0x7f2cd006adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.718+0000 7f2cd8061640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd006dcf0 con 0x7f2cd0161060 2023-11-24T06:16:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.718+0000 7f2cd8061640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd0161ec0 con 0x7f2cd00b3330 2023-11-24T06:16:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.718+0000 7f2cd8061640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd006ec10 con 0x7f2cd00b3790 2023-11-24T06:16:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.719+0000 7f2cd65fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cd00b3790 0x7f2cd006adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.719+0000 7f2cd5dfd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2cd0161060 0x7f2cd0161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47710/0 (socket says 172.21.15.37:47710) 2023-11-24T06:16:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.719+0000 7f2cd5dfd640 1 -- 172.21.15.37:0/1668566853 learned_addr learned my addr 172.21.15.37:0/1668566853 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.719+0000 7f2cd65fe640 1 -- 172.21.15.37:0/1668566853 >> v1:172.21.15.188:6789/0 conn(0x7f2cd00b3330 legacy=0x7f2cd006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.719+0000 7f2cd65fe640 1 -- 172.21.15.37:0/1668566853 >> v1:172.21.15.37:6789/0 conn(0x7f2cd0161060 legacy=0x7f2cd0161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.719+0000 7f2cd65fe640 1 -- 172.21.15.37:0/1668566853 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd006df90 con 0x7f2cd00b3790 2023-11-24T06:16:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.719+0000 7f2cd4dfb640 1 -- 172.21.15.37:0/1668566853 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134535828 0 0) 0x7f2cd006dcf0 con 0x7f2cd0161060 2023-11-24T06:16:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.720+0000 7f2cd65fe640 1 --2- 172.21.15.37:0/1668566853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd00b3790 0x7f2cd006adc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a225f0ef4944a599 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.720+0000 7f2cd4dfb640 1 -- 172.21.15.37:0/1668566853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc802cbd0 con 0x7f2cd00b3790 2023-11-24T06:16:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd4dfb640 1 -- 172.21.15.37:0/1668566853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc802cd30 con 0x7f2cd00b3790 2023-11-24T06:16:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd4dfb640 1 -- 172.21.15.37:0/1668566853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc802cea0 con 0x7f2cd00b3790 2023-11-24T06:16:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd8061640 1 -- 172.21.15.37:0/1668566853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd00b3790 msgr2=0x7f2cd006adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd8061640 1 --2- 172.21.15.37:0/1668566853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd00b3790 0x7f2cd006adc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc802be20 comp rx=0 tx=0).stop 2023-11-24T06:16:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd8061640 1 -- 172.21.15.37:0/1668566853 shutdown_connections 2023-11-24T06:16:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd8061640 1 --2- 172.21.15.37:0/1668566853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd00b3790 0x7f2cd006adc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd8061640 1 -- 172.21.15.37:0/1668566853 >> 172.21.15.37:0/1668566853 conn(0x7f2cd00cf900 msgr2=0x7f2cd00cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd8061640 1 -- 172.21.15.37:0/1668566853 shutdown_connections 2023-11-24T06:16:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.721+0000 7f2cd8061640 1 -- 172.21.15.37:0/1668566853 wait complete. 2023-11-24T06:16:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.723+0000 7f2cd8061640 1 Processor -- start 2023-11-24T06:16:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.723+0000 7f2cd8061640 1 -- start start 2023-11-24T06:16:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.724+0000 7f2cd8061640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cd00b3330 0x7f2cd014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.724+0000 7f2cd8061640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cd00b3790 0x7f2cd00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.724+0000 7f2cd8061640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd0161060 0x7f2cd014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.724+0000 7f2cd8061640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd014f5f0 con 0x7f2cd0161060 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.724+0000 7f2cd8061640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd014e970 con 0x7f2cd00b3790 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.724+0000 7f2cd8061640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd014ec50 con 0x7f2cd00b3330 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd0161060 0x7f2cd014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd0161060 0x7f2cd014b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49508/0 (socket says 172.21.15.37:49508) 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 -- 172.21.15.37:0/3789384685 learned_addr learned my addr 172.21.15.37:0/3789384685 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd5dfd640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cd00b3330 0x7f2cd014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd55fc640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cd00b3790 0x7f2cd00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 -- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cd00b3330 msgr2=0x7f2cd014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cd00b3330 0x7f2cd014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 -- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cd00b3790 msgr2=0x7f2cd00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cd00b3790 0x7f2cd00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd65fe640 1 -- 172.21.15.37:0/3789384685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8009a70 con 0x7f2cd0161060 2023-11-24T06:16:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.725+0000 7f2cd55fc640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cd00b3790 0x7f2cd00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.726+0000 7f2cd65fe640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd0161060 0x7f2cd014b7c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.726+0000 7f2cc67fc640 1 -- 172.21.15.37:0/3789384685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc802cea0 con 0x7f2cd0161060 2023-11-24T06:16:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.726+0000 7f2cc67fc640 1 -- 172.21.15.37:0/3789384685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc803e630 con 0x7f2cd0161060 2023-11-24T06:16:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.726+0000 7f2cc67fc640 1 -- 172.21.15.37:0/3789384685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc803e9e0 con 0x7f2cd0161060 2023-11-24T06:16:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.726+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd014ef30 con 0x7f2cd0161060 2023-11-24T06:16:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.726+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd014fa10 con 0x7f2cd0161060 2023-11-24T06:16:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.727+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd0067990 con 0x7f2cd0161060 2023-11-24T06:16:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.728+0000 7f2cc67fc640 1 -- 172.21.15.37:0/3789384685 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cc803b050 con 0x7f2cd0161060 2023-11-24T06:16:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.729+0000 7f2cc67fc640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2cb406ae40 0x7f2cb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.729+0000 7f2cc67fc640 1 -- 172.21.15.37:0/3789384685 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2cc80abfb0 con 0x7f2cd0161060 2023-11-24T06:16:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.730+0000 7f2cd5dfd640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2cb406ae40 0x7f2cb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.730+0000 7f2cd5dfd640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2cb406ae40 0x7f2cb406d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc000f60 tx=0x7f2ccc007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:22.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.733+0000 7f2cc67fc640 1 -- 172.21.15.37:0/3789384685 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2cc80dee90 con 0x7f2cd0161060 2023-11-24T06:16:22.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.928+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2cd014f730 con 0x7f2cd0161060 2023-11-24T06:16:22.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.929+0000 7f2cc67fc640 1 -- 172.21.15.37:0/3789384685 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2cc8077000 con 0x7f2cd0161060 2023-11-24T06:16:22.931 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:16:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.931+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2cb406ae40 msgr2=0x7f2cb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.931+0000 7f2cd8061640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2cb406ae40 0x7f2cb406d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc000f60 tx=0x7f2ccc007c00 comp rx=0 tx=0).stop 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd0161060 msgr2=0x7f2cd014b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd0161060 0x7f2cd014b7c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc8004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 shutdown_connections 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2cb406ae40 0x7f2cb406d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cd00b3790 0x7f2cd00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd0161060 0x7f2cd014b7c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 --2- 172.21.15.37:0/3789384685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cd00b3330 0x7f2cd014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 >> 172.21.15.37:0/3789384685 conn(0x7f2cd00cf900 msgr2=0x7f2cd00cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 shutdown_connections 2023-11-24T06:16:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:22.932+0000 7f2cd8061640 1 -- 172.21.15.37:0/3789384685 wait complete. 2023-11-24T06:16:22.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:16:23.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.178+0000 7fd0ac597640 1 Processor -- start 2023-11-24T06:16:23.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.178+0000 7fd0ac597640 1 -- start start 2023-11-24T06:16:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0ac597640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0a40cc0f0 0x7fd0a40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0ac597640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd0a40c57e0 0x7fd0a406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0ac597640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a415eea0 con 0x7fd0a415b440 2023-11-24T06:16:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0ac597640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a415b820 con 0x7fd0a40cc0f0 2023-11-24T06:16:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0ac597640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a40abf30 con 0x7fd0a40c57e0 2023-11-24T06:16:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0aa333640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0a415b440 0x7fd0a40cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47714/0 (socket says 172.21.15.37:47714) 2023-11-24T06:16:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0aa333640 1 -- 172.21.15.37:0/1492935396 learned_addr learned my addr 172.21.15.37:0/1492935396 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0a9b32640 1 --2- 172.21.15.37:0/1492935396 >> v2:172.21.15.37:3300/0 conn(0x7fd0a40cc0f0 0x7fd0a40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.180+0000 7fd0aab34640 1 --2- 172.21.15.37:0/1492935396 >> v2:172.21.15.188:3300/0 conn(0x7fd0a40c57e0 0x7fd0a406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.181+0000 7fd0a9331640 1 -- 172.21.15.37:0/1492935396 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094502498 0 0) 0x7fd0a415eea0 con 0x7fd0a415b440 2023-11-24T06:16:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.181+0000 7fd0a9331640 1 -- 172.21.15.37:0/1492935396 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd090003520 con 0x7fd0a415b440 2023-11-24T06:16:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.181+0000 7fd0a9b32640 1 -- 172.21.15.37:0/1492935396 >> v2:172.21.15.188:3300/0 conn(0x7fd0a40c57e0 msgr2=0x7fd0a406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.181+0000 7fd0a9b32640 1 --2- 172.21.15.37:0/1492935396 >> v2:172.21.15.188:3300/0 conn(0x7fd0a40c57e0 0x7fd0a406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.181+0000 7fd0a9b32640 1 -- 172.21.15.37:0/1492935396 >> v1:172.21.15.37:6789/0 conn(0x7fd0a415b440 legacy=0x7fd0a40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.181+0000 7fd0a9b32640 1 -- 172.21.15.37:0/1492935396 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a415f0f0 con 0x7fd0a40cc0f0 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.182+0000 7fd0a9b32640 1 --2- 172.21.15.37:0/1492935396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40cc0f0 0x7fd0a40c52a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40c95e0 tx=0x7fd09402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2211c626f4d616 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.182+0000 7fd0a9331640 1 -- 172.21.15.37:0/1492935396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09402e070 con 0x7fd0a40cc0f0 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0a9331640 1 -- 172.21.15.37:0/1492935396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0940315a0 con 0x7fd0a40cc0f0 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0a9331640 1 -- 172.21.15.37:0/1492935396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094031910 con 0x7fd0a40cc0f0 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 -- 172.21.15.37:0/1492935396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40cc0f0 msgr2=0x7fd0a40c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 --2- 172.21.15.37:0/1492935396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40cc0f0 0x7fd0a40c52a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40c95e0 tx=0x7fd09402b840 comp rx=0 tx=0).stop 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 -- 172.21.15.37:0/1492935396 shutdown_connections 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 --2- 172.21.15.37:0/1492935396 >> v2:172.21.15.188:3300/0 conn(0x7fd0a40c57e0 0x7fd0a406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 --2- 172.21.15.37:0/1492935396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40cc0f0 0x7fd0a40c52a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 -- 172.21.15.37:0/1492935396 >> 172.21.15.37:0/1492935396 conn(0x7fd0a40b0c50 msgr2=0x7fd0a40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 -- 172.21.15.37:0/1492935396 shutdown_connections 2023-11-24T06:16:23.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.183+0000 7fd0ac597640 1 -- 172.21.15.37:0/1492935396 wait complete. 2023-11-24T06:16:23.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.185+0000 7fd0ac597640 1 Processor -- start 2023-11-24T06:16:23.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.185+0000 7fd0ac597640 1 -- start start 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0ac597640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40c57e0 0x7fd0a4154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0ac597640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0a40cc0f0 0x7fd0a40ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0ac597640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0a415b440 0x7fd0a40ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0ac597640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40cd410 con 0x7fd0a40c57e0 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0ac597640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40cd6f0 con 0x7fd0a415b440 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0ac597640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40cd9d0 con 0x7fd0a40cc0f0 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0aa333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40c57e0 0x7fd0a4154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0aa333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40c57e0 0x7fd0a4154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49536/0 (socket says 172.21.15.37:49536) 2023-11-24T06:16:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.186+0000 7fd0aa333640 1 -- 172.21.15.37:0/3482600584 learned_addr learned my addr 172.21.15.37:0/3482600584 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0aab34640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0a415b440 0x7fd0a40ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0a9b32640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0a40cc0f0 0x7fd0a40ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0aa333640 1 -- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0a40cc0f0 msgr2=0x7fd0a40ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0aa333640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0a40cc0f0 0x7fd0a40ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0aa333640 1 -- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0a415b440 msgr2=0x7fd0a40ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0aa333640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0a415b440 0x7fd0a40ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0aa333640 1 -- 172.21.15.37:0/3482600584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094009400 con 0x7fd0a40c57e0 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0a9b32640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0a40cc0f0 0x7fd0a40ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.187+0000 7fd0aa333640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40c57e0 0x7fd0a4154350 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c390 tx=0x7fd0a000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.188+0000 7fd09affd640 1 -- 172.21.15.37:0/3482600584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0005ce0 con 0x7fd0a40c57e0 2023-11-24T06:16:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.188+0000 7fd09affd640 1 -- 172.21.15.37:0/3482600584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0005e40 con 0x7fd0a40c57e0 2023-11-24T06:16:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.188+0000 7fd09affd640 1 -- 172.21.15.37:0/3482600584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00072f0 con 0x7fd0a40c57e0 2023-11-24T06:16:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.188+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a40cdcb0 con 0x7fd0a40c57e0 2023-11-24T06:16:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.188+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a40b0720 con 0x7fd0a40c57e0 2023-11-24T06:16:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.189+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a404e8b0 con 0x7fd0a40c57e0 2023-11-24T06:16:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.190+0000 7fd09affd640 1 -- 172.21.15.37:0/3482600584 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0a0007450 con 0x7fd0a40c57e0 2023-11-24T06:16:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.191+0000 7fd09affd640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd08806ae70 0x7fd08806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.191+0000 7fd09affd640 1 -- 172.21.15.37:0/3482600584 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd0a0088c60 con 0x7fd0a40c57e0 2023-11-24T06:16:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.191+0000 7fd0a9b32640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd08806ae70 0x7fd08806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.192+0000 7fd0a9b32640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd08806ae70 0x7fd08806d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd094036000 tx=0x7fd09403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.195+0000 7fd09affd640 1 -- 172.21.15.37:0/3482600584 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0a0053ca0 con 0x7fd0a40c57e0 2023-11-24T06:16:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.392+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0a406dc80 con 0x7fd0a40c57e0 2023-11-24T06:16:23.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.393+0000 7fd09affd640 1 -- 172.21.15.37:0/3482600584 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0a00170a0 con 0x7fd0a40c57e0 2023-11-24T06:16:23.396 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd08806ae70 msgr2=0x7fd08806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd08806ae70 0x7fd08806d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd094036000 tx=0x7fd09403d040 comp rx=0 tx=0).stop 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40c57e0 msgr2=0x7fd0a4154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40c57e0 0x7fd0a4154350 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c390 tx=0x7fd0a000c850 comp rx=0 tx=0).stop 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 shutdown_connections 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd08806ae70 0x7fd08806d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0a415b440 0x7fd0a40ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0a40cc0f0 0x7fd0a40ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 --2- 172.21.15.37:0/3482600584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40c57e0 0x7fd0a4154350 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 >> 172.21.15.37:0/3482600584 conn(0x7fd0a40b0c50 msgr2=0x7fd0a40704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 shutdown_connections 2023-11-24T06:16:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.396+0000 7fd0ac597640 1 -- 172.21.15.37:0/3482600584 wait complete. 2023-11-24T06:16:23.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.644+0000 7f95ea783640 1 Processor -- start 2023-11-24T06:16:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.644+0000 7f95ea783640 1 -- start start 2023-11-24T06:16:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95ea783640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f95e415b440 0x7f95e40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95ea783640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95e40c59b0 0x7f95e406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95ea783640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e40c5dc0 con 0x7f95e40cbf20 2023-11-24T06:16:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95ea783640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40cc3d0 con 0x7f95e40c59b0 2023-11-24T06:16:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95ea783640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e415b820 con 0x7f95e415b440 2023-11-24T06:16:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95e8d20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95e40c59b0 0x7f95e406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95e8d20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95e40c59b0 0x7f95e406c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49538/0 (socket says 172.21.15.37:49538) 2023-11-24T06:16:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.646+0000 7f95e8d20640 1 -- 172.21.15.37:0/3205342695 learned_addr learned my addr 172.21.15.37:0/3205342695 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.647+0000 7f95e3fff640 1 --2- 172.21.15.37:0/3205342695 >> v2:172.21.15.188:3300/0 conn(0x7f95e415b440 0x7f95e40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.647+0000 7f95e8d20640 1 -- 172.21.15.37:0/3205342695 >> v2:172.21.15.188:3300/0 conn(0x7f95e415b440 msgr2=0x7f95e40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.647+0000 7f95e8d20640 1 --2- 172.21.15.37:0/3205342695 >> v2:172.21.15.188:3300/0 conn(0x7f95e415b440 0x7f95e40cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.647+0000 7f95e8d20640 1 -- 172.21.15.37:0/3205342695 >> v1:172.21.15.188:6789/0 conn(0x7f95e40cbf20 legacy=0x7f95e40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.647+0000 7f95e8d20640 1 -- 172.21.15.37:0/3205342695 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e415eea0 con 0x7f95e40c59b0 2023-11-24T06:16:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.648+0000 7f95e8d20640 1 --2- 172.21.15.37:0/3205342695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e40c59b0 0x7f95e406c5f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95e406e770 tx=0x7f95dc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877449d92969ba36 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95e2ffd640 1 -- 172.21.15.37:0/3205342695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc02ca80 con 0x7f95e40c59b0 2023-11-24T06:16:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95e2ffd640 1 -- 172.21.15.37:0/3205342695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc02cbe0 con 0x7f95e40c59b0 2023-11-24T06:16:23.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95e2ffd640 1 -- 172.21.15.37:0/3205342695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0343f0 con 0x7f95e40c59b0 2023-11-24T06:16:23.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95ea783640 1 -- 172.21.15.37:0/3205342695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e40c59b0 msgr2=0x7f95e406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95ea783640 1 --2- 172.21.15.37:0/3205342695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e40c59b0 0x7f95e406c5f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95e406e770 tx=0x7f95dc02bee0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95ea783640 1 -- 172.21.15.37:0/3205342695 shutdown_connections 2023-11-24T06:16:23.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95ea783640 1 --2- 172.21.15.37:0/3205342695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e40c59b0 0x7f95e406c5f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95ea783640 1 --2- 172.21.15.37:0/3205342695 >> v2:172.21.15.188:3300/0 conn(0x7f95e415b440 0x7f95e40cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.649+0000 7f95ea783640 1 -- 172.21.15.37:0/3205342695 >> 172.21.15.37:0/3205342695 conn(0x7f95e40b0c50 msgr2=0x7f95e40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.650+0000 7f95ea783640 1 -- 172.21.15.37:0/3205342695 shutdown_connections 2023-11-24T06:16:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.650+0000 7f95ea783640 1 -- 172.21.15.37:0/3205342695 wait complete. 2023-11-24T06:16:23.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.651+0000 7f95ea783640 1 Processor -- start 2023-11-24T06:16:23.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.652+0000 7f95ea783640 1 -- start start 2023-11-24T06:16:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.652+0000 7f95ea783640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e40c59b0 0x7f95e4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.652+0000 7f95ea783640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e40cbf20 0x7f95e41f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95ea783640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e415b440 0x7f95e4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95ea783640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41f3fc0 con 0x7f95e415b440 2023-11-24T06:16:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95ea783640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41f4410 con 0x7f95e40c59b0 2023-11-24T06:16:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95ea783640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4154b50 con 0x7f95e40cbf20 2023-11-24T06:16:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e415b440 0x7f95e4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e415b440 0x7f95e4156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49554/0 (socket says 172.21.15.37:49554) 2023-11-24T06:16:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 -- 172.21.15.37:0/1527474985 learned_addr learned my addr 172.21.15.37:0/1527474985 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e3fff640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e40c59b0 0x7f95e4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e37fe640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e40cbf20 0x7f95e41f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 -- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e40cbf20 msgr2=0x7f95e41f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e40cbf20 0x7f95e41f2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 -- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e40c59b0 msgr2=0x7f95e4154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e40c59b0 0x7f95e4154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e8d20640 1 -- 172.21.15.37:0/1527474985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009b30 con 0x7f95e415b440 2023-11-24T06:16:23.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.653+0000 7f95e3fff640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e40c59b0 0x7f95e4154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:23.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.654+0000 7f95e8d20640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e415b440 0x7f95e4156560 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f95dc036040 tx=0x7f95dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.654+0000 7f95e0ff9640 1 -- 172.21.15.37:0/1527474985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc03e450 con 0x7f95e415b440 2023-11-24T06:16:23.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.654+0000 7f95e0ff9640 1 -- 172.21.15.37:0/1527474985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc03e5b0 con 0x7f95e415b440 2023-11-24T06:16:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.654+0000 7f95e0ff9640 1 -- 172.21.15.37:0/1527474985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc03e960 con 0x7f95e415b440 2023-11-24T06:16:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.654+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e41f3470 con 0x7f95e415b440 2023-11-24T06:16:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.654+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e41f3a00 con 0x7f95e415b440 2023-11-24T06:16:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.655+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e41f4170 con 0x7f95e415b440 2023-11-24T06:16:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.656+0000 7f95e0ff9640 1 -- 172.21.15.37:0/1527474985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95dc02cd50 con 0x7f95e415b440 2023-11-24T06:16:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.657+0000 7f95e0ff9640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95d006ae40 0x7f95d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.657+0000 7f95e0ff9640 1 -- 172.21.15.37:0/1527474985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f95dc0ac420 con 0x7f95e415b440 2023-11-24T06:16:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.658+0000 7f95e3fff640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95d006ae40 0x7f95d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.658+0000 7f95e3fff640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95d006ae40 0x7f95d006d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f95d4006fd0 tx=0x7f95d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:23.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.662+0000 7f95e0ff9640 1 -- 172.21.15.37:0/1527474985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95e41f4170 con 0x7f95e415b440 2023-11-24T06:16:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.858+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95e41f4550 con 0x7f95e415b440 2023-11-24T06:16:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.859+0000 7f95e0ff9640 1 -- 172.21.15.37:0/1527474985 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95e41f4550 con 0x7f95e415b440 2023-11-24T06:16:23.877 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:16:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.861+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95d006ae40 msgr2=0x7f95d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.861+0000 7f95ea783640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95d006ae40 0x7f95d006d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f95d4006fd0 tx=0x7f95d4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.861+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e415b440 msgr2=0x7f95e4156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.861+0000 7f95ea783640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e415b440 0x7f95e4156560 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f95dc036040 tx=0x7f95dc004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 shutdown_connections 2023-11-24T06:16:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f95d006ae40 0x7f95d006d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e415b440 0x7f95e4156560 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e40cbf20 0x7f95e41f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 --2- 172.21.15.37:0/1527474985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e40c59b0 0x7f95e4154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 >> 172.21.15.37:0/1527474985 conn(0x7f95e40b0c50 msgr2=0x7f95e40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 shutdown_connections 2023-11-24T06:16:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:23.862+0000 7f95ea783640 1 -- 172.21.15.37:0/1527474985 wait complete. 2023-11-24T06:16:23.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:16:24.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.115+0000 7f67c1060640 1 Processor -- start 2023-11-24T06:16:24.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.115+0000 7f67c1060640 1 -- start start 2023-11-24T06:16:24.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.117+0000 7f67c1060640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f67bc0d3940 0x7f67bc167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.117+0000 7f67c1060640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc0cea30 con 0x7f67bc0b63d0 2023-11-24T06:16:24.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.117+0000 7f67c1060640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc0d2260 con 0x7f67bc15d490 2023-11-24T06:16:24.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.117+0000 7f67c1060640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67bc0d0450 con 0x7f67bc0d3940 2023-11-24T06:16:24.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67b3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67bc0b63d0 0x7f67bc0d3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47722/0 (socket says 172.21.15.37:47722) 2023-11-24T06:16:24.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67b3fff640 1 -- 172.21.15.37:0/886341735 learned_addr learned my addr 172.21.15.37:0/886341735 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:24.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67c085f640 1 --2- 172.21.15.37:0/886341735 >> v2:172.21.15.188:3300/0 conn(0x7f67bc0d3940 0x7f67bc167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570932576 0 0) 0x7f67bc0cea30 con 0x7f67bc0b63d0 2023-11-24T06:16:24.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a8003520 con 0x7f67bc0b63d0 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459136899 0 0) 0x7f67a8003520 con 0x7f67bc0b63d0 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 >> v2:172.21.15.188:3300/0 conn(0x7f67bc0d3940 msgr2=0x7f67bc167ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67bb7fe640 1 --2- 172.21.15.37:0/886341735 >> v2:172.21.15.188:3300/0 conn(0x7f67bc0d3940 0x7f67bc167ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.118+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 >> v1:172.21.15.188:6789/0 conn(0x7f67bc15d490 legacy=0x7f67bc0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0ce750 con 0x7f67bc0b63d0 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f67a4001670 con 0x7f67bc0b63d0 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 >> v1:172.21.15.37:6789/0 conn(0x7f67bc0b63d0 legacy=0x7f67bc0d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a8003970 0x7f67a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a80047c0 0x7f67a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67a8005180 0x7f67a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0d0450 con 0x7f67a80047c0 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a800c020 con 0x7f67a8003970 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a800c1e0 con 0x7f67a8005180 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67b3fff640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a80047c0 0x7f67a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.119+0000 7f67bbfff640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a8003970 0x7f67a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67b3fff640 1 -- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67a8005180 msgr2=0x7f67a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67c085f640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67a8005180 0x7f67a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67b3fff640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67a8005180 0x7f67a800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67b3fff640 1 -- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a8003970 msgr2=0x7f67a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67b3fff640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a8003970 0x7f67a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67b3fff640 1 -- 172.21.15.37:0/886341735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8003520 con 0x7f67a80047c0 2023-11-24T06:16:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67c085f640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67a8005180 0x7f67a800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67bbfff640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a8003970 0x7f67a8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.120+0000 7f67c085f640 1 -- 172.21.15.37:0/886341735 reap_dead start 2023-11-24T06:16:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.121+0000 7f67b3fff640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a80047c0 0x7f67a8004c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c240 tx=0x7f67a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e16d824e336d0ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.121+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4005ad0 con 0x7f67a80047c0 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.121+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a4005c30 con 0x7f67a80047c0 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.121+0000 7f67bb7fe640 1 -- 172.21.15.37:0/886341735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a402c9f0 con 0x7f67a80047c0 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.122+0000 7f67c1060640 1 -- 172.21.15.37:0/886341735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a80047c0 msgr2=0x7f67a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.122+0000 7f67c1060640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a80047c0 0x7f67a8004c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c240 tx=0x7f67a80057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.122+0000 7f67c1060640 1 -- 172.21.15.37:0/886341735 shutdown_connections 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.122+0000 7f67c1060640 1 --2- 172.21.15.37:0/886341735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a80047c0 0x7f67a8004c40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.122+0000 7f67c1060640 1 -- 172.21.15.37:0/886341735 >> 172.21.15.37:0/886341735 conn(0x7f67bc061340 msgr2=0x7f67bc061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.122+0000 7f67c1060640 1 -- 172.21.15.37:0/886341735 shutdown_connections 2023-11-24T06:16:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.122+0000 7f67c1060640 1 -- 172.21.15.37:0/886341735 wait complete. 2023-11-24T06:16:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.124+0000 7f67c1060640 1 Processor -- start 2023-11-24T06:16:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.124+0000 7f67c1060640 1 -- start start 2023-11-24T06:16:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.125+0000 7f67c1060640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a80047c0 0x7f67bc0c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.125+0000 7f67c1060640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc1540d0 0x7f67bc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.125+0000 7f67c1060640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc0c9c80 0x7f67bc0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.125+0000 7f67c1060640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0d0bf0 con 0x7f67bc1540d0 2023-11-24T06:16:24.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.125+0000 7f67c1060640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0ca100 con 0x7f67a80047c0 2023-11-24T06:16:24.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.125+0000 7f67c1060640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc15e4e0 con 0x7f67bc0c9c80 2023-11-24T06:16:24.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc1540d0 0x7f67bc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc1540d0 0x7f67bc0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49566/0 (socket says 172.21.15.37:49566) 2023-11-24T06:16:24.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 -- 172.21.15.37:0/3160136328 learned_addr learned my addr 172.21.15.37:0/3160136328 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:24.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67bbfff640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a80047c0 0x7f67bc0c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67c085f640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc0c9c80 0x7f67bc0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 -- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc0c9c80 msgr2=0x7f67bc0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc0c9c80 0x7f67bc0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 -- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a80047c0 msgr2=0x7f67bc0c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a80047c0 0x7f67bc0c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 -- 172.21.15.37:0/3160136328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0c7400 con 0x7f67bc1540d0 2023-11-24T06:16:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67bbfff640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a80047c0 0x7f67bc0c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.126+0000 7f67b3fff640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc1540d0 0x7f67bc0c9740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f67a4001930 tx=0x7f67a402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.127+0000 7f67b97fa640 1 -- 172.21.15.37:0/3160136328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a403c040 con 0x7f67bc1540d0 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.127+0000 7f67b97fa640 1 -- 172.21.15.37:0/3160136328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a402cc80 con 0x7f67bc1540d0 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.127+0000 7f67b97fa640 1 -- 172.21.15.37:0/3160136328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4007070 con 0x7f67bc1540d0 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.127+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc15d910 con 0x7f67bc1540d0 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.127+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc15de90 con 0x7f67bc1540d0 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.128+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc04e840 con 0x7f67bc1540d0 2023-11-24T06:16:24.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.129+0000 7f67b97fa640 1 -- 172.21.15.37:0/3160136328 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67a4032070 con 0x7f67bc1540d0 2023-11-24T06:16:24.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.131+0000 7f67b97fa640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f679c06ae40 0x7f679c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.131+0000 7f67b97fa640 1 -- 172.21.15.37:0/3160136328 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f67a40aab90 con 0x7f67bc1540d0 2023-11-24T06:16:24.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.131+0000 7f67bbfff640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f679c06ae40 0x7f679c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.132+0000 7f67bbfff640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f679c06ae40 0x7f679c06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007fd0 tx=0x7f67ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.135+0000 7f67b97fa640 1 -- 172.21.15.37:0/3160136328 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67a4075b50 con 0x7f67bc1540d0 2023-11-24T06:16:24.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.343+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67bc0b2130 con 0x7f67bc1540d0 2023-11-24T06:16:24.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.344+0000 7f67b97fa640 1 -- 172.21.15.37:0/3160136328 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v41) v1 ==== 80+0+122 (secure 0 0 0) 0x7f67a4079170 con 0x7f67bc1540d0 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6836/3993737526 2023-11-25T06:16:18.597206+0000 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6834/3993737526 2023-11-25T06:16:18.597206+0000 2023-11-24T06:16:24.347 INFO:teuthology.orchestra.run.smithi037.stderr:listed 2 entries 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f679c06ae40 msgr2=0x7f679c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f679c06ae40 0x7f679c06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007fd0 tx=0x7f67ac009040 comp rx=0 tx=0).stop 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc1540d0 msgr2=0x7f67bc0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc1540d0 0x7f67bc0c9740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f67a4001930 tx=0x7f67a402e070 comp rx=0 tx=0).stop 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 shutdown_connections 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f679c06ae40 0x7f679c06d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc0c9c80 0x7f67bc0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc1540d0 0x7f67bc0c9740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 --2- 172.21.15.37:0/3160136328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67a80047c0 0x7f67bc0c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 >> 172.21.15.37:0/3160136328 conn(0x7f67bc061340 msgr2=0x7f67bc0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:24.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 shutdown_connections 2023-11-24T06:16:24.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.347+0000 7f67c1060640 1 -- 172.21.15.37:0/3160136328 wait complete. 2023-11-24T06:16:24.369 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:16:24.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:24.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:16:24.484 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:16:24.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:24.485 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:16:24.538 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:16:24.539 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:24.599 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:16:24.599 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:24.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.888+0000 7f0694c9b640 1 Processor -- start 2023-11-24T06:16:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.889+0000 7f0694c9b640 1 -- start start 2023-11-24T06:16:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.890+0000 7f0694c9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f069015c7f0 0x7f069006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.890+0000 7f0694c9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06900ce6c0 0x7f06900cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.890+0000 7f0694c9b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900cece0 con 0x7f06900cf450 2023-11-24T06:16:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.890+0000 7f0694c9b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0690156010 con 0x7f06900ce6c0 2023-11-24T06:16:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.890+0000 7f0694c9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069006ce30 con 0x7f069015c7f0 2023-11-24T06:16:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.890+0000 7f068ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06900ce6c0 0x7f06900cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06900ce6c0 0x7f06900cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49574/0 (socket says 172.21.15.37:49574) 2023-11-24T06:16:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068ed9d640 1 -- 172.21.15.37:0/3513144854 learned_addr learned my addr 172.21.15.37:0/3513144854 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068e59c640 1 --2- 172.21.15.37:0/3513144854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f069015c7f0 0x7f069006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068ed9d640 1 -- 172.21.15.37:0/3513144854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f069015c7f0 msgr2=0x7f069006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068ed9d640 1 --2- 172.21.15.37:0/3513144854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f069015c7f0 0x7f069006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068ed9d640 1 -- 172.21.15.37:0/3513144854 >> v1:172.21.15.188:6789/0 conn(0x7f06900cf450 legacy=0x7f06900cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068ed9d640 1 -- 172.21.15.37:0/3513144854 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069006d040 con 0x7f06900ce6c0 2023-11-24T06:16:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.891+0000 7f068e59c640 1 --2- 172.21.15.37:0/3513144854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f069015c7f0 0x7f069006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.892+0000 7f068ed9d640 1 --2- 172.21.15.37:0/3513144854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f06900cf8d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0688009870 tx=0x7f068802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29ddd6689f0cb3f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.892+0000 7f068d59a640 1 -- 172.21.15.37:0/3513144854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688031640 con 0x7f06900ce6c0 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f068d59a640 1 -- 172.21.15.37:0/3513144854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06880317a0 con 0x7f06900ce6c0 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f068d59a640 1 -- 172.21.15.37:0/3513144854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688031b30 con 0x7f06900ce6c0 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 -- 172.21.15.37:0/3513144854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 msgr2=0x7f06900cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 --2- 172.21.15.37:0/3513144854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f06900cf8d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0688009870 tx=0x7f068802b8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 -- 172.21.15.37:0/3513144854 shutdown_connections 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 --2- 172.21.15.37:0/3513144854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f06900cf8d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 --2- 172.21.15.37:0/3513144854 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f069015c7f0 0x7f069006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 -- 172.21.15.37:0/3513144854 >> 172.21.15.37:0/3513144854 conn(0x7f069006a920 msgr2=0x7f069006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 -- 172.21.15.37:0/3513144854 shutdown_connections 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.893+0000 7f0694c9b640 1 -- 172.21.15.37:0/3513144854 wait complete. 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.895+0000 7f0694c9b640 1 Processor -- start 2023-11-24T06:16:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.895+0000 7f0694c9b640 1 -- start start 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.896+0000 7f0694c9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f0690156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.896+0000 7f0694c9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06900cf450 0x7f06901f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.896+0000 7f0694c9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f069015c7f0 0x7f06900ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.896+0000 7f0694c9b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0690158fa0 con 0x7f06900ce6c0 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.896+0000 7f0694c9b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06900ad020 con 0x7f069015c7f0 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.896+0000 7f0694c9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06900ac730 con 0x7f06900cf450 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.896+0000 7f068e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f0690156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f0690156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49588/0 (socket says 172.21.15.37:49588) 2023-11-24T06:16:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 -- 172.21.15.37:0/1650211800 learned_addr learned my addr 172.21.15.37:0/1650211800 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:24.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068dd9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06900cf450 0x7f06901f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068ed9d640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f069015c7f0 0x7f06900ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 -- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06900cf450 msgr2=0x7f06901f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06900cf450 0x7f06901f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 -- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f069015c7f0 msgr2=0x7f06900ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f069015c7f0 0x7f06900ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 -- 172.21.15.37:0/1650211800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880094d0 con 0x7f06900ce6c0 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.897+0000 7f068e59c640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f0690156150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f068000ce30 tx=0x7f068000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.898+0000 7f0686ffd640 1 -- 172.21.15.37:0/1650211800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000f890 con 0x7f06900ce6c0 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.898+0000 7f0686ffd640 1 -- 172.21.15.37:0/1650211800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068000f9f0 con 0x7f06900ce6c0 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.898+0000 7f0686ffd640 1 -- 172.21.15.37:0/1650211800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000fd80 con 0x7f06900ce6c0 2023-11-24T06:16:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.898+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06901f3200 con 0x7f06900ce6c0 2023-11-24T06:16:24.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.898+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900accb0 con 0x7f06900ce6c0 2023-11-24T06:16:24.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.899+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0690067470 con 0x7f06900ce6c0 2023-11-24T06:16:24.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.900+0000 7f0686ffd640 1 -- 172.21.15.37:0/1650211800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f068000b040 con 0x7f06900ce6c0 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.901+0000 7f0686ffd640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f067006ae70 0x7f067006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.902+0000 7f0686ffd640 1 -- 172.21.15.37:0/1650211800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f068008a010 con 0x7f06900ce6c0 2023-11-24T06:16:24.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.902+0000 7f068dd9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f067006ae70 0x7f067006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:24.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.903+0000 7f068dd9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f067006ae70 0x7f067006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:24.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:24.906+0000 7f0686ffd640 1 -- 172.21.15.37:0/1650211800 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0680055050 con 0x7f06900ce6c0 2023-11-24T06:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.101+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06900cd730 con 0x7f06900ce6c0 2023-11-24T06:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.103+0000 7f0686ffd640 1 -- 172.21.15.37:0/1650211800 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f068001d090 con 0x7f06900ce6c0 2023-11-24T06:16:25.106 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:25.107 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:21.608455+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6836/3993737526":"2023-11-25T06:16:18.597206+0000","172.21.15.37:6834/3993737526":"2023-11-25T06:16:18.597206+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:25.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.106+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f067006ae70 msgr2=0x7f067006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.106+0000 7f0694c9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f067006ae70 0x7f067006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678009040 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.106+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 msgr2=0x7f0690156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.106+0000 7f0694c9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f0690156150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f068000ce30 tx=0x7f068000a650 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 shutdown_connections 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f067006ae70 0x7f067006d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f069015c7f0 0x7f06900ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06900cf450 0x7f06901f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 --2- 172.21.15.37:0/1650211800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900ce6c0 0x7f0690156150 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 >> 172.21.15.37:0/1650211800 conn(0x7f069006a920 msgr2=0x7f06900cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 shutdown_connections 2023-11-24T06:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.107+0000 7f0694c9b640 1 -- 172.21.15.37:0/1650211800 wait complete. 2023-11-24T06:16:25.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:15:59.353546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:00.332854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:25.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.353+0000 7f8ef34d1640 1 Processor -- start 2023-11-24T06:16:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.353+0000 7f8ef34d1640 1 -- start start 2023-11-24T06:16:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.355+0000 7f8ef34d1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8eec0b0fb0 0x7f8eec06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.355+0000 7f8ef34d1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec15ed20 con 0x7f8eec0b0b40 2023-11-24T06:16:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.355+0000 7f8ef34d1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec15f8a0 con 0x7f8eec15b260 2023-11-24T06:16:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.355+0000 7f8ef34d1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eec15b640 con 0x7f8eec0b0fb0 2023-11-24T06:16:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.355+0000 7f8ef1cce640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8eec0b0b40 0x7f8eec06c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47730/0 (socket says 172.21.15.37:47730) 2023-11-24T06:16:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.355+0000 7f8ef1cce640 1 -- 172.21.15.37:0/1354252789 learned_addr learned my addr 172.21.15.37:0/1354252789 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:25.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef2cd0640 1 --2- 172.21.15.37:0/1354252789 >> v2:172.21.15.188:3300/0 conn(0x7f8eec0b0fb0 0x7f8eec06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589999827 0 0) 0x7f8eec15ed20 con 0x7f8eec0b0b40 2023-11-24T06:16:25.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed8003520 con 0x7f8eec0b0b40 2023-11-24T06:16:25.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463277481 0 0) 0x7f8ed8003520 con 0x7f8eec0b0b40 2023-11-24T06:16:25.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 >> v2:172.21.15.188:3300/0 conn(0x7f8eec0b0fb0 msgr2=0x7f8eec06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 --2- 172.21.15.37:0/1354252789 >> v2:172.21.15.188:3300/0 conn(0x7f8eec0b0fb0 0x7f8eec06ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 >> v1:172.21.15.188:6789/0 conn(0x7f8eec15b260 legacy=0x7f8eec06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec06e750 con 0x7f8eec0b0b40 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f8edc001670 con 0x7f8eec0b0b40 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 >> v1:172.21.15.37:6789/0 conn(0x7f8eec0b0b40 legacy=0x7f8eec06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8ed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.356+0000 7f8ef14cd640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed80047c0 0x7f8ed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef14cd640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ed80052a0 0x7f8ed800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec15b640 con 0x7f8ed8003970 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800c170 con 0x7f8ed80047c0 2023-11-24T06:16:25.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800c330 con 0x7f8ed80052a0 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef24cf640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8ed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef1cce640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed80047c0 0x7f8ed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef24cf640 1 -- 172.21.15.37:0/1354252789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ed80052a0 msgr2=0x7f8ed800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef24cf640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ed80052a0 0x7f8ed800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef24cf640 1 -- 172.21.15.37:0/1354252789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed80047c0 msgr2=0x7f8ed8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef24cf640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ed80047c0 0x7f8ed8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef24cf640 1 -- 172.21.15.37:0/1354252789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8003520 con 0x7f8ed8003970 2023-11-24T06:16:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.357+0000 7f8ef2cd0640 1 -- 172.21.15.37:0/1354252789 reap_dead start 2023-11-24T06:16:25.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.358+0000 7f8ef24cf640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8ed8003d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8001720 tx=0x7f8ed80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b631fef23ff277a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.359+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80052d0 con 0x7f8ed8003970 2023-11-24T06:16:25.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.359+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee802e050 con 0x7f8ed8003970 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.359+0000 7f8ef14cd640 1 -- 172.21.15.37:0/1354252789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8003830 con 0x7f8ed8003970 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.359+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1354252789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 msgr2=0x7f8ed8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.359+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8ed8003d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8001720 tx=0x7f8ed80057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.360+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1354252789 shutdown_connections 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.360+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1354252789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8ed8003d90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.360+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1354252789 >> 172.21.15.37:0/1354252789 conn(0x7f8eec0cbb40 msgr2=0x7f8eec0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.360+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1354252789 shutdown_connections 2023-11-24T06:16:25.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.360+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1354252789 wait complete. 2023-11-24T06:16:25.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.362+0000 7f8ef34d1640 1 Processor -- start 2023-11-24T06:16:25.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.362+0000 7f8ef34d1640 1 -- start start 2023-11-24T06:16:25.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef34d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8eec0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef34d1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8eec15a350 0x7f8eec0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef34d1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8eec149720 0x7f8eec15d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef34d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec15cfc0 con 0x7f8ed8003970 2023-11-24T06:16:25.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef34d1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0b23e0 con 0x7f8eec149720 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef34d1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0b26c0 con 0x7f8eec15a350 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef24cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8eec0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef24cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8eec0b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49606/0 (socket says 172.21.15.37:49606) 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.363+0000 7f8ef24cf640 1 -- 172.21.15.37:0/1453052066 learned_addr learned my addr 172.21.15.37:0/1453052066 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef1cce640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8eec15a350 0x7f8eec0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef24cf640 1 -- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8eec15a350 msgr2=0x7f8eec0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef24cf640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8eec15a350 0x7f8eec0b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef2cd0640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8eec149720 0x7f8eec15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef24cf640 1 -- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8eec149720 msgr2=0x7f8eec15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef24cf640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8eec149720 0x7f8eec15d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef24cf640 1 -- 172.21.15.37:0/1453052066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec0b29a0 con 0x7f8ed8003970 2023-11-24T06:16:25.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ef24cf640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8eec0b3480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8ee802bbc0 tx=0x7f8ee8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ee2ffd640 1 -- 172.21.15.37:0/1453052066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80076c0 con 0x7f8ed8003970 2023-11-24T06:16:25.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ee2ffd640 1 -- 172.21.15.37:0/1453052066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8007a30 con 0x7f8ed8003970 2023-11-24T06:16:25.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.364+0000 7f8ee2ffd640 1 -- 172.21.15.37:0/1453052066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8006be0 con 0x7f8ed8003970 2023-11-24T06:16:25.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.365+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec0b2c80 con 0x7f8ed8003970 2023-11-24T06:16:25.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.365+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec149ba0 con 0x7f8ed8003970 2023-11-24T06:16:25.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.366+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec149d30 con 0x7f8ed8003970 2023-11-24T06:16:25.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.367+0000 7f8ee2ffd640 1 -- 172.21.15.37:0/1453052066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ee8006d40 con 0x7f8ed8003970 2023-11-24T06:16:25.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.368+0000 7f8ee2ffd640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ed006ae70 0x7f8ed006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.368+0000 7f8ee2ffd640 1 -- 172.21.15.37:0/1453052066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8ee80ab4e0 con 0x7f8ed8003970 2023-11-24T06:16:25.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.368+0000 7f8ef1cce640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ed006ae70 0x7f8ed006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.369+0000 7f8ef1cce640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ed006ae70 0x7f8ed006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8edc001200 tx=0x7f8edc000f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.373+0000 7f8ee2ffd640 1 -- 172.21.15.37:0/1453052066 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ee8076490 con 0x7f8ed8003970 2023-11-24T06:16:25.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.566+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8eec04e840 con 0x7f8ed8003970 2023-11-24T06:16:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.566+0000 7f8ee2ffd640 1 -- 172.21.15.37:0/1453052066 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ee8079ab0 con 0x7f8ed8003970 2023-11-24T06:16:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:16:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ed006ae70 msgr2=0x7f8ed006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ed006ae70 0x7f8ed006d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8edc001200 tx=0x7f8edc000f30 comp rx=0 tx=0).stop 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 msgr2=0x7f8eec0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8eec0b3480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8ee802bbc0 tx=0x7f8ee8001120 comp rx=0 tx=0).stop 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 shutdown_connections 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8ed006ae70 0x7f8ed006d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8eec149720 0x7f8eec15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8eec15a350 0x7f8eec0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 --2- 172.21.15.37:0/1453052066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8003970 0x7f8eec0b3480 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.569+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 >> 172.21.15.37:0/1453052066 conn(0x7f8eec0cbb40 msgr2=0x7f8eec0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.570+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 shutdown_connections 2023-11-24T06:16:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.570+0000 7f8ef34d1640 1 -- 172.21.15.37:0/1453052066 wait complete. 2023-11-24T06:16:25.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:16:25.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.820+0000 7f2c2509f640 1 Processor -- start 2023-11-24T06:16:25.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.820+0000 7f2c2509f640 1 -- start start 2023-11-24T06:16:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.821+0000 7f2c2509f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c2015d3f0 0x7f2c200d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.821+0000 7f2c2509f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c2015d7d0 0x7f2c200d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.821+0000 7f2c2509f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2c200d0e40 0x7f2c200afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.821+0000 7f2c2509f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c200d15e0 con 0x7f2c2015d3f0 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.821+0000 7f2c2509f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c200d0280 con 0x7f2c200d0e40 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.821+0000 7f2c2509f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200d1300 con 0x7f2c2015d7d0 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c2015d3f0 0x7f2c200d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c2015d3f0 0x7f2c200d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49622/0 (socket says 172.21.15.37:49622) 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 -- 172.21.15.37:0/2691739664 learned_addr learned my addr 172.21.15.37:0/2691739664 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 -- 172.21.15.37:0/2691739664 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c2015d7d0 msgr2=0x7f2c200d1d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 --2- 172.21.15.37:0/2691739664 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c2015d7d0 0x7f2c200d1d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 -- 172.21.15.37:0/2691739664 >> v2:172.21.15.188:3300/0 conn(0x7f2c200d0e40 msgr2=0x7f2c200afea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:16:25.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 --2- 172.21.15.37:0/2691739664 >> v2:172.21.15.188:3300/0 conn(0x7f2c200d0e40 0x7f2c200afea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.822+0000 7f2c1ffff640 1 -- 172.21.15.37:0/2691739664 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c200cfc30 con 0x7f2c2015d3f0 2023-11-24T06:16:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.823+0000 7f2c1ffff640 1 --2- 172.21.15.37:0/2691739664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d3f0 0x7f2c200d1830 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2c200d0dd0 tx=0x7f2c1002bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64efb2cfd5cb8e42 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.823+0000 7f2c1f7fe640 1 -- 172.21.15.37:0/2691739664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1002cac0 con 0x7f2c2015d3f0 2023-11-24T06:16:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.823+0000 7f2c1f7fe640 1 -- 172.21.15.37:0/2691739664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1002cc20 con 0x7f2c2015d3f0 2023-11-24T06:16:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.823+0000 7f2c1f7fe640 1 -- 172.21.15.37:0/2691739664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100343f0 con 0x7f2c2015d3f0 2023-11-24T06:16:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 -- 172.21.15.37:0/2691739664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d3f0 msgr2=0x7f2c200d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 --2- 172.21.15.37:0/2691739664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d3f0 0x7f2c200d1830 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2c200d0dd0 tx=0x7f2c1002bf20 comp rx=0 tx=0).stop 2023-11-24T06:16:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 -- 172.21.15.37:0/2691739664 shutdown_connections 2023-11-24T06:16:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 --2- 172.21.15.37:0/2691739664 >> v2:172.21.15.188:3300/0 conn(0x7f2c200d0e40 0x7f2c200afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 --2- 172.21.15.37:0/2691739664 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c2015d7d0 0x7f2c200d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 --2- 172.21.15.37:0/2691739664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d3f0 0x7f2c200d1830 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 -- 172.21.15.37:0/2691739664 >> 172.21.15.37:0/2691739664 conn(0x7f2c2009c5b0 msgr2=0x7f2c200d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 -- 172.21.15.37:0/2691739664 shutdown_connections 2023-11-24T06:16:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.824+0000 7f2c2509f640 1 -- 172.21.15.37:0/2691739664 wait complete. 2023-11-24T06:16:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.826+0000 7f2c2509f640 1 Processor -- start 2023-11-24T06:16:25.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.826+0000 7f2c2509f640 1 -- start start 2023-11-24T06:16:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.827+0000 7f2c2509f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c200d0e40 0x7f2c20159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.827+0000 7f2c2509f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c2015d3f0 0x7f2c200c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.827+0000 7f2c2509f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d7d0 0x7f2c200c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.827+0000 7f2c2509f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200c97d0 con 0x7f2c2015d7d0 2023-11-24T06:16:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.827+0000 7f2c2509f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20159f60 con 0x7f2c2015d3f0 2023-11-24T06:16:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.827+0000 7f2c2509f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200c8bc0 con 0x7f2c200d0e40 2023-11-24T06:16:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.827+0000 7f2c2489e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d7d0 0x7f2c200c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d7d0 0x7f2c200c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49638/0 (socket says 172.21.15.37:49638) 2023-11-24T06:16:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 -- 172.21.15.37:0/1702166894 learned_addr learned my addr 172.21.15.37:0/1702166894 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c177fe640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c2015d3f0 0x7f2c200c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c1ffff640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c200d0e40 0x7f2c20159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 -- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c200d0e40 msgr2=0x7f2c20159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c200d0e40 0x7f2c20159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 -- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c2015d3f0 msgr2=0x7f2c200c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c2015d3f0 0x7f2c200c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 -- 172.21.15.37:0/1702166894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10009b30 con 0x7f2c2015d7d0 2023-11-24T06:16:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.828+0000 7f2c2489e640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d7d0 0x7f2c200c8590 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b3c0 tx=0x7f2c1800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.829+0000 7f2c1d7fa640 1 -- 172.21.15.37:0/1702166894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18011830 con 0x7f2c2015d7d0 2023-11-24T06:16:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.829+0000 7f2c1d7fa640 1 -- 172.21.15.37:0/1702166894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c180119b0 con 0x7f2c2015d7d0 2023-11-24T06:16:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.829+0000 7f2c1d7fa640 1 -- 172.21.15.37:0/1702166894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18011d60 con 0x7f2c2015d7d0 2023-11-24T06:16:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.829+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c200c8ea0 con 0x7f2c2015d7d0 2023-11-24T06:16:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.829+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c200c9460 con 0x7f2c2015d7d0 2023-11-24T06:16:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.830+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c200d06f0 con 0x7f2c2015d7d0 2023-11-24T06:16:25.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.832+0000 7f2c1d7fa640 1 -- 172.21.15.37:0/1702166894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c1801b460 con 0x7f2c2015d7d0 2023-11-24T06:16:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.832+0000 7f2c1d7fa640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2c0006ae40 0x7f2c0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.833+0000 7f2c1d7fa640 1 -- 172.21.15.37:0/1702166894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2c180893c0 con 0x7f2c2015d7d0 2023-11-24T06:16:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.833+0000 7f2c1ffff640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2c0006ae40 0x7f2c0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:25.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.834+0000 7f2c1ffff640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2c0006ae40 0x7f2c0006d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2c10035000 tx=0x7f2c10030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:25.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:25.837+0000 7f2c1d7fa640 1 -- 172.21.15.37:0/1702166894 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c200d06f0 con 0x7f2c2015d7d0 2023-11-24T06:16:26.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.036+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c200d06f0 con 0x7f2c2015d7d0 2023-11-24T06:16:26.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.036+0000 7f2c1d7fa640 1 -- 172.21.15.37:0/1702166894 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c200d06f0 con 0x7f2c2015d7d0 2023-11-24T06:16:26.039 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:16:26.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2c0006ae40 msgr2=0x7f2c0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2c0006ae40 0x7f2c0006d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2c10035000 tx=0x7f2c10030000 comp rx=0 tx=0).stop 2023-11-24T06:16:26.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d7d0 msgr2=0x7f2c200c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d7d0 0x7f2c200c8590 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b3c0 tx=0x7f2c1800b880 comp rx=0 tx=0).stop 2023-11-24T06:16:26.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 shutdown_connections 2023-11-24T06:16:26.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2c0006ae40 0x7f2c0006d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c2015d3f0 0x7f2c200c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c2015d7d0 0x7f2c200c8590 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 --2- 172.21.15.37:0/1702166894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c200d0e40 0x7f2c20159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 >> 172.21.15.37:0/1702166894 conn(0x7f2c2009c5b0 msgr2=0x7f2c2006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:26.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 shutdown_connections 2023-11-24T06:16:26.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.039+0000 7f2c2509f640 1 -- 172.21.15.37:0/1702166894 wait complete. 2023-11-24T06:16:26.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:16:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.288+0000 7f4b13593640 1 Processor -- start 2023-11-24T06:16:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.288+0000 7f4b13593640 1 -- start start 2023-11-24T06:16:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.289+0000 7f4b13593640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b0c15d3f0 0x7f4b0c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.289+0000 7f4b13593640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b0c15d7d0 0x7f4b0c0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.289+0000 7f4b13593640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0d15e0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.289+0000 7f4b13593640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0d0280 con 0x7f4b0c15d3f0 2023-11-24T06:16:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.289+0000 7f4b13593640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0d1300 con 0x7f4b0c15d7d0 2023-11-24T06:16:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.290+0000 7f4b12591640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b0c15d3f0 0x7f4b0c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.290+0000 7f4b12d92640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4b0c0d0e40 0x7f4b0c0afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47732/0 (socket says 172.21.15.37:47732) 2023-11-24T06:16:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.290+0000 7f4b12d92640 1 -- 172.21.15.37:0/3794333939 learned_addr learned my addr 172.21.15.37:0/3794333939 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.290+0000 7f4b11d90640 1 --2- 172.21.15.37:0/3794333939 >> v2:172.21.15.188:3300/0 conn(0x7f4b0c15d7d0 0x7f4b0c0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.291+0000 7f4b12591640 1 -- 172.21.15.37:0/3794333939 >> v2:172.21.15.188:3300/0 conn(0x7f4b0c15d7d0 msgr2=0x7f4b0c0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.291+0000 7f4b12591640 1 --2- 172.21.15.37:0/3794333939 >> v2:172.21.15.188:3300/0 conn(0x7f4b0c15d7d0 0x7f4b0c0d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.291+0000 7f4b12591640 1 -- 172.21.15.37:0/3794333939 >> v1:172.21.15.37:6789/0 conn(0x7f4b0c0d0e40 legacy=0x7f4b0c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.291+0000 7f4b12591640 1 -- 172.21.15.37:0/3794333939 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0cfc30 con 0x7f4b0c15d3f0 2023-11-24T06:16:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.291+0000 7f4b1158f640 1 -- 172.21.15.37:0/3794333939 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036695729 0 0) 0x7f4b0c0d15e0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.291+0000 7f4b11d90640 1 --2- 172.21.15.37:0/3794333939 >> v2:172.21.15.188:3300/0 conn(0x7f4b0c15d7d0 0x7f4b0c0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.292+0000 7f4b12591640 1 --2- 172.21.15.37:0/3794333939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c15d3f0 0x7f4b0c0d1830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c067bd0 tx=0x7f4b0802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eb27afa14900cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.292+0000 7f4b1158f640 1 -- 172.21.15.37:0/3794333939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0802cc80 con 0x7f4b0c15d3f0 2023-11-24T06:16:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.292+0000 7f4b1158f640 1 -- 172.21.15.37:0/3794333939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0802cde0 con 0x7f4b0c15d3f0 2023-11-24T06:16:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.292+0000 7f4b1158f640 1 -- 172.21.15.37:0/3794333939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08034660 con 0x7f4b0c15d3f0 2023-11-24T06:16:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 -- 172.21.15.37:0/3794333939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c15d3f0 msgr2=0x7f4b0c0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 --2- 172.21.15.37:0/3794333939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c15d3f0 0x7f4b0c0d1830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c067bd0 tx=0x7f4b0802bed0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 -- 172.21.15.37:0/3794333939 shutdown_connections 2023-11-24T06:16:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 --2- 172.21.15.37:0/3794333939 >> v2:172.21.15.188:3300/0 conn(0x7f4b0c15d7d0 0x7f4b0c0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 --2- 172.21.15.37:0/3794333939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c15d3f0 0x7f4b0c0d1830 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 -- 172.21.15.37:0/3794333939 >> 172.21.15.37:0/3794333939 conn(0x7f4b0c09c5b0 msgr2=0x7f4b0c0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 -- 172.21.15.37:0/3794333939 shutdown_connections 2023-11-24T06:16:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.293+0000 7f4b13593640 1 -- 172.21.15.37:0/3794333939 wait complete. 2023-11-24T06:16:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.295+0000 7f4b13593640 1 Processor -- start 2023-11-24T06:16:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.295+0000 7f4b13593640 1 -- start start 2023-11-24T06:16:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b13593640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c0d0e40 0x7f4b0c14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b13593640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b0c15d3f0 0x7f4b0c0b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b13593640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b0c15d7d0 0x7f4b0c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b13593640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14a1e0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b13593640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14a9d0 con 0x7f4b0c15d3f0 2023-11-24T06:16:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b13593640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0cb430 con 0x7f4b0c15d7d0 2023-11-24T06:16:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b12591640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c0d0e40 0x7f4b0c14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b12591640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c0d0e40 0x7f4b0c14a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49658/0 (socket says 172.21.15.37:49658) 2023-11-24T06:16:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.296+0000 7f4b12591640 1 -- 172.21.15.37:0/963794909 learned_addr learned my addr 172.21.15.37:0/963794909 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b12591640 1 -- 172.21.15.37:0/963794909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b0c15d7d0 msgr2=0x7f4b0c14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b12591640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b0c15d7d0 0x7f4b0c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b12591640 1 -- 172.21.15.37:0/963794909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b0c15d3f0 msgr2=0x7f4b0c0b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b12591640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b0c15d3f0 0x7f4b0c0b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b12591640 1 -- 172.21.15.37:0/963794909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b08009a70 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b12591640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c0d0e40 0x7f4b0c14a490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4b08037040 tx=0x7f4b08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b02ffd640 1 -- 172.21.15.37:0/963794909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0803e610 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b02ffd640 1 -- 172.21.15.37:0/963794909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0803e7b0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b02ffd640 1 -- 172.21.15.37:0/963794909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0803eb60 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0cb710 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.297+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c0cbcd0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.299+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c04e840 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.300+0000 7f4b02ffd640 1 -- 172.21.15.37:0/963794909 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b0803b050 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.301+0000 7f4b02ffd640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4af006ae40 0x7f4af006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.301+0000 7f4b02ffd640 1 -- 172.21.15.37:0/963794909 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4b080abfb0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.301+0000 7f4b11d90640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4af006ae40 0x7f4af006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.302+0000 7f4b11d90640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4af006ae40 0x7f4af006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4afc006e80 tx=0x7f4afc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.305+0000 7f4b02ffd640 1 -- 172.21.15.37:0/963794909 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b08076ff0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.498+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b0c0d0bb0 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.499+0000 7f4b02ffd640 1 -- 172.21.15.37:0/963794909 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b0804e020 con 0x7f4b0c0d0e40 2023-11-24T06:16:26.502 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:16:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.501+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4af006ae40 msgr2=0x7f4af006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.501+0000 7f4b13593640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4af006ae40 0x7f4af006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4afc006e80 tx=0x7f4afc008040 comp rx=0 tx=0).stop 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.501+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c0d0e40 msgr2=0x7f4b0c14a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.501+0000 7f4b13593640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c0d0e40 0x7f4b0c14a490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4b08037040 tx=0x7f4b08004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 shutdown_connections 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4af006ae40 0x7f4af006d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b0c15d3f0 0x7f4b0c0b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b0c15d7d0 0x7f4b0c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 --2- 172.21.15.37:0/963794909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0c0d0e40 0x7f4b0c14a490 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 >> 172.21.15.37:0/963794909 conn(0x7f4b0c09c5b0 msgr2=0x7f4b0c160360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 shutdown_connections 2023-11-24T06:16:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.502+0000 7f4b13593640 1 -- 172.21.15.37:0/963794909 wait complete. 2023-11-24T06:16:26.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:16:26.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.751+0000 7f0c4e3ac640 1 Processor -- start 2023-11-24T06:16:26.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.751+0000 7f0c4e3ac640 1 -- start start 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4e3ac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0c48070ea0 0x7f0c480b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4e3ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c4806d640 0x7f0c4806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4e3ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4806df90 con 0x7f0c4815a1c0 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4e3ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c480cd920 con 0x7f0c4806d640 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4e3ac640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4815e580 con 0x7f0c48070ea0 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4d3aa640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0c4815a1c0 0x7f0c4815dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47734/0 (socket says 172.21.15.37:47734) 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4d3aa640 1 -- 172.21.15.37:0/562818717 learned_addr learned my addr 172.21.15.37:0/562818717 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.753+0000 7f0c4dbab640 1 --2- 172.21.15.37:0/562818717 >> v2:172.21.15.37:3300/0 conn(0x7f0c4806d640 0x7f0c4806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.754+0000 7f0c4cba9640 1 --2- 172.21.15.37:0/562818717 >> v2:172.21.15.188:3300/0 conn(0x7f0c48070ea0 0x7f0c480b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.754+0000 7f0c3ffff640 1 -- 172.21.15.37:0/562818717 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663421882 0 0) 0x7f0c4806df90 con 0x7f0c4815a1c0 2023-11-24T06:16:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.754+0000 7f0c3ffff640 1 -- 172.21.15.37:0/562818717 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c34003520 con 0x7f0c4815a1c0 2023-11-24T06:16:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.754+0000 7f0c4dbab640 1 -- 172.21.15.37:0/562818717 >> v2:172.21.15.188:3300/0 conn(0x7f0c48070ea0 msgr2=0x7f0c480b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.754+0000 7f0c4dbab640 1 --2- 172.21.15.37:0/562818717 >> v2:172.21.15.188:3300/0 conn(0x7f0c48070ea0 0x7f0c480b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.754+0000 7f0c4dbab640 1 -- 172.21.15.37:0/562818717 >> v1:172.21.15.37:6789/0 conn(0x7f0c4815a1c0 legacy=0x7f0c4815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.754+0000 7f0c4dbab640 1 -- 172.21.15.37:0/562818717 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4815e860 con 0x7f0c4806d640 2023-11-24T06:16:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.755+0000 7f0c4dbab640 1 --2- 172.21.15.37:0/562818717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c4806da50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c48070500 tx=0x7f0c4002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6570e31e176b0b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c3ffff640 1 -- 172.21.15.37:0/562818717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4002cd10 con 0x7f0c4806d640 2023-11-24T06:16:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c3ffff640 1 -- 172.21.15.37:0/562818717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4002ce70 con 0x7f0c4806d640 2023-11-24T06:16:26.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c3ffff640 1 -- 172.21.15.37:0/562818717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40034640 con 0x7f0c4806d640 2023-11-24T06:16:26.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/562818717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 msgr2=0x7f0c4806da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/562818717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c4806da50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c48070500 tx=0x7f0c4002bf60 comp rx=0 tx=0).stop 2023-11-24T06:16:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/562818717 shutdown_connections 2023-11-24T06:16:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/562818717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c4806da50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/562818717 >> v2:172.21.15.188:3300/0 conn(0x7f0c48070ea0 0x7f0c480b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.756+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/562818717 >> 172.21.15.37:0/562818717 conn(0x7f0c480cbb40 msgr2=0x7f0c480cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.757+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/562818717 shutdown_connections 2023-11-24T06:16:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.757+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/562818717 wait complete. 2023-11-24T06:16:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.758+0000 7f0c4e3ac640 1 Processor -- start 2023-11-24T06:16:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.759+0000 7f0c4e3ac640 1 -- start start 2023-11-24T06:16:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.759+0000 7f0c4e3ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c480c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.759+0000 7f0c4e3ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c48070ea0 0x7f0c48150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.759+0000 7f0c4e3ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c4815a1c0 0x7f0c480c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.759+0000 7f0c4e3ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48151cf0 con 0x7f0c4806d640 2023-11-24T06:16:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.759+0000 7f0c4e3ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c480c5640 con 0x7f0c4815a1c0 2023-11-24T06:16:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.759+0000 7f0c4e3ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c480b3fa0 con 0x7f0c48070ea0 2023-11-24T06:16:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c480c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c480c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49670/0 (socket says 172.21.15.37:49670) 2023-11-24T06:16:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 -- 172.21.15.37:0/3092649195 learned_addr learned my addr 172.21.15.37:0/3092649195 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4cba9640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c48070ea0 0x7f0c48150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4dbab640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c4815a1c0 0x7f0c480c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 -- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c48070ea0 msgr2=0x7f0c48150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c48070ea0 0x7f0c48150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 -- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c4815a1c0 msgr2=0x7f0c480c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c4815a1c0 0x7f0c480c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.760+0000 7f0c4d3aa640 1 -- 172.21.15.37:0/3092649195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40009a70 con 0x7f0c4806d640 2023-11-24T06:16:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.761+0000 7f0c4d3aa640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c480c5100 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c410 tx=0x7f0c4400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.761+0000 7f0c3dffb640 1 -- 172.21.15.37:0/3092649195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44005ce0 con 0x7f0c4806d640 2023-11-24T06:16:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.761+0000 7f0c3dffb640 1 -- 172.21.15.37:0/3092649195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44005e40 con 0x7f0c4806d640 2023-11-24T06:16:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.761+0000 7f0c3dffb640 1 -- 172.21.15.37:0/3092649195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c440072f0 con 0x7f0c4806d640 2023-11-24T06:16:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.761+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c480b4280 con 0x7f0c4806d640 2023-11-24T06:16:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.761+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4815ad00 con 0x7f0c4806d640 2023-11-24T06:16:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.762+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c480b44a0 con 0x7f0c4806d640 2023-11-24T06:16:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.763+0000 7f0c3dffb640 1 -- 172.21.15.37:0/3092649195 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c44007450 con 0x7f0c4806d640 2023-11-24T06:16:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.764+0000 7f0c3dffb640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c2c06ae40 0x7f0c2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.764+0000 7f0c3dffb640 1 -- 172.21.15.37:0/3092649195 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0c44088cb0 con 0x7f0c4806d640 2023-11-24T06:16:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.764+0000 7f0c4cba9640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c2c06ae40 0x7f0c2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.765+0000 7f0c4cba9640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c2c06ae40 0x7f0c2c06d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c480c5050 tx=0x7f0c38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:26.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.769+0000 7f0c3dffb640 1 -- 172.21.15.37:0/3092649195 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c44057850 con 0x7f0c4806d640 2023-11-24T06:16:26.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.976+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c4804e840 con 0x7f0c4806d640 2023-11-24T06:16:26.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.977+0000 7f0c3dffb640 1 -- 172.21.15.37:0/3092649195 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v41) v1 ==== 80+0+122 (secure 0 0 0) 0x7f0c44017080 con 0x7f0c4806d640 2023-11-24T06:16:26.980 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6836/3993737526 2023-11-25T06:16:18.597206+0000 2023-11-24T06:16:26.980 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6834/3993737526 2023-11-25T06:16:18.597206+0000 2023-11-24T06:16:26.980 INFO:teuthology.orchestra.run.smithi037.stderr:listed 2 entries 2023-11-24T06:16:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c2c06ae40 msgr2=0x7f0c2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c2c06ae40 0x7f0c2c06d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c480c5050 tx=0x7f0c38008040 comp rx=0 tx=0).stop 2023-11-24T06:16:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 msgr2=0x7f0c480c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c480c5100 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c410 tx=0x7f0c4400c8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 shutdown_connections 2023-11-24T06:16:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c2c06ae40 0x7f0c2c06d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c4815a1c0 0x7f0c480c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c48070ea0 0x7f0c48150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 --2- 172.21.15.37:0/3092649195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c4806d640 0x7f0c480c5100 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 >> 172.21.15.37:0/3092649195 conn(0x7f0c480cbb40 msgr2=0x7f0c480ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 shutdown_connections 2023-11-24T06:16:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:26.980+0000 7f0c4e3ac640 1 -- 172.21.15.37:0/3092649195 wait complete. 2023-11-24T06:16:27.003 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:16:27.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:27.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:16:27.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:16:27.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:16:27.124 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:16:27.175 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:16:27.175 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:27.240 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:16:27.240 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:16:27.241 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:27.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:16:27.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:27.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.532+0000 7f93f9b35640 1 Processor -- start 2023-11-24T06:16:27.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.532+0000 7f93f9b35640 1 -- start start 2023-11-24T06:16:27.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f9b35640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93f4144b30 0x7f93f415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f9b35640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f93f415c410 0x7f93f40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f9b35640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f415bf80 con 0x7f93f40b1de0 2023-11-24T06:16:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f9b35640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f40b1560 con 0x7f93f4144b30 2023-11-24T06:16:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f9b35640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f40b0fb0 con 0x7f93f415c410 2023-11-24T06:16:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f8b33640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93f4144b30 0x7f93f415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f8b33640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93f4144b30 0x7f93f415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49674/0 (socket says 172.21.15.37:49674) 2023-11-24T06:16:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.534+0000 7f93f8b33640 1 -- 172.21.15.37:0/423357044 learned_addr learned my addr 172.21.15.37:0/423357044 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.535+0000 7f93f3fff640 1 --2- 172.21.15.37:0/423357044 >> v2:172.21.15.188:3300/0 conn(0x7f93f415c410 0x7f93f40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.535+0000 7f93f8b33640 1 -- 172.21.15.37:0/423357044 >> v2:172.21.15.188:3300/0 conn(0x7f93f415c410 msgr2=0x7f93f40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.535+0000 7f93f8b33640 1 --2- 172.21.15.37:0/423357044 >> v2:172.21.15.188:3300/0 conn(0x7f93f415c410 0x7f93f40b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.535+0000 7f93f8b33640 1 -- 172.21.15.37:0/423357044 >> v1:172.21.15.188:6789/0 conn(0x7f93f40b1de0 legacy=0x7f93f406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.535+0000 7f93f8b33640 1 -- 172.21.15.37:0/423357044 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40b1280 con 0x7f93f4144b30 2023-11-24T06:16:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.536+0000 7f93f8b33640 1 --2- 172.21.15.37:0/423357044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f415f920 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f93f40cc7a0 tx=0x7f93e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4fa41c3a006575 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.536+0000 7f93f37fe640 1 -- 172.21.15.37:0/423357044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8031870 con 0x7f93f4144b30 2023-11-24T06:16:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.536+0000 7f93f37fe640 1 -- 172.21.15.37:0/423357044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e80319d0 con 0x7f93f4144b30 2023-11-24T06:16:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.536+0000 7f93f37fe640 1 -- 172.21.15.37:0/423357044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8031d60 con 0x7f93f4144b30 2023-11-24T06:16:27.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 -- 172.21.15.37:0/423357044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 msgr2=0x7f93f415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 --2- 172.21.15.37:0/423357044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f415f920 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f93f40cc7a0 tx=0x7f93e802b910 comp rx=0 tx=0).stop 2023-11-24T06:16:27.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 -- 172.21.15.37:0/423357044 shutdown_connections 2023-11-24T06:16:27.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 --2- 172.21.15.37:0/423357044 >> v2:172.21.15.188:3300/0 conn(0x7f93f415c410 0x7f93f40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 --2- 172.21.15.37:0/423357044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f415f920 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 -- 172.21.15.37:0/423357044 >> 172.21.15.37:0/423357044 conn(0x7f93f40cb830 msgr2=0x7f93f40cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:27.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 -- 172.21.15.37:0/423357044 shutdown_connections 2023-11-24T06:16:27.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.537+0000 7f93f9b35640 1 -- 172.21.15.37:0/423357044 wait complete. 2023-11-24T06:16:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.539+0000 7f93f9b35640 1 Processor -- start 2023-11-24T06:16:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.539+0000 7f93f9b35640 1 -- start start 2023-11-24T06:16:27.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.540+0000 7f93f9b35640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93f40b1de0 0x7f93f4160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.540+0000 7f93f9b35640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f4071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.540+0000 7f93f9b35640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93f415c410 0x7f93f41f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.540+0000 7f93f9b35640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4071870 con 0x7f93f4144b30 2023-11-24T06:16:27.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.540+0000 7f93f9b35640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41322a0 con 0x7f93f415c410 2023-11-24T06:16:27.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.540+0000 7f93f9b35640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41313b0 con 0x7f93f40b1de0 2023-11-24T06:16:27.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f4071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f4071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49686/0 (socket says 172.21.15.37:49686) 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 -- 172.21.15.37:0/2095851777 learned_addr learned my addr 172.21.15.37:0/2095851777 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f8b33640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93f40b1de0 0x7f93f4160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f9334640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93f415c410 0x7f93f41f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 -- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93f40b1de0 msgr2=0x7f93f4160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93f40b1de0 0x7f93f4160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 -- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93f415c410 msgr2=0x7f93f41f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93f415c410 0x7f93f41f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 -- 172.21.15.37:0/2095851777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80094d0 con 0x7f93f4144b30 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f9334640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93f415c410 0x7f93f41f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.541+0000 7f93f3fff640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f4071330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d5f0 tx=0x7f93e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.542+0000 7f93f17fa640 1 -- 172.21.15.37:0/2095851777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00125f0 con 0x7f93f4144b30 2023-11-24T06:16:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.542+0000 7f93f17fa640 1 -- 172.21.15.37:0/2095851777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e0012750 con 0x7f93f4144b30 2023-11-24T06:16:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.542+0000 7f93f17fa640 1 -- 172.21.15.37:0/2095851777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0012b00 con 0x7f93f4144b30 2023-11-24T06:16:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.542+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f4131690 con 0x7f93f4144b30 2023-11-24T06:16:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.542+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f4131c50 con 0x7f93f4144b30 2023-11-24T06:16:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.543+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f40b3610 con 0x7f93f4144b30 2023-11-24T06:16:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.544+0000 7f93f17fa640 1 -- 172.21.15.37:0/2095851777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93e0012c60 con 0x7f93f4144b30 2023-11-24T06:16:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.545+0000 7f93f17fa640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f93d806ae40 0x7f93d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.545+0000 7f93f17fa640 1 -- 172.21.15.37:0/2095851777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f93e0089ba0 con 0x7f93f4144b30 2023-11-24T06:16:27.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.545+0000 7f93f8b33640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f93d806ae40 0x7f93d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:27.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.546+0000 7f93f8b33640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f93d806ae40 0x7f93d806d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f93e8036000 tx=0x7f93e803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:27.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.550+0000 7f93f17fa640 1 -- 172.21.15.37:0/2095851777 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93f40b3610 con 0x7f93f4144b30 2023-11-24T06:16:27.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.782+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93f40b3610 con 0x7f93f4144b30 2023-11-24T06:16:27.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.783+0000 7f93f17fa640 1 -- 172.21.15.37:0/2095851777 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f93f40b3610 con 0x7f93f4144b30 2023-11-24T06:16:27.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:27.786 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/1178714141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1178714141},{"type":"v1","addr":"172.21.15.188:6834","nonce":1178714141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3045701683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":3045701683},{"type":"v1","addr":"172.21.15.37:6837","nonce":3045701683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5340,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/2712376439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2712376439},{"type":"v1","addr":"172.21.15.37:6836","nonce":2712376439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:01.307209+0000","modified":"2023-11-24T06:16:04.395591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.188:6835/1936445066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1936445066},{"type":"v1","addr":"172.21.15.188:6835","nonce":1936445066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:16:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-11-24T06:16:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f93d806ae40 msgr2=0x7f93d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f93d806ae40 0x7f93d806d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f93e8036000 tx=0x7f93e803c040 comp rx=0 tx=0).stop 2023-11-24T06:16:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 msgr2=0x7f93f4071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f4071330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d5f0 tx=0x7f93e000dab0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 shutdown_connections 2023-11-24T06:16:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f93d806ae40 0x7f93d806d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f93f415c410 0x7f93f41f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f4144b30 0x7f93f4071330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 --2- 172.21.15.37:0/2095851777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93f40b1de0 0x7f93f4160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 >> 172.21.15.37:0/2095851777 conn(0x7f93f40cb830 msgr2=0x7f93f415c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.786+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 shutdown_connections 2023-11-24T06:16:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:27.787+0000 7f93f9b35640 1 -- 172.21.15.37:0/2095851777 wait complete. 2023-11-24T06:16:27.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.028+0000 7f1161d16640 1 Processor -- start 2023-11-24T06:16:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.029+0000 7f1161d16640 1 -- start start 2023-11-24T06:16:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.030+0000 7f1161d16640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f115c15c7f0 0x7f115c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.030+0000 7f1161d16640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.030+0000 7f1161d16640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0cece0 con 0x7f115c0cf450 2023-11-24T06:16:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.030+0000 7f1161d16640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c0cfe40 con 0x7f115c15c7f0 2023-11-24T06:16:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.030+0000 7f1161d16640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c156010 con 0x7f115c0ce6c0 2023-11-24T06:16:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.031+0000 7f115bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.031+0000 7f115b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f115c15c7f0 0x7f115c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.031+0000 7f115b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f115c15c7f0 0x7f115c06db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:40746/0 (socket says 172.21.15.37:40746) 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.031+0000 7f115b7fe640 1 -- 172.21.15.37:0/2513913272 learned_addr learned my addr 172.21.15.37:0/2513913272 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.031+0000 7f115bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:59630/0 (socket says 172.21.15.37:59630) 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.032+0000 7f115b7fe640 1 -- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 msgr2=0x7f115c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.032+0000 7f115b7fe640 1 --2- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.032+0000 7f115b7fe640 1 -- 172.21.15.37:0/2513913272 >> v1:172.21.15.188:6789/0 conn(0x7f115c0cf450 legacy=0x7f115c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.032+0000 7f115b7fe640 1 -- 172.21.15.37:0/2513913272 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c06d040 con 0x7f115c15c7f0 2023-11-24T06:16:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.032+0000 7f115bfff640 1 --2- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:16:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.033+0000 7f115b7fe640 1 --2- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c15c7f0 0x7f115c06db20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f114c009870 tx=0x7f114c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=161ad93120e7337d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.034+0000 7f115a7fc640 1 -- 172.21.15.37:0/2513913272 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c030840 con 0x7f115c15c7f0 2023-11-24T06:16:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.034+0000 7f115a7fc640 1 -- 172.21.15.37:0/2513913272 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c0309a0 con 0x7f115c15c7f0 2023-11-24T06:16:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.034+0000 7f115a7fc640 1 -- 172.21.15.37:0/2513913272 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c030d30 con 0x7f115c15c7f0 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 -- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c15c7f0 msgr2=0x7f115c06db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 --2- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c15c7f0 0x7f115c06db20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f114c009870 tx=0x7f114c02b980 comp rx=0 tx=0).stop 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 -- 172.21.15.37:0/2513913272 shutdown_connections 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 --2- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 --2- 172.21.15.37:0/2513913272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c15c7f0 0x7f115c06db20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 -- 172.21.15.37:0/2513913272 >> 172.21.15.37:0/2513913272 conn(0x7f115c06a920 msgr2=0x7f115c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 -- 172.21.15.37:0/2513913272 shutdown_connections 2023-11-24T06:16:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.035+0000 7f1161d16640 1 -- 172.21.15.37:0/2513913272 wait complete. 2023-11-24T06:16:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.037+0000 7f1161d16640 1 Processor -- start 2023-11-24T06:16:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.037+0000 7f1161d16640 1 -- start start 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f1161d16640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f1161d16640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c0cf450 0x7f115c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f1161d16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f115c15c7f0 0x7f115c0ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f1161d16640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0ac060 con 0x7f115c15c7f0 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f1161d16640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0ac300 con 0x7f115c0cf450 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f1161d16640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0ac5e0 con 0x7f115c0ce6c0 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f115bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f115c15c7f0 0x7f115c0ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f115bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f115c15c7f0 0x7f115c0ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49696/0 (socket says 172.21.15.37:49696) 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f115bfff640 1 -- 172.21.15.37:0/3373037424 learned_addr learned my addr 172.21.15.37:0/3373037424 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.038+0000 7f115b7fe640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f115affd640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c0cf450 0x7f115c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f115bfff640 1 -- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 msgr2=0x7f115c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f115bfff640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f115bfff640 1 -- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c0cf450 msgr2=0x7f115c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f115bfff640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c0cf450 0x7f115c151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f115bfff640 1 -- 172.21.15.37:0/3373037424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154009a70 con 0x7f115c15c7f0 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f115bfff640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f115c15c7f0 0x7f115c0ac960 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f115400efc0 tx=0x7f115400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f1143fff640 1 -- 172.21.15.37:0/3373037424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154009cc0 con 0x7f115c15c7f0 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f1143fff640 1 -- 172.21.15.37:0/3373037424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115400f040 con 0x7f115c15c7f0 2023-11-24T06:16:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f1143fff640 1 -- 172.21.15.37:0/3373037424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154003990 con 0x7f115c15c7f0 2023-11-24T06:16:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.039+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c0094d0 con 0x7f115c15c7f0 2023-11-24T06:16:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.040+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c0b2ac0 con 0x7f115c15c7f0 2023-11-24T06:16:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.041+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115c0b3010 con 0x7f115c15c7f0 2023-11-24T06:16:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.042+0000 7f1143fff640 1 -- 172.21.15.37:0/3373037424 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1154014480 con 0x7f115c15c7f0 2023-11-24T06:16:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.043+0000 7f1143fff640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f114806ae40 0x7f114806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.043+0000 7f1143fff640 1 -- 172.21.15.37:0/3373037424 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f115408a300 con 0x7f115c15c7f0 2023-11-24T06:16:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.043+0000 7f115b7fe640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f114806ae40 0x7f114806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.045+0000 7f115b7fe640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f114806ae40 0x7f114806d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f114c036000 tx=0x7f114c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.047+0000 7f1143fff640 1 -- 172.21.15.37:0/3373037424 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f115c0b3010 con 0x7f115c15c7f0 2023-11-24T06:16:28.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.243+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f115c0b3010 con 0x7f115c15c7f0 2023-11-24T06:16:28.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.244+0000 7f1143fff640 1 -- 172.21.15.37:0/3373037424 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f115c0b3010 con 0x7f115c15c7f0 2023-11-24T06:16:28.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:28.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:21.608455+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6836/3993737526":"2023-11-25T06:16:18.597206+0000","172.21.15.37:6834/3993737526":"2023-11-25T06:16:18.597206+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f114806ae40 msgr2=0x7f114806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f114806ae40 0x7f114806d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f114c036000 tx=0x7f114c03b040 comp rx=0 tx=0).stop 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f115c15c7f0 msgr2=0x7f115c0ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f115c15c7f0 0x7f115c0ac960 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f115400efc0 tx=0x7f115400c490 comp rx=0 tx=0).stop 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 shutdown_connections 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f114806ae40 0x7f114806d300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f115c0cf450 0x7f115c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f115c15c7f0 0x7f115c0ac960 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 --2- 172.21.15.37:0/3373037424 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f115c0ce6c0 0x7f115c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 >> 172.21.15.37:0/3373037424 conn(0x7f115c06a920 msgr2=0x7f115c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 shutdown_connections 2023-11-24T06:16:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.247+0000 7f1161d16640 1 -- 172.21.15.37:0/3373037424 wait complete. 2023-11-24T06:16:28.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:15:59.353546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:00.332854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:28.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.497+0000 7f6fbdbd5640 1 Processor -- start 2023-11-24T06:16:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.497+0000 7f6fbdbd5640 1 -- start start 2023-11-24T06:16:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.498+0000 7f6fbdbd5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6fb80ccbd0 0x7f6fb81660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.498+0000 7f6fbdbd5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb80c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.498+0000 7f6fbdbd5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb81655f0 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.498+0000 7f6fbdbd5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb80cc380 con 0x7f6fb80ccbd0 2023-11-24T06:16:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.498+0000 7f6fbdbd5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8162b30 con 0x7f6fb80c9650 2023-11-24T06:16:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.499+0000 7f6fb7fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb80c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.499+0000 7f6fb77fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6fb80ccbd0 0x7f6fb81660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.499+0000 7f6fb7fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb80c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:59652/0 (socket says 172.21.15.37:59652) 2023-11-24T06:16:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.499+0000 7f6fb7fff640 1 -- 172.21.15.37:0/3236728755 learned_addr learned my addr 172.21.15.37:0/3236728755 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.500+0000 7f6fb77fe640 1 -- 172.21.15.37:0/3236728755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 msgr2=0x7f6fb80c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.500+0000 7f6fb77fe640 1 --2- 172.21.15.37:0/3236728755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb80c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.500+0000 7f6fb77fe640 1 -- 172.21.15.37:0/3236728755 >> v1:172.21.15.188:6789/0 conn(0x7f6fb80ccfb0 legacy=0x7f6fb8162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.500+0000 7f6fb77fe640 1 -- 172.21.15.37:0/3236728755 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb8162e10 con 0x7f6fb80ccbd0 2023-11-24T06:16:28.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.501+0000 7f6fb77fe640 1 --2- 172.21.15.37:0/3236728755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb81660b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80097a0 tx=0x7f6fa802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c0fbc1e69d0bd39 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.502+0000 7f6fb67fc640 1 -- 172.21.15.37:0/3236728755 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa802d040 con 0x7f6fb80ccbd0 2023-11-24T06:16:28.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.502+0000 7f6fb67fc640 1 -- 172.21.15.37:0/3236728755 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8031810 con 0x7f6fb80ccbd0 2023-11-24T06:16:28.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.502+0000 7f6fb67fc640 1 -- 172.21.15.37:0/3236728755 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8031ba0 con 0x7f6fb80ccbd0 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3236728755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 msgr2=0x7f6fb81660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3236728755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb81660b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80097a0 tx=0x7f6fa802b8b0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3236728755 shutdown_connections 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3236728755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb80c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3236728755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb81660b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3236728755 >> 172.21.15.37:0/3236728755 conn(0x7f6fb80b0c50 msgr2=0x7f6fb80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3236728755 shutdown_connections 2023-11-24T06:16:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.503+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3236728755 wait complete. 2023-11-24T06:16:28.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.505+0000 7f6fbdbd5640 1 Processor -- start 2023-11-24T06:16:28.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.505+0000 7f6fbdbd5640 1 -- start start 2023-11-24T06:16:28.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fbdbd5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb8158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fbdbd5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb80c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fbdbd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb80ccfb0 0x7f6fb80c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fbdbd5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80ac580 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fbdbd5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80711b0 con 0x7f6fb80ccbd0 2023-11-24T06:16:28.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fbdbd5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8071490 con 0x7f6fb80c9650 2023-11-24T06:16:28.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb80ccfb0 0x7f6fb80c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb80ccfb0 0x7f6fb80c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49702/0 (socket says 172.21.15.37:49702) 2023-11-24T06:16:28.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.506+0000 7f6fb7fff640 1 -- 172.21.15.37:0/3725586045 learned_addr learned my addr 172.21.15.37:0/3725586045 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb77fe640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb8158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb6ffd640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb80c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb7fff640 1 -- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 msgr2=0x7f6fb8158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb7fff640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb8158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb7fff640 1 -- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 msgr2=0x7f6fb80c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb7fff640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb80c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb7fff640 1 -- 172.21.15.37:0/3725586045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8009400 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb6ffd640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb80c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.507+0000 7f6fb7fff640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb80ccfb0 0x7f6fb80c5450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000e870 tx=0x7f6fb000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.508+0000 7f6faffff640 1 -- 172.21.15.37:0/3725586045 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000ee60 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.508+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80abf30 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.508+0000 7f6faffff640 1 -- 172.21.15.37:0/3725586045 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000c940 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.508+0000 7f6faffff640 1 -- 172.21.15.37:0/3725586045 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000ccf0 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.508+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb8158c40 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.509+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb80ac730 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.510+0000 7f6faffff640 1 -- 172.21.15.37:0/3725586045 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6fb0013470 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.511+0000 7f6faffff640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6f9806ae40 0x7f6f9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.511+0000 7f6faffff640 1 -- 172.21.15.37:0/3725586045 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6fb0089bd0 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.511+0000 7f6fb77fe640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6f9806ae40 0x7f6f9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.512+0000 7f6fb77fe640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6f9806ae40 0x7f6f9806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8036000 tx=0x7f6fa803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.515+0000 7f6faffff640 1 -- 172.21.15.37:0/3725586045 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6fb80ac730 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.710+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fb80ac730 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.711+0000 7f6faffff640 1 -- 172.21.15.37:0/3725586045 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fb80ac730 con 0x7f6fb80ccfb0 2023-11-24T06:16:28.714 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:16:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6f9806ae40 msgr2=0x7f6f9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6f9806ae40 0x7f6f9806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8036000 tx=0x7f6fa803c040 comp rx=0 tx=0).stop 2023-11-24T06:16:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb80ccfb0 msgr2=0x7f6fb80c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb80ccfb0 0x7f6fb80c5450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000e870 tx=0x7f6fb000ed30 comp rx=0 tx=0).stop 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 shutdown_connections 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6f9806ae40 0x7f6f9806d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fb80ccbd0 0x7f6fb80c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb80ccfb0 0x7f6fb80c5450 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 --2- 172.21.15.37:0/3725586045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fb80c9650 0x7f6fb8158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 >> 172.21.15.37:0/3725586045 conn(0x7f6fb80b0c50 msgr2=0x7f6fb806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 shutdown_connections 2023-11-24T06:16:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.714+0000 7f6fbdbd5640 1 -- 172.21.15.37:0/3725586045 wait complete. 2023-11-24T06:16:28.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:16:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.960+0000 7f81fb9d5640 1 Processor -- start 2023-11-24T06:16:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.960+0000 7f81fb9d5640 1 -- start start 2023-11-24T06:16:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.961+0000 7f81fb9d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81f415b440 0x7f81f40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.961+0000 7f81fb9d5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.961+0000 7f81fb9d5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f415eea0 con 0x7f81f40cbf20 2023-11-24T06:16:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.961+0000 7f81fb9d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40c5e00 con 0x7f81f415b440 2023-11-24T06:16:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81fb9d5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40cc3d0 con 0x7f81f40c59b0 2023-11-24T06:16:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9771640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81f415b440 0x7f81f40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9771640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81f415b440 0x7f81f40cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49704/0 (socket says 172.21.15.37:49704) 2023-11-24T06:16:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9771640 1 -- 172.21.15.37:0/4200258177 learned_addr learned my addr 172.21.15.37:0/4200258177 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9f72640 1 --2- 172.21.15.37:0/4200258177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9771640 1 -- 172.21.15.37:0/4200258177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 msgr2=0x7f81f406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9771640 1 --2- 172.21.15.37:0/4200258177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f406c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9771640 1 -- 172.21.15.37:0/4200258177 >> v1:172.21.15.188:6789/0 conn(0x7f81f40cbf20 legacy=0x7f81f40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.962+0000 7f81f9771640 1 -- 172.21.15.37:0/4200258177 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40abf30 con 0x7f81f415b440 2023-11-24T06:16:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.964+0000 7f81f9771640 1 --2- 172.21.15.37:0/4200258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f40cb9e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f128a92f846af9c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.964+0000 7f81ebfff640 1 -- 172.21.15.37:0/4200258177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f00317c0 con 0x7f81f415b440 2023-11-24T06:16:28.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.964+0000 7f81ebfff640 1 -- 172.21.15.37:0/4200258177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f0031920 con 0x7f81f415b440 2023-11-24T06:16:28.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.964+0000 7f81ebfff640 1 -- 172.21.15.37:0/4200258177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0031cb0 con 0x7f81f415b440 2023-11-24T06:16:28.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 -- 172.21.15.37:0/4200258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 msgr2=0x7f81f40cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/4200258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f40cb9e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002b860 comp rx=0 tx=0).stop 2023-11-24T06:16:28.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 -- 172.21.15.37:0/4200258177 shutdown_connections 2023-11-24T06:16:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/4200258177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/4200258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f40cb9e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 -- 172.21.15.37:0/4200258177 >> 172.21.15.37:0/4200258177 conn(0x7f81f40b0c50 msgr2=0x7f81f40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 -- 172.21.15.37:0/4200258177 shutdown_connections 2023-11-24T06:16:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.965+0000 7f81fb9d5640 1 -- 172.21.15.37:0/4200258177 wait complete. 2023-11-24T06:16:28.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.967+0000 7f81fb9d5640 1 Processor -- start 2023-11-24T06:16:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.968+0000 7f81fb9d5640 1 -- start start 2023-11-24T06:16:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81fb9d5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f409a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81fb9d5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81f40cbf20 0x7f81f415d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81fb9d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f4155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81fb9d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f409a8d0 con 0x7f81f415b440 2023-11-24T06:16:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81fb9d5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f409b2d0 con 0x7f81f40cbf20 2023-11-24T06:16:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81fb9d5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f409b5b0 con 0x7f81f40c59b0 2023-11-24T06:16:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81f9f72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f4155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81f9f72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f4155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49714/0 (socket says 172.21.15.37:49714) 2023-11-24T06:16:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.969+0000 7f81f9f72640 1 -- 172.21.15.37:0/1674741709 learned_addr learned my addr 172.21.15.37:0/1674741709 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f9771640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f409a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f8f70640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81f40cbf20 0x7f81f415d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f9f72640 1 -- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 msgr2=0x7f81f409a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f9f72640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f409a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f9f72640 1 -- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81f40cbf20 msgr2=0x7f81f415d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:28.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f9f72640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81f40cbf20 0x7f81f415d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:28.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f9f72640 1 -- 172.21.15.37:0/1674741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00094d0 con 0x7f81f415b440 2023-11-24T06:16:28.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81f9f72640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f4155660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00cd70 tx=0x7f81ec00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.970+0000 7f81e9ffb640 1 -- 172.21.15.37:0/1674741709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec003b90 con 0x7f81f415b440 2023-11-24T06:16:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.971+0000 7f81e9ffb640 1 -- 172.21.15.37:0/1674741709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec003cf0 con 0x7f81f415b440 2023-11-24T06:16:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.971+0000 7f81e9ffb640 1 -- 172.21.15.37:0/1674741709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec004240 con 0x7f81f415b440 2023-11-24T06:16:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.971+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f409b890 con 0x7f81f415b440 2023-11-24T06:16:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.971+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f415d8c0 con 0x7f81f415b440 2023-11-24T06:16:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.972+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f404e8b0 con 0x7f81f415b440 2023-11-24T06:16:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.973+0000 7f81e9ffb640 1 -- 172.21.15.37:0/1674741709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81ec0043a0 con 0x7f81f415b440 2023-11-24T06:16:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.974+0000 7f81e9ffb640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f81d806ae40 0x7f81d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.974+0000 7f81e9ffb640 1 -- 172.21.15.37:0/1674741709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f81ec012070 con 0x7f81f415b440 2023-11-24T06:16:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.974+0000 7f81f9771640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f81d806ae40 0x7f81d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.975+0000 7f81f9771640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f81d806ae40 0x7f81d806d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81f0036000 tx=0x7f81f003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:28.978+0000 7f81e9ffb640 1 -- 172.21.15.37:0/1674741709 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81ec0550b0 con 0x7f81f415b440 2023-11-24T06:16:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.170+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81f406dc80 con 0x7f81f415b440 2023-11-24T06:16:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.172+0000 7f81e9ffb640 1 -- 172.21.15.37:0/1674741709 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81ec0586d0 con 0x7f81f415b440 2023-11-24T06:16:29.175 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:16:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f81d806ae40 msgr2=0x7f81d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f81d806ae40 0x7f81d806d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81f0036000 tx=0x7f81f003d040 comp rx=0 tx=0).stop 2023-11-24T06:16:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 msgr2=0x7f81f4155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f4155660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00cd70 tx=0x7f81ec00a660 comp rx=0 tx=0).stop 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 shutdown_connections 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f81d806ae40 0x7f81d806d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81f40cbf20 0x7f81f415d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f415b440 0x7f81f4155660 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 --2- 172.21.15.37:0/1674741709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81f40c59b0 0x7f81f409a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.174+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 >> 172.21.15.37:0/1674741709 conn(0x7f81f40b0c50 msgr2=0x7f81f40cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.175+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 shutdown_connections 2023-11-24T06:16:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.175+0000 7f81fb9d5640 1 -- 172.21.15.37:0/1674741709 wait complete. 2023-11-24T06:16:29.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:16:29.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.429+0000 7fee85c13640 1 Processor -- start 2023-11-24T06:16:29.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.429+0000 7fee85c13640 1 -- start start 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85c13640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85c13640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fee800b2200 0x7fee80072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85c13640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee80072570 0x7fee8015f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85c13640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800cf020 con 0x7fee80072570 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85c13640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee80072980 con 0x7fee800b2200 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85c13640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8015bbc0 con 0x7fee80144ae0 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85412640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee80072570 0x7fee8015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85412640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee80072570 0x7fee8015f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49726/0 (socket says 172.21.15.37:49726) 2023-11-24T06:16:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.431+0000 7fee85412640 1 -- 172.21.15.37:0/3220729675 learned_addr learned my addr 172.21.15.37:0/3220729675 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:29.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee84c11640 1 --2- 172.21.15.37:0/3220729675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee77fff640 1 --2- 172.21.15.37:0/3220729675 >> v2:172.21.15.188:3300/0 conn(0x7fee800b2200 0x7fee80072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee85412640 1 -- 172.21.15.37:0/3220729675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 msgr2=0x7fee800ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:29.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee85412640 1 --2- 172.21.15.37:0/3220729675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee85412640 1 -- 172.21.15.37:0/3220729675 >> v2:172.21.15.188:3300/0 conn(0x7fee800b2200 msgr2=0x7fee80072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:29.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee85412640 1 --2- 172.21.15.37:0/3220729675 >> v2:172.21.15.188:3300/0 conn(0x7fee800b2200 0x7fee80072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee85412640 1 -- 172.21.15.37:0/3220729675 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8015bea0 con 0x7fee80072570 2023-11-24T06:16:29.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee84c11640 1 --2- 172.21.15.37:0/3220729675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:29.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.432+0000 7fee77fff640 1 --2- 172.21.15.37:0/3220729675 >> v2:172.21.15.188:3300/0 conn(0x7fee800b2200 0x7fee80072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:29.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.433+0000 7fee85412640 1 --2- 172.21.15.37:0/3220729675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee8015f140 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fee8006b570 tx=0x7fee7802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65ec1f6b4a83ea8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.433+0000 7fee777fe640 1 -- 172.21.15.37:0/3220729675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780317d0 con 0x7fee80072570 2023-11-24T06:16:29.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.433+0000 7fee777fe640 1 -- 172.21.15.37:0/3220729675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee78031930 con 0x7fee80072570 2023-11-24T06:16:29.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.433+0000 7fee777fe640 1 -- 172.21.15.37:0/3220729675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78031cc0 con 0x7fee80072570 2023-11-24T06:16:29.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 -- 172.21.15.37:0/3220729675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 msgr2=0x7fee8015f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 --2- 172.21.15.37:0/3220729675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee8015f140 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fee8006b570 tx=0x7fee7802b870 comp rx=0 tx=0).stop 2023-11-24T06:16:29.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 -- 172.21.15.37:0/3220729675 shutdown_connections 2023-11-24T06:16:29.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 --2- 172.21.15.37:0/3220729675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee8015f140 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 --2- 172.21.15.37:0/3220729675 >> v2:172.21.15.188:3300/0 conn(0x7fee800b2200 0x7fee80072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 --2- 172.21.15.37:0/3220729675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 -- 172.21.15.37:0/3220729675 >> 172.21.15.37:0/3220729675 conn(0x7fee8006d6c0 msgr2=0x7fee8006daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 -- 172.21.15.37:0/3220729675 shutdown_connections 2023-11-24T06:16:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.434+0000 7fee85c13640 1 -- 172.21.15.37:0/3220729675 wait complete. 2023-11-24T06:16:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.436+0000 7fee85c13640 1 Processor -- start 2023-11-24T06:16:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.436+0000 7fee85c13640 1 -- start start 2023-11-24T06:16:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee85c13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee801e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee85c13640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee800b2200 0x7fee801e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee85c13640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee85c13640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801e7200 con 0x7fee80072570 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee85c13640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801e81f0 con 0x7fee800b2200 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee85c13640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee801e6f20 con 0x7fee80144ae0 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee84c11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee801e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee84c11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee801e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49734/0 (socket says 172.21.15.37:49734) 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.437+0000 7fee84c11640 1 -- 172.21.15.37:0/1008933153 learned_addr learned my addr 172.21.15.37:0/1008933153 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee85412640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee77fff640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee800b2200 0x7fee801e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee84c11640 1 -- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 msgr2=0x7fee800b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee84c11640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee84c11640 1 -- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee800b2200 msgr2=0x7fee801e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee84c11640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee800b2200 0x7fee801e7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee84c11640 1 -- 172.21.15.37:0/1008933153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780094d0 con 0x7fee80072570 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee85412640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee77fff640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee800b2200 0x7fee801e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.438+0000 7fee84c11640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee801e6910 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00cf60 tx=0x7fee7c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.439+0000 7fee757fa640 1 -- 172.21.15.37:0/1008933153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00d840 con 0x7fee80072570 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.439+0000 7fee757fa640 1 -- 172.21.15.37:0/1008933153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c00d9a0 con 0x7fee80072570 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.439+0000 7fee757fa640 1 -- 172.21.15.37:0/1008933153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00dd30 con 0x7fee80072570 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.439+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8015ca80 con 0x7fee80072570 2023-11-24T06:16:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.439+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8015d040 con 0x7fee80072570 2023-11-24T06:16:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.440+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8015d260 con 0x7fee80072570 2023-11-24T06:16:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.441+0000 7fee757fa640 1 -- 172.21.15.37:0/1008933153 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee7c015440 con 0x7fee80072570 2023-11-24T06:16:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.442+0000 7fee757fa640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee6c06ae40 0x7fee6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.442+0000 7fee757fa640 1 -- 172.21.15.37:0/1008933153 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fee7c08a040 con 0x7fee80072570 2023-11-24T06:16:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.442+0000 7fee77fff640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee6c06ae40 0x7fee6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.443+0000 7fee77fff640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee6c06ae40 0x7fee6c06d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fee801e6e50 tx=0x7fee70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.446+0000 7fee757fa640 1 -- 172.21.15.37:0/1008933153 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee7c0bce90 con 0x7fee80072570 2023-11-24T06:16:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.646+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee8004e840 con 0x7fee80072570 2023-11-24T06:16:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.647+0000 7fee757fa640 1 -- 172.21.15.37:0/1008933153 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee7c01a0a0 con 0x7fee80072570 2023-11-24T06:16:29.651 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:16:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.649+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee6c06ae40 msgr2=0x7fee6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.649+0000 7fee85c13640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee6c06ae40 0x7fee6c06d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fee801e6e50 tx=0x7fee70008040 comp rx=0 tx=0).stop 2023-11-24T06:16:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.649+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 msgr2=0x7fee801e6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.649+0000 7fee85c13640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee801e6910 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00cf60 tx=0x7fee7c00cf90 comp rx=0 tx=0).stop 2023-11-24T06:16:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 shutdown_connections 2023-11-24T06:16:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee6c06ae40 0x7fee6c06d300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee800b2200 0x7fee801e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee80144ae0 0x7fee800b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 --2- 172.21.15.37:0/1008933153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee80072570 0x7fee801e6910 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 >> 172.21.15.37:0/1008933153 conn(0x7fee8006d6c0 msgr2=0x7fee800b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 shutdown_connections 2023-11-24T06:16:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.650+0000 7fee85c13640 1 -- 172.21.15.37:0/1008933153 wait complete. 2023-11-24T06:16:29.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.892+0000 7fe48759e640 1 Processor -- start 2023-11-24T06:16:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.892+0000 7fe48759e640 1 -- start start 2023-11-24T06:16:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.893+0000 7fe48759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe48815eb20 0x7fe4880cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.893+0000 7fe48759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe48806f840 0x7fe4880cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.893+0000 7fe48759e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880ceba0 con 0x7fe4880cf6a0 2023-11-24T06:16:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.893+0000 7fe48759e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48815ef00 con 0x7fe48815eb20 2023-11-24T06:16:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.893+0000 7fe48759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880d0090 con 0x7fe48806f840 2023-11-24T06:16:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.894+0000 7fe486d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe48806f840 0x7fe4880cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.894+0000 7fe48659c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe48815eb20 0x7fe4880cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.894+0000 7fe48659c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe48815eb20 0x7fe4880cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:40818/0 (socket says 172.21.15.37:40818) 2023-11-24T06:16:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.894+0000 7fe48659c640 1 -- 172.21.15.37:0/3005592724 learned_addr learned my addr 172.21.15.37:0/3005592724 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.895+0000 7fe48659c640 1 -- 172.21.15.37:0/3005592724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe48806f840 msgr2=0x7fe4880cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.895+0000 7fe48659c640 1 --2- 172.21.15.37:0/3005592724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe48806f840 0x7fe4880cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.895+0000 7fe48659c640 1 -- 172.21.15.37:0/3005592724 >> v1:172.21.15.188:6789/0 conn(0x7fe4880cf6a0 legacy=0x7fe4880cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.895+0000 7fe48659c640 1 -- 172.21.15.37:0/3005592724 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880b0070 con 0x7fe48815eb20 2023-11-24T06:16:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.896+0000 7fe48659c640 1 --2- 172.21.15.37:0/3005592724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe4880cf160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe478009e50 tx=0x7fe47802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=968b809d67262bfe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.897+0000 7fe48559a640 1 -- 172.21.15.37:0/3005592724 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47802cb00 con 0x7fe48815eb20 2023-11-24T06:16:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.897+0000 7fe48559a640 1 -- 172.21.15.37:0/3005592724 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47802cc60 con 0x7fe48815eb20 2023-11-24T06:16:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.897+0000 7fe48559a640 1 -- 172.21.15.37:0/3005592724 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780343f0 con 0x7fe48815eb20 2023-11-24T06:16:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 -- 172.21.15.37:0/3005592724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 msgr2=0x7fe4880cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 --2- 172.21.15.37:0/3005592724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe4880cf160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe478009e50 tx=0x7fe47802bf60 comp rx=0 tx=0).stop 2023-11-24T06:16:29.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 -- 172.21.15.37:0/3005592724 shutdown_connections 2023-11-24T06:16:29.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 --2- 172.21.15.37:0/3005592724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe48806f840 0x7fe4880cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 --2- 172.21.15.37:0/3005592724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe4880cf160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 -- 172.21.15.37:0/3005592724 >> 172.21.15.37:0/3005592724 conn(0x7fe4880cda50 msgr2=0x7fe4880cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:29.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 -- 172.21.15.37:0/3005592724 shutdown_connections 2023-11-24T06:16:29.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.898+0000 7fe48759e640 1 -- 172.21.15.37:0/3005592724 wait complete. 2023-11-24T06:16:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.900+0000 7fe48759e640 1 Processor -- start 2023-11-24T06:16:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.901+0000 7fe48759e640 1 -- start start 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48806f840 0x7fe48815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4880cf6a0 0x7fe48814ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe48814bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48814cb60 con 0x7fe48806f840 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48814f6b0 con 0x7fe48815eb20 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48814f990 con 0x7fe4880cf6a0 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48806f840 0x7fe48815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48806f840 0x7fe48815cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49750/0 (socket says 172.21.15.37:49750) 2023-11-24T06:16:29.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.902+0000 7fe48659c640 1 -- 172.21.15.37:0/201556228 learned_addr learned my addr 172.21.15.37:0/201556228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe486d9d640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe48814bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe485d9b640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4880cf6a0 0x7fe48814ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe48659c640 1 -- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4880cf6a0 msgr2=0x7fe48814ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe48659c640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4880cf6a0 0x7fe48814ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe48659c640 1 -- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 msgr2=0x7fe48814bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe48659c640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe48814bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe48659c640 1 -- 172.21.15.37:0/201556228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478009b30 con 0x7fe48806f840 2023-11-24T06:16:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe486d9d640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe48814bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe485d9b640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4880cf6a0 0x7fe48814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe48659c640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48806f840 0x7fe48815cca0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe478000f80 tx=0x7fe478004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.903+0000 7fe47effd640 1 -- 172.21.15.37:0/201556228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47803e450 con 0x7fe48806f840 2023-11-24T06:16:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.904+0000 7fe47effd640 1 -- 172.21.15.37:0/201556228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47803e5d0 con 0x7fe48806f840 2023-11-24T06:16:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.904+0000 7fe47effd640 1 -- 172.21.15.37:0/201556228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47803e980 con 0x7fe48806f840 2023-11-24T06:16:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.904+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48814cd70 con 0x7fe48806f840 2023-11-24T06:16:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.904+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48815dd30 con 0x7fe48806f840 2023-11-24T06:16:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.905+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48814d230 con 0x7fe48806f840 2023-11-24T06:16:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.906+0000 7fe47effd640 1 -- 172.21.15.37:0/201556228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe47803eae0 con 0x7fe48806f840 2023-11-24T06:16:29.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.907+0000 7fe47effd640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe46806ae40 0x7fe46806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:29.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.908+0000 7fe47effd640 1 -- 172.21.15.37:0/201556228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe4780ac280 con 0x7fe48806f840 2023-11-24T06:16:29.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.908+0000 7fe485d9b640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe46806ae40 0x7fe46806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.909+0000 7fe485d9b640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe46806ae40 0x7fe46806d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe4880c8050 tx=0x7fe470009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:29.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:29.914+0000 7fe47effd640 1 -- 172.21.15.37:0/201556228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe478077360 con 0x7fe48806f840 2023-11-24T06:16:30.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.152+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe48804e840 con 0x7fe48806f840 2023-11-24T06:16:30.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.153+0000 7fe47effd640 1 -- 172.21.15.37:0/201556228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fe47807a980 con 0x7fe48806f840 2023-11-24T06:16:30.157 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:30.157 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/1178714141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1178714141},{"type":"v1","addr":"172.21.15.188:6834","nonce":1178714141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3045701683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":3045701683},{"type":"v1","addr":"172.21.15.37:6837","nonce":3045701683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5340,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/2712376439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2712376439},{"type":"v1","addr":"172.21.15.37:6836","nonce":2712376439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:01.307209+0000","modified":"2023-11-24T06:16:04.395591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.188:6835/1936445066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1936445066},{"type":"v1","addr":"172.21.15.188:6835","nonce":1936445066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:16:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-11-24T06:16:30.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe46806ae40 msgr2=0x7fe46806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe46806ae40 0x7fe46806d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe4880c8050 tx=0x7fe470009040 comp rx=0 tx=0).stop 2023-11-24T06:16:30.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48806f840 msgr2=0x7fe48815cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48806f840 0x7fe48815cca0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe478000f80 tx=0x7fe478004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 shutdown_connections 2023-11-24T06:16:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe46806ae40 0x7fe46806d300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe48815eb20 0x7fe48814bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4880cf6a0 0x7fe48814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 --2- 172.21.15.37:0/201556228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48806f840 0x7fe48815cca0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.156+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 >> 172.21.15.37:0/201556228 conn(0x7fe4880cda50 msgr2=0x7fe4880aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.157+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 shutdown_connections 2023-11-24T06:16:30.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.157+0000 7fe48759e640 1 -- 172.21.15.37:0/201556228 wait complete. 2023-11-24T06:16:30.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.407+0000 7f050dd21640 1 Processor -- start 2023-11-24T06:16:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.408+0000 7f050dd21640 1 -- start start 2023-11-24T06:16:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.409+0000 7f050dd21640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f050815d4e0 0x7f05080d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.409+0000 7f050dd21640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d38e0 0x7f05080cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.409+0000 7f050dd21640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080ce990 con 0x7f05080d0070 2023-11-24T06:16:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.409+0000 7f050dd21640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05080d4110 con 0x7f050815d4e0 2023-11-24T06:16:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.409+0000 7f050dd21640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080d04e0 con 0x7f05080d38e0 2023-11-24T06:16:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.409+0000 7f050cd1f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f050815d4e0 0x7f05080d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.410+0000 7f050cd1f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f050815d4e0 0x7f05080d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49764/0 (socket says 172.21.15.37:49764) 2023-11-24T06:16:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.410+0000 7f050cd1f640 1 -- 172.21.15.37:0/2794661763 learned_addr learned my addr 172.21.15.37:0/2794661763 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.410+0000 7f050cd1f640 1 -- 172.21.15.37:0/2794661763 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d38e0 msgr2=0x7f05080cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.410+0000 7f050cd1f640 1 --2- 172.21.15.37:0/2794661763 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d38e0 0x7f05080cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.410+0000 7f050cd1f640 1 -- 172.21.15.37:0/2794661763 >> v1:172.21.15.188:6789/0 conn(0x7f05080d0070 legacy=0x7f05080d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:30.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.410+0000 7f050cd1f640 1 -- 172.21.15.37:0/2794661763 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080cec70 con 0x7f050815d4e0 2023-11-24T06:16:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.411+0000 7f050cd1f640 1 --2- 172.21.15.37:0/2794661763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080d1e20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f050808b800 tx=0x7f04fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3927facd7ae665d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f05077fe640 1 -- 172.21.15.37:0/2794661763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc031830 con 0x7f050815d4e0 2023-11-24T06:16:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f05077fe640 1 -- 172.21.15.37:0/2794661763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc031990 con 0x7f050815d4e0 2023-11-24T06:16:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f05077fe640 1 -- 172.21.15.37:0/2794661763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc031d20 con 0x7f050815d4e0 2023-11-24T06:16:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 -- 172.21.15.37:0/2794661763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 msgr2=0x7f05080d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 --2- 172.21.15.37:0/2794661763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080d1e20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f050808b800 tx=0x7f04fc02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 -- 172.21.15.37:0/2794661763 shutdown_connections 2023-11-24T06:16:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 --2- 172.21.15.37:0/2794661763 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d38e0 0x7f05080cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 --2- 172.21.15.37:0/2794661763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080d1e20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 -- 172.21.15.37:0/2794661763 >> 172.21.15.37:0/2794661763 conn(0x7f050809c510 msgr2=0x7f05080d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 -- 172.21.15.37:0/2794661763 shutdown_connections 2023-11-24T06:16:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.412+0000 7f050dd21640 1 -- 172.21.15.37:0/2794661763 wait complete. 2023-11-24T06:16:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.414+0000 7f050dd21640 1 Processor -- start 2023-11-24T06:16:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.414+0000 7f050dd21640 1 -- start start 2023-11-24T06:16:30.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.415+0000 7f050dd21640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d0070 0x7f050814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.415+0000 7f050dd21640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05080d38e0 0x7f05080b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.415+0000 7f050dd21640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.415+0000 7f050dd21640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050814fbe0 con 0x7f050815d4e0 2023-11-24T06:16:30.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.415+0000 7f050dd21640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080b81a0 con 0x7f05080d38e0 2023-11-24T06:16:30.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.415+0000 7f050dd21640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c6ac0 con 0x7f05080d0070 2023-11-24T06:16:30.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49768/0 (socket says 172.21.15.37:49768) 2023-11-24T06:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 -- 172.21.15.37:0/2795382412 learned_addr learned my addr 172.21.15.37:0/2795382412 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050cd1f640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d0070 0x7f050814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f0507fff640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05080d38e0 0x7f05080b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 -- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d0070 msgr2=0x7f050814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d0070 0x7f050814f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 -- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05080d38e0 msgr2=0x7f05080b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05080d38e0 0x7f05080b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 -- 172.21.15.37:0/2795382412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc0094d0 con 0x7f050815d4e0 2023-11-24T06:16:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.416+0000 7f050d520640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080cc3e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f050000c780 tx=0x7f050000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.417+0000 7f05057fa640 1 -- 172.21.15.37:0/2795382412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500003d80 con 0x7f050815d4e0 2023-11-24T06:16:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.417+0000 7f05057fa640 1 -- 172.21.15.37:0/2795382412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000ce90 con 0x7f050815d4e0 2023-11-24T06:16:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.417+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05080c6da0 con 0x7f050815d4e0 2023-11-24T06:16:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.417+0000 7f05057fa640 1 -- 172.21.15.37:0/2795382412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05000052b0 con 0x7f050815d4e0 2023-11-24T06:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.417+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080c7360 con 0x7f050815d4e0 2023-11-24T06:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.418+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05080cdd70 con 0x7f050815d4e0 2023-11-24T06:16:30.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.419+0000 7f05057fa640 1 -- 172.21.15.37:0/2795382412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0500005410 con 0x7f050815d4e0 2023-11-24T06:16:30.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.420+0000 7f05057fa640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04ec06ae40 0x7f04ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.420+0000 7f05057fa640 1 -- 172.21.15.37:0/2795382412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0500088f90 con 0x7f050815d4e0 2023-11-24T06:16:30.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.420+0000 7f050cd1f640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04ec06ae40 0x7f04ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.421+0000 7f050cd1f640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04ec06ae40 0x7f04ec06d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04fc036000 tx=0x7f04fc03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.425+0000 7f05057fa640 1 -- 172.21.15.37:0/2795382412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0500053f40 con 0x7f050815d4e0 2023-11-24T06:16:30.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.619+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f050804e840 con 0x7f050815d4e0 2023-11-24T06:16:30.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.622+0000 7f05057fa640 1 -- 172.21.15.37:0/2795382412 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f0500017070 con 0x7f050815d4e0 2023-11-24T06:16:30.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:30.626 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:21.608455+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6836/3993737526":"2023-11-25T06:16:18.597206+0000","172.21.15.37:6834/3993737526":"2023-11-25T06:16:18.597206+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.624+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04ec06ae40 msgr2=0x7f04ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04ec06ae40 0x7f04ec06d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04fc036000 tx=0x7f04fc03c040 comp rx=0 tx=0).stop 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 msgr2=0x7f05080cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080cc3e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f050000c780 tx=0x7f050000cc40 comp rx=0 tx=0).stop 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 shutdown_connections 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f04ec06ae40 0x7f04ec06d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05080d38e0 0x7f05080b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f050815d4e0 0x7f05080cc3e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 --2- 172.21.15.37:0/2795382412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05080d0070 0x7f050814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 >> 172.21.15.37:0/2795382412 conn(0x7f050809c510 msgr2=0x7f05080afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 shutdown_connections 2023-11-24T06:16:30.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.625+0000 7f050dd21640 1 -- 172.21.15.37:0/2795382412 wait complete. 2023-11-24T06:16:30.647 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:16:30.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:30.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.863+0000 7fb02f127640 1 Processor -- start 2023-11-24T06:16:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.863+0000 7fb02f127640 1 -- start start 2023-11-24T06:16:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.864+0000 7fb02f127640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb02815d4e0 0x7fb0280d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.864+0000 7fb02f127640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0280d0240 0x7fb0280b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.864+0000 7fb02f127640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280ce990 con 0x7fb0280d38e0 2023-11-24T06:16:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.864+0000 7fb02f127640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0280d4110 con 0x7fb02815d4e0 2023-11-24T06:16:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.864+0000 7fb02f127640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280cec70 con 0x7fb0280d0240 2023-11-24T06:16:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e125640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb02815d4e0 0x7fb0280d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e125640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb02815d4e0 0x7fb0280d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55044/0 (socket says 172.21.15.37:55044) 2023-11-24T06:16:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e125640 1 -- 172.21.15.37:0/3836733034 learned_addr learned my addr 172.21.15.37:0/3836733034 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e926640 1 --2- 172.21.15.37:0/3836733034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0280d0240 0x7fb0280b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e125640 1 -- 172.21.15.37:0/3836733034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0280d0240 msgr2=0x7fb0280b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e125640 1 --2- 172.21.15.37:0/3836733034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0280d0240 0x7fb0280b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e125640 1 -- 172.21.15.37:0/3836733034 >> v1:172.21.15.37:6789/0 conn(0x7fb0280d38e0 legacy=0x7fb0280cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02e125640 1 -- 172.21.15.37:0/3836733034 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280cef50 con 0x7fb02815d4e0 2023-11-24T06:16:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.865+0000 7fb02d123640 1 -- 172.21.15.37:0/3836733034 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277922076 0 0) 0x7fb0280ce990 con 0x7fb0280d38e0 2023-11-24T06:16:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.867+0000 7fb02e125640 1 --2- 172.21.15.37:0/3836733034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02815d4e0 0x7fb0280d1e20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb024009870 tx=0x7fb02402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62a2356b8468432 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.867+0000 7fb02d123640 1 -- 172.21.15.37:0/3836733034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024030840 con 0x7fb02815d4e0 2023-11-24T06:16:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.867+0000 7fb02d123640 1 -- 172.21.15.37:0/3836733034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0240309a0 con 0x7fb02815d4e0 2023-11-24T06:16:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.867+0000 7fb02d123640 1 -- 172.21.15.37:0/3836733034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024030d30 con 0x7fb02815d4e0 2023-11-24T06:16:30.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.867+0000 7fb02f127640 1 -- 172.21.15.37:0/3836733034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02815d4e0 msgr2=0x7fb0280d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.867+0000 7fb02f127640 1 --2- 172.21.15.37:0/3836733034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02815d4e0 0x7fb0280d1e20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb024009870 tx=0x7fb02402b980 comp rx=0 tx=0).stop 2023-11-24T06:16:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.868+0000 7fb02f127640 1 -- 172.21.15.37:0/3836733034 shutdown_connections 2023-11-24T06:16:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.868+0000 7fb02f127640 1 --2- 172.21.15.37:0/3836733034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0280d0240 0x7fb0280b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.868+0000 7fb02f127640 1 --2- 172.21.15.37:0/3836733034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02815d4e0 0x7fb0280d1e20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.868+0000 7fb02f127640 1 -- 172.21.15.37:0/3836733034 >> 172.21.15.37:0/3836733034 conn(0x7fb02809c510 msgr2=0x7fb0280d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.868+0000 7fb02f127640 1 -- 172.21.15.37:0/3836733034 shutdown_connections 2023-11-24T06:16:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.868+0000 7fb02f127640 1 -- 172.21.15.37:0/3836733034 wait complete. 2023-11-24T06:16:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.869+0000 7fb02f127640 1 Processor -- start 2023-11-24T06:16:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.870+0000 7fb02f127640 1 -- start start 2023-11-24T06:16:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02f127640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0280d0240 0x7fb0281f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02f127640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0280d38e0 0x7fb02815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02f127640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb02815d4e0 0x7fb0280c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02f127640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280ca2a0 con 0x7fb0280d38e0 2023-11-24T06:16:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02f127640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280ca4f0 con 0x7fb0280d0240 2023-11-24T06:16:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02f127640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280ca7d0 con 0x7fb02815d4e0 2023-11-24T06:16:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0280d38e0 0x7fb02815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0280d38e0 0x7fb02815b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55050/0 (socket says 172.21.15.37:55050) 2023-11-24T06:16:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 -- 172.21.15.37:0/91611907 learned_addr learned my addr 172.21.15.37:0/91611907 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02e926640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb02815d4e0 0x7fb0280c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 -- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb02815d4e0 msgr2=0x7fb0280c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb02815d4e0 0x7fb0280c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 -- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0280d0240 msgr2=0x7fb0281f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02e125640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0280d0240 0x7fb0281f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0280d0240 0x7fb0281f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.871+0000 7fb02d924640 1 -- 172.21.15.37:0/91611907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240094d0 con 0x7fb0280d38e0 2023-11-24T06:16:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.872+0000 7fb02d924640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0280d38e0 0x7fb02815b6d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c520 tx=0x7fb01800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.872+0000 7fb01effd640 1 -- 172.21.15.37:0/91611907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180052d0 con 0x7fb0280d38e0 2023-11-24T06:16:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.872+0000 7fb01effd640 1 -- 172.21.15.37:0/91611907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018005430 con 0x7fb0280d38e0 2023-11-24T06:16:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.872+0000 7fb01effd640 1 -- 172.21.15.37:0/91611907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018012870 con 0x7fb0280d38e0 2023-11-24T06:16:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.872+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0280caab0 con 0x7fb0280d38e0 2023-11-24T06:16:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.872+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0281f72a0 con 0x7fb0280d38e0 2023-11-24T06:16:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.874+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0280cafd0 con 0x7fb0280d38e0 2023-11-24T06:16:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.875+0000 7fb01effd640 1 -- 172.21.15.37:0/91611907 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb018003610 con 0x7fb0280d38e0 2023-11-24T06:16:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.876+0000 7fb01effd640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb00c06ae40 0x7fb00c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.876+0000 7fb01effd640 1 -- 172.21.15.37:0/91611907 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb018088c60 con 0x7fb0280d38e0 2023-11-24T06:16:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.876+0000 7fb02e125640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb00c06ae40 0x7fb00c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.877+0000 7fb02e125640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb00c06ae40 0x7fb00c06d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb024036000 tx=0x7fb02403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:30.881+0000 7fb01effd640 1 -- 172.21.15.37:0/91611907 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0280cafd0 con 0x7fb0280d38e0 2023-11-24T06:16:31.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.111+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0280cafd0 con 0x7fb0280d38e0 2023-11-24T06:16:31.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.112+0000 7fb01effd640 1 -- 172.21.15.37:0/91611907 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fb0280cafd0 con 0x7fb0280d38e0 2023-11-24T06:16:31.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:31.116 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/1178714141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1178714141},{"type":"v1","addr":"172.21.15.188:6834","nonce":1178714141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3045701683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":3045701683},{"type":"v1","addr":"172.21.15.37:6837","nonce":3045701683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5340,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/2712376439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2712376439},{"type":"v1","addr":"172.21.15.37:6836","nonce":2712376439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:01.307209+0000","modified":"2023-11-24T06:16:04.395591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.188:6835/1936445066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1936445066},{"type":"v1","addr":"172.21.15.188:6835","nonce":1936445066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:16:31.116 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-11-24T06:16:31.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb00c06ae40 msgr2=0x7fb00c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb00c06ae40 0x7fb00c06d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb024036000 tx=0x7fb02403b040 comp rx=0 tx=0).stop 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0280d38e0 msgr2=0x7fb02815b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0280d38e0 0x7fb02815b6d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c520 tx=0x7fb01800c9e0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 shutdown_connections 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb00c06ae40 0x7fb00c06d300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb02815d4e0 0x7fb0280c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0280d38e0 0x7fb02815b6d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 --2- 172.21.15.37:0/91611907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0280d0240 0x7fb0281f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.114+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 >> 172.21.15.37:0/91611907 conn(0x7fb02809c510 msgr2=0x7fb0280b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.115+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 shutdown_connections 2023-11-24T06:16:31.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.115+0000 7fb02f127640 1 -- 172.21.15.37:0/91611907 wait complete. 2023-11-24T06:16:31.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.357+0000 7f2ada2e6640 1 Processor -- start 2023-11-24T06:16:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.358+0000 7f2ada2e6640 1 -- start start 2023-11-24T06:16:31.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ada2e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2ad415d4e0 0x7f2ad40d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ada2e6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ad40d38e0 0x7f2ad40cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ada2e6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40ce990 con 0x7f2ad40d0070 2023-11-24T06:16:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ada2e6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40d4110 con 0x7f2ad40d38e0 2023-11-24T06:16:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ada2e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40d04e0 con 0x7f2ad415d4e0 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ad9ae5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ad40d0070 0x7f2ad40d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51292/0 (socket says 172.21.15.37:51292) 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ad9ae5640 1 -- 172.21.15.37:0/1024311816 learned_addr learned my addr 172.21.15.37:0/1024311816 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.359+0000 7f2ad8ae3640 1 --2- 172.21.15.37:0/1024311816 >> v2:172.21.15.37:3300/0 conn(0x7f2ad40d38e0 0x7f2ad40cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.360+0000 7f2ad92e4640 1 --2- 172.21.15.37:0/1024311816 >> v2:172.21.15.188:3300/0 conn(0x7f2ad415d4e0 0x7f2ad40d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.360+0000 7f2ad3fff640 1 -- 172.21.15.37:0/1024311816 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363782720 0 0) 0x7f2ad40ce990 con 0x7f2ad40d0070 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.360+0000 7f2ad8ae3640 1 -- 172.21.15.37:0/1024311816 >> v2:172.21.15.188:3300/0 conn(0x7f2ad415d4e0 msgr2=0x7f2ad40d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.360+0000 7f2ad8ae3640 1 --2- 172.21.15.37:0/1024311816 >> v2:172.21.15.188:3300/0 conn(0x7f2ad415d4e0 0x7f2ad40d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.360+0000 7f2ad8ae3640 1 -- 172.21.15.37:0/1024311816 >> v1:172.21.15.37:6789/0 conn(0x7f2ad40d0070 legacy=0x7f2ad40d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.360+0000 7f2ad8ae3640 1 -- 172.21.15.37:0/1024311816 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40cec70 con 0x7f2ad40d38e0 2023-11-24T06:16:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.360+0000 7f2ad92e4640 1 --2- 172.21.15.37:0/1024311816 >> v2:172.21.15.188:3300/0 conn(0x7f2ad415d4e0 0x7f2ad40d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.361+0000 7f2ad8ae3640 1 --2- 172.21.15.37:0/1024311816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad40cfb30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ad408b800 tx=0x7f2ac002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb72fc8fe6b0fa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.361+0000 7f2ad3fff640 1 -- 172.21.15.37:0/1024311816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0031830 con 0x7f2ad40d38e0 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.361+0000 7f2ad3fff640 1 -- 172.21.15.37:0/1024311816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac0031990 con 0x7f2ad40d38e0 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.361+0000 7f2ad3fff640 1 -- 172.21.15.37:0/1024311816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0031d20 con 0x7f2ad40d38e0 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 -- 172.21.15.37:0/1024311816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 msgr2=0x7f2ad40cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/1024311816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad40cfb30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ad408b800 tx=0x7f2ac002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 -- 172.21.15.37:0/1024311816 shutdown_connections 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/1024311816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad40cfb30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/1024311816 >> v2:172.21.15.188:3300/0 conn(0x7f2ad415d4e0 0x7f2ad40d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 -- 172.21.15.37:0/1024311816 >> 172.21.15.37:0/1024311816 conn(0x7f2ad409c510 msgr2=0x7f2ad40d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 -- 172.21.15.37:0/1024311816 shutdown_connections 2023-11-24T06:16:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.362+0000 7f2ada2e6640 1 -- 172.21.15.37:0/1024311816 wait complete. 2023-11-24T06:16:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.364+0000 7f2ada2e6640 1 Processor -- start 2023-11-24T06:16:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.364+0000 7f2ada2e6640 1 -- start start 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.365+0000 7f2ada2e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ad40d0070 0x7f2ad4152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.365+0000 7f2ada2e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad4149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.365+0000 7f2ada2e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ad415d4e0 0x7f2ad40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.365+0000 7f2ada2e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40c9b60 con 0x7f2ad40d38e0 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.365+0000 7f2ada2e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40c95a0 con 0x7f2ad40d0070 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.365+0000 7f2ada2e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40c9880 con 0x7f2ad415d4e0 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.365+0000 7f2ad8ae3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad4149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad4149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55076/0 (socket says 172.21.15.37:55076) 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 -- 172.21.15.37:0/4153212778 learned_addr learned my addr 172.21.15.37:0/4153212778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad92e4640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ad40d0070 0x7f2ad4152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad9ae5640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ad415d4e0 0x7f2ad40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 -- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ad415d4e0 msgr2=0x7f2ad40ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ad415d4e0 0x7f2ad40ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 -- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ad40d0070 msgr2=0x7f2ad4152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ad40d0070 0x7f2ad4152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 -- 172.21.15.37:0/4153212778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0009400 con 0x7f2ad40d38e0 2023-11-24T06:16:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad9ae5640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ad415d4e0 0x7f2ad40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.366+0000 7f2ad8ae3640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad4149410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2ac002bee0 tx=0x7f2ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.367+0000 7f2ad1ffb640 1 -- 172.21.15.37:0/4153212778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac003a6f0 con 0x7f2ad40d38e0 2023-11-24T06:16:31.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.367+0000 7f2ad1ffb640 1 -- 172.21.15.37:0/4153212778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac003a870 con 0x7f2ad40d38e0 2023-11-24T06:16:31.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.367+0000 7f2ad1ffb640 1 -- 172.21.15.37:0/4153212778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac003ac20 con 0x7f2ad40d38e0 2023-11-24T06:16:31.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.367+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad415dbe0 con 0x7f2ad40d38e0 2023-11-24T06:16:31.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.367+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad4149950 con 0x7f2ad40d38e0 2023-11-24T06:16:31.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.368+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad415e100 con 0x7f2ad40d38e0 2023-11-24T06:16:31.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.369+0000 7f2ad1ffb640 1 -- 172.21.15.37:0/4153212778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ac0030380 con 0x7f2ad40d38e0 2023-11-24T06:16:31.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.370+0000 7f2ad1ffb640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2ab806ae70 0x7f2ab806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.370+0000 7f2ad1ffb640 1 -- 172.21.15.37:0/4153212778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2ac00aaff0 con 0x7f2ad40d38e0 2023-11-24T06:16:31.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.370+0000 7f2ad92e4640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2ab806ae70 0x7f2ab806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.371+0000 7f2ad92e4640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2ab806ae70 0x7f2ab806d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8003fd0 tx=0x7f2ac80039f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.374+0000 7f2ad1ffb640 1 -- 172.21.15.37:0/4153212778 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ac00dde90 con 0x7f2ad40d38e0 2023-11-24T06:16:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.607+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ad404e840 con 0x7f2ad40d38e0 2023-11-24T06:16:31.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.608+0000 7f2ad1ffb640 1 -- 172.21.15.37:0/4153212778 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f2ad415e100 con 0x7f2ad40d38e0 2023-11-24T06:16:31.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:31.612 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/1178714141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1178714141},{"type":"v1","addr":"172.21.15.188:6834","nonce":1178714141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3045701683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":3045701683},{"type":"v1","addr":"172.21.15.37:6837","nonce":3045701683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5340,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/2712376439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2712376439},{"type":"v1","addr":"172.21.15.37:6836","nonce":2712376439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:01.307209+0000","modified":"2023-11-24T06:16:04.395591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.188:6835/1936445066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1936445066},{"type":"v1","addr":"172.21.15.188:6835","nonce":1936445066}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:16:31.613 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-11-24T06:16:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2ab806ae70 msgr2=0x7f2ab806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2ab806ae70 0x7f2ab806d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8003fd0 tx=0x7f2ac80039f0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 msgr2=0x7f2ad4149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad4149410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2ac002bee0 tx=0x7f2ac00046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 shutdown_connections 2023-11-24T06:16:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2ab806ae70 0x7f2ab806d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ad415d4e0 0x7f2ad40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ad40d38e0 0x7f2ad4149410 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 --2- 172.21.15.37:0/4153212778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ad40d0070 0x7f2ad4152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 >> 172.21.15.37:0/4153212778 conn(0x7f2ad409c510 msgr2=0x7f2ad40afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.611+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 shutdown_connections 2023-11-24T06:16:31.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.612+0000 7f2ada2e6640 1 -- 172.21.15.37:0/4153212778 wait complete. 2023-11-24T06:16:31.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.855+0000 7f2166256640 1 Processor -- start 2023-11-24T06:16:31.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.855+0000 7f2166256640 1 -- start start 2023-11-24T06:16:31.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.857+0000 7f2166256640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f21600b2250 0x7f216015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.857+0000 7f2166256640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f216015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.857+0000 7f2166256640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216015ab80 con 0x7f21600b2630 2023-11-24T06:16:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.857+0000 7f2166256640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216015a990 con 0x7f21600b2250 2023-11-24T06:16:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.857+0000 7f2166256640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216015e680 con 0x7f21600b2aa0 2023-11-24T06:16:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.857+0000 7f2157fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21600b2630 0x7f21600ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51302/0 (socket says 172.21.15.37:51302) 2023-11-24T06:16:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.857+0000 7f2157fff640 1 -- 172.21.15.37:0/1010557810 learned_addr learned my addr 172.21.15.37:0/1010557810 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215ffff640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f216015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993185309 0 0) 0x7f216015ab80 con 0x7f21600b2630 2023-11-24T06:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c003520 con 0x7f21600b2630 2023-11-24T06:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215f7fe640 1 --2- 172.21.15.37:0/1010557810 >> v2:172.21.15.188:3300/0 conn(0x7f21600b2250 0x7f216015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3582041691 0 0) 0x7f214c003520 con 0x7f21600b2630 2023-11-24T06:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 msgr2=0x7f216015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f216015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 >> v2:172.21.15.188:3300/0 conn(0x7f21600b2250 msgr2=0x7f216015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 --2- 172.21.15.37:0/1010557810 >> v2:172.21.15.188:3300/0 conn(0x7f21600b2250 0x7f216015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216015e960 con 0x7f21600b2630 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f2148001670 con 0x7f21600b2630 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215ffff640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f216015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 >> v1:172.21.15.37:6789/0 conn(0x7f21600b2630 legacy=0x7f21600ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f214c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f214c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f214c004d00 0x7f214c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216015e680 con 0x7f214c003970 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c00db90 con 0x7f214c004d00 2023-11-24T06:16:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.858+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c00dd50 con 0x7f21600b2aa0 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f215f7fe640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f214c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f2157fff640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f214c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f215ffff640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f214c004d00 0x7f214c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f215f7fe640 1 -- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 msgr2=0x7f214c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f215f7fe640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f214c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f215f7fe640 1 -- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f214c004d00 msgr2=0x7f214c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f215f7fe640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f214c004d00 0x7f214c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f215f7fe640 1 -- 172.21.15.37:0/1010557810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c003520 con 0x7f214c003970 2023-11-24T06:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.859+0000 7f2157fff640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21600b2aa0 0x7f214c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f215f7fe640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f214c003d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f215000ba30 tx=0x7f214c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963494aa53489e67 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150032680 con 0x7f214c003970 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21500327e0 con 0x7f214c003970 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f215effd640 1 -- 172.21.15.37:0/1010557810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150032b70 con 0x7f214c003970 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f2166256640 1 -- 172.21.15.37:0/1010557810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 msgr2=0x7f214c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f2166256640 1 --2- 172.21.15.37:0/1010557810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f214c003d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f215000ba30 tx=0x7f214c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f215ffff640 1 -- 172.21.15.37:0/1010557810 reap_dead start 2023-11-24T06:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f2166256640 1 -- 172.21.15.37:0/1010557810 shutdown_connections 2023-11-24T06:16:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.861+0000 7f2166256640 1 -- 172.21.15.37:0/1010557810 >> 172.21.15.37:0/1010557810 conn(0x7f216006a920 msgr2=0x7f216006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.862+0000 7f2166256640 1 -- 172.21.15.37:0/1010557810 shutdown_connections 2023-11-24T06:16:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.862+0000 7f2166256640 1 -- 172.21.15.37:0/1010557810 wait complete. 2023-11-24T06:16:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.863+0000 7f2166256640 1 Processor -- start 2023-11-24T06:16:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.864+0000 7f2166256640 1 -- start start 2023-11-24T06:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f2166256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f216009caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f2166256640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2160152b40 0x7f2160153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f2166256640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2160152fa0 0x7f2160154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f2166256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21601526b0 con 0x7f214c003970 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f2166256640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160151aa0 con 0x7f2160152fa0 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f2166256640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2160151d80 con 0x7f2160152b40 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f216009caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f216009caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55100/0 (socket says 172.21.15.37:55100) 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 -- 172.21.15.37:0/3911231883 learned_addr learned my addr 172.21.15.37:0/3911231883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f2157fff640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2160152b40 0x7f2160153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 -- 172.21.15.37:0/3911231883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2160152b40 msgr2=0x7f2160153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2160152b40 0x7f2160153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 -- 172.21.15.37:0/3911231883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2160152fa0 msgr2=0x7f2160154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2160152fa0 0x7f2160154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.865+0000 7f215f7fe640 1 -- 172.21.15.37:0/3911231883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600cd7c0 con 0x7f214c003970 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.866+0000 7f215f7fe640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f216009caf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f215002bf00 tx=0x7f2150004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.866+0000 7f215cff9640 1 -- 172.21.15.37:0/3911231883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150004220 con 0x7f214c003970 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.866+0000 7f215cff9640 1 -- 172.21.15.37:0/3911231883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21500043a0 con 0x7f214c003970 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.866+0000 7f215cff9640 1 -- 172.21.15.37:0/3911231883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150030a20 con 0x7f214c003970 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.866+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2160152060 con 0x7f214c003970 2023-11-24T06:16:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.866+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216009d030 con 0x7f214c003970 2023-11-24T06:16:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.868+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2160067470 con 0x7f214c003970 2023-11-24T06:16:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.868+0000 7f215cff9640 1 -- 172.21.15.37:0/3911231883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2150030b80 con 0x7f214c003970 2023-11-24T06:16:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.869+0000 7f215cff9640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f214006ae40 0x7f214006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.869+0000 7f215cff9640 1 -- 172.21.15.37:0/3911231883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f21500ac030 con 0x7f214c003970 2023-11-24T06:16:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.870+0000 7f2157fff640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f214006ae40 0x7f214006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.870+0000 7f2157fff640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f214006ae40 0x7f214006d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2148001eb0 tx=0x7f2148001c30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:31.874+0000 7f215cff9640 1 -- 172.21.15.37:0/3911231883 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2150077110 con 0x7f214c003970 2023-11-24T06:16:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.068+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2160067470 con 0x7f214c003970 2023-11-24T06:16:32.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.070+0000 7f215cff9640 1 -- 172.21.15.37:0/3911231883 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f2150036090 con 0x7f214c003970 2023-11-24T06:16:32.075 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:32.075 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:21.608455+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:15:59.353546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:00.332854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6836/3993737526":"2023-11-25T06:16:18.597206+0000","172.21.15.37:6834/3993737526":"2023-11-25T06:16:18.597206+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f214006ae40 msgr2=0x7f214006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f214006ae40 0x7f214006d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2148001eb0 tx=0x7f2148001c30 comp rx=0 tx=0).stop 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 msgr2=0x7f216009caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f216009caf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f215002bf00 tx=0x7f2150004730 comp rx=0 tx=0).stop 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 shutdown_connections 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f214006ae40 0x7f214006d300 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2160152fa0 0x7f2160154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2160152b40 0x7f2160153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 --2- 172.21.15.37:0/3911231883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c003970 0x7f216009caf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 >> 172.21.15.37:0/3911231883 conn(0x7f216006a920 msgr2=0x7f21600cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:32.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 shutdown_connections 2023-11-24T06:16:32.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.074+0000 7f2166256640 1 -- 172.21.15.37:0/3911231883 wait complete. 2023-11-24T06:16:32.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:16:32.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.322+0000 7f560edff640 1 Processor -- start 2023-11-24T06:16:32.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.322+0000 7f560edff640 1 -- start start 2023-11-24T06:16:32.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560edff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56080b63d0 0x7f56080d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560edff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56080ce270 0x7f56080d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560edff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080cea30 con 0x7f560815d490 2023-11-24T06:16:32.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560edff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56080d0450 con 0x7f56080ce270 2023-11-24T06:16:32.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560edff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080d0bf0 con 0x7f56080b63d0 2023-11-24T06:16:32.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560d5fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56080b63d0 0x7f56080d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560ddfd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f560815d490 0x7f56080cd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:40242/0 (socket says 172.21.15.37:40242) 2023-11-24T06:16:32.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560ddfd640 1 -- 172.21.15.37:0/2667955225 learned_addr learned my addr 172.21.15.37:0/2667955225 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:32.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.324+0000 7f560e5fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56080ce270 0x7f56080d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.325+0000 7f560d5fc640 1 -- 172.21.15.37:0/2667955225 >> v2:172.21.15.37:3300/0 conn(0x7f56080ce270 msgr2=0x7f56080d3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:32.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.325+0000 7f560d5fc640 1 --2- 172.21.15.37:0/2667955225 >> v2:172.21.15.37:3300/0 conn(0x7f56080ce270 0x7f56080d3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.325+0000 7f560d5fc640 1 -- 172.21.15.37:0/2667955225 >> v1:172.21.15.188:6789/0 conn(0x7f560815d490 legacy=0x7f56080cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.325+0000 7f560d5fc640 1 -- 172.21.15.37:0/2667955225 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080d2260 con 0x7f56080b63d0 2023-11-24T06:16:32.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.327+0000 7f560d5fc640 1 --2- 172.21.15.37:0/2667955225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56080b63d0 0x7f56080d3230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55f80097a0 tx=0x7f55f802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fc7a08816dc0c46 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.327+0000 7f560cdfb640 1 -- 172.21.15.37:0/2667955225 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f802d040 con 0x7f56080b63d0 2023-11-24T06:16:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.327+0000 7f560cdfb640 1 -- 172.21.15.37:0/2667955225 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f8031810 con 0x7f56080b63d0 2023-11-24T06:16:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.327+0000 7f560cdfb640 1 -- 172.21.15.37:0/2667955225 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8031ba0 con 0x7f56080b63d0 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 -- 172.21.15.37:0/2667955225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56080b63d0 msgr2=0x7f56080d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 --2- 172.21.15.37:0/2667955225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56080b63d0 0x7f56080d3230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55f80097a0 tx=0x7f55f802b8b0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 -- 172.21.15.37:0/2667955225 shutdown_connections 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 --2- 172.21.15.37:0/2667955225 >> v2:172.21.15.37:3300/0 conn(0x7f56080ce270 0x7f56080d3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 --2- 172.21.15.37:0/2667955225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56080b63d0 0x7f56080d3230 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 -- 172.21.15.37:0/2667955225 >> 172.21.15.37:0/2667955225 conn(0x7f5608061340 msgr2=0x7f5608061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 -- 172.21.15.37:0/2667955225 shutdown_connections 2023-11-24T06:16:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.328+0000 7f560edff640 1 -- 172.21.15.37:0/2667955225 wait complete. 2023-11-24T06:16:32.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.330+0000 7f560edff640 1 Processor -- start 2023-11-24T06:16:32.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.330+0000 7f560edff640 1 -- start start 2023-11-24T06:16:32.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.331+0000 7f560edff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56080ce270 0x7f56080cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.331+0000 7f560edff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f560815d490 0x7f5608157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.331+0000 7f560edff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56080c7610 0x7f56080b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.331+0000 7f560edff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080cd1f0 con 0x7f56080c7610 2023-11-24T06:16:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.331+0000 7f560edff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080cc150 con 0x7f56080ce270 2023-11-24T06:16:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.331+0000 7f560edff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080cc430 con 0x7f560815d490 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560ddfd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56080ce270 0x7f56080cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560d5fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f560815d490 0x7f5608157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560e5fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56080c7610 0x7f56080b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560d5fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f560815d490 0x7f5608157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:41076/0 (socket says 172.21.15.37:41076) 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560d5fc640 1 -- 172.21.15.37:0/3982326823 learned_addr learned my addr 172.21.15.37:0/3982326823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560e5fe640 1 -- 172.21.15.37:0/3982326823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f560815d490 msgr2=0x7f5608157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560e5fe640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f560815d490 0x7f5608157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560e5fe640 1 -- 172.21.15.37:0/3982326823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56080ce270 msgr2=0x7f56080cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560e5fe640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56080ce270 0x7f56080cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.332+0000 7f560e5fe640 1 -- 172.21.15.37:0/3982326823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8009400 con 0x7f56080c7610 2023-11-24T06:16:32.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.333+0000 7f560e5fe640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56080c7610 0x7f56080b7940 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f560000ef90 tx=0x7f560000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.333+0000 7f55fe7fc640 1 -- 172.21.15.37:0/3982326823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600009c00 con 0x7f56080c7610 2023-11-24T06:16:32.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.333+0000 7f55fe7fc640 1 -- 172.21.15.37:0/3982326823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560000f040 con 0x7f56080c7610 2023-11-24T06:16:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.333+0000 7f55fe7fc640 1 -- 172.21.15.37:0/3982326823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000146c0 con 0x7f56080c7610 2023-11-24T06:16:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.333+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56080cc710 con 0x7f56080c7610 2023-11-24T06:16:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.334+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56080cccd0 con 0x7f56080c7610 2023-11-24T06:16:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.335+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56080ccef0 con 0x7f56080c7610 2023-11-24T06:16:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.339+0000 7f55fe7fc640 1 -- 172.21.15.37:0/3982326823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5600014820 con 0x7f56080c7610 2023-11-24T06:16:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.339+0000 7f55fe7fc640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f55ec06ae40 0x7f55ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.339+0000 7f55fe7fc640 1 -- 172.21.15.37:0/3982326823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f560008a350 con 0x7f56080c7610 2023-11-24T06:16:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.339+0000 7f560ddfd640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f55ec06ae40 0x7f55ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.340+0000 7f560ddfd640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f55ec06ae40 0x7f55ec06d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56080b2fb0 tx=0x7f5604007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.343+0000 7f55fe7fc640 1 -- 172.21.15.37:0/3982326823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5600055450 con 0x7f56080c7610 2023-11-24T06:16:32.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.575+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f560815e9f0 con 0x7f56080c7610 2023-11-24T06:16:32.579 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-11-24T06:16:32.576+0000 7fe7fc218640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:16:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.580+0000 7f55fe7fc640 1 -- 172.21.15.37:0/3982326823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5600058a70 con 0x7f56080c7610 2023-11-24T06:16:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f55ec06ae40 msgr2=0x7f55ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f55ec06ae40 0x7f55ec06d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56080b2fb0 tx=0x7f5604007e80 comp rx=0 tx=0).stop 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56080c7610 msgr2=0x7f56080b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56080c7610 0x7f56080b7940 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f560000ef90 tx=0x7f560000c490 comp rx=0 tx=0).stop 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 shutdown_connections 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f55ec06ae40 0x7f55ec06d300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56080c7610 0x7f56080b7940 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f560815d490 0x7f5608157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 --2- 172.21.15.37:0/3982326823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56080ce270 0x7f56080cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 >> 172.21.15.37:0/3982326823 conn(0x7f5608061340 msgr2=0x7f56080cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 shutdown_connections 2023-11-24T06:16:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.583+0000 7f560edff640 1 -- 172.21.15.37:0/3982326823 wait complete. 2023-11-24T06:16:32.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:16:32.608 INFO:tasks.ceph.mds.d.smithi188.stderr: -2613> 2023-11-24T06:16:04.717+0000 7fb2766dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:16:32.698 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2023-11-24T06:16:32.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.828+0000 7f080f7e3640 1 Processor -- start 2023-11-24T06:16:32.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.828+0000 7f080f7e3640 1 -- start start 2023-11-24T06:16:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080f7e3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f080806de10 0x7f080815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080f7e3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08080c49f0 0x7f08080705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080f7e3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080815ec90 con 0x7f0808072160 2023-11-24T06:16:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080f7e3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080cd530 con 0x7f08080c49f0 2023-11-24T06:16:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080f7e3640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080c4ed0 con 0x7f080806de10 2023-11-24T06:16:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080dd80640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08080c49f0 0x7f08080705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080dd80640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08080c49f0 0x7f08080705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55118/0 (socket says 172.21.15.37:55118) 2023-11-24T06:16:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080dd80640 1 -- 172.21.15.37:0/1545404043 learned_addr learned my addr 172.21.15.37:0/1545404043 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.829+0000 7f080cd7e640 1 --2- 172.21.15.37:0/1545404043 >> v2:172.21.15.188:3300/0 conn(0x7f080806de10 0x7f080815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.830+0000 7f080dd80640 1 -- 172.21.15.37:0/1545404043 >> v2:172.21.15.188:3300/0 conn(0x7f080806de10 msgr2=0x7f080815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.830+0000 7f080dd80640 1 --2- 172.21.15.37:0/1545404043 >> v2:172.21.15.188:3300/0 conn(0x7f080806de10 0x7f080815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.830+0000 7f080dd80640 1 -- 172.21.15.37:0/1545404043 >> v1:172.21.15.188:6789/0 conn(0x7f0808072160 legacy=0x7f080806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.830+0000 7f080dd80640 1 -- 172.21.15.37:0/1545404043 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08080c51b0 con 0x7f08080c49f0 2023-11-24T06:16:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.831+0000 7f080dd80640 1 --2- 172.21.15.37:0/1545404043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080c49f0 0x7f08080705c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f08080cef60 tx=0x7f080002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3439cca52c6e4f90 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.831+0000 7f07fffff640 1 -- 172.21.15.37:0/1545404043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080002ca80 con 0x7f08080c49f0 2023-11-24T06:16:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.831+0000 7f07fffff640 1 -- 172.21.15.37:0/1545404043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080002cbe0 con 0x7f08080c49f0 2023-11-24T06:16:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.831+0000 7f07fffff640 1 -- 172.21.15.37:0/1545404043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000343f0 con 0x7f08080c49f0 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 -- 172.21.15.37:0/1545404043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080c49f0 msgr2=0x7f08080705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1545404043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080c49f0 0x7f08080705c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f08080cef60 tx=0x7f080002bee0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 -- 172.21.15.37:0/1545404043 shutdown_connections 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1545404043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080c49f0 0x7f08080705c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1545404043 >> v2:172.21.15.188:3300/0 conn(0x7f080806de10 0x7f080815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 -- 172.21.15.37:0/1545404043 >> 172.21.15.37:0/1545404043 conn(0x7f08080b0c50 msgr2=0x7f08080b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 -- 172.21.15.37:0/1545404043 shutdown_connections 2023-11-24T06:16:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.832+0000 7f080f7e3640 1 -- 172.21.15.37:0/1545404043 wait complete. 2023-11-24T06:16:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.834+0000 7f080f7e3640 1 Processor -- start 2023-11-24T06:16:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.834+0000 7f080f7e3640 1 -- start start 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080f7e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080806de10 0x7f08080999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080f7e3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0808072160 0x7f0808156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080f7e3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08080c49f0 0x7f08080af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080f7e3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080809ca90 con 0x7f080806de10 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080f7e3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080809a0b0 con 0x7f08080c49f0 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080f7e3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080809a390 con 0x7f0808072160 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080806de10 0x7f08080999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080806de10 0x7f08080999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55132/0 (socket says 172.21.15.37:55132) 2023-11-24T06:16:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 -- 172.21.15.37:0/1166695081 learned_addr learned my addr 172.21.15.37:0/1166695081 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 -- 172.21.15.37:0/1166695081 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0808072160 msgr2=0x7f0808156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0808072160 0x7f0808156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 -- 172.21.15.37:0/1166695081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08080c49f0 msgr2=0x7f08080af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08080c49f0 0x7f08080af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.835+0000 7f080d57f640 1 -- 172.21.15.37:0/1166695081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009b30 con 0x7f080806de10 2023-11-24T06:16:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.836+0000 7f080d57f640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080806de10 0x7f08080999d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f080400c430 tx=0x7f080400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.836+0000 7f07fdffb640 1 -- 172.21.15.37:0/1166695081 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804011790 con 0x7f080806de10 2023-11-24T06:16:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.836+0000 7f07fdffb640 1 -- 172.21.15.37:0/1166695081 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08040118f0 con 0x7f080806de10 2023-11-24T06:16:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.836+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08080c69d0 con 0x7f080806de10 2023-11-24T06:16:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.836+0000 7f07fdffb640 1 -- 172.21.15.37:0/1166695081 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804011ce0 con 0x7f080806de10 2023-11-24T06:16:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.836+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080815a470 con 0x7f080806de10 2023-11-24T06:16:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.837+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08080c6ef0 con 0x7f080806de10 2023-11-24T06:16:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.839+0000 7f07fdffb640 1 -- 172.21.15.37:0/1166695081 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f080401c460 con 0x7f080806de10 2023-11-24T06:16:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.839+0000 7f07fdffb640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07ec06ae40 0x7f07ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.840+0000 7f07fdffb640 1 -- 172.21.15.37:0/1166695081 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0804089690 con 0x7f080806de10 2023-11-24T06:16:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.840+0000 7f080cd7e640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07ec06ae40 0x7f07ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.841+0000 7f080cd7e640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07ec06ae40 0x7f07ec06d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f080815d560 tx=0x7f07f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:32.844+0000 7f07fdffb640 1 -- 172.21.15.37:0/1166695081 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08080c6ef0 con 0x7f080806de10 2023-11-24T06:16:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.083+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f08080c6ef0 con 0x7f080806de10 2023-11-24T06:16:33.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.584+0000 7f07fdffb640 1 -- 172.21.15.37:0/1166695081 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0804054680 con 0x7f080806de10 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07ec06ae40 msgr2=0x7f07ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07ec06ae40 0x7f07ec06d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f080815d560 tx=0x7f07f8008040 comp rx=0 tx=0).stop 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080806de10 msgr2=0x7f08080999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080806de10 0x7f08080999d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f080400c430 tx=0x7f080400c8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 shutdown_connections 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f07ec06ae40 0x7f07ec06d300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08080c49f0 0x7f08080af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0808072160 0x7f0808156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 --2- 172.21.15.37:0/1166695081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080806de10 0x7f08080999d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 >> 172.21.15.37:0/1166695081 conn(0x7f08080b0c50 msgr2=0x7f08080ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.588+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 shutdown_connections 2023-11-24T06:16:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.589+0000 7f080f7e3640 1 -- 172.21.15.37:0/1166695081 wait complete. 2023-11-24T06:16:33.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:16:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.841+0000 7f96b5c10640 1 Processor -- start 2023-11-24T06:16:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.841+0000 7f96b5c10640 1 -- start start 2023-11-24T06:16:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.843+0000 7f96b5c10640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f96b013e230 0x7f96b006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.843+0000 7f96b5c10640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015fa40 0x7f96b006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.843+0000 7f96b5c10640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b015f5b0 con 0x7f96b015b840 2023-11-24T06:16:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.843+0000 7f96b5c10640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b01417c0 con 0x7f96b013e230 2023-11-24T06:16:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.843+0000 7f96b5c10640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b015c380 con 0x7f96b015fa40 2023-11-24T06:16:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.844+0000 7f96b4c0e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f96b013e230 0x7f96b006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.844+0000 7f96affff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015fa40 0x7f96b006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.844+0000 7f96affff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015fa40 0x7f96b006ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:41098/0 (socket says 172.21.15.37:41098) 2023-11-24T06:16:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.844+0000 7f96affff640 1 -- 172.21.15.37:0/3094698981 learned_addr learned my addr 172.21.15.37:0/3094698981 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.844+0000 7f96b4c0e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f96b013e230 0x7f96b006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:47136/0 (socket says 172.21.15.37:47136) 2023-11-24T06:16:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.845+0000 7f96affff640 1 -- 172.21.15.37:0/3094698981 >> v2:172.21.15.188:3300/0 conn(0x7f96b013e230 msgr2=0x7f96b006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.845+0000 7f96affff640 1 --2- 172.21.15.37:0/3094698981 >> v2:172.21.15.188:3300/0 conn(0x7f96b013e230 0x7f96b006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.845+0000 7f96affff640 1 -- 172.21.15.37:0/3094698981 >> v1:172.21.15.188:6789/0 conn(0x7f96b015b840 legacy=0x7f96b015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.845+0000 7f96affff640 1 -- 172.21.15.37:0/3094698981 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b015c570 con 0x7f96b015fa40 2023-11-24T06:16:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.846+0000 7f96affff640 1 --2- 172.21.15.37:0/3094698981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015fa40 0x7f96b006ca30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009870 tx=0x7f96a002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd7f060746d16ad4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.847+0000 7f96af7fe640 1 -- 172.21.15.37:0/3094698981 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0031640 con 0x7f96b015fa40 2023-11-24T06:16:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.847+0000 7f96af7fe640 1 -- 172.21.15.37:0/3094698981 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00317a0 con 0x7f96b015fa40 2023-11-24T06:16:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.847+0000 7f96af7fe640 1 -- 172.21.15.37:0/3094698981 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0031b30 con 0x7f96b015fa40 2023-11-24T06:16:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.847+0000 7f96b5c10640 1 -- 172.21.15.37:0/3094698981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015fa40 msgr2=0x7f96b006ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.847+0000 7f96b5c10640 1 --2- 172.21.15.37:0/3094698981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015fa40 0x7f96b006ca30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009870 tx=0x7f96a002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.848+0000 7f96b5c10640 1 -- 172.21.15.37:0/3094698981 shutdown_connections 2023-11-24T06:16:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.848+0000 7f96b5c10640 1 --2- 172.21.15.37:0/3094698981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015fa40 0x7f96b006ca30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.848+0000 7f96b5c10640 1 --2- 172.21.15.37:0/3094698981 >> v2:172.21.15.188:3300/0 conn(0x7f96b013e230 0x7f96b006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.848+0000 7f96b5c10640 1 -- 172.21.15.37:0/3094698981 >> 172.21.15.37:0/3094698981 conn(0x7f96b006dc30 msgr2=0x7f96b006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.848+0000 7f96b5c10640 1 -- 172.21.15.37:0/3094698981 shutdown_connections 2023-11-24T06:16:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.848+0000 7f96b5c10640 1 -- 172.21.15.37:0/3094698981 wait complete. 2023-11-24T06:16:33.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.850+0000 7f96b5c10640 1 Processor -- start 2023-11-24T06:16:33.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.850+0000 7f96b5c10640 1 -- start start 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b5c10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b013e230 0x7f96b0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b5c10640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015b840 0x7f96b0132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b5c10640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96b015fa40 0x7f96b0155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b5c10640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01556a0 con 0x7f96b013e230 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b5c10640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00af840 con 0x7f96b015fa40 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b5c10640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00aec30 con 0x7f96b015b840 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b4c0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b013e230 0x7f96b0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b4c0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b013e230 0x7f96b0152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55138/0 (socket says 172.21.15.37:55138) 2023-11-24T06:16:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.851+0000 7f96b4c0e640 1 -- 172.21.15.37:0/694684056 learned_addr learned my addr 172.21.15.37:0/694684056 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96affff640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015b840 0x7f96b0132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b540f640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96b015fa40 0x7f96b0155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b4c0e640 1 -- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015b840 msgr2=0x7f96b0132110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b4c0e640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015b840 0x7f96b0132110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b4c0e640 1 -- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96b015fa40 msgr2=0x7f96b0155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b4c0e640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96b015fa40 0x7f96b0155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b4c0e640 1 -- 172.21.15.37:0/694684056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a00094d0 con 0x7f96b013e230 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b540f640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96b015fa40 0x7f96b0155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b4c0e640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b013e230 0x7f96b0152880 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f96a400e9b0 tx=0x7f96a400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96ad7fa640 1 -- 172.21.15.37:0/694684056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4009670 con 0x7f96b013e230 2023-11-24T06:16:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96ad7fa640 1 -- 172.21.15.37:0/694684056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a400c9a0 con 0x7f96b013e230 2023-11-24T06:16:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96ad7fa640 1 -- 172.21.15.37:0/694684056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a400cd50 con 0x7f96b013e230 2023-11-24T06:16:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.852+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b00aef10 con 0x7f96b013e230 2023-11-24T06:16:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.853+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b00af4d0 con 0x7f96b013e230 2023-11-24T06:16:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.854+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b004e840 con 0x7f96b013e230 2023-11-24T06:16:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.855+0000 7f96ad7fa640 1 -- 172.21.15.37:0/694684056 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96a4013470 con 0x7f96b013e230 2023-11-24T06:16:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.856+0000 7f96ad7fa640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f969c06ae40 0x7f969c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.856+0000 7f96ad7fa640 1 -- 172.21.15.37:0/694684056 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f96a40899d0 con 0x7f96b013e230 2023-11-24T06:16:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.856+0000 7f96affff640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f969c06ae40 0x7f969c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.857+0000 7f96affff640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f969c06ae40 0x7f969c06d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96a0036000 tx=0x7f96a003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:33.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:33.861+0000 7f96ad7fa640 1 -- 172.21.15.37:0/694684056 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96a4054970 con 0x7f96b013e230 2023-11-24T06:16:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.060+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96b006b1d0 con 0x7f96b013e230 2023-11-24T06:16:34.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.724+0000 7f96ad7fa640 1 -- 172.21.15.37:0/694684056 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7f96a40170d0 con 0x7f96b013e230 2023-11-24T06:16:34.727 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.729+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f969c06ae40 msgr2=0x7f969c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.729+0000 7f96b5c10640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f969c06ae40 0x7f969c06d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96a0036000 tx=0x7f96a003c040 comp rx=0 tx=0).stop 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.729+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b013e230 msgr2=0x7f96b0152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.729+0000 7f96b5c10640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b013e230 0x7f96b0152880 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f96a400e9b0 tx=0x7f96a400ee70 comp rx=0 tx=0).stop 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 shutdown_connections 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f969c06ae40 0x7f969c06d300 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96a0036000 tx=0x7f96a003c040 comp rx=0 tx=0).stop 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96b015fa40 0x7f96b0155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96b015b840 0x7f96b0132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 --2- 172.21.15.37:0/694684056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b013e230 0x7f96b0152880 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 >> 172.21.15.37:0/694684056 conn(0x7f96b006dc30 msgr2=0x7f96b00cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:34.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 shutdown_connections 2023-11-24T06:16:34.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.730+0000 7f96b5c10640 1 -- 172.21.15.37:0/694684056 wait complete. 2023-11-24T06:16:34.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:16:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.986+0000 7f7c98e1a640 1 Processor -- start 2023-11-24T06:16:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.987+0000 7f7c98e1a640 1 -- start start 2023-11-24T06:16:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.988+0000 7f7c98e1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c940cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.988+0000 7f7c98e1a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7c940d17b0 0x7f7c940d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.988+0000 7f7c98e1a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c940cfc30 0x7f7c940d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.988+0000 7f7c98e1a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940ce280 con 0x7f7c940cfc30 2023-11-24T06:16:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.988+0000 7f7c98e1a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940ce4d0 con 0x7f7c940d17b0 2023-11-24T06:16:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.988+0000 7f7c98e1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940ce7b0 con 0x7f7c9415d260 2023-11-24T06:16:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c940cfc30 0x7f7c940d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c940cfc30 0x7f7c940d0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55154/0 (socket says 172.21.15.37:55154) 2023-11-24T06:16:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 -- 172.21.15.37:0/823990639 learned_addr learned my addr 172.21.15.37:0/823990639 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c8bfff640 1 --2- 172.21.15.37:0/823990639 >> v2:172.21.15.188:3300/0 conn(0x7f7c940d17b0 0x7f7c940d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 -- 172.21.15.37:0/823990639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 msgr2=0x7f7c940cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 --2- 172.21.15.37:0/823990639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c940cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 -- 172.21.15.37:0/823990639 >> v2:172.21.15.188:3300/0 conn(0x7f7c940d17b0 msgr2=0x7f7c940d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 --2- 172.21.15.37:0/823990639 >> v2:172.21.15.188:3300/0 conn(0x7f7c940d17b0 0x7f7c940d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c93fff640 1 -- 172.21.15.37:0/823990639 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940b8b40 con 0x7f7c940cfc30 2023-11-24T06:16:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.989+0000 7f7c8bfff640 1 --2- 172.21.15.37:0/823990639 >> v2:172.21.15.188:3300/0 conn(0x7f7c940d17b0 0x7f7c940d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.990+0000 7f7c93fff640 1 --2- 172.21.15.37:0/823990639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940d0080 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7c9406c510 tx=0x7f7c8c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2403e8b4e93649ea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.991+0000 7f7c92ffd640 1 -- 172.21.15.37:0/823990639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02ca70 con 0x7f7c940cfc30 2023-11-24T06:16:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.991+0000 7f7c92ffd640 1 -- 172.21.15.37:0/823990639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c02cbd0 con 0x7f7c940cfc30 2023-11-24T06:16:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.991+0000 7f7c92ffd640 1 -- 172.21.15.37:0/823990639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0343f0 con 0x7f7c940cfc30 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.991+0000 7f7c98e1a640 1 -- 172.21.15.37:0/823990639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 msgr2=0x7f7c940d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.991+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/823990639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940d0080 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7c9406c510 tx=0x7f7c8c02bed0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.992+0000 7f7c98e1a640 1 -- 172.21.15.37:0/823990639 shutdown_connections 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.992+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/823990639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940d0080 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.992+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/823990639 >> v2:172.21.15.188:3300/0 conn(0x7f7c940d17b0 0x7f7c940d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.992+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/823990639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c940cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.992+0000 7f7c98e1a640 1 -- 172.21.15.37:0/823990639 >> 172.21.15.37:0/823990639 conn(0x7f7c94061340 msgr2=0x7f7c94061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.992+0000 7f7c98e1a640 1 -- 172.21.15.37:0/823990639 shutdown_connections 2023-11-24T06:16:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.992+0000 7f7c98e1a640 1 -- 172.21.15.37:0/823990639 wait complete. 2023-11-24T06:16:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.994+0000 7f7c98e1a640 1 Processor -- start 2023-11-24T06:16:34.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.994+0000 7f7c98e1a640 1 -- start start 2023-11-24T06:16:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c98e1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c98e1a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c940d17b0 0x7f7c9415f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c98e1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c9415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c98e1a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94151fe0 con 0x7f7c940cfc30 2023-11-24T06:16:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c98e1a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940cb270 con 0x7f7c940d17b0 2023-11-24T06:16:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c98e1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940cb550 con 0x7f7c9415d260 2023-11-24T06:16:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55160/0 (socket says 172.21.15.37:55160) 2023-11-24T06:16:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.996+0000 7f7c937fe640 1 -- 172.21.15.37:0/3246310219 learned_addr learned my addr 172.21.15.37:0/3246310219 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:35.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c8bfff640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c940d17b0 0x7f7c9415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c93fff640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c9415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c937fe640 1 -- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 msgr2=0x7f7c9415fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c937fe640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c9415fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c937fe640 1 -- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c940d17b0 msgr2=0x7f7c9415f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c937fe640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c940d17b0 0x7f7c9415f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c937fe640 1 -- 172.21.15.37:0/3246310219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c009b30 con 0x7f7c940cfc30 2023-11-24T06:16:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c8bfff640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c940d17b0 0x7f7c9415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c93fff640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c9415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:35.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c937fe640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940c9d50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400b4a0 tx=0x7f7c8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c90ff9640 1 -- 172.21.15.37:0/3246310219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84010610 con 0x7f7c940cfc30 2023-11-24T06:16:35.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c90ff9640 1 -- 172.21.15.37:0/3246310219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84010770 con 0x7f7c940cfc30 2023-11-24T06:16:35.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c90ff9640 1 -- 172.21.15.37:0/3246310219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84010b20 con 0x7f7c940cfc30 2023-11-24T06:16:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.997+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c940cb830 con 0x7f7c940cfc30 2023-11-24T06:16:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.998+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c940cbdf0 con 0x7f7c940cfc30 2023-11-24T06:16:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:34.999+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c940c7ce0 con 0x7f7c940cfc30 2023-11-24T06:16:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.000+0000 7f7c90ff9640 1 -- 172.21.15.37:0/3246310219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c84010c80 con 0x7f7c940cfc30 2023-11-24T06:16:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.000+0000 7f7c90ff9640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c7406ae40 0x7f7c7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.001+0000 7f7c90ff9640 1 -- 172.21.15.37:0/3246310219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f7c84089220 con 0x7f7c940cfc30 2023-11-24T06:16:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.001+0000 7f7c8bfff640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c7406ae40 0x7f7c7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.002+0000 7f7c8bfff640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c7406ae40 0x7f7c7406d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c006fd0 tx=0x7f7c7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.005+0000 7f7c90ff9640 1 -- 172.21.15.37:0/3246310219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c84054330 con 0x7f7c940cfc30 2023-11-24T06:16:35.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.199+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c9404e840 con 0x7f7c940cfc30 2023-11-24T06:16:35.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.741+0000 7f7c90ff9640 1 -- 172.21.15.37:0/3246310219 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c84057950 con 0x7f7c940cfc30 2023-11-24T06:16:35.744 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-11-24T06:16:35.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.746+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c7406ae40 msgr2=0x7f7c7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.746+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c7406ae40 0x7f7c7406d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c006fd0 tx=0x7f7c7c008040 comp rx=0 tx=0).stop 2023-11-24T06:16:35.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.746+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 msgr2=0x7f7c940c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.746+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940c9d50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400b4a0 tx=0x7f7c8400b960 comp rx=0 tx=0).stop 2023-11-24T06:16:35.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.747+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 shutdown_connections 2023-11-24T06:16:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.747+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c7406ae40 0x7f7c7406d300 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.747+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c940d17b0 0x7f7c9415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.747+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c9415d260 0x7f7c9415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.747+0000 7f7c98e1a640 1 --2- 172.21.15.37:0/3246310219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c940cfc30 0x7f7c940c9d50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.747+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 >> 172.21.15.37:0/3246310219 conn(0x7f7c94061340 msgr2=0x7f7c9415b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.748+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 shutdown_connections 2023-11-24T06:16:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.748+0000 7f7c98e1a640 1 -- 172.21.15.37:0/3246310219 wait complete. 2023-11-24T06:16:35.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:16:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.988+0000 7f35a0f83640 1 Processor -- start 2023-11-24T06:16:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.988+0000 7f35a0f83640 1 -- start start 2023-11-24T06:16:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.990+0000 7f35a0f83640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 0x7f359c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.990+0000 7f35a0f83640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c0b14f0 con 0x7f359c0b1090 2023-11-24T06:16:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.990+0000 7f35a0f83640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c1450d0 con 0x7f359c071fe0 2023-11-24T06:16:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.990+0000 7f35a0f83640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c1422b0 con 0x7f359c141b90 2023-11-24T06:16:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.990+0000 7f359affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f359c0b1090 0x7f359c0718d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51316/0 (socket says 172.21.15.37:51316) 2023-11-24T06:16:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.990+0000 7f359affd640 1 -- 172.21.15.37:0/3164770341 learned_addr learned my addr 172.21.15.37:0/3164770341 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359b7fe640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 0x7f359c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802749158 0 0) 0x7f359c0b14f0 con 0x7f359c0b1090 2023-11-24T06:16:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3588003520 con 0x7f359c0b1090 2023-11-24T06:16:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821658396 0 0) 0x7f3588003520 con 0x7f359c0b1090 2023-11-24T06:16:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 msgr2=0x7f359c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 0x7f359c0b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 >> v1:172.21.15.188:6789/0 conn(0x7f359c071fe0 legacy=0x7f359c142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0725e0 con 0x7f359c0b1090 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f358c0019f0 con 0x7f359c0b1090 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 >> v1:172.21.15.37:6789/0 conn(0x7f359c0b1090 legacy=0x7f359c0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35880039a0 0x7f3588003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f3588004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 0x7f3588005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c1422b0 con 0x7f3588004350 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358800ba30 con 0x7f35880039a0 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.991+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358800bbf0 con 0x7f359c141b90 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359affd640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f3588004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359b7fe640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35880039a0 0x7f3588003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359bfff640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 0x7f3588005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359affd640 1 -- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 msgr2=0x7f3588005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359affd640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 0x7f3588005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359affd640 1 -- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35880039a0 msgr2=0x7f3588003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359affd640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35880039a0 0x7f3588003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359affd640 1 -- 172.21.15.37:0/3164770341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3588003520 con 0x7f3588004350 2023-11-24T06:16:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359b7fe640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35880039a0 0x7f3588003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.992+0000 7f359bfff640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c141b90 0x7f3588005120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.993+0000 7f359affd640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f3588004820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f358c00a7d0 tx=0x7f35880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23d1eed8c81e14b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c034630 con 0x7f3588004350 2023-11-24T06:16:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c02f070 con 0x7f3588004350 2023-11-24T06:16:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f359a7fc640 1 -- 172.21.15.37:0/3164770341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0349f0 con 0x7f3588004350 2023-11-24T06:16:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f35a0f83640 1 -- 172.21.15.37:0/3164770341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 msgr2=0x7f3588004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f35a0f83640 1 --2- 172.21.15.37:0/3164770341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f3588004820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f358c00a7d0 tx=0x7f35880057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f359bfff640 1 -- 172.21.15.37:0/3164770341 reap_dead start 2023-11-24T06:16:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f35a0f83640 1 -- 172.21.15.37:0/3164770341 shutdown_connections 2023-11-24T06:16:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f35a0f83640 1 -- 172.21.15.37:0/3164770341 >> 172.21.15.37:0/3164770341 conn(0x7f359c06a500 msgr2=0x7f359c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f35a0f83640 1 -- 172.21.15.37:0/3164770341 shutdown_connections 2023-11-24T06:16:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.994+0000 7f35a0f83640 1 -- 172.21.15.37:0/3164770341 wait complete. 2023-11-24T06:16:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.996+0000 7f35a0f83640 1 Processor -- start 2023-11-24T06:16:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.996+0000 7f35a0f83640 1 -- start start 2023-11-24T06:16:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.997+0000 7f35a0f83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f359c1f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.997+0000 7f35a0f83640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c1409c0 0x7f359c1f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.997+0000 7f35a0f83640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f359c1f6b30 0x7f359c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.997+0000 7f35a0f83640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b1fc0 con 0x7f3588004350 2023-11-24T06:16:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.997+0000 7f35a0f83640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b2580 con 0x7f359c1f6b30 2023-11-24T06:16:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.997+0000 7f35a0f83640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c1f70b0 con 0x7f359c1409c0 2023-11-24T06:16:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f359c1f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f359c1f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55166/0 (socket says 172.21.15.37:55166) 2023-11-24T06:16:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 -- 172.21.15.37:0/744359775 learned_addr learned my addr 172.21.15.37:0/744359775 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359affd640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c1409c0 0x7f359c1f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 -- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c1409c0 msgr2=0x7f359c1f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359bfff640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f359c1f6b30 0x7f359c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c1409c0 0x7f359c1f65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 -- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f359c1f6b30 msgr2=0x7f359c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f359c1f6b30 0x7f359c0afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 -- 172.21.15.37:0/744359775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c1f7390 con 0x7f3588004350 2023-11-24T06:16:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.998+0000 7f359b7fe640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f359c1f3050 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f35840108e0 tx=0x7f3584010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.999+0000 7f3593fff640 1 -- 172.21.15.37:0/744359775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400ebc0 con 0x7f3588004350 2023-11-24T06:16:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.999+0000 7f3593fff640 1 -- 172.21.15.37:0/744359775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400ed20 con 0x7f3588004350 2023-11-24T06:16:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.999+0000 7f3593fff640 1 -- 172.21.15.37:0/744359775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358401c600 con 0x7f3588004350 2023-11-24T06:16:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.999+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c0b2210 con 0x7f3588004350 2023-11-24T06:16:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:35.999+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c0ae4c0 con 0x7f3588004350 2023-11-24T06:16:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.000+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c1f7520 con 0x7f3588004350 2023-11-24T06:16:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.001+0000 7f3593fff640 1 -- 172.21.15.37:0/744359775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f358401c760 con 0x7f3588004350 2023-11-24T06:16:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.002+0000 7f3593fff640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f357c06ae70 0x7f357c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.002+0000 7f3593fff640 1 -- 172.21.15.37:0/744359775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3584089a80 con 0x7f3588004350 2023-11-24T06:16:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.002+0000 7f359affd640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f357c06ae70 0x7f357c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.003+0000 7f359affd640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f357c06ae70 0x7f357c06d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f358c034000 tx=0x7f358c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:36.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.007+0000 7f3593fff640 1 -- 172.21.15.37:0/744359775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3584054de0 con 0x7f3588004350 2023-11-24T06:16:36.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.221+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f359c04e840 con 0x7f3588004350 2023-11-24T06:16:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.227+0000 7f3593fff640 1 -- 172.21.15.37:0/744359775 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3584058400 con 0x7f3588004350 2023-11-24T06:16:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f357c06ae70 msgr2=0x7f357c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f357c06ae70 0x7f357c06d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f358c034000 tx=0x7f358c02f000 comp rx=0 tx=0).stop 2023-11-24T06:16:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 msgr2=0x7f359c1f3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f359c1f3050 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f35840108e0 tx=0x7f3584010da0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 shutdown_connections 2023-11-24T06:16:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f357c06ae70 0x7f357c06d330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f359c1f6b30 0x7f359c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f359c1409c0 0x7f359c1f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 --2- 172.21.15.37:0/744359775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3588004350 0x7f359c1f3050 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 >> 172.21.15.37:0/744359775 conn(0x7f359c06a500 msgr2=0x7f359c15ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 shutdown_connections 2023-11-24T06:16:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.230+0000 7f35a0f83640 1 -- 172.21.15.37:0/744359775 wait complete. 2023-11-24T06:16:36.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-11-24T06:16:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.467+0000 7f7271b0c640 1 Processor -- start 2023-11-24T06:16:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.467+0000 7f7271b0c640 1 -- start start 2023-11-24T06:16:36.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.468+0000 7f7271b0c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f726c15b5e0 0x7f726c0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f7271b0c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f7271b0c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f726c0ccea0 0x7f726c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f7271b0c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c0b4540 con 0x7f726c0ccea0 2023-11-24T06:16:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f7271b0c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c0cd870 con 0x7f726c15b5e0 2023-11-24T06:16:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f7271b0c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0711e0 con 0x7f726c0abf50 2023-11-24T06:16:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f726bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f726c0ccea0 0x7f726c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f726bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f726c0ccea0 0x7f726c0cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55178/0 (socket says 172.21.15.37:55178) 2023-11-24T06:16:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f726bfff640 1 -- 172.21.15.37:0/3729489294 learned_addr learned my addr 172.21.15.37:0/3729489294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f726b7fe640 1 --2- 172.21.15.37:0/3729489294 >> v2:172.21.15.188:3300/0 conn(0x7f726c15b5e0 0x7f726c0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.469+0000 7f726affd640 1 --2- 172.21.15.37:0/3729489294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.470+0000 7f726bfff640 1 -- 172.21.15.37:0/3729489294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 msgr2=0x7f726c0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.470+0000 7f726bfff640 1 --2- 172.21.15.37:0/3729489294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c0b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.470+0000 7f726bfff640 1 -- 172.21.15.37:0/3729489294 >> v2:172.21.15.188:3300/0 conn(0x7f726c15b5e0 msgr2=0x7f726c0b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.470+0000 7f726bfff640 1 --2- 172.21.15.37:0/3729489294 >> v2:172.21.15.188:3300/0 conn(0x7f726c15b5e0 0x7f726c0b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.470+0000 7f726bfff640 1 -- 172.21.15.37:0/3729489294 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0cdc80 con 0x7f726c0ccea0 2023-11-24T06:16:36.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.471+0000 7f726bfff640 1 --2- 172.21.15.37:0/3729489294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c0cd330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f726c06bcc0 tx=0x7f726402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e80e034c40e011 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:36.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.471+0000 7f726a7fc640 1 -- 172.21.15.37:0/3729489294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726402ca70 con 0x7f726c0ccea0 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.471+0000 7f726a7fc640 1 -- 172.21.15.37:0/3729489294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726402cbd0 con 0x7f726c0ccea0 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.471+0000 7f726a7fc640 1 -- 172.21.15.37:0/3729489294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640343f0 con 0x7f726c0ccea0 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 -- 172.21.15.37:0/3729489294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 msgr2=0x7f726c0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3729489294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c0cd330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f726c06bcc0 tx=0x7f726402bed0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 -- 172.21.15.37:0/3729489294 shutdown_connections 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3729489294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c0cd330 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3729489294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c0b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3729489294 >> v2:172.21.15.188:3300/0 conn(0x7f726c15b5e0 0x7f726c0b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 -- 172.21.15.37:0/3729489294 >> 172.21.15.37:0/3729489294 conn(0x7f726c0b0c70 msgr2=0x7f726c0b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 -- 172.21.15.37:0/3729489294 shutdown_connections 2023-11-24T06:16:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.472+0000 7f7271b0c640 1 -- 172.21.15.37:0/3729489294 wait complete. 2023-11-24T06:16:36.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.474+0000 7f7271b0c640 1 Processor -- start 2023-11-24T06:16:36.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.474+0000 7f7271b0c640 1 -- start start 2023-11-24T06:16:36.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f7271b0c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c1f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f7271b0c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f7271b0c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f726c15b5e0 0x7f726c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f7271b0c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c14c950 con 0x7f726c0ccea0 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f7271b0c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c1f3730 con 0x7f726c15b5e0 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f7271b0c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c06e580 con 0x7f726c0abf50 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f726affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f726affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c06d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55180/0 (socket says 172.21.15.37:55180) 2023-11-24T06:16:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f726affd640 1 -- 172.21.15.37:0/3277300243 learned_addr learned my addr 172.21.15.37:0/3277300243 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.475+0000 7f726b7fe640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c1f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f726bfff640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f726c15b5e0 0x7f726c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f726affd640 1 -- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 msgr2=0x7f726c1f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f726affd640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c1f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f726affd640 1 -- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f726c15b5e0 msgr2=0x7f726c158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f726affd640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f726c15b5e0 0x7f726c158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f726affd640 1 -- 172.21.15.37:0/3277300243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009b30 con 0x7f726c0ccea0 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f726affd640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c06d770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f726000d800 tx=0x7f726000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f7253fff640 1 -- 172.21.15.37:0/3277300243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72600096a0 con 0x7f726c0ccea0 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f7253fff640 1 -- 172.21.15.37:0/3277300243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260009800 con 0x7f726c0ccea0 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f7253fff640 1 -- 172.21.15.37:0/3277300243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260009b90 con 0x7f726c0ccea0 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.476+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c06dfc0 con 0x7f726c0ccea0 2023-11-24T06:16:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.477+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c158310 con 0x7f726c0ccea0 2023-11-24T06:16:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.478+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c04e8b0 con 0x7f726c0ccea0 2023-11-24T06:16:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.479+0000 7f7253fff640 1 -- 172.21.15.37:0/3277300243 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7260009cf0 con 0x7f726c0ccea0 2023-11-24T06:16:36.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.480+0000 7f7253fff640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f725806ae40 0x7f725806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:36.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.480+0000 7f7253fff640 1 -- 172.21.15.37:0/3277300243 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7260089830 con 0x7f726c0ccea0 2023-11-24T06:16:36.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.480+0000 7f726b7fe640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f725806ae40 0x7f725806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:36.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.481+0000 7f726b7fe640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f725806ae40 0x7f725806d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f725c006fd0 tx=0x7f725c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:36.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.484+0000 7f7253fff640 1 -- 172.21.15.37:0/3277300243 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7260054b80 con 0x7f726c0ccea0 2023-11-24T06:16:36.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.747+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f726c0cc9e0 con 0x7f726c0ccea0 2023-11-24T06:16:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.762+0000 7f7253fff640 1 -- 172.21.15.37:0/3277300243 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v120) v1 ==== 135+0+0 (secure 0 0 0) 0x7f726000b440 con 0x7f726c0ccea0 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f725806ae40 msgr2=0x7f725806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f725806ae40 0x7f725806d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f725c006fd0 tx=0x7f725c008040 comp rx=0 tx=0).stop 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 msgr2=0x7f726c06d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c06d770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f726000d800 tx=0x7f726000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 shutdown_connections 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f725806ae40 0x7f725806d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f726c15b5e0 0x7f726c158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c0ccea0 0x7f726c06d770 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 --2- 172.21.15.37:0/3277300243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f726c0abf50 0x7f726c1f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:36.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.765+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 >> 172.21.15.37:0/3277300243 conn(0x7f726c0b0c70 msgr2=0x7f726c155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:36.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.766+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 shutdown_connections 2023-11-24T06:16:36.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:36.766+0000 7f7271b0c640 1 -- 172.21.15.37:0/3277300243 wait complete. 2023-11-24T06:16:36.789 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2023-11-24T06:16:36.789 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2023-11-24T06:16:36.789 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2023-11-24T06:16:36.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.009+0000 7fcbf2078640 1 Processor -- start 2023-11-24T06:16:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.009+0000 7fcbf2078640 1 -- start start 2023-11-24T06:16:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.011+0000 7fcbf2078640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcbec144b30 0x7fcbec15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.011+0000 7fcbf2078640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbec15c410 0x7fcbec0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.011+0000 7fcbf2078640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec15bf80 con 0x7fcbec0b1de0 2023-11-24T06:16:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.011+0000 7fcbf2078640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0b1560 con 0x7fcbec15c410 2023-11-24T06:16:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.011+0000 7fcbf2078640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0b0fb0 con 0x7fcbec144b30 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.011+0000 7fcbf0875640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbec15c410 0x7fcbec0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.012+0000 7fcbf0875640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbec15c410 0x7fcbec0b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55192/0 (socket says 172.21.15.37:55192) 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.012+0000 7fcbf0875640 1 -- 172.21.15.37:0/2807746122 learned_addr learned my addr 172.21.15.37:0/2807746122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.012+0000 7fcbf1076640 1 --2- 172.21.15.37:0/2807746122 >> v2:172.21.15.188:3300/0 conn(0x7fcbec144b30 0x7fcbec15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.012+0000 7fcbf0875640 1 -- 172.21.15.37:0/2807746122 >> v2:172.21.15.188:3300/0 conn(0x7fcbec144b30 msgr2=0x7fcbec15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.012+0000 7fcbf0875640 1 --2- 172.21.15.37:0/2807746122 >> v2:172.21.15.188:3300/0 conn(0x7fcbec144b30 0x7fcbec15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.012+0000 7fcbf0875640 1 -- 172.21.15.37:0/2807746122 >> v1:172.21.15.37:6789/0 conn(0x7fcbec0b1de0 legacy=0x7fcbec06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.012+0000 7fcbf0875640 1 -- 172.21.15.37:0/2807746122 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0b1280 con 0x7fcbec15c410 2023-11-24T06:16:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.013+0000 7fcbf0875640 1 --2- 172.21.15.37:0/2807746122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec15c410 0x7fcbec0b0a70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcbec06f690 tx=0x7fcbdc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8550174c859b96 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.013+0000 7fcbe3fff640 1 -- 172.21.15.37:0/2807746122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc030860 con 0x7fcbec15c410 2023-11-24T06:16:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbe3fff640 1 -- 172.21.15.37:0/2807746122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0309c0 con 0x7fcbec15c410 2023-11-24T06:16:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbe3fff640 1 -- 172.21.15.37:0/2807746122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc030d50 con 0x7fcbec15c410 2023-11-24T06:16:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbf2078640 1 -- 172.21.15.37:0/2807746122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec15c410 msgr2=0x7fcbec0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbf2078640 1 --2- 172.21.15.37:0/2807746122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec15c410 0x7fcbec0b0a70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcbec06f690 tx=0x7fcbdc02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbf2078640 1 -- 172.21.15.37:0/2807746122 shutdown_connections 2023-11-24T06:16:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbf2078640 1 --2- 172.21.15.37:0/2807746122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec15c410 0x7fcbec0b0a70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbf2078640 1 --2- 172.21.15.37:0/2807746122 >> v2:172.21.15.188:3300/0 conn(0x7fcbec144b30 0x7fcbec15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbf2078640 1 -- 172.21.15.37:0/2807746122 >> 172.21.15.37:0/2807746122 conn(0x7fcbec0cb830 msgr2=0x7fcbec0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.014+0000 7fcbf2078640 1 -- 172.21.15.37:0/2807746122 shutdown_connections 2023-11-24T06:16:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.015+0000 7fcbf2078640 1 -- 172.21.15.37:0/2807746122 wait complete. 2023-11-24T06:16:37.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.017+0000 7fcbf2078640 1 Processor -- start 2023-11-24T06:16:37.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.017+0000 7fcbf2078640 1 -- start start 2023-11-24T06:16:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.018+0000 7fcbf2078640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec0b1de0 0x7fcbec0a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.018+0000 7fcbf2078640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbec144b30 0x7fcbec133520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.018+0000 7fcbf2078640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbec15c410 0x7fcbec0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.018+0000 7fcbf2078640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec1319c0 con 0x7fcbec0b1de0 2023-11-24T06:16:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.018+0000 7fcbf2078640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec133fb0 con 0x7fcbec144b30 2023-11-24T06:16:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.018+0000 7fcbf2078640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec134290 con 0x7fcbec15c410 2023-11-24T06:16:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec0b1de0 0x7fcbec0a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec0b1de0 0x7fcbec0a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55194/0 (socket says 172.21.15.37:55194) 2023-11-24T06:16:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 -- 172.21.15.37:0/1764340870 learned_addr learned my addr 172.21.15.37:0/1764340870 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf0875640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbec144b30 0x7fcbec133520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1877640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbec15c410 0x7fcbec0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 -- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbec15c410 msgr2=0x7fcbec0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbec15c410 0x7fcbec0b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 -- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbec144b30 msgr2=0x7fcbec133520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbec144b30 0x7fcbec133520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 -- 172.21.15.37:0/1764340870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0094d0 con 0x7fcbec0b1de0 2023-11-24T06:16:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1877640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbec15c410 0x7fcbec0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf0875640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbec144b30 0x7fcbec133520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.019+0000 7fcbf1076640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec0b1de0 0x7fcbec0a8c00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d800 tx=0x7fcbe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.020+0000 7fcbe1ffb640 1 -- 172.21.15.37:0/1764340870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800b6c0 con 0x7fcbec0b1de0 2023-11-24T06:16:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.020+0000 7fcbe1ffb640 1 -- 172.21.15.37:0/1764340870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe800b820 con 0x7fcbec0b1de0 2023-11-24T06:16:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.020+0000 7fcbe1ffb640 1 -- 172.21.15.37:0/1764340870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800bbb0 con 0x7fcbec0b1de0 2023-11-24T06:16:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.020+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec131650 con 0x7fcbec0b1de0 2023-11-24T06:16:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.020+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec13f740 con 0x7fcbec0b1de0 2023-11-24T06:16:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.021+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec13f930 con 0x7fcbec0b1de0 2023-11-24T06:16:37.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.022+0000 7fcbe1ffb640 1 -- 172.21.15.37:0/1764340870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbe800bd10 con 0x7fcbec0b1de0 2023-11-24T06:16:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.023+0000 7fcbe1ffb640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcbd006ae70 0x7fcbd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.023+0000 7fcbe1ffb640 1 -- 172.21.15.37:0/1764340870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcbe8089940 con 0x7fcbec0b1de0 2023-11-24T06:16:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.023+0000 7fcbf0875640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcbd006ae70 0x7fcbd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.024+0000 7fcbf0875640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcbd006ae70 0x7fcbd006d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc036000 tx=0x7fcbdc03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.028+0000 7fcbe1ffb640 1 -- 172.21.15.37:0/1764340870 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbec13f930 con 0x7fcbec0b1de0 2023-11-24T06:16:37.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.225+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbec13f930 con 0x7fcbec0b1de0 2023-11-24T06:16:37.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.227+0000 7fcbe1ffb640 1 -- 172.21.15.37:0/1764340870 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13082 (secure 0 0 0) 0x7fcbec13f930 con 0x7fcbec0b1de0 2023-11-24T06:16:37.230 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:37.230 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":44,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:35.738141+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6835/1936445066":"2023-11-25T06:16:32.577723+0000","172.21.15.188:6833/1936445066":"2023-11-25T06:16:32.577723+0000","172.21.15.37:6836/3993737526":"2023-11-25T06:16:18.597206+0000","172.21.15.37:6834/3993737526":"2023-11-25T06:16:18.597206+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:37.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcbd006ae70 msgr2=0x7fcbd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcbd006ae70 0x7fcbd006d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc036000 tx=0x7fcbdc03b040 comp rx=0 tx=0).stop 2023-11-24T06:16:37.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec0b1de0 msgr2=0x7fcbec0a8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec0b1de0 0x7fcbec0a8c00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d800 tx=0x7fcbe800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 shutdown_connections 2023-11-24T06:16:37.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcbd006ae70 0x7fcbd006d330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcbec144b30 0x7fcbec133520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcbec15c410 0x7fcbec0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 --2- 172.21.15.37:0/1764340870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbec0b1de0 0x7fcbec0a8c00 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 >> 172.21.15.37:0/1764340870 conn(0x7fcbec0cb830 msgr2=0x7fcbec071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:37.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 shutdown_connections 2023-11-24T06:16:37.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.230+0000 7fcbf2078640 1 -- 172.21.15.37:0/1764340870 wait complete. 2023-11-24T06:16:37.251 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:37.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.478+0000 7f3b8126d640 1 Processor -- start 2023-11-24T06:16:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.479+0000 7f3b8126d640 1 -- start start 2023-11-24T06:16:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.480+0000 7f3b8126d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.480+0000 7f3b8126d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3b7c0ca940 0x7f3b7c0c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.480+0000 7f3b8126d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c0b1a10 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.481+0000 7f3b8126d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c0cb960 con 0x7f3b7c0ca940 2023-11-24T06:16:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.481+0000 7f3b8126d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c161e40 con 0x7f3b7c0cb580 2023-11-24T06:16:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.481+0000 7f3b73fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3b7c0ca940 0x7f3b7c0c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.481+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.481+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:41182/0 (socket says 172.21.15.37:41182) 2023-11-24T06:16:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.481+0000 7f3b7bfff640 1 -- 172.21.15.37:0/670666097 learned_addr learned my addr 172.21.15.37:0/670666097 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.482+0000 7f3b7bfff640 1 -- 172.21.15.37:0/670666097 >> v2:172.21.15.188:3300/0 conn(0x7f3b7c0ca940 msgr2=0x7f3b7c0c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.482+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/670666097 >> v2:172.21.15.188:3300/0 conn(0x7f3b7c0ca940 0x7f3b7c0c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.482+0000 7f3b7bfff640 1 -- 172.21.15.37:0/670666097 >> v1:172.21.15.188:6789/0 conn(0x7f3b7c0b0e90 legacy=0x7f3b7c0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.482+0000 7f3b7bfff640 1 -- 172.21.15.37:0/670666097 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c162120 con 0x7f3b7c0cb580 2023-11-24T06:16:37.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.483+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/670666097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009870 tx=0x7f3b6c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0837e18efb59bf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.484+0000 7f3b7b7fe640 1 -- 172.21.15.37:0/670666097 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c030840 con 0x7f3b7c0cb580 2023-11-24T06:16:37.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.484+0000 7f3b7b7fe640 1 -- 172.21.15.37:0/670666097 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0309a0 con 0x7f3b7c0cb580 2023-11-24T06:16:37.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.484+0000 7f3b7b7fe640 1 -- 172.21.15.37:0/670666097 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c030d30 con 0x7f3b7c0cb580 2023-11-24T06:16:37.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 -- 172.21.15.37:0/670666097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0cb580 msgr2=0x7f3b7c0c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 --2- 172.21.15.37:0/670666097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009870 tx=0x7f3b6c02b980 comp rx=0 tx=0).stop 2023-11-24T06:16:37.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 -- 172.21.15.37:0/670666097 shutdown_connections 2023-11-24T06:16:37.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 --2- 172.21.15.37:0/670666097 >> v2:172.21.15.188:3300/0 conn(0x7f3b7c0ca940 0x7f3b7c0c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 --2- 172.21.15.37:0/670666097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 -- 172.21.15.37:0/670666097 >> 172.21.15.37:0/670666097 conn(0x7f3b7c0cbb40 msgr2=0x7f3b7c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 -- 172.21.15.37:0/670666097 shutdown_connections 2023-11-24T06:16:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.485+0000 7f3b8126d640 1 -- 172.21.15.37:0/670666097 wait complete. 2023-11-24T06:16:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.487+0000 7f3b8126d640 1 Processor -- start 2023-11-24T06:16:37.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.487+0000 7f3b8126d640 1 -- start start 2023-11-24T06:16:37.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b8126d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0b0e90 0x7f3b7c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b8126d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0ca940 0x7f3b7c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b8126d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b8126d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c158b40 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b8126d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c6500 con 0x7f3b7c0cb580 2023-11-24T06:16:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b8126d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c67e0 con 0x7f3b7c0ca940 2023-11-24T06:16:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0b0e90 0x7f3b7c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0b0e90 0x7f3b7c0c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55208/0 (socket says 172.21.15.37:55208) 2023-11-24T06:16:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b7bfff640 1 -- 172.21.15.37:0/412155109 learned_addr learned my addr 172.21.15.37:0/412155109 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b73fff640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0ca940 0x7f3b7c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b7bfff640 1 -- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0ca940 msgr2=0x7f3b7c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0ca940 0x7f3b7c0b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b80a6c640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.489+0000 7f3b7bfff640 1 -- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b7c0cb580 msgr2=0x7f3b7c0c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b7bfff640 1 -- 172.21.15.37:0/412155109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0094d0 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b80a6c640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0b0e90 0x7f3b7c0c75a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0090b0 tx=0x7f3b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b797fa640 1 -- 172.21.15.37:0/412155109 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c03e070 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b797fa640 1 -- 172.21.15.37:0/412155109 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c039a10 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b797fa640 1 -- 172.21.15.37:0/412155109 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c039de0 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c0c6ac0 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.490+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c0c7080 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.492+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c164dc0 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.492+0000 7f3b797fa640 1 -- 172.21.15.37:0/412155109 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b6c04b400 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.493+0000 7f3b797fa640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3b5c06ae40 0x7f3b5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.493+0000 7f3b797fa640 1 -- 172.21.15.37:0/412155109 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3b6c0ab990 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.494+0000 7f3b73fff640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3b5c06ae40 0x7f3b5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.494+0000 7f3b73fff640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3b5c06ae40 0x7f3b5c06d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c164130 tx=0x7f3b64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.498+0000 7f3b797fa640 1 -- 172.21.15.37:0/412155109 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b6c076c40 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.695+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b7c04e840 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.696+0000 7f3b797fa640 1 -- 172.21.15.37:0/412155109 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b6c034020 con 0x7f3b7c0b0e90 2023-11-24T06:16:37.699 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.698+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3b5c06ae40 msgr2=0x7f3b5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.698+0000 7f3b8126d640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3b5c06ae40 0x7f3b5c06d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c164130 tx=0x7f3b64008040 comp rx=0 tx=0).stop 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.698+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0b0e90 msgr2=0x7f3b7c0c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.698+0000 7f3b8126d640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0b0e90 0x7f3b7c0c75a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0090b0 tx=0x7f3b6c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 shutdown_connections 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3b5c06ae40 0x7f3b5c06d300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b7c0cb580 0x7f3b7c0c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b7c0ca940 0x7f3b7c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 --2- 172.21.15.37:0/412155109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0b0e90 0x7f3b7c0c75a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 >> 172.21.15.37:0/412155109 conn(0x7f3b7c0cbb40 msgr2=0x7f3b7c164590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 shutdown_connections 2023-11-24T06:16:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.699+0000 7f3b8126d640 1 -- 172.21.15.37:0/412155109 wait complete. 2023-11-24T06:16:37.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-11-24T06:16:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.945+0000 7f1fac82d640 1 Processor -- start 2023-11-24T06:16:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.945+0000 7f1fac82d640 1 -- start start 2023-11-24T06:16:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.947+0000 7f1fac82d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1fa8160930 0x7f1fa806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.947+0000 7f1fac82d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa80cf330 con 0x7f1fa80cfc90 2023-11-24T06:16:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.947+0000 7f1fac82d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa80ced70 con 0x7f1fa80d1fd0 2023-11-24T06:16:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.947+0000 7f1fac82d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80cf050 con 0x7f1fa8160930 2023-11-24T06:16:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.947+0000 7f1fa5d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1fa80cfc90 0x7f1fa80d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51332/0 (socket says 172.21.15.37:51332) 2023-11-24T06:16:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.947+0000 7f1fa5d9b640 1 -- 172.21.15.37:0/1202607617 learned_addr learned my addr 172.21.15.37:0/1202607617 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa659c640 1 --2- 172.21.15.37:0/1202607617 >> v2:172.21.15.188:3300/0 conn(0x7f1fa8160930 0x7f1fa806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526245836 0 0) 0x7f1fa80cf330 con 0x7f1fa80cfc90 2023-11-24T06:16:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f94003520 con 0x7f1fa80cfc90 2023-11-24T06:16:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2137690110 0 0) 0x7f1f94003520 con 0x7f1fa80cfc90 2023-11-24T06:16:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 >> v2:172.21.15.188:3300/0 conn(0x7f1fa8160930 msgr2=0x7f1fa806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 --2- 172.21.15.37:0/1202607617 >> v2:172.21.15.188:3300/0 conn(0x7f1fa8160930 0x7f1fa806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 >> v1:172.21.15.188:6789/0 conn(0x7f1fa80d1fd0 legacy=0x7f1fa80cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80d10c0 con 0x7f1fa80cfc90 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f1f900019f0 con 0x7f1fa80cfc90 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.948+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 >> v1:172.21.15.37:6789/0 conn(0x7f1fa80cfc90 legacy=0x7f1fa80d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa559a640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f94003970 0x7f1f94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa559a640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1f94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa559a640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f94005180 0x7f1f9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80cf050 con 0x7f1f940047c0 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9400c120 con 0x7f1f94003970 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9400c2e0 con 0x7f1f94005180 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa5d9b640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1f94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa659c640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f94003970 0x7f1f94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa5d9b640 1 -- 172.21.15.37:0/1202607617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f94005180 msgr2=0x7f1f9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa5d9b640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f94005180 0x7f1f9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa5d9b640 1 -- 172.21.15.37:0/1202607617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f94003970 msgr2=0x7f1f94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa5d9b640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f94003970 0x7f1f94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa5d9b640 1 -- 172.21.15.37:0/1202607617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94003520 con 0x7f1f940047c0 2023-11-24T06:16:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.949+0000 7f1fa6d9d640 1 -- 172.21.15.37:0/1202607617 reap_dead start 2023-11-24T06:16:37.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.951+0000 7f1fa5d9b640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1f94004c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000a830 tx=0x7f1f940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8383fdaf0efa3408 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.951+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900072d0 con 0x7f1f940047c0 2023-11-24T06:16:37.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.951+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9002f070 con 0x7f1f940047c0 2023-11-24T06:16:37.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.951+0000 7f1fa559a640 1 -- 172.21.15.37:0/1202607617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900076f0 con 0x7f1f940047c0 2023-11-24T06:16:37.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.951+0000 7f1fac82d640 1 -- 172.21.15.37:0/1202607617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 msgr2=0x7f1f94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.951+0000 7f1fac82d640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1f94004c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000a830 tx=0x7f1f940057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.952+0000 7f1fac82d640 1 -- 172.21.15.37:0/1202607617 shutdown_connections 2023-11-24T06:16:37.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.952+0000 7f1fac82d640 1 --2- 172.21.15.37:0/1202607617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1f94004c40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.952+0000 7f1fac82d640 1 -- 172.21.15.37:0/1202607617 >> 172.21.15.37:0/1202607617 conn(0x7f1fa809c750 msgr2=0x7f1fa80d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:37.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.952+0000 7f1fac82d640 1 -- 172.21.15.37:0/1202607617 shutdown_connections 2023-11-24T06:16:37.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.952+0000 7f1fac82d640 1 -- 172.21.15.37:0/1202607617 wait complete. 2023-11-24T06:16:37.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.953+0000 7f1fac82d640 1 Processor -- start 2023-11-24T06:16:37.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.954+0000 7f1fac82d640 1 -- start start 2023-11-24T06:16:37.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fac82d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1fa80ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fac82d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fa81f4730 0x7f1fa81f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fac82d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1fa80cab00 0x7f1fa80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fac82d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80c9020 con 0x7f1f940047c0 2023-11-24T06:16:37.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fac82d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81f4570 con 0x7f1fa81f4730 2023-11-24T06:16:37.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fac82d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81f4c30 con 0x7f1fa80cab00 2023-11-24T06:16:37.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1fa80ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1fa80ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55228/0 (socket says 172.21.15.37:55228) 2023-11-24T06:16:37.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 -- 172.21.15.37:0/2971804235 learned_addr learned my addr 172.21.15.37:0/2971804235 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:37.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa6d9d640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1fa80cab00 0x7f1fa80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 -- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1fa80cab00 msgr2=0x7f1fa80b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa5d9b640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fa81f4730 0x7f1fa81f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1fa80cab00 0x7f1fa80b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 -- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fa81f4730 msgr2=0x7f1fa81f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fa81f4730 0x7f1fa81f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.955+0000 7f1fa659c640 1 -- 172.21.15.37:0/2971804235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa81f4f10 con 0x7f1f940047c0 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.956+0000 7f1fa659c640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1fa80ccb80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1f980116d0 tx=0x7f1f98011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.956+0000 7f1f9effd640 1 -- 172.21.15.37:0/2971804235 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800f9c0 con 0x7f1f940047c0 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.956+0000 7f1f9effd640 1 -- 172.21.15.37:0/2971804235 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800fb20 con 0x7f1f940047c0 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.956+0000 7f1f9effd640 1 -- 172.21.15.37:0/2971804235 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800fe90 con 0x7f1f940047c0 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.956+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa81f51f0 con 0x7f1f940047c0 2023-11-24T06:16:37.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.956+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa81f57b0 con 0x7f1f940047c0 2023-11-24T06:16:37.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.957+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa81f5940 con 0x7f1f940047c0 2023-11-24T06:16:37.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.958+0000 7f1f9effd640 1 -- 172.21.15.37:0/2971804235 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f98015460 con 0x7f1f940047c0 2023-11-24T06:16:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.959+0000 7f1f9effd640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f8806ae40 0x7f1f8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.959+0000 7f1f9effd640 1 -- 172.21.15.37:0/2971804235 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1f98089970 con 0x7f1f940047c0 2023-11-24T06:16:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.960+0000 7f1fa5d9b640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f8806ae40 0x7f1f8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:37.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.960+0000 7f1fa5d9b640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f8806ae40 0x7f1f8806d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1f90034000 tx=0x7f1f90007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:37.964+0000 7f1f9effd640 1 -- 172.21.15.37:0/2971804235 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f98054c20 con 0x7f1f940047c0 2023-11-24T06:16:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.221+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f1fa804e8b0 con 0x7f1f940047c0 2023-11-24T06:16:38.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.773+0000 7f1f9effd640 1 -- 172.21.15.37:0/2971804235 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v122) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1f98058240 con 0x7f1f940047c0 2023-11-24T06:16:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f8806ae40 msgr2=0x7f1f8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f8806ae40 0x7f1f8806d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1f90034000 tx=0x7f1f90007000 comp rx=0 tx=0).stop 2023-11-24T06:16:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 msgr2=0x7f1fa80ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1fa80ccb80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1f980116d0 tx=0x7f1f98011b90 comp rx=0 tx=0).stop 2023-11-24T06:16:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 shutdown_connections 2023-11-24T06:16:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f8806ae40 0x7f1f8806d300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1fa81f4730 0x7f1fa81f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1fa80cab00 0x7f1fa80b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 --2- 172.21.15.37:0/2971804235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f940047c0 0x7f1fa80ccb80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 >> 172.21.15.37:0/2971804235 conn(0x7f1fa809c750 msgr2=0x7f1fa80d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 shutdown_connections 2023-11-24T06:16:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:38.777+0000 7f1fac82d640 1 -- 172.21.15.37:0/2971804235 wait complete. 2023-11-24T06:16:38.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:16:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.029+0000 7f3cdf883640 1 Processor -- start 2023-11-24T06:16:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.029+0000 7f3cdf883640 1 -- start start 2023-11-24T06:16:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdf883640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd815b440 0x7f3cd80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdf883640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd80c59b0 0x7f3cd806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdf883640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80cc3a0 con 0x7f3cd80cbf20 2023-11-24T06:16:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdf883640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd815b820 con 0x7f3cd80c59b0 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdf883640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd815eea0 con 0x7f3cd815b440 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdde20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd80c59b0 0x7f3cd806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdde20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd80c59b0 0x7f3cd806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55234/0 (socket says 172.21.15.37:55234) 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.031+0000 7f3cdde20640 1 -- 172.21.15.37:0/2694502508 learned_addr learned my addr 172.21.15.37:0/2694502508 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.032+0000 7f3cdd61f640 1 --2- 172.21.15.37:0/2694502508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd815b440 0x7f3cd80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.032+0000 7f3cdde20640 1 -- 172.21.15.37:0/2694502508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd815b440 msgr2=0x7f3cd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.032+0000 7f3cdde20640 1 --2- 172.21.15.37:0/2694502508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd815b440 0x7f3cd80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.032+0000 7f3cdde20640 1 -- 172.21.15.37:0/2694502508 >> v1:172.21.15.188:6789/0 conn(0x7f3cd80cbf20 legacy=0x7f3cd80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.032+0000 7f3cdde20640 1 -- 172.21.15.37:0/2694502508 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80abf30 con 0x7f3cd80c59b0 2023-11-24T06:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.033+0000 7f3cdde20640 1 --2- 172.21.15.37:0/2694502508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80c59b0 0x7f3cd806c5f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009e50 tx=0x7f3cd002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f3e1c28d078f0f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.033+0000 7f3ccffff640 1 -- 172.21.15.37:0/2694502508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd002c9e0 con 0x7f3cd80c59b0 2023-11-24T06:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3ccffff640 1 -- 172.21.15.37:0/2694502508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd002cb40 con 0x7f3cd80c59b0 2023-11-24T06:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3ccffff640 1 -- 172.21.15.37:0/2694502508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00343f0 con 0x7f3cd80c59b0 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 -- 172.21.15.37:0/2694502508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80c59b0 msgr2=0x7f3cd806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 --2- 172.21.15.37:0/2694502508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80c59b0 0x7f3cd806c5f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009e50 tx=0x7f3cd002be40 comp rx=0 tx=0).stop 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 -- 172.21.15.37:0/2694502508 shutdown_connections 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 --2- 172.21.15.37:0/2694502508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80c59b0 0x7f3cd806c5f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 --2- 172.21.15.37:0/2694502508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd815b440 0x7f3cd80cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 -- 172.21.15.37:0/2694502508 >> 172.21.15.37:0/2694502508 conn(0x7f3cd80b0c50 msgr2=0x7f3cd80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 -- 172.21.15.37:0/2694502508 shutdown_connections 2023-11-24T06:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.034+0000 7f3cdf883640 1 -- 172.21.15.37:0/2694502508 wait complete. 2023-11-24T06:16:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.036+0000 7f3cdf883640 1 Processor -- start 2023-11-24T06:16:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.036+0000 7f3cdf883640 1 -- start start 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.037+0000 7f3cdf883640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd80c59b0 0x7f3cd8154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.037+0000 7f3cdf883640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cd80cbf20 0x7f3cd80c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.037+0000 7f3cdf883640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd815b440 0x7f3cd81546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.037+0000 7f3cdf883640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd8154570 con 0x7f3cd815b440 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.037+0000 7f3cdf883640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c82d0 con 0x7f3cd80cbf20 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.037+0000 7f3cdf883640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c7470 con 0x7f3cd80c59b0 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd815b440 0x7f3cd81546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd815b440 0x7f3cd81546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55244/0 (socket says 172.21.15.37:55244) 2023-11-24T06:16:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 -- 172.21.15.37:0/336321440 learned_addr learned my addr 172.21.15.37:0/336321440 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdd61f640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd80c59b0 0x7f3cd8154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdce1e640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cd80cbf20 0x7f3cd80c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 -- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd80c59b0 msgr2=0x7f3cd8154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd80c59b0 0x7f3cd8154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 -- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cd80cbf20 msgr2=0x7f3cd80c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cd80cbf20 0x7f3cd80c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 -- 172.21.15.37:0/336321440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0009b30 con 0x7f3cd815b440 2023-11-24T06:16:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdd61f640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd80c59b0 0x7f3cd8154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdce1e640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cd80cbf20 0x7f3cd80c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.038+0000 7f3cdde20640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd815b440 0x7f3cd81546e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009e50 tx=0x7f3cd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.039+0000 7f3ccdffb640 1 -- 172.21.15.37:0/336321440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0009510 con 0x7f3cd815b440 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.039+0000 7f3ccdffb640 1 -- 172.21.15.37:0/336321440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd003e450 con 0x7f3cd815b440 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.039+0000 7f3ccdffb640 1 -- 172.21.15.37:0/336321440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd003e800 con 0x7f3cd815b440 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.039+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd815a3d0 con 0x7f3cd815b440 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.039+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd80c79a0 con 0x7f3cd815b440 2023-11-24T06:16:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.040+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd81554b0 con 0x7f3cd815b440 2023-11-24T06:16:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.041+0000 7f3ccdffb640 1 -- 172.21.15.37:0/336321440 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cd003e960 con 0x7f3cd815b440 2023-11-24T06:16:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.042+0000 7f3ccdffb640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cbc06ae40 0x7f3cbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.042+0000 7f3ccdffb640 1 -- 172.21.15.37:0/336321440 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3cd00abfe0 con 0x7f3cd815b440 2023-11-24T06:16:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.042+0000 7f3cdd61f640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cbc06ae40 0x7f3cbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.043+0000 7f3cdd61f640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cbc06ae40 0x7f3cbc06d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4006fd0 tx=0x7f3cd4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.046+0000 7f3ccdffb640 1 -- 172.21.15.37:0/336321440 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3cd81554b0 con 0x7f3cd815b440 2023-11-24T06:16:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.240+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3cd80cc3a0 con 0x7f3cd815b440 2023-11-24T06:16:39.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.247+0000 7f3ccdffb640 1 -- 172.21.15.37:0/336321440 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3cd80cc3a0 con 0x7f3cd815b440 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cbc06ae40 msgr2=0x7f3cbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cbc06ae40 0x7f3cbc06d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4006fd0 tx=0x7f3cd4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd815b440 msgr2=0x7f3cd81546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd815b440 0x7f3cd81546e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009e50 tx=0x7f3cd0004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 shutdown_connections 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3cbc06ae40 0x7f3cbc06d300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cd80cbf20 0x7f3cd80c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd815b440 0x7f3cd81546e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 --2- 172.21.15.37:0/336321440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cd80c59b0 0x7f3cd8154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 >> 172.21.15.37:0/336321440 conn(0x7f3cd80b0c50 msgr2=0x7f3cd80c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 shutdown_connections 2023-11-24T06:16:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.250+0000 7f3cdf883640 1 -- 172.21.15.37:0/336321440 wait complete. 2023-11-24T06:16:39.271 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:16:39.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:39.381 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:16:39.502 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:16:39.503 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:16:39.503 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:39.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:16:39.565 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:16:39.565 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:39.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:39.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:16:39.625 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:16:39.625 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:39.634 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:16:39.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:16:39.685 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:16:39.685 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:16:39.734 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:16:39.735 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:16:39.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:39.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.970+0000 7fb1c9e90640 1 Processor -- start 2023-11-24T06:16:39.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.970+0000 7fb1c9e90640 1 -- start start 2023-11-24T06:16:39.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.971+0000 7fb1c9e90640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40cf510 0x7fb1c40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.971+0000 7fb1c9e90640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1c40ce0e0 0x7fb1c406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.971+0000 7fb1c9e90640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c415c860 con 0x7fb1c415c480 2023-11-24T06:16:39.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.971+0000 7fb1c9e90640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c4141830 con 0x7fb1c40ce0e0 2023-11-24T06:16:39.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.971+0000 7fb1c9e90640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4140c20 con 0x7fb1c40cf510 2023-11-24T06:16:39.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.971+0000 7fb1c3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1c40ce0e0 0x7fb1c406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.972+0000 7fb1c3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1c40ce0e0 0x7fb1c406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55246/0 (socket says 172.21.15.37:55246) 2023-11-24T06:16:39.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.972+0000 7fb1c3fff640 1 -- 172.21.15.37:0/791496504 learned_addr learned my addr 172.21.15.37:0/791496504 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:39.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.972+0000 7fb1c2ffd640 1 --2- 172.21.15.37:0/791496504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40cf510 0x7fb1c40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.972+0000 7fb1c3fff640 1 -- 172.21.15.37:0/791496504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40cf510 msgr2=0x7fb1c40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.972+0000 7fb1c3fff640 1 --2- 172.21.15.37:0/791496504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40cf510 0x7fb1c40cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.972+0000 7fb1c3fff640 1 -- 172.21.15.37:0/791496504 >> v1:172.21.15.188:6789/0 conn(0x7fb1c415c480 legacy=0x7fb1c40cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:39.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.972+0000 7fb1c3fff640 1 -- 172.21.15.37:0/791496504 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4140f00 con 0x7fb1c40ce0e0 2023-11-24T06:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.973+0000 7fb1c3fff640 1 --2- 172.21.15.37:0/791496504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c40ce0e0 0x7fb1c406ff90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009870 tx=0x7fb1bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2948fbe24b1fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c27fc640 1 -- 172.21.15.37:0/791496504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc031640 con 0x7fb1c40ce0e0 2023-11-24T06:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c27fc640 1 -- 172.21.15.37:0/791496504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0317a0 con 0x7fb1c40ce0e0 2023-11-24T06:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c27fc640 1 -- 172.21.15.37:0/791496504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc031b30 con 0x7fb1c40ce0e0 2023-11-24T06:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c9e90640 1 -- 172.21.15.37:0/791496504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c40ce0e0 msgr2=0x7fb1c406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/791496504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c40ce0e0 0x7fb1c406ff90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009870 tx=0x7fb1bc02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c9e90640 1 -- 172.21.15.37:0/791496504 shutdown_connections 2023-11-24T06:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/791496504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c40ce0e0 0x7fb1c406ff90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/791496504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40cf510 0x7fb1c40cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c9e90640 1 -- 172.21.15.37:0/791496504 >> 172.21.15.37:0/791496504 conn(0x7fb1c40b2e40 msgr2=0x7fb1c40b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.974+0000 7fb1c9e90640 1 -- 172.21.15.37:0/791496504 shutdown_connections 2023-11-24T06:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.975+0000 7fb1c9e90640 1 -- 172.21.15.37:0/791496504 wait complete. 2023-11-24T06:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.976+0000 7fb1c9e90640 1 Processor -- start 2023-11-24T06:16:39.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.976+0000 7fb1c9e90640 1 -- start start 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.977+0000 7fb1c9e90640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40ce0e0 0x7fb1c4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.977+0000 7fb1c9e90640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1c40cf510 0x7fb1c415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.977+0000 7fb1c9e90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c415c480 0x7fb1c40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.977+0000 7fb1c9e90640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c415af30 con 0x7fb1c415c480 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.977+0000 7fb1c9e90640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40c8840 con 0x7fb1c40cf510 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.977+0000 7fb1c9e90640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c415b320 con 0x7fb1c40ce0e0 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c415c480 0x7fb1c40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c415c480 0x7fb1c40c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55260/0 (socket says 172.21.15.37:55260) 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 -- 172.21.15.37:0/2979699010 learned_addr learned my addr 172.21.15.37:0/2979699010 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c37fe640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40ce0e0 0x7fb1c4158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c2ffd640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1c40cf510 0x7fb1c415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 -- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40ce0e0 msgr2=0x7fb1c4158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40ce0e0 0x7fb1c4158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 -- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1c40cf510 msgr2=0x7fb1c415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:39.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1c40cf510 0x7fb1c415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:39.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.978+0000 7fb1c3fff640 1 -- 172.21.15.37:0/2979699010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0094d0 con 0x7fb1c415c480 2023-11-24T06:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.979+0000 7fb1c3fff640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c415c480 0x7fb1c40c8300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009870 tx=0x7fb1bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.979+0000 7fb1bbfff640 1 -- 172.21.15.37:0/2979699010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc03ac60 con 0x7fb1c415c480 2023-11-24T06:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.979+0000 7fb1bbfff640 1 -- 172.21.15.37:0/2979699010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc03adc0 con 0x7fb1c415c480 2023-11-24T06:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.979+0000 7fb1bbfff640 1 -- 172.21.15.37:0/2979699010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc044630 con 0x7fb1c415c480 2023-11-24T06:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.979+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c406ba90 con 0x7fb1c415c480 2023-11-24T06:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.979+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c40c8d50 con 0x7fb1c415c480 2023-11-24T06:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.980+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c406bc20 con 0x7fb1c415c480 2023-11-24T06:16:39.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.981+0000 7fb1bbfff640 1 -- 172.21.15.37:0/2979699010 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1bc02f050 con 0x7fb1c415c480 2023-11-24T06:16:39.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.982+0000 7fb1bbfff640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:39.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.982+0000 7fb1bbfff640 1 -- 172.21.15.37:0/2979699010 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb1bc0ab150 con 0x7fb1c415c480 2023-11-24T06:16:39.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.982+0000 7fb1c37fe640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:39.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.983+0000 7fb1c37fe640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb1a406ae70 0x7fb1a406d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4006fd0 tx=0x7fb1b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:39.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:39.986+0000 7fb1bbfff640 1 -- 172.21.15.37:0/2979699010 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1bc076520 con 0x7fb1c415c480 2023-11-24T06:16:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.223+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1c415c860 con 0x7fb1c415c480 2023-11-24T06:16:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.224+0000 7fb1bbfff640 1 -- 172.21.15.37:0/2979699010 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fb1c415c860 con 0x7fb1c415c480 2023-11-24T06:16:40.230 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:40.230 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4756,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/1178714141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1178714141},{"type":"v1","addr":"172.21.15.188:6834","nonce":1178714141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3045701683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":3045701683},{"type":"v1","addr":"172.21.15.37:6837","nonce":3045701683}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2949938308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2949938308},{"type":"v1","addr":"172.21.15.188:6835","nonce":2949938308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5340,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/2712376439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2712376439},{"type":"v1","addr":"172.21.15.37:6836","nonce":2712376439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[]} 2023-11-24T06:16:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2023-11-24T06:16:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb1a406ae70 msgr2=0x7fb1a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb1a406ae70 0x7fb1a406d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4006fd0 tx=0x7fb1b4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c415c480 msgr2=0x7fb1c40c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c415c480 0x7fb1c40c8300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009870 tx=0x7fb1bc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 shutdown_connections 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1c40cf510 0x7fb1c415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c415c480 0x7fb1c40c8300 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 --2- 172.21.15.37:0/2979699010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1c40ce0e0 0x7fb1c4158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 >> 172.21.15.37:0/2979699010 conn(0x7fb1c40b2e40 msgr2=0x7fb1c40cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 shutdown_connections 2023-11-24T06:16:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.227+0000 7fb1c9e90640 1 -- 172.21.15.37:0/2979699010 wait complete. 2023-11-24T06:16:40.250 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:16:40.250 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:16:40.251 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:16:40.251 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:40.251 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:16:40.251 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:16:40.251 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:16:40.251 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:40.251 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:16:40.252 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:16:40.252 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:16:40.252 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:40.252 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:16:40.252 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:16:40.252 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:16:40.252 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:16:40.270 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:16:40.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:16:40.272 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:16:40.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:16:40.273 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:16:40.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:16:40.276 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:16:40.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:16:40.320 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:16:40.321 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:40.324 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:16:40.324 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:40.328 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:16:40.328 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:40.331 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:16:40.331 DEBUG:teuthology.parallel:result is None 2023-11-24T06:16:40.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:16:40.483 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-11-24T06:16:40.489 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2023-11-24T06:16:40.490 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2023-11-24T06:16:40.490 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-11-24T06:16:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.527+0000 7f02e7b33640 1 Processor -- start 2023-11-24T06:16:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.527+0000 7f02e7b33640 1 -- start start 2023-11-24T06:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.528+0000 7f02e7b33640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e0072160 0x7f02e015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.528+0000 7f02e7b33640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f02e00c49f0 0x7f02e006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.528+0000 7f02e7b33640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e015ec90 con 0x7f02e006dc40 2023-11-24T06:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.528+0000 7f02e7b33640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e006e0f0 con 0x7f02e00c49f0 2023-11-24T06:16:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.528+0000 7f02e7b33640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00cd530 con 0x7f02e0072160 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e58cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e0072160 0x7f02e015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e50ce640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f02e00c49f0 0x7f02e006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e58cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e0072160 0x7f02e015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:41272/0 (socket says 172.21.15.37:41272) 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e58cf640 1 -- 172.21.15.37:0/1973995184 learned_addr learned my addr 172.21.15.37:0/1973995184 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e58cf640 1 -- 172.21.15.37:0/1973995184 >> v2:172.21.15.188:3300/0 conn(0x7f02e00c49f0 msgr2=0x7f02e006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e58cf640 1 --2- 172.21.15.37:0/1973995184 >> v2:172.21.15.188:3300/0 conn(0x7f02e00c49f0 0x7f02e006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e58cf640 1 -- 172.21.15.37:0/1973995184 >> v1:172.21.15.188:6789/0 conn(0x7f02e006dc40 legacy=0x7f02e00cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.529+0000 7f02e58cf640 1 -- 172.21.15.37:0/1973995184 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00c4ed0 con 0x7f02e0072160 2023-11-24T06:16:40.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.530+0000 7f02e58cf640 1 --2- 172.21.15.37:0/1973995184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e0072160 0x7f02e015e750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d150 tx=0x7f02dc02e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7049e95c48068e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.531+0000 7f02e48cd640 1 -- 172.21.15.37:0/1973995184 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00b0d0 con 0x7f02e0072160 2023-11-24T06:16:40.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.531+0000 7f02e48cd640 1 -- 172.21.15.37:0/1973995184 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc00b230 con 0x7f02e0072160 2023-11-24T06:16:40.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.531+0000 7f02e48cd640 1 -- 172.21.15.37:0/1973995184 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc009600 con 0x7f02e0072160 2023-11-24T06:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.531+0000 7f02e7b33640 1 -- 172.21.15.37:0/1973995184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e0072160 msgr2=0x7f02e015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.531+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1973995184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e0072160 0x7f02e015e750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d150 tx=0x7f02dc02e160 comp rx=0 tx=0).stop 2023-11-24T06:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.532+0000 7f02e7b33640 1 -- 172.21.15.37:0/1973995184 shutdown_connections 2023-11-24T06:16:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.532+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1973995184 >> v2:172.21.15.188:3300/0 conn(0x7f02e00c49f0 0x7f02e006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.532+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1973995184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e0072160 0x7f02e015e750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.532+0000 7f02e7b33640 1 -- 172.21.15.37:0/1973995184 >> 172.21.15.37:0/1973995184 conn(0x7f02e00b0c50 msgr2=0x7f02e00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.532+0000 7f02e7b33640 1 -- 172.21.15.37:0/1973995184 shutdown_connections 2023-11-24T06:16:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.532+0000 7f02e7b33640 1 -- 172.21.15.37:0/1973995184 wait complete. 2023-11-24T06:16:40.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.533+0000 7f02e7b33640 1 Processor -- start 2023-11-24T06:16:40.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.534+0000 7f02e7b33640 1 -- start start 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.534+0000 7f02e7b33640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e006dc40 0x7f02e015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.534+0000 7f02e7b33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02e0072160 0x7f02e00b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.534+0000 7f02e7b33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00c49f0 0x7f02e009bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e7b33640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00b5030 con 0x7f02e00c49f0 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e7b33640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e009c000 con 0x7f02e0072160 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e7b33640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e015c100 con 0x7f02e006dc40 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00c49f0 0x7f02e009bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00c49f0 0x7f02e009bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55290/0 (socket says 172.21.15.37:55290) 2023-11-24T06:16:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 -- 172.21.15.37:0/1110107949 learned_addr learned my addr 172.21.15.37:0/1110107949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e58cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e006dc40 0x7f02e015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e50ce640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02e0072160 0x7f02e00b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 -- 172.21.15.37:0/1110107949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e006dc40 msgr2=0x7f02e015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e006dc40 0x7f02e015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 -- 172.21.15.37:0/1110107949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02e0072160 msgr2=0x7f02e00b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02e0072160 0x7f02e00b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:40.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.535+0000 7f02e60d0640 1 -- 172.21.15.37:0/1110107949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc00bd40 con 0x7f02e00c49f0 2023-11-24T06:16:40.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.536+0000 7f02e60d0640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00c49f0 0x7f02e009bac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f02d8001eb0 tx=0x7f02d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.536+0000 7f02d67fc640 1 -- 172.21.15.37:0/1110107949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80052d0 con 0x7f02e00c49f0 2023-11-24T06:16:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.536+0000 7f02d67fc640 1 -- 172.21.15.37:0/1110107949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8005430 con 0x7f02e00c49f0 2023-11-24T06:16:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.536+0000 7f02d67fc640 1 -- 172.21.15.37:0/1110107949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8003810 con 0x7f02e00c49f0 2023-11-24T06:16:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.536+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e015b4f0 con 0x7f02e00c49f0 2023-11-24T06:16:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.536+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e015bab0 con 0x7f02e00c49f0 2023-11-24T06:16:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.537+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e004e8b0 con 0x7f02e00c49f0 2023-11-24T06:16:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.539+0000 7f02d67fc640 1 -- 172.21.15.37:0/1110107949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02d8003970 con 0x7f02e00c49f0 2023-11-24T06:16:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.540+0000 7f02d67fc640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f02c406ae40 0x7f02c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.540+0000 7f02d67fc640 1 -- 172.21.15.37:0/1110107949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f02d80886f0 con 0x7f02e00c49f0 2023-11-24T06:16:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.540+0000 7f02e58cf640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f02c406ae40 0x7f02c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.541+0000 7f02e58cf640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f02c406ae40 0x7f02c406d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02dc037000 tx=0x7f02dc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:40.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.544+0000 7f02d67fc640 1 -- 172.21.15.37:0/1110107949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f02d8053ae0 con 0x7f02e00c49f0 2023-11-24T06:16:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:40.761+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02e015ec90 con 0x7f02e00c49f0 2023-11-24T06:16:41.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.705+0000 7f02d67fc640 1 -- 172.21.15.37:0/1110107949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02e015ec90 con 0x7f02e00c49f0 2023-11-24T06:16:43.812 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-11-24T06:16:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.709+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f02c406ae40 msgr2=0x7f02c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.709+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f02c406ae40 0x7f02c406d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02dc037000 tx=0x7f02dc032000 comp rx=0 tx=0).stop 2023-11-24T06:16:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.709+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00c49f0 msgr2=0x7f02e009bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.709+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00c49f0 0x7f02e009bac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f02d8001eb0 tx=0x7f02d800c890 comp rx=0 tx=0).stop 2023-11-24T06:16:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 shutdown_connections 2023-11-24T06:16:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f02c406ae40 0x7f02c406d300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02e0072160 0x7f02e00b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00c49f0 0x7f02e009bac0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 --2- 172.21.15.37:0/1110107949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02e006dc40 0x7f02e015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 >> 172.21.15.37:0/1110107949 conn(0x7f02e00b0c50 msgr2=0x7f02e00704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 shutdown_connections 2023-11-24T06:16:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:41.710+0000 7f02e7b33640 1 -- 172.21.15.37:0/1110107949 wait complete. 2023-11-24T06:16:43.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:16:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.046+0000 7fc2e4b2e640 1 Processor -- start 2023-11-24T06:16:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.046+0000 7fc2e4b2e640 1 -- start start 2023-11-24T06:16:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2e4b2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e015d4a0 0x7fc2e00d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2e4b2e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2e00b0ee0 0x7fc2e00d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2e4b2e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e00ce2a0 con 0x7fc2e00d1070 2023-11-24T06:16:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2e4b2e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e00d38a0 con 0x7fc2e00b0ee0 2023-11-24T06:16:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2e4b2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00ce580 con 0x7fc2e015d4a0 2023-11-24T06:16:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2e00b0ee0 0x7fc2e00d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2d7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc2e00d1070 0x7fc2e00cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46288/0 (socket says 172.21.15.37:46288) 2023-11-24T06:16:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.048+0000 7fc2d7fff640 1 -- 172.21.15.37:0/2758056947 learned_addr learned my addr 172.21.15.37:0/2758056947 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.049+0000 7fc2df7fe640 1 --2- 172.21.15.37:0/2758056947 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e015d4a0 0x7fc2e00d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.049+0000 7fc2dffff640 1 -- 172.21.15.37:0/2758056947 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e015d4a0 msgr2=0x7fc2e00d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.049+0000 7fc2deffd640 1 -- 172.21.15.37:0/2758056947 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394167315 0 0) 0x7fc2e00ce2a0 con 0x7fc2e00d1070 2023-11-24T06:16:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.049+0000 7fc2dffff640 1 --2- 172.21.15.37:0/2758056947 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e015d4a0 0x7fc2e00d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.049+0000 7fc2dffff640 1 -- 172.21.15.37:0/2758056947 >> v1:172.21.15.37:6789/0 conn(0x7fc2e00d1070 legacy=0x7fc2e00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.049+0000 7fc2dffff640 1 -- 172.21.15.37:0/2758056947 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00ce860 con 0x7fc2e00b0ee0 2023-11-24T06:16:44.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.050+0000 7fc2dffff640 1 --2- 172.21.15.37:0/2758056947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b0ee0 0x7fc2e00d3360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009d90 tx=0x7fc2d802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8741bea0bd8f922d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:44.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.050+0000 7fc2deffd640 1 -- 172.21.15.37:0/2758056947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d802cbd0 con 0x7fc2e00b0ee0 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.050+0000 7fc2deffd640 1 -- 172.21.15.37:0/2758056947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d802cd30 con 0x7fc2e00b0ee0 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.050+0000 7fc2deffd640 1 -- 172.21.15.37:0/2758056947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d802cea0 con 0x7fc2e00b0ee0 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/2758056947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b0ee0 msgr2=0x7fc2e00d3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/2758056947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b0ee0 0x7fc2e00d3360 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009d90 tx=0x7fc2d802be20 comp rx=0 tx=0).stop 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/2758056947 shutdown_connections 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/2758056947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b0ee0 0x7fc2e00d3360 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/2758056947 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e015d4a0 0x7fc2e00d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/2758056947 >> 172.21.15.37:0/2758056947 conn(0x7fc2e008cc30 msgr2=0x7fc2e009c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/2758056947 shutdown_connections 2023-11-24T06:16:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.051+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/2758056947 wait complete. 2023-11-24T06:16:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.053+0000 7fc2e4b2e640 1 Processor -- start 2023-11-24T06:16:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.053+0000 7fc2e4b2e640 1 -- start start 2023-11-24T06:16:44.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2e4b2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e00b0ee0 0x7fc2e015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2e4b2e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e00d1070 0x7fc2e00c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2e4b2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e015d4a0 0x7fc2e00d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2e4b2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00c9890 con 0x7fc2e015d4a0 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2e4b2e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00c8c80 con 0x7fc2e00d1070 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2e4b2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00c8f60 con 0x7fc2e00b0ee0 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e015d4a0 0x7fc2e00d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e015d4a0 0x7fc2e00d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36358/0 (socket says 172.21.15.37:36358) 2023-11-24T06:16:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.054+0000 7fc2dffff640 1 -- 172.21.15.37:0/3251572560 learned_addr learned my addr 172.21.15.37:0/3251572560 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:44.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dffff640 1 -- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e00b0ee0 msgr2=0x7fc2e015fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2df7fe640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e00b0ee0 0x7fc2e015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2d7fff640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e00d1070 0x7fc2e00c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dffff640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e00b0ee0 0x7fc2e015fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dffff640 1 -- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e00d1070 msgr2=0x7fc2e00c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dffff640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e00d1070 0x7fc2e00c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dffff640 1 -- 172.21.15.37:0/3251572560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8009a70 con 0x7fc2e015d4a0 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2df7fe640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e00b0ee0 0x7fc2e015fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dffff640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e015d4a0 0x7fc2e00d00f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009d90 tx=0x7fc2d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dcff9640 1 -- 172.21.15.37:0/3251572560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d802cea0 con 0x7fc2e015d4a0 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dcff9640 1 -- 172.21.15.37:0/3251572560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8040670 con 0x7fc2e015d4a0 2023-11-24T06:16:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2dcff9640 1 -- 172.21.15.37:0/3251572560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8040a20 con 0x7fc2e015d4a0 2023-11-24T06:16:44.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.055+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e00c9240 con 0x7fc2e015d4a0 2023-11-24T06:16:44.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.056+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e00c8930 con 0x7fc2e015d4a0 2023-11-24T06:16:44.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.057+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e004e840 con 0x7fc2e015d4a0 2023-11-24T06:16:44.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.058+0000 7fc2dcff9640 1 -- 172.21.15.37:0/3251572560 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2d8040b80 con 0x7fc2e015d4a0 2023-11-24T06:16:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.059+0000 7fc2dcff9640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006ae40 0x7fc2c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.059+0000 7fc2dcff9640 1 -- 172.21.15.37:0/3251572560 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2d80ac070 con 0x7fc2e015d4a0 2023-11-24T06:16:44.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.059+0000 7fc2df7fe640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006ae40 0x7fc2c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.059+0000 7fc2df7fe640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006ae40 0x7fc2c006d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0006fd0 tx=0x7fc2d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:44.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.063+0000 7fc2dcff9640 1 -- 172.21.15.37:0/3251572560 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2d80dee90 con 0x7fc2e015d4a0 2023-11-24T06:16:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.321+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc2e00c99d0 con 0x7fc2e015d4a0 2023-11-24T06:16:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.322+0000 7fc2dcff9640 1 -- 172.21.15.37:0/3251572560 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc2d80773d0 con 0x7fc2e015d4a0 2023-11-24T06:16:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:44.325 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:16:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-11-24T06:16:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-11-24T06:16:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlgknvDhAAb5FktSscZfBXGBuKWouBXA==", 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlJjg6MhAANLI6BPtnpgIn9G0CEPxTVQ==", 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2Bl9wrhIBAAp1rkuZvYeDseCqvLIHzS3g==", 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlurVTBxAAgadZStT24OMDy63I86vTUA==", 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdP2Blh/MmBRAAwJHTQ1wwlmIGG8B26AeHJw==", 2023-11-24T06:16:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAgP2BlWl7zIBAAat/1A8KGpPpqC1cmaGGN6g==", 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAjP2Bl4Rk7OxAAJ86tWyBRTgnF5nyjFqTOKA==", 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAnP2BlpK9fGRAANr9PMAxN1uBbcKllLiUluA==", 2023-11-24T06:16:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAuP2Bl1izGHxAAXjn5+EnnFQOnKxiuDeg1Ug==", 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAxP2BlSpciKRAAG5p7jzKUX0CDLhPbPGpV2g==", 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1P2BlTZUKBxAAYSXZ0hoJrqzN5I6NkT4RrA==", 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA4P2Bluo2REBAAnUZSYi+3ENutNfPVGxF8oQ==", 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:16:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA==", 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-11-24T06:16:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlhpPeLBAA+FETlJwFxw/Un58VF8KxtQ==", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlLSTWIRAAntWBgOa+b6RFdEH4Jb9BjQ==", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:16:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlIx2bNxAASM7PdeBoVMXV+iLedKvdfA==", 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAWP2BlJBINARAAYuCFdJsu598989ZBCaK/Xw==", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlCBlAAhAATR60ipjSv9JZI4d7vH8t9Q==", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:16:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAWP2Bl+PLrMhAA6Gc/HfKd/LAjoPsOGI1O6w==", 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-11-24T06:16:44.338 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:16:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006ae40 msgr2=0x7fc2c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006ae40 0x7fc2c006d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0006fd0 tx=0x7fc2d0008040 comp rx=0 tx=0).stop 2023-11-24T06:16:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e015d4a0 msgr2=0x7fc2e00d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e015d4a0 0x7fc2e00d00f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009d90 tx=0x7fc2d8004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 shutdown_connections 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006ae40 0x7fc2c006d300 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2e00d1070 0x7fc2e00c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e015d4a0 0x7fc2e00d00f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 --2- 172.21.15.37:0/3251572560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2e00b0ee0 0x7fc2e015fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 >> 172.21.15.37:0/3251572560 conn(0x7fc2e008cc30 msgr2=0x7fc2e00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 shutdown_connections 2023-11-24T06:16:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.325+0000 7fc2e4b2e640 1 -- 172.21.15.37:0/3251572560 wait complete. 2023-11-24T06:16:44.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:44.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.562+0000 7fd8b5106640 1 Processor -- start 2023-11-24T06:16:44.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.562+0000 7fd8b5106640 1 -- start start 2023-11-24T06:16:44.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.564+0000 7fd8b5106640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd8b0144b30 0x7fd8b015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.564+0000 7fd8b5106640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b015bf80 con 0x7fd8b015c410 2023-11-24T06:16:44.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.564+0000 7fd8b5106640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b00b1560 con 0x7fd8b00b1de0 2023-11-24T06:16:44.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.564+0000 7fd8b5106640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b00b1280 con 0x7fd8b0144b30 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.564+0000 7fd8af7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd8b015c410 0x7fd8b00b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46300/0 (socket says 172.21.15.37:46300) 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.564+0000 7fd8af7fe640 1 -- 172.21.15.37:0/3092854870 learned_addr learned my addr 172.21.15.37:0/3092854870 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8affff640 1 --2- 172.21.15.37:0/3092854870 >> v2:172.21.15.188:3300/0 conn(0x7fd8b0144b30 0x7fd8b015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642464844 0 0) 0x7fd8b015bf80 con 0x7fd8b015c410 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd898003520 con 0x7fd8b015c410 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 191516281 0 0) 0x7fd898003520 con 0x7fd8b015c410 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 >> v2:172.21.15.188:3300/0 conn(0x7fd8b0144b30 msgr2=0x7fd8b015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 --2- 172.21.15.37:0/3092854870 >> v2:172.21.15.188:3300/0 conn(0x7fd8b0144b30 0x7fd8b015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 >> v1:172.21.15.188:6789/0 conn(0x7fd8b00b1de0 legacy=0x7fd8b00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b015b930 con 0x7fd8b015c410 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd8a4001670 con 0x7fd8b015c410 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 >> v1:172.21.15.37:6789/0 conn(0x7fd8b015c410 legacy=0x7fd8b00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd898003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8980047c0 0x7fd898004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd898005180 0x7fd89800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00b1280 con 0x7fd8980039c0 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89800c080 con 0x7fd8980047c0 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.565+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89800c240 con 0x7fd898005180 2023-11-24T06:16:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8affff640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd898003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8affff640 1 -- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd898005180 msgr2=0x7fd89800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:44.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8affff640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd898005180 0x7fd89800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8affff640 1 -- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8980047c0 msgr2=0x7fd898004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:44.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8af7fe640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8980047c0 0x7fd898004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8affff640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8980047c0 0x7fd898004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8affff640 1 -- 172.21.15.37:0/3092854870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898003520 con 0x7fd8980039c0 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8b4905640 1 -- 172.21.15.37:0/3092854870 reap_dead start 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.566+0000 7fd8af7fe640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8980047c0 0x7fd898004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.567+0000 7fd8affff640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd898003de0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009ac0 tx=0x7fd8980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27949cec7d430dc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a002c6d0 con 0x7fd8980039c0 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a002c830 con 0x7fd8980039c0 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8aeffd640 1 -- 172.21.15.37:0/3092854870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a002cbc0 con 0x7fd8980039c0 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8b5106640 1 -- 172.21.15.37:0/3092854870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 msgr2=0x7fd898003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8b5106640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd898003de0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009ac0 tx=0x7fd8980057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8b5106640 1 -- 172.21.15.37:0/3092854870 shutdown_connections 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8b5106640 1 --2- 172.21.15.37:0/3092854870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd898003de0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8b5106640 1 -- 172.21.15.37:0/3092854870 >> 172.21.15.37:0/3092854870 conn(0x7fd8b00cb830 msgr2=0x7fd8b00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8b5106640 1 -- 172.21.15.37:0/3092854870 shutdown_connections 2023-11-24T06:16:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.568+0000 7fd8b5106640 1 -- 172.21.15.37:0/3092854870 wait complete. 2023-11-24T06:16:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.570+0000 7fd8b5106640 1 Processor -- start 2023-11-24T06:16:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.570+0000 7fd8b5106640 1 -- start start 2023-11-24T06:16:44.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.571+0000 7fd8b5106640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd8b01f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.571+0000 7fd8b5106640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b0072000 0x7fd8b015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.571+0000 7fd8b5106640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8b0070c90 0x7fd8b015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8b5106640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c8830 con 0x7fd8980039c0 2023-11-24T06:16:44.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8b5106640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0070800 con 0x7fd8b0072000 2023-11-24T06:16:44.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8b5106640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01f3e40 con 0x7fd8b0070c90 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd8b01f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd8b01f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36382/0 (socket says 172.21.15.37:36382) 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 -- 172.21.15.37:0/2704949692 learned_addr learned my addr 172.21.15.37:0/2704949692 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8b4905640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8b0070c90 0x7fd8b015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 -- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8b0070c90 msgr2=0x7fd8b015cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8b0070c90 0x7fd8b015cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 -- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b0072000 msgr2=0x7fd8b015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8af7fe640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b0072000 0x7fd8b015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b0072000 0x7fd8b015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8affff640 1 -- 172.21.15.37:0/2704949692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b015b090 con 0x7fd8980039c0 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.572+0000 7fd8b4905640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8b0070c90 0x7fd8b015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:44.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.573+0000 7fd8affff640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd8b01f3900 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd8a002c270 tx=0x7fd8a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:44.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.573+0000 7fd8acff9640 1 -- 172.21.15.37:0/2704949692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0003810 con 0x7fd8980039c0 2023-11-24T06:16:44.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.573+0000 7fd8acff9640 1 -- 172.21.15.37:0/2704949692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0003970 con 0x7fd8980039c0 2023-11-24T06:16:44.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.573+0000 7fd8acff9640 1 -- 172.21.15.37:0/2704949692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0003ce0 con 0x7fd8980039c0 2023-11-24T06:16:44.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.573+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b00c8270 con 0x7fd8980039c0 2023-11-24T06:16:44.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.573+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b0070490 con 0x7fd8980039c0 2023-11-24T06:16:44.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.574+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b0067990 con 0x7fd8980039c0 2023-11-24T06:16:44.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.575+0000 7fd8acff9640 1 -- 172.21.15.37:0/2704949692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8a0040660 con 0x7fd8980039c0 2023-11-24T06:16:44.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.576+0000 7fd8acff9640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd89c06ae70 0x7fd89c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:44.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.576+0000 7fd8acff9640 1 -- 172.21.15.37:0/2704949692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8a00ab370 con 0x7fd8980039c0 2023-11-24T06:16:44.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.576+0000 7fd8af7fe640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd89c06ae70 0x7fd89c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:44.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.577+0000 7fd8af7fe640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd89c06ae70 0x7fd89c06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00ce250 tx=0x7fd8a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:44.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.580+0000 7fd8acff9640 1 -- 172.21.15.37:0/2704949692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8a00767f0 con 0x7fd8980039c0 2023-11-24T06:16:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.776+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8b00702f0 con 0x7fd8980039c0 2023-11-24T06:16:44.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.778+0000 7fd8acff9640 1 -- 172.21.15.37:0/2704949692 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+12821 (secure 0 0 0) 0x7fd8b00702f0 con 0x7fd8980039c0 2023-11-24T06:16:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:44.781 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:41.702329+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.780+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd89c06ae70 msgr2=0x7fd89c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.780+0000 7fd8b5106640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd89c06ae70 0x7fd89c06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00ce250 tx=0x7fd8a4009040 comp rx=0 tx=0).stop 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 msgr2=0x7fd8b01f3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd8b01f3900 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd8a002c270 tx=0x7fd8a0004730 comp rx=0 tx=0).stop 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 shutdown_connections 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd89c06ae70 0x7fd89c06d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8b0072000 0x7fd8b015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8b0070c90 0x7fd8b015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 --2- 172.21.15.37:0/2704949692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8980039c0 0x7fd8b01f3900 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:44.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 >> 172.21.15.37:0/2704949692 conn(0x7fd8b00cb830 msgr2=0x7fd8b013f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:44.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 shutdown_connections 2023-11-24T06:16:44.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:44.781+0000 7fd8b5106640 1 -- 172.21.15.37:0/2704949692 wait complete. 2023-11-24T06:16:44.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:16:44.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:16:45.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.036+0000 7f1a49163640 1 Processor -- start 2023-11-24T06:16:45.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.036+0000 7f1a49163640 1 -- start start 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a49163640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1a4415b260 0x7f1a4406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a49163640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a4406e580 0x7f1a440b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a49163640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a440b1080 0x7f1a440ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a49163640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4415b640 con 0x7f1a4406e580 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a49163640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a440b1510 con 0x7f1a4415b260 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a49163640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4415ed20 con 0x7f1a440b1080 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a437fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a4406e580 0x7f1a440b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a437fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a4406e580 0x7f1a440b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36394/0 (socket says 172.21.15.37:36394) 2023-11-24T06:16:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.038+0000 7f1a437fe640 1 -- 172.21.15.37:0/2477887021 learned_addr learned my addr 172.21.15.37:0/2477887021 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a43fff640 1 --2- 172.21.15.37:0/2477887021 >> v2:172.21.15.188:3300/0 conn(0x7f1a4415b260 0x7f1a4406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a48962640 1 --2- 172.21.15.37:0/2477887021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a440b1080 0x7f1a440ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a437fe640 1 -- 172.21.15.37:0/2477887021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a440b1080 msgr2=0x7f1a440ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a437fe640 1 --2- 172.21.15.37:0/2477887021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a440b1080 0x7f1a440ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a437fe640 1 -- 172.21.15.37:0/2477887021 >> v2:172.21.15.188:3300/0 conn(0x7f1a4415b260 msgr2=0x7f1a4406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a437fe640 1 --2- 172.21.15.37:0/2477887021 >> v2:172.21.15.188:3300/0 conn(0x7f1a4415b260 0x7f1a4406e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a437fe640 1 -- 172.21.15.37:0/2477887021 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4415f8a0 con 0x7f1a4406e580 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a43fff640 1 --2- 172.21.15.37:0/2477887021 >> v2:172.21.15.188:3300/0 conn(0x7f1a4415b260 0x7f1a4406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.039+0000 7f1a48962640 1 --2- 172.21.15.37:0/2477887021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a440b1080 0x7f1a440ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.040+0000 7f1a437fe640 1 --2- 172.21.15.37:0/2477887021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4406e580 0x7f1a440b0b40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1a440d0160 tx=0x7f1a3802b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8d0d324e8903d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.040+0000 7f1a42ffd640 1 -- 172.21.15.37:0/2477887021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38031760 con 0x7f1a4406e580 2023-11-24T06:16:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.040+0000 7f1a42ffd640 1 -- 172.21.15.37:0/2477887021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a380318c0 con 0x7f1a4406e580 2023-11-24T06:16:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.040+0000 7f1a42ffd640 1 -- 172.21.15.37:0/2477887021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38031c50 con 0x7f1a4406e580 2023-11-24T06:16:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 -- 172.21.15.37:0/2477887021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4406e580 msgr2=0x7f1a440b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 --2- 172.21.15.37:0/2477887021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4406e580 0x7f1a440b0b40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1a440d0160 tx=0x7f1a3802b800 comp rx=0 tx=0).stop 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 -- 172.21.15.37:0/2477887021 shutdown_connections 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 --2- 172.21.15.37:0/2477887021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a440b1080 0x7f1a440ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 --2- 172.21.15.37:0/2477887021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a4406e580 0x7f1a440b0b40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 --2- 172.21.15.37:0/2477887021 >> v2:172.21.15.188:3300/0 conn(0x7f1a4415b260 0x7f1a4406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 -- 172.21.15.37:0/2477887021 >> 172.21.15.37:0/2477887021 conn(0x7f1a440cbb40 msgr2=0x7f1a440cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 -- 172.21.15.37:0/2477887021 shutdown_connections 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.041+0000 7f1a49163640 1 -- 172.21.15.37:0/2477887021 wait complete. 2023-11-24T06:16:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.043+0000 7f1a49163640 1 Processor -- start 2023-11-24T06:16:45.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.043+0000 7f1a49163640 1 -- start start 2023-11-24T06:16:45.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a49163640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a4406e580 0x7f1a4409c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a49163640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440b1080 0x7f1a44155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a49163640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a4415b260 0x7f1a4409a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a49163640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a441f2b00 con 0x7f1a440b1080 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a49163640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4409ca30 con 0x7f1a4406e580 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a49163640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440b3320 con 0x7f1a4415b260 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440b1080 0x7f1a44155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440b1080 0x7f1a44155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36402/0 (socket says 172.21.15.37:36402) 2023-11-24T06:16:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a437fe640 1 -- 172.21.15.37:0/616588848 learned_addr learned my addr 172.21.15.37:0/616588848 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a437fe640 1 -- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a4415b260 msgr2=0x7f1a4409a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a437fe640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a4415b260 0x7f1a4409a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a437fe640 1 -- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a4406e580 msgr2=0x7f1a4409c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.044+0000 7f1a43fff640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a4406e580 0x7f1a4409c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a437fe640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a4406e580 0x7f1a4409c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a437fe640 1 -- 172.21.15.37:0/616588848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380094d0 con 0x7f1a440b1080 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a43fff640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a4406e580 0x7f1a4409c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a437fe640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440b1080 0x7f1a44155610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a40ff9640 1 -- 172.21.15.37:0/616588848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3803b800 con 0x7f1a440b1080 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a40ff9640 1 -- 172.21.15.37:0/616588848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3803b960 con 0x7f1a440b1080 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a40ff9640 1 -- 172.21.15.37:0/616588848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3803bd10 con 0x7f1a440b1080 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a440b2470 con 0x7f1a440b1080 2023-11-24T06:16:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.045+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a440b2710 con 0x7f1a440b1080 2023-11-24T06:16:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.047+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4404e840 con 0x7f1a440b1080 2023-11-24T06:16:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.047+0000 7f1a40ff9640 1 -- 172.21.15.37:0/616588848 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a380453f0 con 0x7f1a440b1080 2023-11-24T06:16:45.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.048+0000 7f1a40ff9640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1a3006ae40 0x7f1a3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.049+0000 7f1a40ff9640 1 -- 172.21.15.37:0/616588848 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a3802f050 con 0x7f1a440b1080 2023-11-24T06:16:45.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.049+0000 7f1a43fff640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1a3006ae40 0x7f1a3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.049+0000 7f1a43fff640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1a3006ae40 0x7f1a3006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a34006fd0 tx=0x7f1a34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.053+0000 7f1a40ff9640 1 -- 172.21.15.37:0/616588848 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a380765d0 con 0x7f1a440b1080 2023-11-24T06:16:45.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.246+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a440ce640 con 0x7f1a440b1080 2023-11-24T06:16:45.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.247+0000 7f1a40ff9640 1 -- 172.21.15.37:0/616588848 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a38079bf0 con 0x7f1a440b1080 2023-11-24T06:16:45.250 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:16:45.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1a3006ae40 msgr2=0x7f1a3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1a3006ae40 0x7f1a3006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a34006fd0 tx=0x7f1a34008040 comp rx=0 tx=0).stop 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440b1080 msgr2=0x7f1a44155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440b1080 0x7f1a44155610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a380046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 shutdown_connections 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1a3006ae40 0x7f1a3006d300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a4415b260 0x7f1a4409a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440b1080 0x7f1a44155610 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 --2- 172.21.15.37:0/616588848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a4406e580 0x7f1a4409c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 >> 172.21.15.37:0/616588848 conn(0x7f1a440cbb40 msgr2=0x7f1a440aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 shutdown_connections 2023-11-24T06:16:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.250+0000 7f1a49163640 1 -- 172.21.15.37:0/616588848 wait complete. 2023-11-24T06:16:45.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:16:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.497+0000 7f047c70f640 1 Processor -- start 2023-11-24T06:16:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.497+0000 7f047c70f640 1 -- start start 2023-11-24T06:16:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.498+0000 7f047c70f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04740b2250 0x7f047415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.498+0000 7f047c70f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f04740b2aa0 0x7f047415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.498+0000 7f047c70f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047415ab80 con 0x7f04740b2630 2023-11-24T06:16:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.498+0000 7f047c70f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047415a990 con 0x7f04740b2250 2023-11-24T06:16:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.498+0000 7f047c70f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047415e680 con 0x7f04740b2aa0 2023-11-24T06:16:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047a4ab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04740b2250 0x7f047415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047a4ab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04740b2250 0x7f047415df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36408/0 (socket says 172.21.15.37:36408) 2023-11-24T06:16:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047a4ab640 1 -- 172.21.15.37:0/4104300065 learned_addr learned my addr 172.21.15.37:0/4104300065 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047acac640 1 --2- 172.21.15.37:0/4104300065 >> v2:172.21.15.188:3300/0 conn(0x7f04740b2aa0 0x7f047415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047a4ab640 1 -- 172.21.15.37:0/4104300065 >> v2:172.21.15.188:3300/0 conn(0x7f04740b2aa0 msgr2=0x7f047415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047a4ab640 1 --2- 172.21.15.37:0/4104300065 >> v2:172.21.15.188:3300/0 conn(0x7f04740b2aa0 0x7f047415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047a4ab640 1 -- 172.21.15.37:0/4104300065 >> v1:172.21.15.188:6789/0 conn(0x7f04740b2630 legacy=0x7f04740ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.499+0000 7f047a4ab640 1 -- 172.21.15.37:0/4104300065 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047415e960 con 0x7f04740b2250 2023-11-24T06:16:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.501+0000 7f047a4ab640 1 --2- 172.21.15.37:0/4104300065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2250 0x7f047415df80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f04740b2fa0 tx=0x7f047002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8d3ee8be08dc0c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.501+0000 7f04794a9640 1 -- 172.21.15.37:0/4104300065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047002ee90 con 0x7f04740b2250 2023-11-24T06:16:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.501+0000 7f04794a9640 1 -- 172.21.15.37:0/4104300065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470036440 con 0x7f04740b2250 2023-11-24T06:16:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.501+0000 7f04794a9640 1 -- 172.21.15.37:0/4104300065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04700367d0 con 0x7f04740b2250 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 -- 172.21.15.37:0/4104300065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2250 msgr2=0x7f047415df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 --2- 172.21.15.37:0/4104300065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2250 0x7f047415df80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f04740b2fa0 tx=0x7f047002e0e0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 -- 172.21.15.37:0/4104300065 shutdown_connections 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 --2- 172.21.15.37:0/4104300065 >> v2:172.21.15.188:3300/0 conn(0x7f04740b2aa0 0x7f047415b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 --2- 172.21.15.37:0/4104300065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2250 0x7f047415df80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 -- 172.21.15.37:0/4104300065 >> 172.21.15.37:0/4104300065 conn(0x7f047406a920 msgr2=0x7f047406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 -- 172.21.15.37:0/4104300065 shutdown_connections 2023-11-24T06:16:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.502+0000 7f047c70f640 1 -- 172.21.15.37:0/4104300065 wait complete. 2023-11-24T06:16:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.504+0000 7f047c70f640 1 Processor -- start 2023-11-24T06:16:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.504+0000 7f047c70f640 1 -- start start 2023-11-24T06:16:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047c70f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04740b2250 0x7f04741541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047c70f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04740b2630 0x7f04740ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047c70f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2aa0 0x7f0474155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047c70f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740b1360 con 0x7f04740b2aa0 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047c70f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047415df10 con 0x7f04740b2250 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047c70f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047415e1d0 con 0x7f04740b2630 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047acac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2aa0 0x7f0474155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047acac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2aa0 0x7f0474155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36422/0 (socket says 172.21.15.37:36422) 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.505+0000 7f047acac640 1 -- 172.21.15.37:0/1164655239 learned_addr learned my addr 172.21.15.37:0/1164655239 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047a4ab640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04740b2250 0x7f04741541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047acac640 1 -- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04740b2630 msgr2=0x7f04740ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047acac640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04740b2630 0x7f04740ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047acac640 1 -- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04740b2250 msgr2=0x7f04741541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047acac640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04740b2250 0x7f04741541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047acac640 1 -- 172.21.15.37:0/1164655239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047000b770 con 0x7f04740b2aa0 2023-11-24T06:16:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047a4ab640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04740b2250 0x7f04741541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047acac640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2aa0 0x7f0474155050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f046c007cf0 tx=0x7f046c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f046affd640 1 -- 172.21.15.37:0/1164655239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c014420 con 0x7f04740b2aa0 2023-11-24T06:16:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f046affd640 1 -- 172.21.15.37:0/1164655239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c0145a0 con 0x7f04740b2aa0 2023-11-24T06:16:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f046affd640 1 -- 172.21.15.37:0/1164655239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c014950 con 0x7f04740b2aa0 2023-11-24T06:16:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.506+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04740cd7c0 con 0x7f04740b2aa0 2023-11-24T06:16:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.507+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04740b18e0 con 0x7f04740b2aa0 2023-11-24T06:16:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.508+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0474067470 con 0x7f04740b2aa0 2023-11-24T06:16:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.509+0000 7f046affd640 1 -- 172.21.15.37:0/1164655239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f046c014ab0 con 0x7f04740b2aa0 2023-11-24T06:16:45.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.510+0000 7f046affd640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae70 0x7f045806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.510+0000 7f046affd640 1 -- 172.21.15.37:0/1164655239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f046c089b20 con 0x7f04740b2aa0 2023-11-24T06:16:45.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.510+0000 7f047a4ab640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae70 0x7f045806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.511+0000 7f047a4ab640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae70 0x7f045806d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0470038000 tx=0x7f0470008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.514+0000 7f046affd640 1 -- 172.21.15.37:0/1164655239 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f046c054f20 con 0x7f04740b2aa0 2023-11-24T06:16:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.711+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f04740cb460 con 0x7f04740b2aa0 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.712+0000 7f046affd640 1 -- 172.21.15.37:0/1164655239 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+65 (secure 0 0 0) 0x7f046c058540 con 0x7f04740b2aa0 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:16:45.715 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:16:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae70 msgr2=0x7f045806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae70 0x7f045806d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0470038000 tx=0x7f0470008040 comp rx=0 tx=0).stop 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2aa0 msgr2=0x7f0474155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2aa0 0x7f0474155050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f046c007cf0 tx=0x7f046c00e4b0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 shutdown_connections 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f045806ae70 0x7f045806d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04740b2aa0 0x7f0474155050 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04740b2630 0x7f04740ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 --2- 172.21.15.37:0/1164655239 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04740b2250 0x7f04741541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 >> 172.21.15.37:0/1164655239 conn(0x7f047406a920 msgr2=0x7f04740cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 shutdown_connections 2023-11-24T06:16:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.715+0000 7f047c70f640 1 -- 172.21.15.37:0/1164655239 wait complete. 2023-11-24T06:16:45.738 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:16:45.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:16:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.969+0000 7fbbdf46d640 1 Processor -- start 2023-11-24T06:16:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.969+0000 7fbbdf46d640 1 -- start start 2023-11-24T06:16:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.971+0000 7fbbdf46d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd8144510 0x7fbbd806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.971+0000 7fbbdf46d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbbd815edd0 0x7fbbd80b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.971+0000 7fbbdf46d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd81448f0 con 0x7fbbd80ccd00 2023-11-24T06:16:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.971+0000 7fbbdf46d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd8144d80 con 0x7fbbd815edd0 2023-11-24T06:16:45.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.971+0000 7fbbdf46d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815f2d0 con 0x7fbbd8144510 2023-11-24T06:16:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.972+0000 7fbbde46b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd8144510 0x7fbbd806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.972+0000 7fbbde46b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd8144510 0x7fbbd806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:52194/0 (socket says 172.21.15.37:52194) 2023-11-24T06:16:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.972+0000 7fbbde46b640 1 -- 172.21.15.37:0/2208614583 learned_addr learned my addr 172.21.15.37:0/2208614583 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:45.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.972+0000 7fbbddc6a640 1 --2- 172.21.15.37:0/2208614583 >> v2:172.21.15.188:3300/0 conn(0x7fbbd815edd0 0x7fbbd80b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.973+0000 7fbbde46b640 1 -- 172.21.15.37:0/2208614583 >> v2:172.21.15.188:3300/0 conn(0x7fbbd815edd0 msgr2=0x7fbbd80b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:45.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.973+0000 7fbbde46b640 1 --2- 172.21.15.37:0/2208614583 >> v2:172.21.15.188:3300/0 conn(0x7fbbd815edd0 0x7fbbd80b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.973+0000 7fbbde46b640 1 -- 172.21.15.37:0/2208614583 >> v1:172.21.15.188:6789/0 conn(0x7fbbd80ccd00 legacy=0x7fbbd80b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:45.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.973+0000 7fbbde46b640 1 -- 172.21.15.37:0/2208614583 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd815f5b0 con 0x7fbbd8144510 2023-11-24T06:16:45.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.974+0000 7fbbde46b640 1 --2- 172.21.15.37:0/2208614583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd8144510 0x7fbbd806d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009870 tx=0x7fbbd402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=574fdecf9c1bf6a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.975+0000 7fbbdd469640 1 -- 172.21.15.37:0/2208614583 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4031640 con 0x7fbbd8144510 2023-11-24T06:16:45.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.975+0000 7fbbdd469640 1 -- 172.21.15.37:0/2208614583 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd40317a0 con 0x7fbbd8144510 2023-11-24T06:16:45.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.975+0000 7fbbdd469640 1 -- 172.21.15.37:0/2208614583 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4031b30 con 0x7fbbd8144510 2023-11-24T06:16:45.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.975+0000 7fbbdf46d640 1 -- 172.21.15.37:0/2208614583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd8144510 msgr2=0x7fbbd806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.975+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/2208614583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd8144510 0x7fbbd806d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009870 tx=0x7fbbd402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.976+0000 7fbbdf46d640 1 -- 172.21.15.37:0/2208614583 shutdown_connections 2023-11-24T06:16:45.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.976+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/2208614583 >> v2:172.21.15.188:3300/0 conn(0x7fbbd815edd0 0x7fbbd80b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.976+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/2208614583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd8144510 0x7fbbd806d7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.976+0000 7fbbdf46d640 1 -- 172.21.15.37:0/2208614583 >> 172.21.15.37:0/2208614583 conn(0x7fbbd80cb8a0 msgr2=0x7fbbd80cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:45.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.976+0000 7fbbdf46d640 1 -- 172.21.15.37:0/2208614583 shutdown_connections 2023-11-24T06:16:45.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.976+0000 7fbbdf46d640 1 -- 172.21.15.37:0/2208614583 wait complete. 2023-11-24T06:16:45.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.977+0000 7fbbdf46d640 1 Processor -- start 2023-11-24T06:16:45.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.978+0000 7fbbdf46d640 1 -- start start 2023-11-24T06:16:45.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.978+0000 7fbbdf46d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd80ccd00 0x7fbbd813f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbdf46d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd8144510 0x7fbbd81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbdf46d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbd815edd0 0x7fbbd8142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbdf46d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8140b70 con 0x7fbbd8144510 2023-11-24T06:16:45.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbdf46d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8140820 con 0x7fbbd815edd0 2023-11-24T06:16:45.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbdf46d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8158f00 con 0x7fbbd80ccd00 2023-11-24T06:16:45.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd8144510 0x7fbbd81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd8144510 0x7fbbd81589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36438/0 (socket says 172.21.15.37:36438) 2023-11-24T06:16:45.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 -- 172.21.15.37:0/29827362 learned_addr learned my addr 172.21.15.37:0/29827362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:45.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 -- 172.21.15.37:0/29827362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd80ccd00 msgr2=0x7fbbd813f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd80ccd00 0x7fbbd813f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 -- 172.21.15.37:0/29827362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbd815edd0 msgr2=0x7fbbd8142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:45.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbd815edd0 0x7fbbd8142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:45.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.979+0000 7fbbddc6a640 1 -- 172.21.15.37:0/29827362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd40094d0 con 0x7fbbd8144510 2023-11-24T06:16:45.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.980+0000 7fbbddc6a640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd8144510 0x7fbbd81589c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800e8a0 tx=0x7fbbc800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.980+0000 7fbbceffd640 1 -- 172.21.15.37:0/29827362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80095c0 con 0x7fbbd8144510 2023-11-24T06:16:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.980+0000 7fbbceffd640 1 -- 172.21.15.37:0/29827362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc800c8e0 con 0x7fbbd8144510 2023-11-24T06:16:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.980+0000 7fbbceffd640 1 -- 172.21.15.37:0/29827362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800cc50 con 0x7fbbd8144510 2023-11-24T06:16:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.980+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd813f890 con 0x7fbbd8144510 2023-11-24T06:16:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.980+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd813fe50 con 0x7fbbd8144510 2023-11-24T06:16:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.981+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd804e840 con 0x7fbbd8144510 2023-11-24T06:16:45.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.982+0000 7fbbceffd640 1 -- 172.21.15.37:0/29827362 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbc8013470 con 0x7fbbd8144510 2023-11-24T06:16:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.983+0000 7fbbceffd640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbbbc06ae70 0x7fbbbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.983+0000 7fbbceffd640 1 -- 172.21.15.37:0/29827362 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbbc8089930 con 0x7fbbd8144510 2023-11-24T06:16:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.984+0000 7fbbde46b640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbbbc06ae70 0x7fbbbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:45.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.984+0000 7fbbde46b640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbbbc06ae70 0x7fbbbc06d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4036000 tx=0x7fbbd4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:45.988+0000 7fbbceffd640 1 -- 172.21.15.37:0/29827362 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbc8054b80 con 0x7fbbd8144510 2023-11-24T06:16:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.192+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbbd8140d20 con 0x7fbbd8144510 2023-11-24T06:16:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.825+0000 7fbbceffd640 1 -- 172.21.15.37:0/29827362 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbbd8140d20 con 0x7fbbd8144510 2023-11-24T06:16:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-11-24T06:16:46.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.829+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbbbc06ae70 msgr2=0x7fbbbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:46.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.829+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbbbc06ae70 0x7fbbbc06d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4036000 tx=0x7fbbd4030000 comp rx=0 tx=0).stop 2023-11-24T06:16:46.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.829+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd8144510 msgr2=0x7fbbd81589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:46.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.829+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd8144510 0x7fbbd81589c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800e8a0 tx=0x7fbbc800ed60 comp rx=0 tx=0).stop 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 shutdown_connections 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbbbc06ae70 0x7fbbbc06d330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbd815edd0 0x7fbbd8142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd8144510 0x7fbbd81589c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 --2- 172.21.15.37:0/29827362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbd80ccd00 0x7fbbd813f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 >> 172.21.15.37:0/29827362 conn(0x7fbbd80cb8a0 msgr2=0x7fbbd80ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 shutdown_connections 2023-11-24T06:16:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:46.830+0000 7fbbdf46d640 1 -- 172.21.15.37:0/29827362 wait complete. 2023-11-24T06:16:46.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:16:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.075+0000 7fd64c6e0640 1 Processor -- start 2023-11-24T06:16:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.075+0000 7fd64c6e0640 1 -- start start 2023-11-24T06:16:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.077+0000 7fd64c6e0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 0x7fd644166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.077+0000 7fd64c6e0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64415eea0 con 0x7fd64415b440 2023-11-24T06:16:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.077+0000 7fd64c6e0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64406d600 con 0x7fd6440cc0f0 2023-11-24T06:16:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.077+0000 7fd64c6e0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440c5e00 con 0x7fd6440c59b0 2023-11-24T06:16:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.077+0000 7fd64a47c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd64415b440 0x7fd6440cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46314/0 (socket says 172.21.15.37:46314) 2023-11-24T06:16:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.077+0000 7fd64a47c640 1 -- 172.21.15.37:0/2448019931 learned_addr learned my addr 172.21.15.37:0/2448019931 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64ac7d640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 0x7fd644166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944070892 0 0) 0x7fd64415eea0 con 0x7fd64415b440 2023-11-24T06:16:47.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd630003520 con 0x7fd64415b440 2023-11-24T06:16:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616120729 0 0) 0x7fd630003520 con 0x7fd64415b440 2023-11-24T06:16:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 msgr2=0x7fd644166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 0x7fd644166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 >> v1:172.21.15.188:6789/0 conn(0x7fd6440cc0f0 legacy=0x7fd6440c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440abf30 con 0x7fd64415b440 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd640001670 con 0x7fd64415b440 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 >> v1:172.21.15.37:6789/0 conn(0x7fd64415b440 legacy=0x7fd6440cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6300039a0 0x7fd630003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.078+0000 7fd64947a640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 0x7fd6300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64947a640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd630004d00 0x7fd630005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63000bb30 con 0x7fd6300039a0 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63000bca0 con 0x7fd630004d00 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63000be60 con 0x7fd6440c59b0 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64a47c640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6300039a0 0x7fd630003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd649c7b640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 0x7fd6300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64ac7d640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd630004d00 0x7fd630005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64a47c640 1 -- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 msgr2=0x7fd6300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64a47c640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440c59b0 0x7fd6300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64a47c640 1 -- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd630004d00 msgr2=0x7fd630005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64a47c640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd630004d00 0x7fd630005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.079+0000 7fd64a47c640 1 -- 172.21.15.37:0/2448019931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630003520 con 0x7fd6300039a0 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.080+0000 7fd64a47c640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6300039a0 0x7fd630003dc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd64000c240 tx=0x7fd6300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9cf9dd4f3df719 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640005ad0 con 0x7fd6300039a0 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640005c30 con 0x7fd6300039a0 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64947a640 1 -- 172.21.15.37:0/2448019931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64002c8b0 con 0x7fd6300039a0 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64c6e0640 1 -- 172.21.15.37:0/2448019931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6300039a0 msgr2=0x7fd630003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64c6e0640 1 --2- 172.21.15.37:0/2448019931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6300039a0 0x7fd630003dc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd64000c240 tx=0x7fd6300057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64ac7d640 1 -- 172.21.15.37:0/2448019931 reap_dead start 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64c6e0640 1 -- 172.21.15.37:0/2448019931 shutdown_connections 2023-11-24T06:16:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.081+0000 7fd64c6e0640 1 -- 172.21.15.37:0/2448019931 >> 172.21.15.37:0/2448019931 conn(0x7fd6440b0c50 msgr2=0x7fd6440b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.082+0000 7fd64c6e0640 1 -- 172.21.15.37:0/2448019931 shutdown_connections 2023-11-24T06:16:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.082+0000 7fd64c6e0640 1 -- 172.21.15.37:0/2448019931 wait complete. 2023-11-24T06:16:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.083+0000 7fd64c6e0640 1 Processor -- start 2023-11-24T06:16:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.083+0000 7fd64c6e0640 1 -- start start 2023-11-24T06:16:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.084+0000 7fd64c6e0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6300039a0 0x7fd6441f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.084+0000 7fd64c6e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6440ccbd0 0x7fd644155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.084+0000 7fd64c6e0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440cd050 0x7fd644156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd64c6e0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440cd540 con 0x7fd6440ccbd0 2023-11-24T06:16:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd64c6e0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440cd820 con 0x7fd6300039a0 2023-11-24T06:16:47.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd64c6e0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440cdb00 con 0x7fd6440cd050 2023-11-24T06:16:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6440ccbd0 0x7fd644155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6440ccbd0 0x7fd644155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36456/0 (socket says 172.21.15.37:36456) 2023-11-24T06:16:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 -- 172.21.15.37:0/888802157 learned_addr learned my addr 172.21.15.37:0/888802157 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd64a47c640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6300039a0 0x7fd6441f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd64ac7d640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440cd050 0x7fd644156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 -- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440cd050 msgr2=0x7fd644156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440cd050 0x7fd644156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 -- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6300039a0 msgr2=0x7fd6441f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6300039a0 0x7fd6441f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd649c7b640 1 -- 172.21.15.37:0/888802157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64415d0a0 con 0x7fd6440ccbd0 2023-11-24T06:16:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.085+0000 7fd64ac7d640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440cd050 0x7fd644156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.086+0000 7fd649c7b640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6440ccbd0 0x7fd644155cc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e550 tx=0x7fd63400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.086+0000 7fd63affd640 1 -- 172.21.15.37:0/888802157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340052e0 con 0x7fd6440ccbd0 2023-11-24T06:16:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.086+0000 7fd63affd640 1 -- 172.21.15.37:0/888802157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd634005440 con 0x7fd6440ccbd0 2023-11-24T06:16:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.086+0000 7fd63affd640 1 -- 172.21.15.37:0/888802157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634003810 con 0x7fd6440ccbd0 2023-11-24T06:16:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.086+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6441f48d0 con 0x7fd6440ccbd0 2023-11-24T06:16:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.086+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6441f36e0 con 0x7fd6440ccbd0 2023-11-24T06:16:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.087+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6440cdcc0 con 0x7fd6440ccbd0 2023-11-24T06:16:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.089+0000 7fd63affd640 1 -- 172.21.15.37:0/888802157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd634003970 con 0x7fd6440ccbd0 2023-11-24T06:16:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.089+0000 7fd63affd640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd62806ae40 0x7fd62806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.090+0000 7fd63affd640 1 -- 172.21.15.37:0/888802157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd6340891c0 con 0x7fd6440ccbd0 2023-11-24T06:16:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.090+0000 7fd64a47c640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd62806ae40 0x7fd62806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.091+0000 7fd64a47c640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd62806ae40 0x7fd62806d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd640034000 tx=0x7fd640009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.095+0000 7fd63affd640 1 -- 172.21.15.37:0/888802157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd634054440 con 0x7fd6440ccbd0 2023-11-24T06:16:47.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.291+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd64415d230 con 0x7fd6440ccbd0 2023-11-24T06:16:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.832+0000 7fd63affd640 1 -- 172.21.15.37:0/888802157 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v51) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd634057a60 con 0x7fd6440ccbd0 2023-11-24T06:16:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-11-24T06:16:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.835+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd62806ae40 msgr2=0x7fd62806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.835+0000 7fd64c6e0640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd62806ae40 0x7fd62806d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd640034000 tx=0x7fd640009030 comp rx=0 tx=0).stop 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.835+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6440ccbd0 msgr2=0x7fd644155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.835+0000 7fd64c6e0640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6440ccbd0 0x7fd644155cc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e550 tx=0x7fd63400ea10 comp rx=0 tx=0).stop 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 shutdown_connections 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd62806ae40 0x7fd62806d300 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6440cd050 0x7fd644156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6440ccbd0 0x7fd644155cc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 --2- 172.21.15.37:0/888802157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6300039a0 0x7fd6441f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 >> 172.21.15.37:0/888802157 conn(0x7fd6440b0c50 msgr2=0x7fd64406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 shutdown_connections 2023-11-24T06:16:47.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:47.836+0000 7fd64c6e0640 1 -- 172.21.15.37:0/888802157 wait complete. 2023-11-24T06:16:47.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:16:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.061+0000 7fac55a44640 1 Processor -- start 2023-11-24T06:16:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.061+0000 7fac55a44640 1 -- start start 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac55a44640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac500ccbd0 0x7fac501660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac55a44640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac501655f0 con 0x7fac500c9650 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac55a44640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac500cc380 con 0x7fac500ccfb0 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac55a44640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac50162b30 con 0x7fac500ccbd0 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac4effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac500ccbd0 0x7fac501660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac4effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac500ccbd0 0x7fac501660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36466/0 (socket says 172.21.15.37:36466) 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac4effd640 1 -- 172.21.15.37:0/2296877397 learned_addr learned my addr 172.21.15.37:0/2296877397 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.063+0000 7fac4f7fe640 1 --1- 172.21.15.37:0/2296877397 >> v1:172.21.15.37:6789/0 conn(0x7fac500c9650 0x7fac500c9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46326/0 (socket says 172.21.15.37:46326) 2023-11-24T06:16:48.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.064+0000 7fac4effd640 1 -- 172.21.15.37:0/2296877397 >> v1:172.21.15.188:6789/0 conn(0x7fac500ccfb0 legacy=0x7fac50162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:48.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.064+0000 7fac4effd640 1 -- 172.21.15.37:0/2296877397 >> v1:172.21.15.37:6789/0 conn(0x7fac500c9650 legacy=0x7fac500c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.064+0000 7fac4effd640 1 -- 172.21.15.37:0/2296877397 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50162e10 con 0x7fac500ccbd0 2023-11-24T06:16:48.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.064+0000 7fac4e7fc640 1 -- 172.21.15.37:0/2296877397 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829721392 0 0) 0x7fac501655f0 con 0x7fac500c9650 2023-11-24T06:16:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.065+0000 7fac4effd640 1 --2- 172.21.15.37:0/2296877397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500ccbd0 0x7fac501660b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fac40009870 tx=0x7fac4002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dc0577fc6656d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.065+0000 7fac4e7fc640 1 -- 172.21.15.37:0/2296877397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40030860 con 0x7fac500ccbd0 2023-11-24T06:16:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.065+0000 7fac4e7fc640 1 -- 172.21.15.37:0/2296877397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400309c0 con 0x7fac500ccbd0 2023-11-24T06:16:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.065+0000 7fac4e7fc640 1 -- 172.21.15.37:0/2296877397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40030d50 con 0x7fac500ccbd0 2023-11-24T06:16:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.066+0000 7fac55a44640 1 -- 172.21.15.37:0/2296877397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500ccbd0 msgr2=0x7fac501660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.066+0000 7fac55a44640 1 --2- 172.21.15.37:0/2296877397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500ccbd0 0x7fac501660b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fac40009870 tx=0x7fac4002b9a0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.066+0000 7fac55a44640 1 -- 172.21.15.37:0/2296877397 shutdown_connections 2023-11-24T06:16:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.066+0000 7fac55a44640 1 --2- 172.21.15.37:0/2296877397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500ccbd0 0x7fac501660b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.066+0000 7fac55a44640 1 -- 172.21.15.37:0/2296877397 >> 172.21.15.37:0/2296877397 conn(0x7fac500b0c50 msgr2=0x7fac500b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.066+0000 7fac55a44640 1 -- 172.21.15.37:0/2296877397 shutdown_connections 2023-11-24T06:16:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.066+0000 7fac55a44640 1 -- 172.21.15.37:0/2296877397 wait complete. 2023-11-24T06:16:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.068+0000 7fac55a44640 1 Processor -- start 2023-11-24T06:16:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.068+0000 7fac55a44640 1 -- start start 2023-11-24T06:16:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac55a44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500c9650 0x7fac50071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac55a44640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac500ccbd0 0x7fac5015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac55a44640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac500ccfb0 0x7fac5015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac55a44640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac50072400 con 0x7fac500c9650 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac55a44640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5015f5d0 con 0x7fac500ccbd0 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac55a44640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5015ea50 con 0x7fac500ccfb0 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac4effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500c9650 0x7fac50071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac4effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500c9650 0x7fac50071ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36474/0 (socket says 172.21.15.37:36474) 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.069+0000 7fac4effd640 1 -- 172.21.15.37:0/721250167 learned_addr learned my addr 172.21.15.37:0/721250167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac47fff640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac500ccbd0 0x7fac5015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4effd640 1 -- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac500ccfb0 msgr2=0x7fac5015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4f7fe640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac500ccfb0 0x7fac5015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4effd640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac500ccfb0 0x7fac5015cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4effd640 1 -- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac500ccbd0 msgr2=0x7fac5015c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4effd640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac500ccbd0 0x7fac5015c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4effd640 1 -- 172.21.15.37:0/721250167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac400094d0 con 0x7fac500c9650 2023-11-24T06:16:48.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac47fff640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac500ccbd0 0x7fac5015c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:48.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4effd640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500c9650 0x7fac50071ec0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fac40009870 tx=0x7fac40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4cff9640 1 -- 172.21.15.37:0/721250167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40030810 con 0x7fac500c9650 2023-11-24T06:16:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4cff9640 1 -- 172.21.15.37:0/721250167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40039d90 con 0x7fac500c9650 2023-11-24T06:16:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac4cff9640 1 -- 172.21.15.37:0/721250167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40043630 con 0x7fac500c9650 2023-11-24T06:16:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.070+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5015ed30 con 0x7fac500c9650 2023-11-24T06:16:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.071+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5015f2f0 con 0x7fac500c9650 2023-11-24T06:16:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.072+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac500cd3f0 con 0x7fac500c9650 2023-11-24T06:16:48.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.073+0000 7fac4cff9640 1 -- 172.21.15.37:0/721250167 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac4004c3b0 con 0x7fac500c9650 2023-11-24T06:16:48.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.075+0000 7fac4cff9640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fac3006ae90 0x7fac3006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:48.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.075+0000 7fac4cff9640 1 -- 172.21.15.37:0/721250167 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fac400abd20 con 0x7fac500c9650 2023-11-24T06:16:48.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.075+0000 7fac47fff640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fac3006ae90 0x7fac3006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:48.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.076+0000 7fac47fff640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fac3006ae90 0x7fac3006d350 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fac500acfb0 tx=0x7fac38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.080+0000 7fac4cff9640 1 -- 172.21.15.37:0/721250167 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac500cd3f0 con 0x7fac500c9650 2023-11-24T06:16:48.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.317+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fac500cd3f0 con 0x7fac500c9650 2023-11-24T06:16:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.878+0000 7fac4cff9640 1 -- 172.21.15.37:0/721250167 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) v1 ==== 172+0+0 (secure 0 0 0) 0x7fac500cd3f0 con 0x7fac500c9650 2023-11-24T06:16:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 8 and data pool 9 2023-11-24T06:16:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.896+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fac3006ae90 msgr2=0x7fac3006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.896+0000 7fac55a44640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fac3006ae90 0x7fac3006d350 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fac500acfb0 tx=0x7fac38009040 comp rx=0 tx=0).stop 2023-11-24T06:16:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.896+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500c9650 msgr2=0x7fac50071ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.896+0000 7fac55a44640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500c9650 0x7fac50071ec0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fac40009870 tx=0x7fac40004730 comp rx=0 tx=0).stop 2023-11-24T06:16:48.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 shutdown_connections 2023-11-24T06:16:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fac3006ae90 0x7fac3006d350 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac500ccbd0 0x7fac5015c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac500ccfb0 0x7fac5015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 --2- 172.21.15.37:0/721250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac500c9650 0x7fac50071ec0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 >> 172.21.15.37:0/721250167 conn(0x7fac500b0c50 msgr2=0x7fac500b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 shutdown_connections 2023-11-24T06:16:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:48.899+0000 7fac55a44640 1 -- 172.21.15.37:0/721250167 wait complete. 2023-11-24T06:16:48.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.113+0000 7f592a0c2640 1 Processor -- start 2023-11-24T06:16:49.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.113+0000 7f592a0c2640 1 -- start start 2023-11-24T06:16:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f592a0c2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59240cfb60 0x7f5924161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f592a0c2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59240ce0b0 con 0x7f5924157c70 2023-11-24T06:16:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f592a0c2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5924161960 con 0x7f592415dc80 2023-11-24T06:16:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f592a0c2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592415e8d0 con 0x7f59240cfb60 2023-11-24T06:16:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f59237fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5924157c70 0x7f59240cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46340/0 (socket says 172.21.15.37:46340) 2023-11-24T06:16:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f59237fe640 1 -- 172.21.15.37:0/1772584212 learned_addr learned my addr 172.21.15.37:0/1772584212 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f591affd640 1 --2- 172.21.15.37:0/1772584212 >> v2:172.21.15.37:3300/0 conn(0x7f59240cfb60 0x7f5924161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f5922ffd640 1 -- 172.21.15.37:0/1772584212 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092908194 0 0) 0x7f59240ce0b0 con 0x7f5924157c70 2023-11-24T06:16:49.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.115+0000 7f5922ffd640 1 -- 172.21.15.37:0/1772584212 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5910003520 con 0x7f5924157c70 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.116+0000 7f591affd640 1 -- 172.21.15.37:0/1772584212 >> v1:172.21.15.188:6789/0 conn(0x7f592415dc80 legacy=0x7f59240b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.116+0000 7f591affd640 1 -- 172.21.15.37:0/1772584212 >> v1:172.21.15.37:6789/0 conn(0x7f5924157c70 legacy=0x7f59240cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.116+0000 7f591affd640 1 -- 172.21.15.37:0/1772584212 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592415ebb0 con 0x7f59240cfb60 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.117+0000 7f591affd640 1 --2- 172.21.15.37:0/1772584212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59240cfb60 0x7f5924161df0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f590c0097a0 tx=0x7f590c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44147ca0a9b37453 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.117+0000 7f5922ffd640 1 -- 172.21.15.37:0/1772584212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c02e070 con 0x7f59240cfb60 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.117+0000 7f5922ffd640 1 -- 172.21.15.37:0/1772584212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c0315a0 con 0x7f59240cfb60 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.117+0000 7f5922ffd640 1 -- 172.21.15.37:0/1772584212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c031930 con 0x7f59240cfb60 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.118+0000 7f592a0c2640 1 -- 172.21.15.37:0/1772584212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59240cfb60 msgr2=0x7f5924161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.118+0000 7f592a0c2640 1 --2- 172.21.15.37:0/1772584212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59240cfb60 0x7f5924161df0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f590c0097a0 tx=0x7f590c02b840 comp rx=0 tx=0).stop 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.118+0000 7f592a0c2640 1 -- 172.21.15.37:0/1772584212 shutdown_connections 2023-11-24T06:16:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.118+0000 7f592a0c2640 1 --2- 172.21.15.37:0/1772584212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59240cfb60 0x7f5924161df0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.118+0000 7f592a0c2640 1 -- 172.21.15.37:0/1772584212 >> 172.21.15.37:0/1772584212 conn(0x7f592406a920 msgr2=0x7f592406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.118+0000 7f592a0c2640 1 -- 172.21.15.37:0/1772584212 shutdown_connections 2023-11-24T06:16:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.118+0000 7f592a0c2640 1 -- 172.21.15.37:0/1772584212 wait complete. 2023-11-24T06:16:49.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.120+0000 7f592a0c2640 1 Processor -- start 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.120+0000 7f592a0c2640 1 -- start start 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f592a0c2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59240cfb60 0x7f59241510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f592a0c2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5924157c70 0x7f592409cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f592a0c2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592415dc80 0x7f59240c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f592a0c2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c98f0 con 0x7f592415dc80 2023-11-24T06:16:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f592a0c2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c9b90 con 0x7f5924157c70 2023-11-24T06:16:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f592a0c2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c9e70 con 0x7f59240cfb60 2023-11-24T06:16:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f5923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592415dc80 0x7f59240c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f5923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592415dc80 0x7f59240c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36494/0 (socket says 172.21.15.37:36494) 2023-11-24T06:16:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f5923fff640 1 -- 172.21.15.37:0/2297884521 learned_addr learned my addr 172.21.15.37:0/2297884521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.121+0000 7f591affd640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5924157c70 0x7f592409cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5923fff640 1 -- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59240cfb60 msgr2=0x7f59241510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f59237fe640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59240cfb60 0x7f59241510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5923fff640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59240cfb60 0x7f59241510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5923fff640 1 -- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5924157c70 msgr2=0x7f592409cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5923fff640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5924157c70 0x7f592409cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5923fff640 1 -- 172.21.15.37:0/2297884521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c009400 con 0x7f592415dc80 2023-11-24T06:16:49.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f591affd640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5924157c70 0x7f592409cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:49.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f59237fe640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59240cfb60 0x7f59241510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:49.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5923fff640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592415dc80 0x7f59240c93b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f591c00c410 tx=0x7f591c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5920ff9640 1 -- 172.21.15.37:0/2297884521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c005230 con 0x7f592415dc80 2023-11-24T06:16:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5920ff9640 1 -- 172.21.15.37:0/2297884521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c005390 con 0x7f592415dc80 2023-11-24T06:16:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f5920ff9640 1 -- 172.21.15.37:0/2297884521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c0117d0 con 0x7f592415dc80 2023-11-24T06:16:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59240ca150 con 0x7f592415dc80 2023-11-24T06:16:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.122+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59240ca710 con 0x7f592415dc80 2023-11-24T06:16:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.124+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59240ca900 con 0x7f592415dc80 2023-11-24T06:16:49.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.124+0000 7f5920ff9640 1 -- 172.21.15.37:0/2297884521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f591c011930 con 0x7f592415dc80 2023-11-24T06:16:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.125+0000 7f5920ff9640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f590406ae40 0x7f590406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.126+0000 7f5920ff9640 1 -- 172.21.15.37:0/2297884521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f591c088a70 con 0x7f592415dc80 2023-11-24T06:16:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.126+0000 7f59237fe640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f590406ae40 0x7f590406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.126+0000 7f59237fe640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f590406ae40 0x7f590406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5914001560 tx=0x7f5914009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.130+0000 7f5920ff9640 1 -- 172.21.15.37:0/2297884521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f591c053a80 con 0x7f592415dc80 2023-11-24T06:16:49.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.323+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5924067470 con 0x7f592415dc80 2023-11-24T06:16:49.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.326+0000 7f5920ff9640 1 -- 172.21.15.37:0/2297884521 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f591c017090 con 0x7f592415dc80 2023-11-24T06:16:49.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:49.329 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:48.318893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f590406ae40 msgr2=0x7f590406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f590406ae40 0x7f590406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5914001560 tx=0x7f5914009040 comp rx=0 tx=0).stop 2023-11-24T06:16:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592415dc80 msgr2=0x7f59240c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592415dc80 0x7f59240c93b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f591c00c410 tx=0x7f591c00c8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 shutdown_connections 2023-11-24T06:16:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f590406ae40 0x7f590406d300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5924157c70 0x7f592409cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.328+0000 7f592a0c2640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592415dc80 0x7f59240c93b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.329+0000 7f592a0c2640 1 --2- 172.21.15.37:0/2297884521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59240cfb60 0x7f59241510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.329+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 >> 172.21.15.37:0/2297884521 conn(0x7f592406a920 msgr2=0x7f59240b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.329+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 shutdown_connections 2023-11-24T06:16:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.329+0000 7f592a0c2640 1 -- 172.21.15.37:0/2297884521 wait complete. 2023-11-24T06:16:49.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:49.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.572+0000 7f06ddc61640 1 Processor -- start 2023-11-24T06:16:49.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.573+0000 7f06ddc61640 1 -- start start 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.574+0000 7f06ddc61640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06d80d1ed0 0x7f06d80d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.574+0000 7f06ddc61640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d22b0 0x7f06d80ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.574+0000 7f06ddc61640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80b2d90 con 0x7f06d80ce710 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.574+0000 7f06ddc61640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d80ceb80 con 0x7f06d80d1ed0 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.574+0000 7f06ddc61640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80d1540 con 0x7f06d80d22b0 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06d77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06d80d1ed0 0x7f06d80d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06d7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06d80ce710 0x7f06d80cfdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46346/0 (socket says 172.21.15.37:46346) 2023-11-24T06:16:49.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06d7fff640 1 -- 172.21.15.37:0/3272773300 learned_addr learned my addr 172.21.15.37:0/3272773300 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:49.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06cffff640 1 --2- 172.21.15.37:0/3272773300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d22b0 0x7f06d80ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06d77fe640 1 -- 172.21.15.37:0/3272773300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d22b0 msgr2=0x7f06d80ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:49.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06d77fe640 1 --2- 172.21.15.37:0/3272773300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d22b0 0x7f06d80ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06d77fe640 1 -- 172.21.15.37:0/3272773300 >> v1:172.21.15.37:6789/0 conn(0x7f06d80ce710 legacy=0x7f06d80cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.575+0000 7f06d77fe640 1 -- 172.21.15.37:0/3272773300 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80b45f0 con 0x7f06d80d1ed0 2023-11-24T06:16:49.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.576+0000 7f06d77fe640 1 --2- 172.21.15.37:0/3272773300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80d1ed0 0x7f06d80d1000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097a0 tx=0x7f06c802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c860de12fda74885 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06d6ffd640 1 -- 172.21.15.37:0/3272773300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8031780 con 0x7f06d80d1ed0 2023-11-24T06:16:49.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06d6ffd640 1 -- 172.21.15.37:0/3272773300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c80318e0 con 0x7f06d80d1ed0 2023-11-24T06:16:49.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06d6ffd640 1 -- 172.21.15.37:0/3272773300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8031c70 con 0x7f06d80d1ed0 2023-11-24T06:16:49.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 -- 172.21.15.37:0/3272773300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80d1ed0 msgr2=0x7f06d80d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3272773300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80d1ed0 0x7f06d80d1000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097a0 tx=0x7f06c802b820 comp rx=0 tx=0).stop 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 -- 172.21.15.37:0/3272773300 shutdown_connections 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3272773300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d22b0 0x7f06d80ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3272773300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80d1ed0 0x7f06d80d1000 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 -- 172.21.15.37:0/3272773300 >> 172.21.15.37:0/3272773300 conn(0x7f06d808af60 msgr2=0x7f06d80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 -- 172.21.15.37:0/3272773300 shutdown_connections 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.577+0000 7f06ddc61640 1 -- 172.21.15.37:0/3272773300 wait complete. 2023-11-24T06:16:49.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.579+0000 7f06ddc61640 1 Processor -- start 2023-11-24T06:16:49.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.580+0000 7f06ddc61640 1 -- start start 2023-11-24T06:16:49.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.580+0000 7f06ddc61640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80ce710 0x7f06d81dd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.580+0000 7f06ddc61640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d1ed0 0x7f06d81e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.580+0000 7f06ddc61640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06d80d22b0 0x7f06d80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.580+0000 7f06ddc61640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d81e3500 con 0x7f06d80ce710 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06ddc61640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80b7de0 con 0x7f06d80d22b0 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06ddc61640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80b80c0 con 0x7f06d80d1ed0 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80ce710 0x7f06d81dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80ce710 0x7f06d81dd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36514/0 (socket says 172.21.15.37:36514) 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 -- 172.21.15.37:0/3282568100 learned_addr learned my addr 172.21.15.37:0/3282568100 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06cffff640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d1ed0 0x7f06d81e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d7fff640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06d80d22b0 0x7f06d80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 -- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d1ed0 msgr2=0x7f06d81e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d1ed0 0x7f06d81e3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 -- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06d80d22b0 msgr2=0x7f06d80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06d80d22b0 0x7f06d80b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d77fe640 1 -- 172.21.15.37:0/3282568100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8009400 con 0x7f06d80ce710 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.581+0000 7f06d7fff640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06d80d22b0 0x7f06d80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.582+0000 7f06d77fe640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80ce710 0x7f06d81dd040 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f06c8034040 tx=0x7f06c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.582+0000 7f06d4ff9640 1 -- 172.21.15.37:0/3282568100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8032820 con 0x7f06d80ce710 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.582+0000 7f06d4ff9640 1 -- 172.21.15.37:0/3282568100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8032980 con 0x7f06d80ce710 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.582+0000 7f06d4ff9640 1 -- 172.21.15.37:0/3282568100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8032d30 con 0x7f06d80ce710 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.582+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d81e3190 con 0x7f06d80ce710 2023-11-24T06:16:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.582+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d81e3ed0 con 0x7f06d80ce710 2023-11-24T06:16:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.583+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d8067470 con 0x7f06d80ce710 2023-11-24T06:16:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.584+0000 7f06d4ff9640 1 -- 172.21.15.37:0/3282568100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06c804e440 con 0x7f06d80ce710 2023-11-24T06:16:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.585+0000 7f06d4ff9640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06b806ae90 0x7f06b806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.586+0000 7f06d4ff9640 1 -- 172.21.15.37:0/3282568100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06c80ab790 con 0x7f06d80ce710 2023-11-24T06:16:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.586+0000 7f06cffff640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06b806ae90 0x7f06b806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:49.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.586+0000 7f06cffff640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06b806ae90 0x7f06b806d350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06c0006fd0 tx=0x7f06c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:49.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.590+0000 7f06d4ff9640 1 -- 172.21.15.37:0/3282568100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06c8076820 con 0x7f06d80ce710 2023-11-24T06:16:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.784+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06d80c9c10 con 0x7f06d80ce710 2023-11-24T06:16:49.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.788+0000 7f06d4ff9640 1 -- 172.21.15.37:0/3282568100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f06c8079e40 con 0x7f06d80ce710 2023-11-24T06:16:49.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:49.791 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:48.318893+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:49.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.791+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06b806ae90 msgr2=0x7f06b806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.791+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06b806ae90 0x7f06b806d350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06c0006fd0 tx=0x7f06c0008040 comp rx=0 tx=0).stop 2023-11-24T06:16:49.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.791+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80ce710 msgr2=0x7f06d81dd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.791+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80ce710 0x7f06d81dd040 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f06c8034040 tx=0x7f06c80046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 shutdown_connections 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f06b806ae90 0x7f06b806d350 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06d80d22b0 0x7f06d80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06d80d1ed0 0x7f06d81e3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 --2- 172.21.15.37:0/3282568100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80ce710 0x7f06d81dd040 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 >> 172.21.15.37:0/3282568100 conn(0x7f06d808af60 msgr2=0x7f06d81e28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 shutdown_connections 2023-11-24T06:16:49.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:49.792+0000 7f06ddc61640 1 -- 172.21.15.37:0/3282568100 wait complete. 2023-11-24T06:16:49.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:16:50.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.032+0000 7ffaf656c640 1 Processor -- start 2023-11-24T06:16:50.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.032+0000 7ffaf656c640 1 -- start start 2023-11-24T06:16:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.034+0000 7ffaf656c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffaf00b0fb0 0x7ffaf006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.034+0000 7ffaf656c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf015ed20 con 0x7ffaf00b0b40 2023-11-24T06:16:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.034+0000 7ffaf656c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf015f8a0 con 0x7ffaf015b260 2023-11-24T06:16:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.034+0000 7ffaf656c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf015b640 con 0x7ffaf00b0fb0 2023-11-24T06:16:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.034+0000 7ffaf4d69640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffaf00b0b40 0x7ffaf006c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46360/0 (socket says 172.21.15.37:46360) 2023-11-24T06:16:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.034+0000 7ffaf4d69640 1 -- 172.21.15.37:0/1534454642 learned_addr learned my addr 172.21.15.37:0/1534454642 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.034+0000 7ffaf5d6b640 1 --2- 172.21.15.37:0/1534454642 >> v2:172.21.15.37:3300/0 conn(0x7ffaf00b0fb0 0x7ffaf006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.035+0000 7ffae7fff640 1 -- 172.21.15.37:0/1534454642 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963525867 0 0) 0x7ffaf015ed20 con 0x7ffaf00b0b40 2023-11-24T06:16:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.035+0000 7ffae7fff640 1 -- 172.21.15.37:0/1534454642 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffadc003520 con 0x7ffaf00b0b40 2023-11-24T06:16:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.035+0000 7ffaf5d6b640 1 -- 172.21.15.37:0/1534454642 >> v1:172.21.15.188:6789/0 conn(0x7ffaf015b260 legacy=0x7ffaf006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.035+0000 7ffaf5d6b640 1 -- 172.21.15.37:0/1534454642 >> v1:172.21.15.37:6789/0 conn(0x7ffaf00b0b40 legacy=0x7ffaf006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.035+0000 7ffaf5d6b640 1 -- 172.21.15.37:0/1534454642 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf006e750 con 0x7ffaf00b0fb0 2023-11-24T06:16:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.036+0000 7ffaf5d6b640 1 --2- 172.21.15.37:0/1534454642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b0fb0 0x7ffaf006ccc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009d90 tx=0x7ffae802bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ec95c23d073fd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.036+0000 7ffae7fff640 1 -- 172.21.15.37:0/1534454642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae802cb40 con 0x7ffaf00b0fb0 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.036+0000 7ffae7fff640 1 -- 172.21.15.37:0/1534454642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae802cca0 con 0x7ffaf00b0fb0 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.036+0000 7ffae7fff640 1 -- 172.21.15.37:0/1534454642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8034640 con 0x7ffaf00b0fb0 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.037+0000 7ffaf656c640 1 -- 172.21.15.37:0/1534454642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b0fb0 msgr2=0x7ffaf006ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.037+0000 7ffaf656c640 1 --2- 172.21.15.37:0/1534454642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b0fb0 0x7ffaf006ccc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009d90 tx=0x7ffae802bd90 comp rx=0 tx=0).stop 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.037+0000 7ffaf656c640 1 -- 172.21.15.37:0/1534454642 shutdown_connections 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.037+0000 7ffaf656c640 1 --2- 172.21.15.37:0/1534454642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b0fb0 0x7ffaf006ccc0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.037+0000 7ffaf656c640 1 -- 172.21.15.37:0/1534454642 >> 172.21.15.37:0/1534454642 conn(0x7ffaf00cbb40 msgr2=0x7ffaf00cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.037+0000 7ffaf656c640 1 -- 172.21.15.37:0/1534454642 shutdown_connections 2023-11-24T06:16:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.037+0000 7ffaf656c640 1 -- 172.21.15.37:0/1534454642 wait complete. 2023-11-24T06:16:50.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.039+0000 7ffaf656c640 1 Processor -- start 2023-11-24T06:16:50.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.039+0000 7ffaf656c640 1 -- start start 2023-11-24T06:16:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf656c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffaf00b0b40 0x7ffaf00b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf656c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffaf00b0fb0 0x7ffaf00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf656c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf015b260 0x7ffaf0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf656c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf009a370 con 0x7ffaf015b260 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf656c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00b4c10 con 0x7ffaf00b0b40 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf656c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00999d0 con 0x7ffaf00b0fb0 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf5d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf015b260 0x7ffaf0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf5d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf015b260 0x7ffaf0155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36528/0 (socket says 172.21.15.37:36528) 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf5d6b640 1 -- 172.21.15.37:0/3497053496 learned_addr learned my addr 172.21.15.37:0/3497053496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.040+0000 7ffaf556a640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffaf00b0b40 0x7ffaf00b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf5d6b640 1 -- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffaf00b0fb0 msgr2=0x7ffaf00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf5d6b640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffaf00b0fb0 0x7ffaf00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf5d6b640 1 -- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffaf00b0b40 msgr2=0x7ffaf00b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf5d6b640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffaf00b0b40 0x7ffaf00b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf5d6b640 1 -- 172.21.15.37:0/3497053496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8009a70 con 0x7ffaf015b260 2023-11-24T06:16:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf556a640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffaf00b0b40 0x7ffaf00b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf5d6b640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf015b260 0x7ffaf0155ce0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009eb0 tx=0x7ffae8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffae5ffb640 1 -- 172.21.15.37:0/3497053496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae803e610 con 0x7ffaf015b260 2023-11-24T06:16:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffae5ffb640 1 -- 172.21.15.37:0/3497053496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae803e790 con 0x7ffaf015b260 2023-11-24T06:16:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffae5ffb640 1 -- 172.21.15.37:0/3497053496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae803eb40 con 0x7ffaf015b260 2023-11-24T06:16:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.041+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf0099cb0 con 0x7ffaf015b260 2023-11-24T06:16:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.042+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf01567e0 con 0x7ffaf015b260 2023-11-24T06:16:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.043+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf006eec0 con 0x7ffaf015b260 2023-11-24T06:16:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.044+0000 7ffae5ffb640 1 -- 172.21.15.37:0/3497053496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffae803b050 con 0x7ffaf015b260 2023-11-24T06:16:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.044+0000 7ffae5ffb640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffad406ae40 0x7ffad406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.045+0000 7ffae5ffb640 1 -- 172.21.15.37:0/3497053496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffae80ab810 con 0x7ffaf015b260 2023-11-24T06:16:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.045+0000 7ffaf556a640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffad406ae40 0x7ffad406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.045+0000 7ffaf556a640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffad406ae40 0x7ffad406d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00a830 tx=0x7ffaec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.049+0000 7ffae5ffb640 1 -- 172.21.15.37:0/3497053496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffae8076930 con 0x7ffaf015b260 2023-11-24T06:16:50.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.281+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffaf004e840 con 0x7ffaf015b260 2023-11-24T06:16:50.801 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-11-24T06:16:50.798+0000 7f674e5af640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:16:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.903+0000 7ffae5ffb640 1 -- 172.21.15.37:0/3497053496 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffae804d0b0 con 0x7ffaf015b260 2023-11-24T06:16:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.907+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffad406ae40 msgr2=0x7ffad406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.907+0000 7ffaf656c640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffad406ae40 0x7ffad406d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00a830 tx=0x7ffaec008040 comp rx=0 tx=0).stop 2023-11-24T06:16:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.907+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf015b260 msgr2=0x7ffaf0155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.907+0000 7ffaf656c640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf015b260 0x7ffaf0155ce0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009eb0 tx=0x7ffae8004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.907+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 shutdown_connections 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.907+0000 7ffaf656c640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ffad406ae40 0x7ffad406d300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.908+0000 7ffaf656c640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf015b260 0x7ffaf0155ce0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.908+0000 7ffaf656c640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffaf00b0fb0 0x7ffaf00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.908+0000 7ffaf656c640 1 --2- 172.21.15.37:0/3497053496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffaf00b0b40 0x7ffaf00b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.908+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 >> 172.21.15.37:0/3497053496 conn(0x7ffaf00cbb40 msgr2=0x7ffaf00af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.908+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 shutdown_connections 2023-11-24T06:16:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:50.908+0000 7ffaf656c640 1 -- 172.21.15.37:0/3497053496 wait complete. 2023-11-24T06:16:50.933 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:16:50.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:16:51.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.164+0000 7f1c849cf640 1 Processor -- start 2023-11-24T06:16:51.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.164+0000 7f1c849cf640 1 -- start start 2023-11-24T06:16:51.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.165+0000 7f1c849cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c8015b260 0x7f1c8006e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.165+0000 7f1c849cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c8006e580 0x7f1c800b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.165+0000 7f1c849cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 0x7f1c800ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.165+0000 7f1c849cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8015b640 con 0x7f1c8006e580 2023-11-24T06:16:51.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.165+0000 7f1c849cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c800b1510 con 0x7f1c8015b260 2023-11-24T06:16:51.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.165+0000 7f1c849cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8015ed20 con 0x7f1c800b1080 2023-11-24T06:16:51.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.166+0000 7f1c77fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c8006e580 0x7f1c800b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.166+0000 7f1c77fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c8006e580 0x7f1c800b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43574/0 (socket says 172.21.15.37:43574) 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.166+0000 7f1c77fff640 1 -- 172.21.15.37:0/1902522721 learned_addr learned my addr 172.21.15.37:0/1902522721 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.166+0000 7f1c7f7fe640 1 --2- 172.21.15.37:0/1902522721 >> v2:172.21.15.188:3300/0 conn(0x7f1c8015b260 0x7f1c8006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.166+0000 7f1c7ffff640 1 --2- 172.21.15.37:0/1902522721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 0x7f1c800ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.167+0000 7f1c77fff640 1 -- 172.21.15.37:0/1902522721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 msgr2=0x7f1c800ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.167+0000 7f1c77fff640 1 --2- 172.21.15.37:0/1902522721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 0x7f1c800ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.167+0000 7f1c77fff640 1 -- 172.21.15.37:0/1902522721 >> v2:172.21.15.188:3300/0 conn(0x7f1c8015b260 msgr2=0x7f1c8006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.167+0000 7f1c77fff640 1 --2- 172.21.15.37:0/1902522721 >> v2:172.21.15.188:3300/0 conn(0x7f1c8015b260 0x7f1c8006e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.167+0000 7f1c77fff640 1 -- 172.21.15.37:0/1902522721 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8015f8a0 con 0x7f1c8006e580 2023-11-24T06:16:51.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.167+0000 7f1c7f7fe640 1 --2- 172.21.15.37:0/1902522721 >> v2:172.21.15.188:3300/0 conn(0x7f1c8015b260 0x7f1c8006e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:51.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.168+0000 7f1c77fff640 1 --2- 172.21.15.37:0/1902522721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b0b40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c800d0160 tx=0x7f1c6802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331100a776409e99 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.168+0000 7f1c7effd640 1 -- 172.21.15.37:0/1902522721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68031740 con 0x7f1c8006e580 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.168+0000 7f1c7effd640 1 -- 172.21.15.37:0/1902522721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c680318a0 con 0x7f1c8006e580 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.168+0000 7f1c7effd640 1 -- 172.21.15.37:0/1902522721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68031c30 con 0x7f1c8006e580 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 -- 172.21.15.37:0/1902522721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 msgr2=0x7f1c800b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 --2- 172.21.15.37:0/1902522721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b0b40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c800d0160 tx=0x7f1c6802b7e0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 -- 172.21.15.37:0/1902522721 shutdown_connections 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 --2- 172.21.15.37:0/1902522721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 0x7f1c800ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 --2- 172.21.15.37:0/1902522721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b0b40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 --2- 172.21.15.37:0/1902522721 >> v2:172.21.15.188:3300/0 conn(0x7f1c8015b260 0x7f1c8006e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 -- 172.21.15.37:0/1902522721 >> 172.21.15.37:0/1902522721 conn(0x7f1c800cbb40 msgr2=0x7f1c800cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:51.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 -- 172.21.15.37:0/1902522721 shutdown_connections 2023-11-24T06:16:51.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.169+0000 7f1c849cf640 1 -- 172.21.15.37:0/1902522721 wait complete. 2023-11-24T06:16:51.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.171+0000 7f1c849cf640 1 Processor -- start 2023-11-24T06:16:51.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.171+0000 7f1c849cf640 1 -- start start 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c849cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c849cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 0x7f1c8015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c849cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c8015b260 0x7f1c801545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c849cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80153b50 con 0x7f1c8006e580 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c849cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800b3d60 con 0x7f1c8015b260 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c849cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80154af0 con 0x7f1c800b1080 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43578/0 (socket says 172.21.15.37:43578) 2023-11-24T06:16:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.172+0000 7f1c7f7fe640 1 -- 172.21.15.37:0/157551577 learned_addr learned my addr 172.21.15.37:0/157551577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7f7fe640 1 -- 172.21.15.37:0/157551577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 msgr2=0x7f1c8015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7f7fe640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 0x7f1c8015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7f7fe640 1 -- 172.21.15.37:0/157551577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c8015b260 msgr2=0x7f1c801545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7ffff640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c8015b260 0x7f1c801545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7f7fe640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c8015b260 0x7f1c801545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7f7fe640 1 -- 172.21.15.37:0/157551577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680094d0 con 0x7f1c8006e580 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7f7fe640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b2ac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000d800 tx=0x7f1c7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7cff9640 1 -- 172.21.15.37:0/157551577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70004030 con 0x7f1c8006e580 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7cff9640 1 -- 172.21.15.37:0/157551577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70004190 con 0x7f1c8006e580 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c7cff9640 1 -- 172.21.15.37:0/157551577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70004500 con 0x7f1c8006e580 2023-11-24T06:16:51.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c800b3150 con 0x7f1c8006e580 2023-11-24T06:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.173+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c800b3710 con 0x7f1c8006e580 2023-11-24T06:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.174+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8004e840 con 0x7f1c8006e580 2023-11-24T06:16:51.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.175+0000 7f1c7cff9640 1 -- 172.21.15.37:0/157551577 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c7000b6c0 con 0x7f1c8006e580 2023-11-24T06:16:51.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.176+0000 7f1c7cff9640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1c6006ae40 0x7f1c6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:51.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.176+0000 7f1c7cff9640 1 -- 172.21.15.37:0/157551577 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c70089830 con 0x7f1c8006e580 2023-11-24T06:16:51.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.177+0000 7f1c77fff640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1c6006ae40 0x7f1c6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:51.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.177+0000 7f1c77fff640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1c6006ae40 0x7f1c6006d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c68035000 tx=0x7f1c68030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:51.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.181+0000 7f1c7cff9640 1 -- 172.21.15.37:0/157551577 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c70054840 con 0x7f1c8006e580 2023-11-24T06:16:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.407+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1c800ce640 con 0x7f1c8006e580 2023-11-24T06:16:51.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.906+0000 7f1c7cff9640 1 -- 172.21.15.37:0/157551577 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c70057e60 con 0x7f1c8006e580 2023-11-24T06:16:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.909+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1c6006ae40 msgr2=0x7f1c6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.909+0000 7f1c849cf640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1c6006ae40 0x7f1c6006d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c68035000 tx=0x7f1c68030000 comp rx=0 tx=0).stop 2023-11-24T06:16:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.909+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 msgr2=0x7f1c800b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.909+0000 7f1c849cf640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b2ac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000d800 tx=0x7f1c7000dcc0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 shutdown_connections 2023-11-24T06:16:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1c6006ae40 0x7f1c6006d300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c8015b260 0x7f1c801545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c800b1080 0x7f1c8015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 --2- 172.21.15.37:0/157551577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8006e580 0x7f1c800b2ac0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 >> 172.21.15.37:0/157551577 conn(0x7f1c800cbb40 msgr2=0x7f1c800ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 shutdown_connections 2023-11-24T06:16:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:51.910+0000 7f1c849cf640 1 -- 172.21.15.37:0/157551577 wait complete. 2023-11-24T06:16:51.933 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:16:51.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.146+0000 7fa8b605c640 1 Processor -- start 2023-11-24T06:16:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.146+0000 7fa8b605c640 1 -- start start 2023-11-24T06:16:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.148+0000 7fa8b605c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 0x7fa8b00cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.148+0000 7fa8b605c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00cece0 con 0x7fa8b015c7f0 2023-11-24T06:16:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.148+0000 7fa8b605c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b006d040 con 0x7fa8b00cf450 2023-11-24T06:16:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.148+0000 7fa8b605c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00cfe40 con 0x7fa8b00ce6c0 2023-11-24T06:16:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.148+0000 7fa8af7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa8b015c7f0 0x7fa8b006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43174/0 (socket says 172.21.15.37:43174) 2023-11-24T06:16:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.148+0000 7fa8af7fe640 1 -- 172.21.15.37:0/2119012222 learned_addr learned my addr 172.21.15.37:0/2119012222 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8affff640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 0x7fa8b00cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013101488 0 0) 0x7fa8b00cece0 con 0x7fa8b015c7f0 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c003520 con 0x7fa8b015c7f0 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4257179444 0 0) 0x7fa89c003520 con 0x7fa8b015c7f0 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 msgr2=0x7fa8b00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 0x7fa8b00cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 >> v1:172.21.15.188:6789/0 conn(0x7fa8b00cf450 legacy=0x7fa8b00cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b006d320 con 0x7fa8b015c7f0 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fa8a0001670 con 0x7fa8b015c7f0 2023-11-24T06:16:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 >> v1:172.21.15.37:6789/0 conn(0x7fa8b015c7f0 legacy=0x7fa8b006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89c0039a0 0x7fa89c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa89c004350 0x7fa89c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 0x7fa89c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00cfe40 con 0x7fa89c0039a0 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c00b980 con 0x7fa89c004350 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.149+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c00bb40 con 0x7fa8b00ce6c0 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89c0039a0 0x7fa89c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8a6ffd640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa89c004350 0x7fa89c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8af7fe640 1 -- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 msgr2=0x7fa89c005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8affff640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 0x7fa89c005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8b00ce6c0 0x7fa89c005080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8af7fe640 1 -- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa89c004350 msgr2=0x7fa89c004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa89c004350 0x7fa89c004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8af7fe640 1 -- 172.21.15.37:0/2119012222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c003520 con 0x7fa89c0039a0 2023-11-24T06:16:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.150+0000 7fa8a6ffd640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa89c004350 0x7fa89c004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.151+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89c0039a0 0x7fa89c003d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c210 tx=0x7fa89c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d613302bb33a7a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.151+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a002cae0 con 0x7fa89c0039a0 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.151+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a002cc60 con 0x7fa89c0039a0 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8aeffd640 1 -- 172.21.15.37:0/2119012222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00058d0 con 0x7fa89c0039a0 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8b605c640 1 -- 172.21.15.37:0/2119012222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89c0039a0 msgr2=0x7fa89c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8b605c640 1 --2- 172.21.15.37:0/2119012222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89c0039a0 0x7fa89c003d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c210 tx=0x7fa89c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8affff640 1 -- 172.21.15.37:0/2119012222 reap_dead start 2023-11-24T06:16:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8b605c640 1 -- 172.21.15.37:0/2119012222 shutdown_connections 2023-11-24T06:16:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8b605c640 1 -- 172.21.15.37:0/2119012222 >> 172.21.15.37:0/2119012222 conn(0x7fa8b006a920 msgr2=0x7fa8b006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8b605c640 1 -- 172.21.15.37:0/2119012222 shutdown_connections 2023-11-24T06:16:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.152+0000 7fa8b605c640 1 -- 172.21.15.37:0/2119012222 wait complete. 2023-11-24T06:16:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.154+0000 7fa8b605c640 1 Processor -- start 2023-11-24T06:16:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.154+0000 7fa8b605c640 1 -- start start 2023-11-24T06:16:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.155+0000 7fa8b605c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89c0039a0 0x7fa8b014c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.155+0000 7fa8b605c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b00b2580 0x7fa8b00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.155+0000 7fa8b605c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b0154b10 0x7fa8b00af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.155+0000 7fa8b605c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00b3700 con 0x7fa8b00b2580 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.155+0000 7fa8b605c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b014c8b0 con 0x7fa8b0154b10 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.155+0000 7fa8b605c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00b2a80 con 0x7fa89c0039a0 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b00b2580 0x7fa8b00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b00b2580 0x7fa8b00b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43598/0 (socket says 172.21.15.37:43598) 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 -- 172.21.15.37:0/1056621560 learned_addr learned my addr 172.21.15.37:0/1056621560 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8affff640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b0154b10 0x7fa8b00af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89c0039a0 0x7fa8b014c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 -- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89c0039a0 msgr2=0x7fa8b014c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89c0039a0 0x7fa8b014c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 -- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b0154b10 msgr2=0x7fa8b00af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b0154b10 0x7fa8b00af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 -- 172.21.15.37:0/1056621560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00b2d60 con 0x7fa8b00b2580 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89c0039a0 0x7fa8b014c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.156+0000 7fa8a6ffd640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b00b2580 0x7fa8b00b3b20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa89800d7f0 tx=0x7fa89800dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.157+0000 7fa8acff9640 1 -- 172.21.15.37:0/1056621560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898005270 con 0x7fa8b00b2580 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.157+0000 7fa8acff9640 1 -- 172.21.15.37:0/1056621560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8980053d0 con 0x7fa8b00b2580 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.157+0000 7fa8acff9640 1 -- 172.21.15.37:0/1056621560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800b870 con 0x7fa8b00b2580 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.157+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00b3040 con 0x7fa8b00b2580 2023-11-24T06:16:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.157+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b00b4060 con 0x7fa8b00b2580 2023-11-24T06:16:52.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.158+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0067470 con 0x7fa8b00b2580 2023-11-24T06:16:52.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.159+0000 7fa8acff9640 1 -- 172.21.15.37:0/1056621560 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa89800bbe0 con 0x7fa8b00b2580 2023-11-24T06:16:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.160+0000 7fa8acff9640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa89006ae70 0x7fa89006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.160+0000 7fa8acff9640 1 -- 172.21.15.37:0/1056621560 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa898089910 con 0x7fa8b00b2580 2023-11-24T06:16:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.160+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa89006ae70 0x7fa89006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.161+0000 7fa8af7fe640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa89006ae70 0x7fa89006d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa8a002cfd0 tx=0x7fa8a0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.164+0000 7fa8acff9640 1 -- 172.21.15.37:0/1056621560 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8980549b0 con 0x7fa8b00b2580 2023-11-24T06:16:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.394+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8b015fbf0 con 0x7fa8b00b2580 2023-11-24T06:16:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.396+0000 7fa8acff9640 1 -- 172.21.15.37:0/1056621560 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fa898057fd0 con 0x7fa8b00b2580 2023-11-24T06:16:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:52.399 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1029063982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1029063982},{"type":"v1","addr":"172.21.15.37:6835","nonce":1029063982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/3663508959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3663508959},{"type":"v1","addr":"172.21.15.188:6834","nonce":3663508959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/1387291964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1387291964},{"type":"v1","addr":"172.21.15.188:6835","nonce":1387291964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:48.319764+0000","modified":"2023-11-24T06:16:51.408924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5568":{"gid":5568,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6837/1413576215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1413576215},{"type":"v1","addr":"172.21.15.37:6837","nonce":1413576215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:16:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa89006ae70 msgr2=0x7fa89006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa89006ae70 0x7fa89006d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa8a002cfd0 tx=0x7fa8a0009030 comp rx=0 tx=0).stop 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b00b2580 msgr2=0x7fa8b00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b00b2580 0x7fa8b00b3b20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa89800d7f0 tx=0x7fa89800dcb0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 shutdown_connections 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa89006ae70 0x7fa89006d330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b0154b10 0x7fa8b00af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b00b2580 0x7fa8b00b3b20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 --2- 172.21.15.37:0/1056621560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89c0039a0 0x7fa8b014c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 >> 172.21.15.37:0/1056621560 conn(0x7fa8b006a920 msgr2=0x7fa8b006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 shutdown_connections 2023-11-24T06:16:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.398+0000 7fa8b605c640 1 -- 172.21.15.37:0/1056621560 wait complete. 2023-11-24T06:16:52.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:16:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.647+0000 7fe042d16640 1 Processor -- start 2023-11-24T06:16:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.647+0000 7fe042d16640 1 -- start start 2023-11-24T06:16:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe042d16640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe03c161080 0x7fe03c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe042d16640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c0b0fb0 0x7fe03c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe042d16640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c161510 con 0x7fe03c143870 2023-11-24T06:16:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe042d16640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03c0b1460 con 0x7fe03c161080 2023-11-24T06:16:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe042d16640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c070460 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe041513640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe03c161080 0x7fe03c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe041d14640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe03c143870 0x7fe03c146970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43176/0 (socket says 172.21.15.37:43176) 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.649+0000 7fe041d14640 1 -- 172.21.15.37:0/1587548741 learned_addr learned my addr 172.21.15.37:0/1587548741 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.650+0000 7fe042515640 1 --2- 172.21.15.37:0/1587548741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c0b0fb0 0x7fe03c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.650+0000 7fe041513640 1 -- 172.21.15.37:0/1587548741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c0b0fb0 msgr2=0x7fe03c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.650+0000 7fe041513640 1 --2- 172.21.15.37:0/1587548741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c0b0fb0 0x7fe03c0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.650+0000 7fe041513640 1 -- 172.21.15.37:0/1587548741 >> v1:172.21.15.37:6789/0 conn(0x7fe03c143870 legacy=0x7fe03c146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.650+0000 7fe041513640 1 -- 172.21.15.37:0/1587548741 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c1617f0 con 0x7fe03c161080 2023-11-24T06:16:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.651+0000 7fe041513640 1 --2- 172.21.15.37:0/1587548741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c161080 0x7fe03c0b0a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f747e975c744ade5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.651+0000 7fe040d12640 1 -- 172.21.15.37:0/1587548741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c02d040 con 0x7fe03c161080 2023-11-24T06:16:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe040d12640 1 -- 172.21.15.37:0/1587548741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c031810 con 0x7fe03c161080 2023-11-24T06:16:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe040d12640 1 -- 172.21.15.37:0/1587548741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c031ba0 con 0x7fe03c161080 2023-11-24T06:16:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 -- 172.21.15.37:0/1587548741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c161080 msgr2=0x7fe03c0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 --2- 172.21.15.37:0/1587548741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c161080 0x7fe03c0b0a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02b8b0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 -- 172.21.15.37:0/1587548741 shutdown_connections 2023-11-24T06:16:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 --2- 172.21.15.37:0/1587548741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c0b0fb0 0x7fe03c0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 --2- 172.21.15.37:0/1587548741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c161080 0x7fe03c0b0a70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 -- 172.21.15.37:0/1587548741 >> 172.21.15.37:0/1587548741 conn(0x7fe03c0cb830 msgr2=0x7fe03c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 -- 172.21.15.37:0/1587548741 shutdown_connections 2023-11-24T06:16:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.652+0000 7fe042d16640 1 -- 172.21.15.37:0/1587548741 wait complete. 2023-11-24T06:16:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.654+0000 7fe042d16640 1 Processor -- start 2023-11-24T06:16:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.654+0000 7fe042d16640 1 -- start start 2023-11-24T06:16:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.655+0000 7fe042d16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c0b0fb0 0x7fe03c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.655+0000 7fe042d16640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c143870 0x7fe03c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.655+0000 7fe042d16640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe03c15e050 0x7fe03c141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.655+0000 7fe042d16640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0b1bd0 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.655+0000 7fe042d16640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15e4f0 con 0x7fe03c15e050 2023-11-24T06:16:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.655+0000 7fe042d16640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15e7d0 con 0x7fe03c143870 2023-11-24T06:16:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c0b0fb0 0x7fe03c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c0b0fb0 0x7fe03c15cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43616/0 (socket says 172.21.15.37:43616) 2023-11-24T06:16:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 -- 172.21.15.37:0/784153323 learned_addr learned my addr 172.21.15.37:0/784153323 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:52.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041513640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c143870 0x7fe03c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe042515640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe03c15e050 0x7fe03c141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 -- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c143870 msgr2=0x7fe03c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c143870 0x7fe03c15db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 -- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe03c15e050 msgr2=0x7fe03c141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe03c15e050 0x7fe03c141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 -- 172.21.15.37:0/784153323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c009400 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041513640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c143870 0x7fe03c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe042515640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe03c15e050 0x7fe03c141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.656+0000 7fe041d14640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c0b0fb0 0x7fe03c15cef0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c4a0 tx=0x7fe03800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.657+0000 7fe0327fc640 1 -- 172.21.15.37:0/784153323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038005ce0 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.657+0000 7fe0327fc640 1 -- 172.21.15.37:0/784153323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038005e40 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.657+0000 7fe0327fc640 1 -- 172.21.15.37:0/784153323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038007270 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.657+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c15eab0 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.657+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c140280 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.658+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c04e840 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.659+0000 7fe0327fc640 1 -- 172.21.15.37:0/784153323 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0380073d0 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.660+0000 7fe0327fc640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe02006ae70 0x7fe02006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.660+0000 7fe0327fc640 1 -- 172.21.15.37:0/784153323 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe038088aa0 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.660+0000 7fe041513640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe02006ae70 0x7fe02006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.661+0000 7fe041513640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe02006ae70 0x7fe02006d330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe02c036000 tx=0x7fe02c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.665+0000 7fe0327fc640 1 -- 172.21.15.37:0/784153323 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe038053b60 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.860+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe03c0b4e90 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.862+0000 7fe0327fc640 1 -- 172.21.15.37:0/784153323 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fe038017020 con 0x7fe03c0b0fb0 2023-11-24T06:16:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:52.866 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:49.877706+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:16:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe02006ae70 msgr2=0x7fe02006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe02006ae70 0x7fe02006d330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe02c036000 tx=0x7fe02c03c040 comp rx=0 tx=0).stop 2023-11-24T06:16:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c0b0fb0 msgr2=0x7fe03c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c0b0fb0 0x7fe03c15cef0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c4a0 tx=0x7fe03800c960 comp rx=0 tx=0).stop 2023-11-24T06:16:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 shutdown_connections 2023-11-24T06:16:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe02006ae70 0x7fe02006d330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe03c15e050 0x7fe03c141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe03c143870 0x7fe03c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 --2- 172.21.15.37:0/784153323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c0b0fb0 0x7fe03c15cef0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 >> 172.21.15.37:0/784153323 conn(0x7fe03c0cb830 msgr2=0x7fe03c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 shutdown_connections 2023-11-24T06:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:52.865+0000 7fe042d16640 1 -- 172.21.15.37:0/784153323 wait complete. 2023-11-24T06:16:52.886 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:16:52.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:53.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.105+0000 7fc28a167640 1 Processor -- start 2023-11-24T06:16:53.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.105+0000 7fc28a167640 1 -- start start 2023-11-24T06:16:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.107+0000 7fc28a167640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc284144b30 0x7fc28415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.107+0000 7fc28a167640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2840b1de0 0x7fc2840b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.107+0000 7fc28a167640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28415bf80 con 0x7fc28415c410 2023-11-24T06:16:53.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.107+0000 7fc28a167640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2840b27b0 con 0x7fc284144b30 2023-11-24T06:16:53.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.107+0000 7fc28a167640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840b1560 con 0x7fc2840b1de0 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.107+0000 7fc288964640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc28415c410 0x7fc2840b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43184/0 (socket says 172.21.15.37:43184) 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.107+0000 7fc288964640 1 -- 172.21.15.37:0/1541325567 learned_addr learned my addr 172.21.15.37:0/1541325567 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc289165640 1 --2- 172.21.15.37:0/1541325567 >> v2:172.21.15.37:3300/0 conn(0x7fc284144b30 0x7fc28415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc289966640 1 --2- 172.21.15.37:0/1541325567 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2840b1de0 0x7fc2840b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc27bfff640 1 -- 172.21.15.37:0/1541325567 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379229994 0 0) 0x7fc28415bf80 con 0x7fc28415c410 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc27bfff640 1 -- 172.21.15.37:0/1541325567 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc270003520 con 0x7fc28415c410 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc289165640 1 -- 172.21.15.37:0/1541325567 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2840b1de0 msgr2=0x7fc2840b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc289165640 1 --2- 172.21.15.37:0/1541325567 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2840b1de0 0x7fc2840b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc289165640 1 -- 172.21.15.37:0/1541325567 >> v1:172.21.15.37:6789/0 conn(0x7fc28415c410 legacy=0x7fc2840b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.108+0000 7fc289165640 1 -- 172.21.15.37:0/1541325567 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2840b1280 con 0x7fc284144b30 2023-11-24T06:16:53.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.110+0000 7fc289165640 1 --2- 172.21.15.37:0/1541325567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc28415f920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc2800097a0 tx=0x7fc28002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef7df8b8b0d0cf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:53.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.110+0000 7fc27bfff640 1 -- 172.21.15.37:0/1541325567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280031830 con 0x7fc284144b30 2023-11-24T06:16:53.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.110+0000 7fc27bfff640 1 -- 172.21.15.37:0/1541325567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc280031990 con 0x7fc284144b30 2023-11-24T06:16:53.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.110+0000 7fc27bfff640 1 -- 172.21.15.37:0/1541325567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280031d20 con 0x7fc284144b30 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 -- 172.21.15.37:0/1541325567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 msgr2=0x7fc28415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 --2- 172.21.15.37:0/1541325567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc28415f920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc2800097a0 tx=0x7fc28002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 -- 172.21.15.37:0/1541325567 shutdown_connections 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 --2- 172.21.15.37:0/1541325567 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2840b1de0 0x7fc2840b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 --2- 172.21.15.37:0/1541325567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc28415f920 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 -- 172.21.15.37:0/1541325567 >> 172.21.15.37:0/1541325567 conn(0x7fc2840cb830 msgr2=0x7fc2840cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 -- 172.21.15.37:0/1541325567 shutdown_connections 2023-11-24T06:16:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.111+0000 7fc28a167640 1 -- 172.21.15.37:0/1541325567 wait complete. 2023-11-24T06:16:53.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.113+0000 7fc28a167640 1 Processor -- start 2023-11-24T06:16:53.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.113+0000 7fc28a167640 1 -- start start 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc28a167640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2840b1de0 0x7fc284135720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc28a167640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc2841f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc28a167640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc28415c410 0x7fc2841f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc28a167640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc284135c60 con 0x7fc284144b30 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc28a167640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840c7210 con 0x7fc2840b1de0 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc28a167640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840c5b60 con 0x7fc28415c410 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc288964640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc2841f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc288964640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc2841f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43632/0 (socket says 172.21.15.37:43632) 2023-11-24T06:16:53.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.114+0000 7fc288964640 1 -- 172.21.15.37:0/1471098520 learned_addr learned my addr 172.21.15.37:0/1471098520 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:53.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc289966640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc28415c410 0x7fc2841f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc288964640 1 -- 172.21.15.37:0/1471098520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc28415c410 msgr2=0x7fc2841f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc288964640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc28415c410 0x7fc2841f12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc288964640 1 -- 172.21.15.37:0/1471098520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2840b1de0 msgr2=0x7fc284135720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc288964640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2840b1de0 0x7fc284135720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc288964640 1 -- 172.21.15.37:0/1471098520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280009400 con 0x7fc284144b30 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc288964640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc2841f0d60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c390 tx=0x7fc27400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc279ffb640 1 -- 172.21.15.37:0/1471098520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274005ce0 con 0x7fc284144b30 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc279ffb640 1 -- 172.21.15.37:0/1471098520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274005e40 con 0x7fc284144b30 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc279ffb640 1 -- 172.21.15.37:0/1471098520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740072f0 con 0x7fc284144b30 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.115+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2840c7460 con 0x7fc284144b30 2023-11-24T06:16:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.116+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2840c7a20 con 0x7fc284144b30 2023-11-24T06:16:53.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.117+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28404e840 con 0x7fc284144b30 2023-11-24T06:16:53.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.118+0000 7fc279ffb640 1 -- 172.21.15.37:0/1471098520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc274007450 con 0x7fc284144b30 2023-11-24T06:16:53.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.119+0000 7fc279ffb640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc26806ae40 0x7fc26806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.119+0000 7fc279ffb640 1 -- 172.21.15.37:0/1471098520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc274088c40 con 0x7fc284144b30 2023-11-24T06:16:53.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.119+0000 7fc289165640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc26806ae40 0x7fc26806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.120+0000 7fc289165640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc26806ae40 0x7fc26806d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc280036000 tx=0x7fc280030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:53.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.124+0000 7fc279ffb640 1 -- 172.21.15.37:0/1471098520 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc274053ce0 con 0x7fc284144b30 2023-11-24T06:16:53.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.313+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc28415bc10 con 0x7fc26806ae40 2023-11-24T06:16:53.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.339+0000 7fc279ffb640 1 -- 172.21.15.37:0/1471098520 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283645 (secure 0 0 0) 0x7fc28003b430 con 0x7fc26806ae40 2023-11-24T06:16:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc26806ae40 msgr2=0x7fc26806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc26806ae40 0x7fc26806d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc280036000 tx=0x7fc280030000 comp rx=0 tx=0).stop 2023-11-24T06:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 msgr2=0x7fc2841f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc2841f0d60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c390 tx=0x7fc27400c850 comp rx=0 tx=0).stop 2023-11-24T06:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 shutdown_connections 2023-11-24T06:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc26806ae40 0x7fc26806d300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc28415c410 0x7fc2841f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc284144b30 0x7fc2841f0d60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 --2- 172.21.15.37:0/1471098520 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2840b1de0 0x7fc284135720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.346+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 >> 172.21.15.37:0/1471098520 conn(0x7fc2840cb830 msgr2=0x7fc2840b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.347+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 shutdown_connections 2023-11-24T06:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.347+0000 7fc28a167640 1 -- 172.21.15.37:0/1471098520 wait complete. 2023-11-24T06:16:53.371 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-11-24T06:16:52.852248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230432,"kb_used_data":5928,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744288,"statfs":{"total":773094113280,"available":772858150912,"internally_reserved":0,"allocated":6070272,"data_stored":3249096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002017"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.888238+0000","last_change":"2023-11-24T06:16:48.888238+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.888238+0000","last_undegraded":"2023-11-24T06:16:48.888238+0000","last_fullsized":"2023-11-24T06:16:48.888238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:54.224214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882218+0000","last_change":"2023-11-24T06:16:48.882218+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882218+0000","last_undegraded":"2023-11-24T06:16:48.882218+0000","last_fullsized":"2023-11-24T06:16:48.882218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:20:49.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.866046+0000","last_change":"2023-11-24T06:16:47.866046+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.866046+0000","last_undegraded":"2023-11-24T06:16:47.866046+0000","last_fullsized":"2023-11-24T06:16:47.866046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866210+0000","last_change":"2023-11-24T06:16:48.866210+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866210+0000","last_undegraded":"2023-11-24T06:16:48.866210+0000","last_fullsized":"2023-11-24T06:16:48.866210+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:39:38.395169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.881698+0000","last_change":"2023-11-24T06:16:48.881698+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.881698+0000","last_undegraded":"2023-11-24T06:16:48.881698+0000","last_fullsized":"2023-11-24T06:16:48.881698+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:53.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852166+0000","last_change":"2023-11-24T06:16:47.852166+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852166+0000","last_undegraded":"2023-11-24T06:16:47.852166+0000","last_fullsized":"2023-11-24T06:16:47.852166+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869228+0000","last_change":"2023-11-24T06:16:48.869228+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869228+0000","last_undegraded":"2023-11-24T06:16:48.869228+0000","last_fullsized":"2023-11-24T06:16:48.869228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:06.358345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.877814+0000","last_change":"2023-11-24T06:16:48.877814+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.877814+0000","last_undegraded":"2023-11-24T06:16:48.877814+0000","last_fullsized":"2023-11-24T06:16:48.877814+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869253+0000","last_change":"2023-11-24T06:16:48.869253+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869253+0000","last_undegraded":"2023-11-24T06:16:48.869253+0000","last_fullsized":"2023-11-24T06:16:48.869253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.888135+0000","last_change":"2023-11-24T06:16:48.888135+0000","last_active":"2023-11-24T06:16:48.888135+0000","last_peered":"2023-11-24T06:16:48.888135+0000","last_clean":"2023-11-24T06:16:48.888135+0000","last_became_active":"2023-11-24T06:16:48.887851+0000","last_became_peered":"2023-11-24T06:16:48.887851+0000","last_unstale":"2023-11-24T06:16:48.888135+0000","last_undegraded":"2023-11-24T06:16:48.888135+0000","last_fullsized":"2023-11-24T06:16:48.888135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:29.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.865859+0000","last_change":"2023-11-24T06:16:48.865859+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.865859+0000","last_undegraded":"2023-11-24T06:16:48.865859+0000","last_fullsized":"2023-11-24T06:16:48.865859+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866143+0000","last_change":"2023-11-24T06:16:48.866143+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866143+0000","last_undegraded":"2023-11-24T06:16:48.866143+0000","last_fullsized":"2023-11-24T06:16:48.866143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.854247+0000","last_change":"2023-11-24T06:16:47.854247+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.854247+0000","last_undegraded":"2023-11-24T06:16:47.854247+0000","last_fullsized":"2023-11-24T06:16:47.854247+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.870028+0000","last_change":"2023-11-24T06:16:48.870028+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.870028+0000","last_undegraded":"2023-11-24T06:16:48.870028+0000","last_fullsized":"2023-11-24T06:16:48.870028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:29.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868735+0000","last_change":"2023-11-24T06:16:48.868735+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868735+0000","last_undegraded":"2023-11-24T06:16:48.868735+0000","last_fullsized":"2023-11-24T06:16:48.868735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:53.231928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852897+0000","last_change":"2023-11-24T06:16:47.852897+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852897+0000","last_undegraded":"2023-11-24T06:16:47.852897+0000","last_fullsized":"2023-11-24T06:16:47.852897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.887667+0000","last_change":"2023-11-24T06:16:48.887667+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.887667+0000","last_undegraded":"2023-11-24T06:16:48.887667+0000","last_fullsized":"2023-11-24T06:16:48.887667+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:28:32.474805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.866187+0000","last_change":"2023-11-24T06:16:47.866187+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.866187+0000","last_undegraded":"2023-11-24T06:16:47.866187+0000","last_fullsized":"2023-11-24T06:16:47.866187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.890640+0000","last_change":"2023-11-24T06:16:48.890640+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.890640+0000","last_undegraded":"2023-11-24T06:16:48.890640+0000","last_fullsized":"2023-11-24T06:16:48.890640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:31:56.753495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.880622+0000","last_change":"2023-11-24T06:16:48.880622+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.880622+0000","last_undegraded":"2023-11-24T06:16:48.880622+0000","last_fullsized":"2023-11-24T06:16:48.880622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:32.077444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.865010+0000","last_change":"2023-11-24T06:16:47.865010+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.865010+0000","last_undegraded":"2023-11-24T06:16:47.865010+0000","last_fullsized":"2023-11-24T06:16:47.865010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.879338+0000","last_change":"2023-11-24T06:16:48.879338+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.879338+0000","last_undegraded":"2023-11-24T06:16:48.879338+0000","last_fullsized":"2023-11-24T06:16:48.879338+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.861382+0000","last_change":"2023-11-24T06:16:47.861382+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.861382+0000","last_undegraded":"2023-11-24T06:16:47.861382+0000","last_fullsized":"2023-11-24T06:16:47.861382+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.853738+0000","last_change":"2023-11-24T06:16:47.853738+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.853738+0000","last_undegraded":"2023-11-24T06:16:47.853738+0000","last_fullsized":"2023-11-24T06:16:47.853738+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.884018+0000","last_change":"2023-11-24T06:16:48.884018+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.884018+0000","last_undegraded":"2023-11-24T06:16:48.884018+0000","last_fullsized":"2023-11-24T06:16:48.884018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:27:51.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.873446+0000","last_change":"2023-11-24T06:16:48.873446+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.873446+0000","last_undegraded":"2023-11-24T06:16:48.873446+0000","last_fullsized":"2023-11-24T06:16:48.873446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:42.334420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863359+0000","last_change":"2023-11-24T06:16:47.863359+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863359+0000","last_undegraded":"2023-11-24T06:16:47.863359+0000","last_fullsized":"2023-11-24T06:16:47.863359+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882110+0000","last_change":"2023-11-24T06:16:48.882110+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882110+0000","last_undegraded":"2023-11-24T06:16:48.882110+0000","last_fullsized":"2023-11-24T06:16:48.882110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:20.275650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882757+0000","last_change":"2023-11-24T06:16:48.882757+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882757+0000","last_undegraded":"2023-11-24T06:16:48.882757+0000","last_fullsized":"2023-11-24T06:16:48.882757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:20.197865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863533+0000","last_change":"2023-11-24T06:16:47.863533+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863533+0000","last_undegraded":"2023-11-24T06:16:47.863533+0000","last_fullsized":"2023-11-24T06:16:47.863533+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878935+0000","last_change":"2023-11-24T06:16:48.878935+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878935+0000","last_undegraded":"2023-11-24T06:16:48.878935+0000","last_fullsized":"2023-11-24T06:16:48.878935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:05.112330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852241+0000","last_change":"2023-11-24T06:16:47.852241+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852241+0000","last_undegraded":"2023-11-24T06:16:47.852241+0000","last_fullsized":"2023-11-24T06:16:47.852241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.855447+0000","last_change":"2023-11-24T06:16:47.855447+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.855447+0000","last_undegraded":"2023-11-24T06:16:47.855447+0000","last_fullsized":"2023-11-24T06:16:47.855447+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876100+0000","last_change":"2023-11-24T06:16:47.870996+0000","last_active":"2023-11-24T06:16:47.876100+0000","last_peered":"2023-11-24T06:16:47.876100+0000","last_clean":"2023-11-24T06:16:47.876100+0000","last_became_active":"2023-11-24T06:16:47.870728+0000","last_became_peered":"2023-11-24T06:16:47.870728+0000","last_unstale":"2023-11-24T06:16:47.876100+0000","last_undegraded":"2023-11-24T06:16:47.876100+0000","last_fullsized":"2023-11-24T06:16:47.876100+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866318+0000","last_change":"2023-11-24T06:16:48.866318+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866318+0000","last_undegraded":"2023-11-24T06:16:48.866318+0000","last_fullsized":"2023-11-24T06:16:48.866318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:09.576866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.882499+0000","last_change":"2023-11-24T06:16:47.873548+0000","last_active":"2023-11-24T06:16:48.882499+0000","last_peered":"2023-11-24T06:16:48.882499+0000","last_clean":"2023-11-24T06:16:48.882499+0000","last_became_active":"2023-11-24T06:16:47.873228+0000","last_became_peered":"2023-11-24T06:16:47.873228+0000","last_unstale":"2023-11-24T06:16:48.882499+0000","last_undegraded":"2023-11-24T06:16:48.882499+0000","last_fullsized":"2023-11-24T06:16:48.882499+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:26.312030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.859889+0000","last_change":"2023-11-24T06:16:47.859889+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.859889+0000","last_undegraded":"2023-11-24T06:16:47.859889+0000","last_fullsized":"2023-11-24T06:16:47.859889+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875830+0000","last_change":"2023-11-24T06:16:47.869007+0000","last_active":"2023-11-24T06:16:47.875830+0000","last_peered":"2023-11-24T06:16:47.875830+0000","last_clean":"2023-11-24T06:16:47.875830+0000","last_became_active":"2023-11-24T06:16:47.868662+0000","last_became_peered":"2023-11-24T06:16:47.868662+0000","last_unstale":"2023-11-24T06:16:47.875830+0000","last_undegraded":"2023-11-24T06:16:47.875830+0000","last_fullsized":"2023-11-24T06:16:47.875830+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:05.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.861396+0000","last_change":"2023-11-24T06:16:47.861396+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.861396+0000","last_undegraded":"2023-11-24T06:16:47.861396+0000","last_fullsized":"2023-11-24T06:16:47.861396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.873856+0000","last_change":"2023-11-24T06:16:47.871257+0000","last_active":"2023-11-24T06:16:48.873856+0000","last_peered":"2023-11-24T06:16:48.873856+0000","last_clean":"2023-11-24T06:16:48.873856+0000","last_became_active":"2023-11-24T06:16:47.870777+0000","last_became_peered":"2023-11-24T06:16:47.870777+0000","last_unstale":"2023-11-24T06:16:48.873856+0000","last_undegraded":"2023-11-24T06:16:48.873856+0000","last_fullsized":"2023-11-24T06:16:48.873856+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:54.500222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878811+0000","last_change":"2023-11-24T06:16:48.878811+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878811+0000","last_undegraded":"2023-11-24T06:16:48.878811+0000","last_fullsized":"2023-11-24T06:16:48.878811+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.872075+0000","last_change":"2023-11-24T06:16:47.863936+0000","last_active":"2023-11-24T06:16:48.872075+0000","last_peered":"2023-11-24T06:16:48.872075+0000","last_clean":"2023-11-24T06:16:48.872075+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.872075+0000","last_undegraded":"2023-11-24T06:16:48.872075+0000","last_fullsized":"2023-11-24T06:16:48.872075+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.881642+0000","last_change":"2023-11-24T06:16:48.881642+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.881642+0000","last_undegraded":"2023-11-24T06:16:48.881642+0000","last_fullsized":"2023-11-24T06:16:48.881642+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:09:36.957387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875847+0000","last_change":"2023-11-24T06:16:47.869191+0000","last_active":"2023-11-24T06:16:47.875847+0000","last_peered":"2023-11-24T06:16:47.875847+0000","last_clean":"2023-11-24T06:16:47.875847+0000","last_became_active":"2023-11-24T06:16:47.868879+0000","last_became_peered":"2023-11-24T06:16:47.868879+0000","last_unstale":"2023-11-24T06:16:47.875847+0000","last_undegraded":"2023-11-24T06:16:47.875847+0000","last_fullsized":"2023-11-24T06:16:47.875847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:55.803447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852539+0000","last_change":"2023-11-24T06:16:47.852539+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852539+0000","last_undegraded":"2023-11-24T06:16:47.852539+0000","last_fullsized":"2023-11-24T06:16:47.852539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867085+0000","last_change":"2023-11-24T06:16:47.858024+0000","last_active":"2023-11-24T06:16:48.867085+0000","last_peered":"2023-11-24T06:16:48.867085+0000","last_clean":"2023-11-24T06:16:48.867085+0000","last_became_active":"2023-11-24T06:16:47.856960+0000","last_became_peered":"2023-11-24T06:16:47.856960+0000","last_unstale":"2023-11-24T06:16:48.867085+0000","last_undegraded":"2023-11-24T06:16:48.867085+0000","last_fullsized":"2023-11-24T06:16:48.867085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:56.432004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.883129+0000","last_change":"2023-11-24T06:16:48.883129+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.883129+0000","last_undegraded":"2023-11-24T06:16:48.883129+0000","last_fullsized":"2023-11-24T06:16:48.883129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:39.715380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.873497+0000","last_change":"2023-11-24T06:16:47.862985+0000","last_active":"2023-11-24T06:16:48.873497+0000","last_peered":"2023-11-24T06:16:48.873497+0000","last_clean":"2023-11-24T06:16:48.873497+0000","last_became_active":"2023-11-24T06:16:47.862698+0000","last_became_peered":"2023-11-24T06:16:47.862698+0000","last_unstale":"2023-11-24T06:16:48.873497+0000","last_undegraded":"2023-11-24T06:16:48.873497+0000","last_fullsized":"2023-11-24T06:16:48.873497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:40.831546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868830+0000","last_change":"2023-11-24T06:16:48.868830+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868830+0000","last_undegraded":"2023-11-24T06:16:48.868830+0000","last_fullsized":"2023-11-24T06:16:48.868830+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:56.808592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.878458+0000","last_change":"2023-11-24T06:16:47.876806+0000","last_active":"2023-11-24T06:16:47.878458+0000","last_peered":"2023-11-24T06:16:47.878458+0000","last_clean":"2023-11-24T06:16:47.878458+0000","last_became_active":"2023-11-24T06:16:47.876538+0000","last_became_peered":"2023-11-24T06:16:47.876538+0000","last_unstale":"2023-11-24T06:16:47.878458+0000","last_undegraded":"2023-11-24T06:16:47.878458+0000","last_fullsized":"2023-11-24T06:16:47.878458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:59.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863834+0000","last_change":"2023-11-24T06:16:47.863834+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863834+0000","last_undegraded":"2023-11-24T06:16:47.863834+0000","last_fullsized":"2023-11-24T06:16:47.863834+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.883404+0000","last_change":"2023-11-24T06:16:47.866036+0000","last_active":"2023-11-24T06:16:48.883404+0000","last_peered":"2023-11-24T06:16:48.883404+0000","last_clean":"2023-11-24T06:16:48.883404+0000","last_became_active":"2023-11-24T06:16:47.865636+0000","last_became_peered":"2023-11-24T06:16:47.865636+0000","last_unstale":"2023-11-24T06:16:48.883404+0000","last_undegraded":"2023-11-24T06:16:48.883404+0000","last_fullsized":"2023-11-24T06:16:48.883404+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.426322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.887175+0000","last_change":"2023-11-24T06:16:48.884882+0000","last_active":"2023-11-24T06:16:48.887175+0000","last_peered":"2023-11-24T06:16:48.887175+0000","last_clean":"2023-11-24T06:16:48.887175+0000","last_became_active":"2023-11-24T06:16:48.884435+0000","last_became_peered":"2023-11-24T06:16:48.884435+0000","last_unstale":"2023-11-24T06:16:48.887175+0000","last_undegraded":"2023-11-24T06:16:48.887175+0000","last_fullsized":"2023-11-24T06:16:48.887175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:56.808592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.878469+0000","last_change":"2023-11-24T06:16:47.876849+0000","last_active":"2023-11-24T06:16:47.878469+0000","last_peered":"2023-11-24T06:16:47.878469+0000","last_clean":"2023-11-24T06:16:47.878469+0000","last_became_active":"2023-11-24T06:16:47.876481+0000","last_became_peered":"2023-11-24T06:16:47.876481+0000","last_unstale":"2023-11-24T06:16:47.878469+0000","last_undegraded":"2023-11-24T06:16:47.878469+0000","last_fullsized":"2023-11-24T06:16:47.878469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:25.375717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.865500+0000","last_change":"2023-11-24T06:16:47.865500+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.865500+0000","last_undegraded":"2023-11-24T06:16:47.865500+0000","last_fullsized":"2023-11-24T06:16:47.865500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.874905+0000","last_change":"2023-11-24T06:16:47.871704+0000","last_active":"2023-11-24T06:16:48.874905+0000","last_peered":"2023-11-24T06:16:48.874905+0000","last_clean":"2023-11-24T06:16:48.874905+0000","last_became_active":"2023-11-24T06:16:47.870074+0000","last_became_peered":"2023-11-24T06:16:47.870074+0000","last_unstale":"2023-11-24T06:16:48.874905+0000","last_undegraded":"2023-11-24T06:16:48.874905+0000","last_fullsized":"2023-11-24T06:16:48.874905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:17.477112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866162+0000","last_change":"2023-11-24T06:16:48.866162+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866162+0000","last_undegraded":"2023-11-24T06:16:48.866162+0000","last_fullsized":"2023-11-24T06:16:48.866162+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:26.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.881918+0000","last_change":"2023-11-24T06:16:47.863197+0000","last_active":"2023-11-24T06:16:48.881918+0000","last_peered":"2023-11-24T06:16:48.881918+0000","last_clean":"2023-11-24T06:16:48.881918+0000","last_became_active":"2023-11-24T06:16:47.862546+0000","last_became_peered":"2023-11-24T06:16:47.862546+0000","last_unstale":"2023-11-24T06:16:48.881918+0000","last_undegraded":"2023-11-24T06:16:48.881918+0000","last_fullsized":"2023-11-24T06:16:48.881918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:57.415614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863994+0000","last_change":"2023-11-24T06:16:47.863994+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863994+0000","last_undegraded":"2023-11-24T06:16:47.863994+0000","last_fullsized":"2023-11-24T06:16:47.863994+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875130+0000","last_change":"2023-11-24T06:16:47.870027+0000","last_active":"2023-11-24T06:16:47.875130+0000","last_peered":"2023-11-24T06:16:47.875130+0000","last_clean":"2023-11-24T06:16:47.875130+0000","last_became_active":"2023-11-24T06:16:47.869101+0000","last_became_peered":"2023-11-24T06:16:47.869101+0000","last_unstale":"2023-11-24T06:16:47.875130+0000","last_undegraded":"2023-11-24T06:16:47.875130+0000","last_fullsized":"2023-11-24T06:16:47.875130+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:40.094063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.872366+0000","last_change":"2023-11-24T06:16:48.872366+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.872366+0000","last_undegraded":"2023-11-24T06:16:48.872366+0000","last_fullsized":"2023-11-24T06:16:48.872366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867406+0000","last_change":"2023-11-24T06:16:47.872547+0000","last_active":"2023-11-24T06:16:48.867406+0000","last_peered":"2023-11-24T06:16:48.867406+0000","last_clean":"2023-11-24T06:16:48.867406+0000","last_became_active":"2023-11-24T06:16:47.872211+0000","last_became_peered":"2023-11-24T06:16:47.872211+0000","last_unstale":"2023-11-24T06:16:48.867406+0000","last_undegraded":"2023-11-24T06:16:48.867406+0000","last_fullsized":"2023-11-24T06:16:48.867406+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:48.204786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.860832+0000","last_change":"2023-11-24T06:16:47.860832+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.860832+0000","last_undegraded":"2023-11-24T06:16:47.860832+0000","last_fullsized":"2023-11-24T06:16:47.860832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876015+0000","last_change":"2023-11-24T06:16:47.874455+0000","last_active":"2023-11-24T06:16:47.876015+0000","last_peered":"2023-11-24T06:16:47.876015+0000","last_clean":"2023-11-24T06:16:47.876015+0000","last_became_active":"2023-11-24T06:16:47.873907+0000","last_became_peered":"2023-11-24T06:16:47.873907+0000","last_unstale":"2023-11-24T06:16:47.876015+0000","last_undegraded":"2023-11-24T06:16:47.876015+0000","last_fullsized":"2023-11-24T06:16:47.876015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:34.104751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.864486+0000","last_change":"2023-11-24T06:16:47.864486+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.864486+0000","last_undegraded":"2023-11-24T06:16:47.864486+0000","last_fullsized":"2023-11-24T06:16:47.864486+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.888073+0000","last_change":"2023-11-24T06:16:47.862458+0000","last_active":"2023-11-24T06:16:48.888073+0000","last_peered":"2023-11-24T06:16:48.888073+0000","last_clean":"2023-11-24T06:16:48.888073+0000","last_became_active":"2023-11-24T06:16:47.862117+0000","last_became_peered":"2023-11-24T06:16:47.862117+0000","last_unstale":"2023-11-24T06:16:48.888073+0000","last_undegraded":"2023-11-24T06:16:48.888073+0000","last_fullsized":"2023-11-24T06:16:48.888073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:16:29.279401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.870396+0000","last_change":"2023-11-24T06:16:48.870396+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.870396+0000","last_undegraded":"2023-11-24T06:16:48.870396+0000","last_fullsized":"2023-11-24T06:16:48.870396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:54.444313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875979+0000","last_change":"2023-11-24T06:16:47.870009+0000","last_active":"2023-11-24T06:16:47.875979+0000","last_peered":"2023-11-24T06:16:47.875979+0000","last_clean":"2023-11-24T06:16:47.875979+0000","last_became_active":"2023-11-24T06:16:47.869406+0000","last_became_peered":"2023-11-24T06:16:47.869406+0000","last_unstale":"2023-11-24T06:16:47.875979+0000","last_undegraded":"2023-11-24T06:16:47.875979+0000","last_fullsized":"2023-11-24T06:16:47.875979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:28.253114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878781+0000","last_change":"2023-11-24T06:16:48.878781+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878781+0000","last_undegraded":"2023-11-24T06:16:48.878781+0000","last_fullsized":"2023-11-24T06:16:48.878781+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.866611+0000","last_change":"2023-11-24T06:16:47.873847+0000","last_active":"2023-11-24T06:16:48.866611+0000","last_peered":"2023-11-24T06:16:48.866611+0000","last_clean":"2023-11-24T06:16:48.866611+0000","last_became_active":"2023-11-24T06:16:47.873471+0000","last_became_peered":"2023-11-24T06:16:47.873471+0000","last_unstale":"2023-11-24T06:16:48.866611+0000","last_undegraded":"2023-11-24T06:16:48.866611+0000","last_fullsized":"2023-11-24T06:16:48.866611+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:20.193807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.864888+0000","last_change":"2023-11-24T06:16:47.864888+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.864888+0000","last_undegraded":"2023-11-24T06:16:47.864888+0000","last_fullsized":"2023-11-24T06:16:47.864888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875891+0000","last_change":"2023-11-24T06:16:47.869212+0000","last_active":"2023-11-24T06:16:47.875891+0000","last_peered":"2023-11-24T06:16:47.875891+0000","last_clean":"2023-11-24T06:16:47.875891+0000","last_became_active":"2023-11-24T06:16:47.868677+0000","last_became_peered":"2023-11-24T06:16:47.868677+0000","last_unstale":"2023-11-24T06:16:47.875891+0000","last_undegraded":"2023-11-24T06:16:47.875891+0000","last_fullsized":"2023-11-24T06:16:47.875891+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868427+0000","last_change":"2023-11-24T06:16:48.868427+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868427+0000","last_undegraded":"2023-11-24T06:16:48.868427+0000","last_fullsized":"2023-11-24T06:16:48.868427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.143846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.883045+0000","last_change":"2023-11-24T06:16:47.859062+0000","last_active":"2023-11-24T06:16:48.883045+0000","last_peered":"2023-11-24T06:16:48.883045+0000","last_clean":"2023-11-24T06:16:48.883045+0000","last_became_active":"2023-11-24T06:16:47.858688+0000","last_became_peered":"2023-11-24T06:16:47.858688+0000","last_unstale":"2023-11-24T06:16:48.883045+0000","last_undegraded":"2023-11-24T06:16:48.883045+0000","last_fullsized":"2023-11-24T06:16:48.883045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:52.914802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.855859+0000","last_change":"2023-11-24T06:16:47.855859+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.855859+0000","last_undegraded":"2023-11-24T06:16:47.855859+0000","last_fullsized":"2023-11-24T06:16:47.855859+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864878+0000","last_change":"2023-11-24T06:16:47.863548+0000","last_active":"2023-11-24T06:16:48.864878+0000","last_peered":"2023-11-24T06:16:48.864878+0000","last_clean":"2023-11-24T06:16:48.864878+0000","last_became_active":"2023-11-24T06:16:47.863229+0000","last_became_peered":"2023-11-24T06:16:47.863229+0000","last_unstale":"2023-11-24T06:16:48.864878+0000","last_undegraded":"2023-11-24T06:16:48.864878+0000","last_fullsized":"2023-11-24T06:16:48.864878+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:00.282582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.856807+0000","last_change":"2023-11-24T06:16:47.856807+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.856807+0000","last_undegraded":"2023-11-24T06:16:47.856807+0000","last_fullsized":"2023-11-24T06:16:47.856807+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867790+0000","last_change":"2023-11-24T06:16:47.864670+0000","last_active":"2023-11-24T06:16:48.867790+0000","last_peered":"2023-11-24T06:16:48.867790+0000","last_clean":"2023-11-24T06:16:48.867790+0000","last_became_active":"2023-11-24T06:16:47.864390+0000","last_became_peered":"2023-11-24T06:16:47.864390+0000","last_unstale":"2023-11-24T06:16:48.867790+0000","last_undegraded":"2023-11-24T06:16:48.867790+0000","last_fullsized":"2023-11-24T06:16:48.867790+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:26:28.591350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.867777+0000","last_change":"2023-11-24T06:16:48.867777+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.867777+0000","last_undegraded":"2023-11-24T06:16:48.867777+0000","last_fullsized":"2023-11-24T06:16:48.867777+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:07.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.866364+0000","last_change":"2023-11-24T06:16:47.863613+0000","last_active":"2023-11-24T06:16:48.866364+0000","last_peered":"2023-11-24T06:16:48.866364+0000","last_clean":"2023-11-24T06:16:48.866364+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.866364+0000","last_undegraded":"2023-11-24T06:16:48.866364+0000","last_fullsized":"2023-11-24T06:16:48.866364+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869296+0000","last_change":"2023-11-24T06:16:48.869296+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869296+0000","last_undegraded":"2023-11-24T06:16:48.869296+0000","last_fullsized":"2023-11-24T06:16:48.869296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:03.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876001+0000","last_change":"2023-11-24T06:16:47.870072+0000","last_active":"2023-11-24T06:16:47.876001+0000","last_peered":"2023-11-24T06:16:47.876001+0000","last_clean":"2023-11-24T06:16:47.876001+0000","last_became_active":"2023-11-24T06:16:47.869378+0000","last_became_peered":"2023-11-24T06:16:47.869378+0000","last_unstale":"2023-11-24T06:16:47.876001+0000","last_undegraded":"2023-11-24T06:16:47.876001+0000","last_fullsized":"2023-11-24T06:16:47.876001+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:57.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.887076+0000","last_change":"2023-11-24T06:16:48.887076+0000","last_active":"2023-11-24T06:16:48.887076+0000","last_peered":"2023-11-24T06:16:48.887076+0000","last_clean":"2023-11-24T06:16:48.887076+0000","last_became_active":"2023-11-24T06:16:48.886197+0000","last_became_peered":"2023-11-24T06:16:48.886197+0000","last_unstale":"2023-11-24T06:16:48.887076+0000","last_undegraded":"2023-11-24T06:16:48.887076+0000","last_fullsized":"2023-11-24T06:16:48.887076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:06.358345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.867040+0000","last_change":"2023-11-24T06:16:47.861764+0000","last_active":"2023-11-24T06:16:47.867040+0000","last_peered":"2023-11-24T06:16:47.867040+0000","last_clean":"2023-11-24T06:16:47.867040+0000","last_became_active":"2023-11-24T06:16:47.861429+0000","last_became_peered":"2023-11-24T06:16:47.861429+0000","last_unstale":"2023-11-24T06:16:47.867040+0000","last_undegraded":"2023-11-24T06:16:47.867040+0000","last_fullsized":"2023-11-24T06:16:47.867040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:29.319849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852446+0000","last_change":"2023-11-24T06:16:47.852446+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852446+0000","last_undegraded":"2023-11-24T06:16:47.852446+0000","last_fullsized":"2023-11-24T06:16:47.852446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.872583+0000","last_change":"2023-11-24T06:16:47.859106+0000","last_active":"2023-11-24T06:16:48.872583+0000","last_peered":"2023-11-24T06:16:48.872583+0000","last_clean":"2023-11-24T06:16:48.872583+0000","last_became_active":"2023-11-24T06:16:47.858851+0000","last_became_peered":"2023-11-24T06:16:47.858851+0000","last_unstale":"2023-11-24T06:16:48.872583+0000","last_undegraded":"2023-11-24T06:16:48.872583+0000","last_fullsized":"2023-11-24T06:16:48.872583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878050+0000","last_change":"2023-11-24T06:16:48.878050+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878050+0000","last_undegraded":"2023-11-24T06:16:48.878050+0000","last_fullsized":"2023-11-24T06:16:48.878050+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864999+0000","last_change":"2023-11-24T06:16:47.867455+0000","last_active":"2023-11-24T06:16:48.864999+0000","last_peered":"2023-11-24T06:16:48.864999+0000","last_clean":"2023-11-24T06:16:48.864999+0000","last_became_active":"2023-11-24T06:16:47.867160+0000","last_became_peered":"2023-11-24T06:16:47.867160+0000","last_unstale":"2023-11-24T06:16:48.864999+0000","last_undegraded":"2023-11-24T06:16:48.864999+0000","last_fullsized":"2023-11-24T06:16:48.864999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:48.066853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863041+0000","last_change":"2023-11-24T06:16:47.863041+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863041+0000","last_undegraded":"2023-11-24T06:16:47.863041+0000","last_fullsized":"2023-11-24T06:16:47.863041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.870718+0000","last_change":"2023-11-24T06:16:47.869254+0000","last_active":"2023-11-24T06:16:48.870718+0000","last_peered":"2023-11-24T06:16:48.870718+0000","last_clean":"2023-11-24T06:16:48.870718+0000","last_became_active":"2023-11-24T06:16:47.868976+0000","last_became_peered":"2023-11-24T06:16:47.868976+0000","last_unstale":"2023-11-24T06:16:48.870718+0000","last_undegraded":"2023-11-24T06:16:48.870718+0000","last_fullsized":"2023-11-24T06:16:48.870718+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.889009+0000","last_change":"2023-11-24T06:16:48.889009+0000","last_active":"2023-11-24T06:16:48.889009+0000","last_peered":"2023-11-24T06:16:48.889009+0000","last_clean":"2023-11-24T06:16:48.889009+0000","last_became_active":"2023-11-24T06:16:48.888731+0000","last_became_peered":"2023-11-24T06:16:48.888731+0000","last_unstale":"2023-11-24T06:16:48.889009+0000","last_undegraded":"2023-11-24T06:16:48.889009+0000","last_fullsized":"2023-11-24T06:16:48.889009+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:53.231928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864877+0000","last_change":"2023-11-24T06:16:47.869741+0000","last_active":"2023-11-24T06:16:48.864877+0000","last_peered":"2023-11-24T06:16:48.864877+0000","last_clean":"2023-11-24T06:16:48.864877+0000","last_became_active":"2023-11-24T06:16:47.869465+0000","last_became_peered":"2023-11-24T06:16:47.869465+0000","last_unstale":"2023-11-24T06:16:48.864877+0000","last_undegraded":"2023-11-24T06:16:48.864877+0000","last_fullsized":"2023-11-24T06:16:48.864877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:06.921054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":4,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.887384+0000","last_change":"2023-11-24T06:16:48.876908+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.887384+0000","last_undegraded":"2023-11-24T06:16:48.887384+0000","last_fullsized":"2023-11-24T06:16:48.887384+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.886988+0000","last_change":"2023-11-24T06:16:47.871713+0000","last_active":"2023-11-24T06:16:48.886988+0000","last_peered":"2023-11-24T06:16:48.886988+0000","last_clean":"2023-11-24T06:16:48.886988+0000","last_became_active":"2023-11-24T06:16:47.870883+0000","last_became_peered":"2023-11-24T06:16:47.870883+0000","last_unstale":"2023-11-24T06:16:48.886988+0000","last_undegraded":"2023-11-24T06:16:48.886988+0000","last_fullsized":"2023-11-24T06:16:48.886988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:19:32.348025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.876562+0000","last_change":"2023-11-24T06:16:48.876562+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.876562+0000","last_undegraded":"2023-11-24T06:16:48.876562+0000","last_fullsized":"2023-11-24T06:16:48.876562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.872126+0000","last_change":"2023-11-24T06:16:47.868677+0000","last_active":"2023-11-24T06:16:47.872126+0000","last_peered":"2023-11-24T06:16:47.872126+0000","last_clean":"2023-11-24T06:16:47.872126+0000","last_became_active":"2023-11-24T06:16:47.868343+0000","last_became_peered":"2023-11-24T06:16:47.868343+0000","last_unstale":"2023-11-24T06:16:47.872126+0000","last_undegraded":"2023-11-24T06:16:47.872126+0000","last_fullsized":"2023-11-24T06:16:47.872126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:23.063822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-24T06:16:46.845772+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:16:46.845772+0000","last_peered":"2023-11-24T06:16:46.845772+0000","last_clean":"2023-11-24T06:16:46.845772+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:16:46.845772+0000","last_undegraded":"2023-11-24T06:16:46.845772+0000","last_fullsized":"2023-11-24T06:16:46.845772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1204224,"data_stored":848913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.012,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.24}]},{"osd":1,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.536,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.171},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2430000000000001},"min":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.6220000000000001,"5min":2.004,"15min":2.004},"last":1.014}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.198},"min":{"1min":0.79700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.288},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1579999999999999,"15min":1.153},"min":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.637,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.107}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.234,"15min":1.23},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8069999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.337,"15min":1.339},"min":{"1min":0.95999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.71,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.472}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.351,"15min":1.347},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.454,"5min":1.4590000000000001,"15min":1.46},"min":{"1min":1.139,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.873,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.7050000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4430000000000001,"15min":1.4390000000000001},"min":{"1min":0.89800000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.704,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.4790000000000001,"15min":1.4850000000000001},"min":{"1min":1.0980000000000001,"5min":1.022,"15min":1.022},"max":{"1min":1.8300000000000001,"5min":1.944,"15min":1.944},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5429999999999999,"15min":1.55},"min":{"1min":1.042,"5min":0.623,"15min":0.623},"max":{"1min":1.7589999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.379},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.476,"15min":1.48},"min":{"1min":0.95699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6859999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.7949999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.72699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.52,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.0269999999999999,"15min":1.016},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.135}]},{"osd":1,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5660000000000001,"5min":1.615,"15min":1.615},"last":1.012},{"interface":"front","average":{"1min":1.145,"5min":1.181,"15min":1.1870000000000001},"min":{"1min":0.76100000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6419999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.2370000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.323,"15min":1.325},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9339999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.351,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.645,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.367}]},{"osd":3,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.359,"15min":1.3779999999999999},"min":{"1min":0.90300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0350000000000001,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.296,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9119999999999999,"5min":2.056,"15min":2.056},"last":1.302}]},{"osd":4,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4470000000000001,"15min":1.456},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8029999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.506,"5min":1.5389999999999999,"15min":1.5449999999999999},"min":{"1min":0.80500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0219999999999998,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.5780000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.4650000000000001},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.825,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.635,"15min":1.641},"min":{"1min":0.71399999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0649999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.518}]},{"osd":7,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.5509999999999999,"15min":1.5389999999999999},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9079999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.665},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.498,"15min":1.484},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.024,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.8200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0449999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.464,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5429999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.5429999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1579999999999999,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.619,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.292,"15min":1.3069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.542,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.3029999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2629999999999999,"15min":1.2709999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.444},"min":{"1min":0.98199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0720000000000001,"5min":2.198,"15min":2.198},"last":1.4099999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6359999999999999,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.028},{"interface":"front","average":{"1min":1.407,"5min":1.4450000000000001,"15min":1.4510000000000001},"min":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.9470000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6659999999999999,"5min":2.427,"15min":2.427},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4670000000000001,"15min":1.4830000000000001},"min":{"1min":0.83299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8680000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.5780000000000001,"15min":1.5940000000000001},"min":{"1min":1.1000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8029999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.587,"15min":1.6200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8069999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.6739999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.651,"15min":1.663},"min":{"1min":1.042,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0230000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.706,"15min":1.712},"min":{"1min":1.234,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1789999999999998,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.6180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0129999999999999,"15min":0.997},"min":{"1min":0.69699999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.073,"15min":1.069},"min":{"1min":0.77800000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.115}]},{"osd":1,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.083,"15min":1.0780000000000001},"min":{"1min":0.73399999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.88900000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.71,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.383}]},{"osd":2,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.216,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.766,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.87},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.232,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5820000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.339},"min":{"1min":0.95099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.643,"5min":2.089,"15min":2.089},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3360000000000001,"15min":1.337},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.873,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.167}]},{"osd":5,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3899999999999999,"15min":1.4019999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.234}]},{"osd":6,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.6100000000000001,"15min":1.6240000000000001},"min":{"1min":1.1819999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2730000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.5840000000000001,"15min":1.595},"min":{"1min":1.0920000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.1789999999999998,"5min":2.222,"15min":2.222},"last":1.339}]},{"osd":7,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.5069999999999999,"15min":1.524},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.3},{"interface":"front","average":{"1min":1.595,"5min":1.7030000000000001,"15min":1.7210000000000001},"min":{"1min":1.2729999999999999,"5min":1.157,"15min":1.157},"max":{"1min":2.0190000000000001,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.591}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.363,"5min":1.71,"15min":1.71},"last":1.268},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.2010000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":0.98099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.242,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.97399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8859999999999999,"5min":1.998,"15min":1.998},"last":1.556}]},{"osd":2,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.673,"5min":1.802,"15min":1.802},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1000000000000001,"15min":1.095},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.667,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.706}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":9.7599999999999998,"15min":11.188000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.833,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.4139999999999999,"15min":1.448},"min":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.714,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.095}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.4450000000000001,"15min":1.4770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9370000000000001,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.399,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9159999999999999,"5min":4.274,"15min":4.274},"last":1.9410000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.7669999999999999,"15min":1.825},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.1190000000000002,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":2.0190000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.399,"15min":1.4219999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0369999999999999,"5min":3.157,"15min":3.157},"last":1.623}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5389999999999999,"15min":1.5680000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1709999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1829999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.6850000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2190000000000001,"5min":1.304,"15min":1.304},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.3109999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0589999999999999,"15min":1.0680000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6879999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.357,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.131,"15min":1.137},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6950000000000001,"5min":2.355,"15min":2.355},"last":1.278},{"interface":"front","average":{"1min":1.159,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.24}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3,"15min":1.294},"min":{"1min":0.85499999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.875,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.157},{"interface":"front","average":{"1min":1.468,"5min":1.4490000000000001,"15min":1.446},"min":{"1min":0.95499999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0979999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4990000000000001,"15min":1.502},"min":{"1min":0.95899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.347},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3979999999999999,"15min":1.3999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7869999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.038}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5349999999999999,"15min":1.5389999999999999},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.4119999999999999,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.591,"15min":1.589},"min":{"1min":0.92100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.518}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.544,"15min":1.5509999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0070000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.577,"15min":1.5840000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.266,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.798}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1830000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1,"5min":1.002,"15min":1.002},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.879,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.1439999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.999,"15min":1.0089999999999999},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.6000000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.2450000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.712,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.907,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.712,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.3200000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.365,"15min":1.393},"min":{"1min":0.84599999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.609,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.607},{"interface":"front","average":{"1min":1.337,"5min":1.5209999999999999,"15min":1.552},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7769999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.3660000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.621,"15min":1.661},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8360000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.554},{"interface":"front","average":{"1min":1.341,"5min":1.6799999999999999,"15min":1.736},"min":{"1min":0.91200000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5860000000000001,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.397}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5760000000000001,"15min":1.5960000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.246,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.8320000000000001,"15min":1.8879999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1619999999999999,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.6459999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5960000000000001,"15min":1.6080000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.004,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.7},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.611,"15min":1.639},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.8240000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.522}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":848913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.97399999999999998,"15min":0.96999999999999997},"min":{"1min":0.53800000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6919999999999999,"5min":2.452,"15min":2.452},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.056,"15min":1.0740000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3360000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.88100000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2529999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6950000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.113,"15min":1.131},"min":{"1min":0.498,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":3.411,"15min":3.411},"last":1.2290000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.645,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.419},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.258,"15min":1.264},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.579,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.0669999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.446,"15min":1.452},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7949999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.575,"15min":1.605},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9379999999999999,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.6599999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.532,"15min":1.5469999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0150000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5469999999999999,"15min":1.5680000000000001},"min":{"1min":0.876,"5min":0.875,"15min":0.875},"max":{"1min":2.0019999999999998,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.4790000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.9039999999999999,"15min":1.9870000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0510000000000002,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.7989999999999999,"15min":1.847},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9470000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.393}]},{"osd":7,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.95599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0379999999999998,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.708},{"interface":"front","average":{"1min":1.536,"5min":1.841,"15min":1.8919999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0609999999999999,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.5289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:53.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:53.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.642+0000 7f94de9a0640 1 Processor -- start 2023-11-24T06:16:53.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.643+0000 7f94de9a0640 1 -- start start 2023-11-24T06:16:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.644+0000 7f94de9a0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94d80d1bf0 0x7f94d80b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.644+0000 7f94de9a0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80cdd70 con 0x7f94d80d17b0 2023-11-24T06:16:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.644+0000 7f94de9a0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80cdff0 con 0x7f94d815d710 2023-11-24T06:16:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.644+0000 7f94de9a0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80ce2d0 con 0x7f94d80d1bf0 2023-11-24T06:16:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94de19f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94d80d1bf0 0x7f94d80b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94de19f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94d80d1bf0 0x7f94d80b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43634/0 (socket says 172.21.15.37:43634) 2023-11-24T06:16:53.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94de19f640 1 -- 172.21.15.37:0/2807972132 learned_addr learned my addr 172.21.15.37:0/2807972132 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:53.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94dd19d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f94d80d17b0 0x7f94d80afe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43198/0 (socket says 172.21.15.37:43198) 2023-11-24T06:16:53.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94de19f640 1 -- 172.21.15.37:0/2807972132 >> v1:172.21.15.188:6789/0 conn(0x7f94d815d710 legacy=0x7f94d80d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:53.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94de19f640 1 -- 172.21.15.37:0/2807972132 >> v1:172.21.15.37:6789/0 conn(0x7f94d80d17b0 legacy=0x7f94d80afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94de19f640 1 -- 172.21.15.37:0/2807972132 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80ce5b0 con 0x7f94d80d1bf0 2023-11-24T06:16:53.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.645+0000 7f94dc99c640 1 -- 172.21.15.37:0/2807972132 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806377847 0 0) 0x7f94d80cdd70 con 0x7f94d80d17b0 2023-11-24T06:16:53.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.647+0000 7f94de19f640 1 --2- 172.21.15.37:0/2807972132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d80d1bf0 0x7f94d80b0510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009e50 tx=0x7f94d002c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb92436010de0c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:53.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.647+0000 7f94dc99c640 1 -- 172.21.15.37:0/2807972132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d002cc30 con 0x7f94d80d1bf0 2023-11-24T06:16:53.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.647+0000 7f94dc99c640 1 -- 172.21.15.37:0/2807972132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d002cd90 con 0x7f94d80d1bf0 2023-11-24T06:16:53.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.647+0000 7f94dc99c640 1 -- 172.21.15.37:0/2807972132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0034610 con 0x7f94d80d1bf0 2023-11-24T06:16:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.647+0000 7f94de9a0640 1 -- 172.21.15.37:0/2807972132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d80d1bf0 msgr2=0x7f94d80b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.647+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2807972132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d80d1bf0 0x7f94d80b0510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009e50 tx=0x7f94d002c090 comp rx=0 tx=0).stop 2023-11-24T06:16:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.647+0000 7f94de9a0640 1 -- 172.21.15.37:0/2807972132 shutdown_connections 2023-11-24T06:16:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.648+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2807972132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d80d1bf0 0x7f94d80b0510 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.648+0000 7f94de9a0640 1 -- 172.21.15.37:0/2807972132 >> 172.21.15.37:0/2807972132 conn(0x7f94d809c510 msgr2=0x7f94d80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.648+0000 7f94de9a0640 1 -- 172.21.15.37:0/2807972132 shutdown_connections 2023-11-24T06:16:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.648+0000 7f94de9a0640 1 -- 172.21.15.37:0/2807972132 wait complete. 2023-11-24T06:16:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.649+0000 7f94de9a0640 1 Processor -- start 2023-11-24T06:16:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.650+0000 7f94de9a0640 1 -- start start 2023-11-24T06:16:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.650+0000 7f94de9a0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94d80d17b0 0x7f94d80b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de9a0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94d80d1bf0 0x7f94d815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de9a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d815d710 0x7f94d806c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de9a0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d81f4010 con 0x7f94d815d710 2023-11-24T06:16:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de9a0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d81f3d30 con 0x7f94d80d17b0 2023-11-24T06:16:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de9a0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80b5ed0 con 0x7f94d80d1bf0 2023-11-24T06:16:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d815d710 0x7f94d806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d815d710 0x7f94d806c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43636/0 (socket says 172.21.15.37:43636) 2023-11-24T06:16:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 -- 172.21.15.37:0/2583156171 learned_addr learned my addr 172.21.15.37:0/2583156171 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94dd19d640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94d80d1bf0 0x7f94d815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94dd99e640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94d80d17b0 0x7f94d80b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 -- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94d80d1bf0 msgr2=0x7f94d815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94d80d1bf0 0x7f94d815f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 -- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94d80d17b0 msgr2=0x7f94d80b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94d80d17b0 0x7f94d80b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.651+0000 7f94de19f640 1 -- 172.21.15.37:0/2583156171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0009b30 con 0x7f94d815d710 2023-11-24T06:16:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.652+0000 7f94de19f640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d815d710 0x7f94d806c310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009e50 tx=0x7f94d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.652+0000 7f94ce7fc640 1 -- 172.21.15.37:0/2583156171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0009510 con 0x7f94d815d710 2023-11-24T06:16:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.652+0000 7f94ce7fc640 1 -- 172.21.15.37:0/2583156171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d003e450 con 0x7f94d815d710 2023-11-24T06:16:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.652+0000 7f94ce7fc640 1 -- 172.21.15.37:0/2583156171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d003e800 con 0x7f94d815d710 2023-11-24T06:16:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.652+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80b61b0 con 0x7f94d815d710 2023-11-24T06:16:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.652+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d815f7a0 con 0x7f94d815d710 2023-11-24T06:16:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.653+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d80b66d0 con 0x7f94d815d710 2023-11-24T06:16:53.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.654+0000 7f94ce7fc640 1 -- 172.21.15.37:0/2583156171 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94d003e960 con 0x7f94d815d710 2023-11-24T06:16:53.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.655+0000 7f94ce7fc640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f94bc06ae40 0x7f94bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.655+0000 7f94ce7fc640 1 -- 172.21.15.37:0/2583156171 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d00ac4a0 con 0x7f94d815d710 2023-11-24T06:16:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.655+0000 7f94dd99e640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f94bc06ae40 0x7f94bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.656+0000 7f94dd99e640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f94bc06ae40 0x7f94bc06d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f94d80b1ab0 tx=0x7f94d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:53.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.659+0000 7f94ce7fc640 1 -- 172.21.15.37:0/2583156171 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94d80b66d0 con 0x7f94d815d710 2023-11-24T06:16:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.846+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94d80d2080 con 0x7f94bc06ae40 2023-11-24T06:16:53.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.855+0000 7f94ce7fc640 1 -- 172.21.15.37:0/2583156171 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283645 (secure 0 0 0) 0x7f94d4005080 con 0x7f94bc06ae40 2023-11-24T06:16:53.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:16:53.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f94bc06ae40 msgr2=0x7f94bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f94bc06ae40 0x7f94bc06d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f94d80b1ab0 tx=0x7f94d4009040 comp rx=0 tx=0).stop 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d815d710 msgr2=0x7f94d806c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d815d710 0x7f94d806c310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009e50 tx=0x7f94d0004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 shutdown_connections 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f94bc06ae40 0x7f94bc06d300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94d815d710 0x7f94d806c310 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94d80d1bf0 0x7f94d815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 --2- 172.21.15.37:0/2583156171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94d80d17b0 0x7f94d80b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 >> 172.21.15.37:0/2583156171 conn(0x7f94d809c510 msgr2=0x7f94d80b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 shutdown_connections 2023-11-24T06:16:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:53.861+0000 7f94de9a0640 1 -- 172.21.15.37:0/2583156171 wait complete. 2023-11-24T06:16:53.883 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-11-24T06:16:52.852248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230432,"kb_used_data":5928,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744288,"statfs":{"total":773094113280,"available":772858150912,"internally_reserved":0,"allocated":6070272,"data_stored":3249096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002017"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.888238+0000","last_change":"2023-11-24T06:16:48.888238+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.888238+0000","last_undegraded":"2023-11-24T06:16:48.888238+0000","last_fullsized":"2023-11-24T06:16:48.888238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:54.224214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882218+0000","last_change":"2023-11-24T06:16:48.882218+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882218+0000","last_undegraded":"2023-11-24T06:16:48.882218+0000","last_fullsized":"2023-11-24T06:16:48.882218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:20:49.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.866046+0000","last_change":"2023-11-24T06:16:47.866046+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.866046+0000","last_undegraded":"2023-11-24T06:16:47.866046+0000","last_fullsized":"2023-11-24T06:16:47.866046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866210+0000","last_change":"2023-11-24T06:16:48.866210+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866210+0000","last_undegraded":"2023-11-24T06:16:48.866210+0000","last_fullsized":"2023-11-24T06:16:48.866210+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:39:38.395169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.881698+0000","last_change":"2023-11-24T06:16:48.881698+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.881698+0000","last_undegraded":"2023-11-24T06:16:48.881698+0000","last_fullsized":"2023-11-24T06:16:48.881698+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:53.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852166+0000","last_change":"2023-11-24T06:16:47.852166+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852166+0000","last_undegraded":"2023-11-24T06:16:47.852166+0000","last_fullsized":"2023-11-24T06:16:47.852166+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869228+0000","last_change":"2023-11-24T06:16:48.869228+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869228+0000","last_undegraded":"2023-11-24T06:16:48.869228+0000","last_fullsized":"2023-11-24T06:16:48.869228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:06.358345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.877814+0000","last_change":"2023-11-24T06:16:48.877814+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.877814+0000","last_undegraded":"2023-11-24T06:16:48.877814+0000","last_fullsized":"2023-11-24T06:16:48.877814+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869253+0000","last_change":"2023-11-24T06:16:48.869253+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869253+0000","last_undegraded":"2023-11-24T06:16:48.869253+0000","last_fullsized":"2023-11-24T06:16:48.869253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.888135+0000","last_change":"2023-11-24T06:16:48.888135+0000","last_active":"2023-11-24T06:16:48.888135+0000","last_peered":"2023-11-24T06:16:48.888135+0000","last_clean":"2023-11-24T06:16:48.888135+0000","last_became_active":"2023-11-24T06:16:48.887851+0000","last_became_peered":"2023-11-24T06:16:48.887851+0000","last_unstale":"2023-11-24T06:16:48.888135+0000","last_undegraded":"2023-11-24T06:16:48.888135+0000","last_fullsized":"2023-11-24T06:16:48.888135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:29.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.865859+0000","last_change":"2023-11-24T06:16:48.865859+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.865859+0000","last_undegraded":"2023-11-24T06:16:48.865859+0000","last_fullsized":"2023-11-24T06:16:48.865859+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866143+0000","last_change":"2023-11-24T06:16:48.866143+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866143+0000","last_undegraded":"2023-11-24T06:16:48.866143+0000","last_fullsized":"2023-11-24T06:16:48.866143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.854247+0000","last_change":"2023-11-24T06:16:47.854247+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.854247+0000","last_undegraded":"2023-11-24T06:16:47.854247+0000","last_fullsized":"2023-11-24T06:16:47.854247+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.870028+0000","last_change":"2023-11-24T06:16:48.870028+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.870028+0000","last_undegraded":"2023-11-24T06:16:48.870028+0000","last_fullsized":"2023-11-24T06:16:48.870028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:29.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868735+0000","last_change":"2023-11-24T06:16:48.868735+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868735+0000","last_undegraded":"2023-11-24T06:16:48.868735+0000","last_fullsized":"2023-11-24T06:16:48.868735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:53.231928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852897+0000","last_change":"2023-11-24T06:16:47.852897+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852897+0000","last_undegraded":"2023-11-24T06:16:47.852897+0000","last_fullsized":"2023-11-24T06:16:47.852897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.887667+0000","last_change":"2023-11-24T06:16:48.887667+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.887667+0000","last_undegraded":"2023-11-24T06:16:48.887667+0000","last_fullsized":"2023-11-24T06:16:48.887667+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:28:32.474805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.866187+0000","last_change":"2023-11-24T06:16:47.866187+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.866187+0000","last_undegraded":"2023-11-24T06:16:47.866187+0000","last_fullsized":"2023-11-24T06:16:47.866187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.890640+0000","last_change":"2023-11-24T06:16:48.890640+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.890640+0000","last_undegraded":"2023-11-24T06:16:48.890640+0000","last_fullsized":"2023-11-24T06:16:48.890640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:31:56.753495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.880622+0000","last_change":"2023-11-24T06:16:48.880622+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.880622+0000","last_undegraded":"2023-11-24T06:16:48.880622+0000","last_fullsized":"2023-11-24T06:16:48.880622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:32.077444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.865010+0000","last_change":"2023-11-24T06:16:47.865010+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.865010+0000","last_undegraded":"2023-11-24T06:16:47.865010+0000","last_fullsized":"2023-11-24T06:16:47.865010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.879338+0000","last_change":"2023-11-24T06:16:48.879338+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.879338+0000","last_undegraded":"2023-11-24T06:16:48.879338+0000","last_fullsized":"2023-11-24T06:16:48.879338+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.861382+0000","last_change":"2023-11-24T06:16:47.861382+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.861382+0000","last_undegraded":"2023-11-24T06:16:47.861382+0000","last_fullsized":"2023-11-24T06:16:47.861382+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.853738+0000","last_change":"2023-11-24T06:16:47.853738+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.853738+0000","last_undegraded":"2023-11-24T06:16:47.853738+0000","last_fullsized":"2023-11-24T06:16:47.853738+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.884018+0000","last_change":"2023-11-24T06:16:48.884018+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.884018+0000","last_undegraded":"2023-11-24T06:16:48.884018+0000","last_fullsized":"2023-11-24T06:16:48.884018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:27:51.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.873446+0000","last_change":"2023-11-24T06:16:48.873446+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.873446+0000","last_undegraded":"2023-11-24T06:16:48.873446+0000","last_fullsized":"2023-11-24T06:16:48.873446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:42.334420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863359+0000","last_change":"2023-11-24T06:16:47.863359+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863359+0000","last_undegraded":"2023-11-24T06:16:47.863359+0000","last_fullsized":"2023-11-24T06:16:47.863359+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882110+0000","last_change":"2023-11-24T06:16:48.882110+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882110+0000","last_undegraded":"2023-11-24T06:16:48.882110+0000","last_fullsized":"2023-11-24T06:16:48.882110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:20.275650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882757+0000","last_change":"2023-11-24T06:16:48.882757+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882757+0000","last_undegraded":"2023-11-24T06:16:48.882757+0000","last_fullsized":"2023-11-24T06:16:48.882757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:20.197865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863533+0000","last_change":"2023-11-24T06:16:47.863533+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863533+0000","last_undegraded":"2023-11-24T06:16:47.863533+0000","last_fullsized":"2023-11-24T06:16:47.863533+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878935+0000","last_change":"2023-11-24T06:16:48.878935+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878935+0000","last_undegraded":"2023-11-24T06:16:48.878935+0000","last_fullsized":"2023-11-24T06:16:48.878935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:05.112330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852241+0000","last_change":"2023-11-24T06:16:47.852241+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852241+0000","last_undegraded":"2023-11-24T06:16:47.852241+0000","last_fullsized":"2023-11-24T06:16:47.852241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.855447+0000","last_change":"2023-11-24T06:16:47.855447+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.855447+0000","last_undegraded":"2023-11-24T06:16:47.855447+0000","last_fullsized":"2023-11-24T06:16:47.855447+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876100+0000","last_change":"2023-11-24T06:16:47.870996+0000","last_active":"2023-11-24T06:16:47.876100+0000","last_peered":"2023-11-24T06:16:47.876100+0000","last_clean":"2023-11-24T06:16:47.876100+0000","last_became_active":"2023-11-24T06:16:47.870728+0000","last_became_peered":"2023-11-24T06:16:47.870728+0000","last_unstale":"2023-11-24T06:16:47.876100+0000","last_undegraded":"2023-11-24T06:16:47.876100+0000","last_fullsized":"2023-11-24T06:16:47.876100+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866318+0000","last_change":"2023-11-24T06:16:48.866318+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866318+0000","last_undegraded":"2023-11-24T06:16:48.866318+0000","last_fullsized":"2023-11-24T06:16:48.866318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:09.576866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.882499+0000","last_change":"2023-11-24T06:16:47.873548+0000","last_active":"2023-11-24T06:16:48.882499+0000","last_peered":"2023-11-24T06:16:48.882499+0000","last_clean":"2023-11-24T06:16:48.882499+0000","last_became_active":"2023-11-24T06:16:47.873228+0000","last_became_peered":"2023-11-24T06:16:47.873228+0000","last_unstale":"2023-11-24T06:16:48.882499+0000","last_undegraded":"2023-11-24T06:16:48.882499+0000","last_fullsized":"2023-11-24T06:16:48.882499+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:26.312030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.859889+0000","last_change":"2023-11-24T06:16:47.859889+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.859889+0000","last_undegraded":"2023-11-24T06:16:47.859889+0000","last_fullsized":"2023-11-24T06:16:47.859889+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875830+0000","last_change":"2023-11-24T06:16:47.869007+0000","last_active":"2023-11-24T06:16:47.875830+0000","last_peered":"2023-11-24T06:16:47.875830+0000","last_clean":"2023-11-24T06:16:47.875830+0000","last_became_active":"2023-11-24T06:16:47.868662+0000","last_became_peered":"2023-11-24T06:16:47.868662+0000","last_unstale":"2023-11-24T06:16:47.875830+0000","last_undegraded":"2023-11-24T06:16:47.875830+0000","last_fullsized":"2023-11-24T06:16:47.875830+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:05.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.861396+0000","last_change":"2023-11-24T06:16:47.861396+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.861396+0000","last_undegraded":"2023-11-24T06:16:47.861396+0000","last_fullsized":"2023-11-24T06:16:47.861396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.873856+0000","last_change":"2023-11-24T06:16:47.871257+0000","last_active":"2023-11-24T06:16:48.873856+0000","last_peered":"2023-11-24T06:16:48.873856+0000","last_clean":"2023-11-24T06:16:48.873856+0000","last_became_active":"2023-11-24T06:16:47.870777+0000","last_became_peered":"2023-11-24T06:16:47.870777+0000","last_unstale":"2023-11-24T06:16:48.873856+0000","last_undegraded":"2023-11-24T06:16:48.873856+0000","last_fullsized":"2023-11-24T06:16:48.873856+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:54.500222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878811+0000","last_change":"2023-11-24T06:16:48.878811+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878811+0000","last_undegraded":"2023-11-24T06:16:48.878811+0000","last_fullsized":"2023-11-24T06:16:48.878811+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.872075+0000","last_change":"2023-11-24T06:16:47.863936+0000","last_active":"2023-11-24T06:16:48.872075+0000","last_peered":"2023-11-24T06:16:48.872075+0000","last_clean":"2023-11-24T06:16:48.872075+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.872075+0000","last_undegraded":"2023-11-24T06:16:48.872075+0000","last_fullsized":"2023-11-24T06:16:48.872075+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.881642+0000","last_change":"2023-11-24T06:16:48.881642+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.881642+0000","last_undegraded":"2023-11-24T06:16:48.881642+0000","last_fullsized":"2023-11-24T06:16:48.881642+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:09:36.957387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875847+0000","last_change":"2023-11-24T06:16:47.869191+0000","last_active":"2023-11-24T06:16:47.875847+0000","last_peered":"2023-11-24T06:16:47.875847+0000","last_clean":"2023-11-24T06:16:47.875847+0000","last_became_active":"2023-11-24T06:16:47.868879+0000","last_became_peered":"2023-11-24T06:16:47.868879+0000","last_unstale":"2023-11-24T06:16:47.875847+0000","last_undegraded":"2023-11-24T06:16:47.875847+0000","last_fullsized":"2023-11-24T06:16:47.875847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:55.803447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852539+0000","last_change":"2023-11-24T06:16:47.852539+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852539+0000","last_undegraded":"2023-11-24T06:16:47.852539+0000","last_fullsized":"2023-11-24T06:16:47.852539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867085+0000","last_change":"2023-11-24T06:16:47.858024+0000","last_active":"2023-11-24T06:16:48.867085+0000","last_peered":"2023-11-24T06:16:48.867085+0000","last_clean":"2023-11-24T06:16:48.867085+0000","last_became_active":"2023-11-24T06:16:47.856960+0000","last_became_peered":"2023-11-24T06:16:47.856960+0000","last_unstale":"2023-11-24T06:16:48.867085+0000","last_undegraded":"2023-11-24T06:16:48.867085+0000","last_fullsized":"2023-11-24T06:16:48.867085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:56.432004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.883129+0000","last_change":"2023-11-24T06:16:48.883129+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.883129+0000","last_undegraded":"2023-11-24T06:16:48.883129+0000","last_fullsized":"2023-11-24T06:16:48.883129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:39.715380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.873497+0000","last_change":"2023-11-24T06:16:47.862985+0000","last_active":"2023-11-24T06:16:48.873497+0000","last_peered":"2023-11-24T06:16:48.873497+0000","last_clean":"2023-11-24T06:16:48.873497+0000","last_became_active":"2023-11-24T06:16:47.862698+0000","last_became_peered":"2023-11-24T06:16:47.862698+0000","last_unstale":"2023-11-24T06:16:48.873497+0000","last_undegraded":"2023-11-24T06:16:48.873497+0000","last_fullsized":"2023-11-24T06:16:48.873497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:40.831546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868830+0000","last_change":"2023-11-24T06:16:48.868830+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868830+0000","last_undegraded":"2023-11-24T06:16:48.868830+0000","last_fullsized":"2023-11-24T06:16:48.868830+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:56.808592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.878458+0000","last_change":"2023-11-24T06:16:47.876806+0000","last_active":"2023-11-24T06:16:47.878458+0000","last_peered":"2023-11-24T06:16:47.878458+0000","last_clean":"2023-11-24T06:16:47.878458+0000","last_became_active":"2023-11-24T06:16:47.876538+0000","last_became_peered":"2023-11-24T06:16:47.876538+0000","last_unstale":"2023-11-24T06:16:47.878458+0000","last_undegraded":"2023-11-24T06:16:47.878458+0000","last_fullsized":"2023-11-24T06:16:47.878458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:59.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863834+0000","last_change":"2023-11-24T06:16:47.863834+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863834+0000","last_undegraded":"2023-11-24T06:16:47.863834+0000","last_fullsized":"2023-11-24T06:16:47.863834+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.883404+0000","last_change":"2023-11-24T06:16:47.866036+0000","last_active":"2023-11-24T06:16:48.883404+0000","last_peered":"2023-11-24T06:16:48.883404+0000","last_clean":"2023-11-24T06:16:48.883404+0000","last_became_active":"2023-11-24T06:16:47.865636+0000","last_became_peered":"2023-11-24T06:16:47.865636+0000","last_unstale":"2023-11-24T06:16:48.883404+0000","last_undegraded":"2023-11-24T06:16:48.883404+0000","last_fullsized":"2023-11-24T06:16:48.883404+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.426322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.887175+0000","last_change":"2023-11-24T06:16:48.884882+0000","last_active":"2023-11-24T06:16:48.887175+0000","last_peered":"2023-11-24T06:16:48.887175+0000","last_clean":"2023-11-24T06:16:48.887175+0000","last_became_active":"2023-11-24T06:16:48.884435+0000","last_became_peered":"2023-11-24T06:16:48.884435+0000","last_unstale":"2023-11-24T06:16:48.887175+0000","last_undegraded":"2023-11-24T06:16:48.887175+0000","last_fullsized":"2023-11-24T06:16:48.887175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:56.808592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.878469+0000","last_change":"2023-11-24T06:16:47.876849+0000","last_active":"2023-11-24T06:16:47.878469+0000","last_peered":"2023-11-24T06:16:47.878469+0000","last_clean":"2023-11-24T06:16:47.878469+0000","last_became_active":"2023-11-24T06:16:47.876481+0000","last_became_peered":"2023-11-24T06:16:47.876481+0000","last_unstale":"2023-11-24T06:16:47.878469+0000","last_undegraded":"2023-11-24T06:16:47.878469+0000","last_fullsized":"2023-11-24T06:16:47.878469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:25.375717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.865500+0000","last_change":"2023-11-24T06:16:47.865500+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.865500+0000","last_undegraded":"2023-11-24T06:16:47.865500+0000","last_fullsized":"2023-11-24T06:16:47.865500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.874905+0000","last_change":"2023-11-24T06:16:47.871704+0000","last_active":"2023-11-24T06:16:48.874905+0000","last_peered":"2023-11-24T06:16:48.874905+0000","last_clean":"2023-11-24T06:16:48.874905+0000","last_became_active":"2023-11-24T06:16:47.870074+0000","last_became_peered":"2023-11-24T06:16:47.870074+0000","last_unstale":"2023-11-24T06:16:48.874905+0000","last_undegraded":"2023-11-24T06:16:48.874905+0000","last_fullsized":"2023-11-24T06:16:48.874905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:17.477112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866162+0000","last_change":"2023-11-24T06:16:48.866162+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866162+0000","last_undegraded":"2023-11-24T06:16:48.866162+0000","last_fullsized":"2023-11-24T06:16:48.866162+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:26.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.881918+0000","last_change":"2023-11-24T06:16:47.863197+0000","last_active":"2023-11-24T06:16:48.881918+0000","last_peered":"2023-11-24T06:16:48.881918+0000","last_clean":"2023-11-24T06:16:48.881918+0000","last_became_active":"2023-11-24T06:16:47.862546+0000","last_became_peered":"2023-11-24T06:16:47.862546+0000","last_unstale":"2023-11-24T06:16:48.881918+0000","last_undegraded":"2023-11-24T06:16:48.881918+0000","last_fullsized":"2023-11-24T06:16:48.881918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:57.415614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863994+0000","last_change":"2023-11-24T06:16:47.863994+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863994+0000","last_undegraded":"2023-11-24T06:16:47.863994+0000","last_fullsized":"2023-11-24T06:16:47.863994+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875130+0000","last_change":"2023-11-24T06:16:47.870027+0000","last_active":"2023-11-24T06:16:47.875130+0000","last_peered":"2023-11-24T06:16:47.875130+0000","last_clean":"2023-11-24T06:16:47.875130+0000","last_became_active":"2023-11-24T06:16:47.869101+0000","last_became_peered":"2023-11-24T06:16:47.869101+0000","last_unstale":"2023-11-24T06:16:47.875130+0000","last_undegraded":"2023-11-24T06:16:47.875130+0000","last_fullsized":"2023-11-24T06:16:47.875130+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:40.094063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.872366+0000","last_change":"2023-11-24T06:16:48.872366+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.872366+0000","last_undegraded":"2023-11-24T06:16:48.872366+0000","last_fullsized":"2023-11-24T06:16:48.872366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867406+0000","last_change":"2023-11-24T06:16:47.872547+0000","last_active":"2023-11-24T06:16:48.867406+0000","last_peered":"2023-11-24T06:16:48.867406+0000","last_clean":"2023-11-24T06:16:48.867406+0000","last_became_active":"2023-11-24T06:16:47.872211+0000","last_became_peered":"2023-11-24T06:16:47.872211+0000","last_unstale":"2023-11-24T06:16:48.867406+0000","last_undegraded":"2023-11-24T06:16:48.867406+0000","last_fullsized":"2023-11-24T06:16:48.867406+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:48.204786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.860832+0000","last_change":"2023-11-24T06:16:47.860832+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.860832+0000","last_undegraded":"2023-11-24T06:16:47.860832+0000","last_fullsized":"2023-11-24T06:16:47.860832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876015+0000","last_change":"2023-11-24T06:16:47.874455+0000","last_active":"2023-11-24T06:16:47.876015+0000","last_peered":"2023-11-24T06:16:47.876015+0000","last_clean":"2023-11-24T06:16:47.876015+0000","last_became_active":"2023-11-24T06:16:47.873907+0000","last_became_peered":"2023-11-24T06:16:47.873907+0000","last_unstale":"2023-11-24T06:16:47.876015+0000","last_undegraded":"2023-11-24T06:16:47.876015+0000","last_fullsized":"2023-11-24T06:16:47.876015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:34.104751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.864486+0000","last_change":"2023-11-24T06:16:47.864486+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.864486+0000","last_undegraded":"2023-11-24T06:16:47.864486+0000","last_fullsized":"2023-11-24T06:16:47.864486+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.888073+0000","last_change":"2023-11-24T06:16:47.862458+0000","last_active":"2023-11-24T06:16:48.888073+0000","last_peered":"2023-11-24T06:16:48.888073+0000","last_clean":"2023-11-24T06:16:48.888073+0000","last_became_active":"2023-11-24T06:16:47.862117+0000","last_became_peered":"2023-11-24T06:16:47.862117+0000","last_unstale":"2023-11-24T06:16:48.888073+0000","last_undegraded":"2023-11-24T06:16:48.888073+0000","last_fullsized":"2023-11-24T06:16:48.888073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:16:29.279401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.870396+0000","last_change":"2023-11-24T06:16:48.870396+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.870396+0000","last_undegraded":"2023-11-24T06:16:48.870396+0000","last_fullsized":"2023-11-24T06:16:48.870396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:54.444313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875979+0000","last_change":"2023-11-24T06:16:47.870009+0000","last_active":"2023-11-24T06:16:47.875979+0000","last_peered":"2023-11-24T06:16:47.875979+0000","last_clean":"2023-11-24T06:16:47.875979+0000","last_became_active":"2023-11-24T06:16:47.869406+0000","last_became_peered":"2023-11-24T06:16:47.869406+0000","last_unstale":"2023-11-24T06:16:47.875979+0000","last_undegraded":"2023-11-24T06:16:47.875979+0000","last_fullsized":"2023-11-24T06:16:47.875979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:28.253114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878781+0000","last_change":"2023-11-24T06:16:48.878781+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878781+0000","last_undegraded":"2023-11-24T06:16:48.878781+0000","last_fullsized":"2023-11-24T06:16:48.878781+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.866611+0000","last_change":"2023-11-24T06:16:47.873847+0000","last_active":"2023-11-24T06:16:48.866611+0000","last_peered":"2023-11-24T06:16:48.866611+0000","last_clean":"2023-11-24T06:16:48.866611+0000","last_became_active":"2023-11-24T06:16:47.873471+0000","last_became_peered":"2023-11-24T06:16:47.873471+0000","last_unstale":"2023-11-24T06:16:48.866611+0000","last_undegraded":"2023-11-24T06:16:48.866611+0000","last_fullsized":"2023-11-24T06:16:48.866611+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:20.193807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.864888+0000","last_change":"2023-11-24T06:16:47.864888+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.864888+0000","last_undegraded":"2023-11-24T06:16:47.864888+0000","last_fullsized":"2023-11-24T06:16:47.864888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875891+0000","last_change":"2023-11-24T06:16:47.869212+0000","last_active":"2023-11-24T06:16:47.875891+0000","last_peered":"2023-11-24T06:16:47.875891+0000","last_clean":"2023-11-24T06:16:47.875891+0000","last_became_active":"2023-11-24T06:16:47.868677+0000","last_became_peered":"2023-11-24T06:16:47.868677+0000","last_unstale":"2023-11-24T06:16:47.875891+0000","last_undegraded":"2023-11-24T06:16:47.875891+0000","last_fullsized":"2023-11-24T06:16:47.875891+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868427+0000","last_change":"2023-11-24T06:16:48.868427+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868427+0000","last_undegraded":"2023-11-24T06:16:48.868427+0000","last_fullsized":"2023-11-24T06:16:48.868427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.143846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.883045+0000","last_change":"2023-11-24T06:16:47.859062+0000","last_active":"2023-11-24T06:16:48.883045+0000","last_peered":"2023-11-24T06:16:48.883045+0000","last_clean":"2023-11-24T06:16:48.883045+0000","last_became_active":"2023-11-24T06:16:47.858688+0000","last_became_peered":"2023-11-24T06:16:47.858688+0000","last_unstale":"2023-11-24T06:16:48.883045+0000","last_undegraded":"2023-11-24T06:16:48.883045+0000","last_fullsized":"2023-11-24T06:16:48.883045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:52.914802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.855859+0000","last_change":"2023-11-24T06:16:47.855859+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.855859+0000","last_undegraded":"2023-11-24T06:16:47.855859+0000","last_fullsized":"2023-11-24T06:16:47.855859+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864878+0000","last_change":"2023-11-24T06:16:47.863548+0000","last_active":"2023-11-24T06:16:48.864878+0000","last_peered":"2023-11-24T06:16:48.864878+0000","last_clean":"2023-11-24T06:16:48.864878+0000","last_became_active":"2023-11-24T06:16:47.863229+0000","last_became_peered":"2023-11-24T06:16:47.863229+0000","last_unstale":"2023-11-24T06:16:48.864878+0000","last_undegraded":"2023-11-24T06:16:48.864878+0000","last_fullsized":"2023-11-24T06:16:48.864878+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:00.282582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.856807+0000","last_change":"2023-11-24T06:16:47.856807+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.856807+0000","last_undegraded":"2023-11-24T06:16:47.856807+0000","last_fullsized":"2023-11-24T06:16:47.856807+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867790+0000","last_change":"2023-11-24T06:16:47.864670+0000","last_active":"2023-11-24T06:16:48.867790+0000","last_peered":"2023-11-24T06:16:48.867790+0000","last_clean":"2023-11-24T06:16:48.867790+0000","last_became_active":"2023-11-24T06:16:47.864390+0000","last_became_peered":"2023-11-24T06:16:47.864390+0000","last_unstale":"2023-11-24T06:16:48.867790+0000","last_undegraded":"2023-11-24T06:16:48.867790+0000","last_fullsized":"2023-11-24T06:16:48.867790+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:26:28.591350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.867777+0000","last_change":"2023-11-24T06:16:48.867777+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.867777+0000","last_undegraded":"2023-11-24T06:16:48.867777+0000","last_fullsized":"2023-11-24T06:16:48.867777+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:07.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.866364+0000","last_change":"2023-11-24T06:16:47.863613+0000","last_active":"2023-11-24T06:16:48.866364+0000","last_peered":"2023-11-24T06:16:48.866364+0000","last_clean":"2023-11-24T06:16:48.866364+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.866364+0000","last_undegraded":"2023-11-24T06:16:48.866364+0000","last_fullsized":"2023-11-24T06:16:48.866364+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869296+0000","last_change":"2023-11-24T06:16:48.869296+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869296+0000","last_undegraded":"2023-11-24T06:16:48.869296+0000","last_fullsized":"2023-11-24T06:16:48.869296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:03.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876001+0000","last_change":"2023-11-24T06:16:47.870072+0000","last_active":"2023-11-24T06:16:47.876001+0000","last_peered":"2023-11-24T06:16:47.876001+0000","last_clean":"2023-11-24T06:16:47.876001+0000","last_became_active":"2023-11-24T06:16:47.869378+0000","last_became_peered":"2023-11-24T06:16:47.869378+0000","last_unstale":"2023-11-24T06:16:47.876001+0000","last_undegraded":"2023-11-24T06:16:47.876001+0000","last_fullsized":"2023-11-24T06:16:47.876001+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:57.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.887076+0000","last_change":"2023-11-24T06:16:48.887076+0000","last_active":"2023-11-24T06:16:48.887076+0000","last_peered":"2023-11-24T06:16:48.887076+0000","last_clean":"2023-11-24T06:16:48.887076+0000","last_became_active":"2023-11-24T06:16:48.886197+0000","last_became_peered":"2023-11-24T06:16:48.886197+0000","last_unstale":"2023-11-24T06:16:48.887076+0000","last_undegraded":"2023-11-24T06:16:48.887076+0000","last_fullsized":"2023-11-24T06:16:48.887076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:06.358345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.867040+0000","last_change":"2023-11-24T06:16:47.861764+0000","last_active":"2023-11-24T06:16:47.867040+0000","last_peered":"2023-11-24T06:16:47.867040+0000","last_clean":"2023-11-24T06:16:47.867040+0000","last_became_active":"2023-11-24T06:16:47.861429+0000","last_became_peered":"2023-11-24T06:16:47.861429+0000","last_unstale":"2023-11-24T06:16:47.867040+0000","last_undegraded":"2023-11-24T06:16:47.867040+0000","last_fullsized":"2023-11-24T06:16:47.867040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:29.319849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852446+0000","last_change":"2023-11-24T06:16:47.852446+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852446+0000","last_undegraded":"2023-11-24T06:16:47.852446+0000","last_fullsized":"2023-11-24T06:16:47.852446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.872583+0000","last_change":"2023-11-24T06:16:47.859106+0000","last_active":"2023-11-24T06:16:48.872583+0000","last_peered":"2023-11-24T06:16:48.872583+0000","last_clean":"2023-11-24T06:16:48.872583+0000","last_became_active":"2023-11-24T06:16:47.858851+0000","last_became_peered":"2023-11-24T06:16:47.858851+0000","last_unstale":"2023-11-24T06:16:48.872583+0000","last_undegraded":"2023-11-24T06:16:48.872583+0000","last_fullsized":"2023-11-24T06:16:48.872583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878050+0000","last_change":"2023-11-24T06:16:48.878050+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878050+0000","last_undegraded":"2023-11-24T06:16:48.878050+0000","last_fullsized":"2023-11-24T06:16:48.878050+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864999+0000","last_change":"2023-11-24T06:16:47.867455+0000","last_active":"2023-11-24T06:16:48.864999+0000","last_peered":"2023-11-24T06:16:48.864999+0000","last_clean":"2023-11-24T06:16:48.864999+0000","last_became_active":"2023-11-24T06:16:47.867160+0000","last_became_peered":"2023-11-24T06:16:47.867160+0000","last_unstale":"2023-11-24T06:16:48.864999+0000","last_undegraded":"2023-11-24T06:16:48.864999+0000","last_fullsized":"2023-11-24T06:16:48.864999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:48.066853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863041+0000","last_change":"2023-11-24T06:16:47.863041+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863041+0000","last_undegraded":"2023-11-24T06:16:47.863041+0000","last_fullsized":"2023-11-24T06:16:47.863041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.870718+0000","last_change":"2023-11-24T06:16:47.869254+0000","last_active":"2023-11-24T06:16:48.870718+0000","last_peered":"2023-11-24T06:16:48.870718+0000","last_clean":"2023-11-24T06:16:48.870718+0000","last_became_active":"2023-11-24T06:16:47.868976+0000","last_became_peered":"2023-11-24T06:16:47.868976+0000","last_unstale":"2023-11-24T06:16:48.870718+0000","last_undegraded":"2023-11-24T06:16:48.870718+0000","last_fullsized":"2023-11-24T06:16:48.870718+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.889009+0000","last_change":"2023-11-24T06:16:48.889009+0000","last_active":"2023-11-24T06:16:48.889009+0000","last_peered":"2023-11-24T06:16:48.889009+0000","last_clean":"2023-11-24T06:16:48.889009+0000","last_became_active":"2023-11-24T06:16:48.888731+0000","last_became_peered":"2023-11-24T06:16:48.888731+0000","last_unstale":"2023-11-24T06:16:48.889009+0000","last_undegraded":"2023-11-24T06:16:48.889009+0000","last_fullsized":"2023-11-24T06:16:48.889009+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:53.231928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864877+0000","last_change":"2023-11-24T06:16:47.869741+0000","last_active":"2023-11-24T06:16:48.864877+0000","last_peered":"2023-11-24T06:16:48.864877+0000","last_clean":"2023-11-24T06:16:48.864877+0000","last_became_active":"2023-11-24T06:16:47.869465+0000","last_became_peered":"2023-11-24T06:16:47.869465+0000","last_unstale":"2023-11-24T06:16:48.864877+0000","last_undegraded":"2023-11-24T06:16:48.864877+0000","last_fullsized":"2023-11-24T06:16:48.864877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:06.921054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":4,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.887384+0000","last_change":"2023-11-24T06:16:48.876908+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.887384+0000","last_undegraded":"2023-11-24T06:16:48.887384+0000","last_fullsized":"2023-11-24T06:16:48.887384+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.886988+0000","last_change":"2023-11-24T06:16:47.871713+0000","last_active":"2023-11-24T06:16:48.886988+0000","last_peered":"2023-11-24T06:16:48.886988+0000","last_clean":"2023-11-24T06:16:48.886988+0000","last_became_active":"2023-11-24T06:16:47.870883+0000","last_became_peered":"2023-11-24T06:16:47.870883+0000","last_unstale":"2023-11-24T06:16:48.886988+0000","last_undegraded":"2023-11-24T06:16:48.886988+0000","last_fullsized":"2023-11-24T06:16:48.886988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:19:32.348025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.876562+0000","last_change":"2023-11-24T06:16:48.876562+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.876562+0000","last_undegraded":"2023-11-24T06:16:48.876562+0000","last_fullsized":"2023-11-24T06:16:48.876562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.872126+0000","last_change":"2023-11-24T06:16:47.868677+0000","last_active":"2023-11-24T06:16:47.872126+0000","last_peered":"2023-11-24T06:16:47.872126+0000","last_clean":"2023-11-24T06:16:47.872126+0000","last_became_active":"2023-11-24T06:16:47.868343+0000","last_became_peered":"2023-11-24T06:16:47.868343+0000","last_unstale":"2023-11-24T06:16:47.872126+0000","last_undegraded":"2023-11-24T06:16:47.872126+0000","last_fullsized":"2023-11-24T06:16:47.872126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:23.063822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-24T06:16:46.845772+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:16:46.845772+0000","last_peered":"2023-11-24T06:16:46.845772+0000","last_clean":"2023-11-24T06:16:46.845772+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:16:46.845772+0000","last_undegraded":"2023-11-24T06:16:46.845772+0000","last_fullsized":"2023-11-24T06:16:46.845772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1204224,"data_stored":848913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.012,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.24}]},{"osd":1,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.536,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.171},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2430000000000001},"min":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.6220000000000001,"5min":2.004,"15min":2.004},"last":1.014}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.198},"min":{"1min":0.79700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.288},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1579999999999999,"15min":1.153},"min":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.637,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.107}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.234,"15min":1.23},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8069999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.337,"15min":1.339},"min":{"1min":0.95999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.71,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.472}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.351,"15min":1.347},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.454,"5min":1.4590000000000001,"15min":1.46},"min":{"1min":1.139,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.873,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.7050000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4430000000000001,"15min":1.4390000000000001},"min":{"1min":0.89800000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.704,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.4790000000000001,"15min":1.4850000000000001},"min":{"1min":1.0980000000000001,"5min":1.022,"15min":1.022},"max":{"1min":1.8300000000000001,"5min":1.944,"15min":1.944},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5429999999999999,"15min":1.55},"min":{"1min":1.042,"5min":0.623,"15min":0.623},"max":{"1min":1.7589999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.379},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.476,"15min":1.48},"min":{"1min":0.95699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6859999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.7949999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.72699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.52,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.0269999999999999,"15min":1.016},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.135}]},{"osd":1,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5660000000000001,"5min":1.615,"15min":1.615},"last":1.012},{"interface":"front","average":{"1min":1.145,"5min":1.181,"15min":1.1870000000000001},"min":{"1min":0.76100000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6419999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.2370000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.323,"15min":1.325},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9339999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.351,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.645,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.367}]},{"osd":3,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.359,"15min":1.3779999999999999},"min":{"1min":0.90300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0350000000000001,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.296,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9119999999999999,"5min":2.056,"15min":2.056},"last":1.302}]},{"osd":4,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4470000000000001,"15min":1.456},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8029999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.506,"5min":1.5389999999999999,"15min":1.5449999999999999},"min":{"1min":0.80500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0219999999999998,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.5780000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.4650000000000001},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.825,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.635,"15min":1.641},"min":{"1min":0.71399999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0649999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.518}]},{"osd":7,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.5509999999999999,"15min":1.5389999999999999},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9079999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.665},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.498,"15min":1.484},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.024,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.8200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0449999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.464,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5429999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.5429999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1579999999999999,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.619,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.292,"15min":1.3069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.542,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.3029999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2629999999999999,"15min":1.2709999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.444},"min":{"1min":0.98199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0720000000000001,"5min":2.198,"15min":2.198},"last":1.4099999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6359999999999999,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.028},{"interface":"front","average":{"1min":1.407,"5min":1.4450000000000001,"15min":1.4510000000000001},"min":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.9470000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6659999999999999,"5min":2.427,"15min":2.427},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4670000000000001,"15min":1.4830000000000001},"min":{"1min":0.83299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8680000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.5780000000000001,"15min":1.5940000000000001},"min":{"1min":1.1000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8029999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.587,"15min":1.6200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8069999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.6739999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.651,"15min":1.663},"min":{"1min":1.042,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0230000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.706,"15min":1.712},"min":{"1min":1.234,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1789999999999998,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.6180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0129999999999999,"15min":0.997},"min":{"1min":0.69699999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.073,"15min":1.069},"min":{"1min":0.77800000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.115}]},{"osd":1,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.083,"15min":1.0780000000000001},"min":{"1min":0.73399999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.88900000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.71,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.383}]},{"osd":2,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.216,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.766,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.87},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.232,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5820000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.339},"min":{"1min":0.95099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.643,"5min":2.089,"15min":2.089},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3360000000000001,"15min":1.337},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.873,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.167}]},{"osd":5,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3899999999999999,"15min":1.4019999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.234}]},{"osd":6,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.6100000000000001,"15min":1.6240000000000001},"min":{"1min":1.1819999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2730000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.5840000000000001,"15min":1.595},"min":{"1min":1.0920000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.1789999999999998,"5min":2.222,"15min":2.222},"last":1.339}]},{"osd":7,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.5069999999999999,"15min":1.524},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.3},{"interface":"front","average":{"1min":1.595,"5min":1.7030000000000001,"15min":1.7210000000000001},"min":{"1min":1.2729999999999999,"5min":1.157,"15min":1.157},"max":{"1min":2.0190000000000001,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.591}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.363,"5min":1.71,"15min":1.71},"last":1.268},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.2010000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":0.98099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.242,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.97399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8859999999999999,"5min":1.998,"15min":1.998},"last":1.556}]},{"osd":2,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.673,"5min":1.802,"15min":1.802},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1000000000000001,"15min":1.095},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.667,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.706}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":9.7599999999999998,"15min":11.188000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.833,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.4139999999999999,"15min":1.448},"min":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.714,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.095}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.4450000000000001,"15min":1.4770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9370000000000001,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.399,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9159999999999999,"5min":4.274,"15min":4.274},"last":1.9410000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.7669999999999999,"15min":1.825},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.1190000000000002,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":2.0190000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.399,"15min":1.4219999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0369999999999999,"5min":3.157,"15min":3.157},"last":1.623}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5389999999999999,"15min":1.5680000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1709999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1829999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.6850000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2190000000000001,"5min":1.304,"15min":1.304},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.3109999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0589999999999999,"15min":1.0680000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6879999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.357,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.131,"15min":1.137},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6950000000000001,"5min":2.355,"15min":2.355},"last":1.278},{"interface":"front","average":{"1min":1.159,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.24}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3,"15min":1.294},"min":{"1min":0.85499999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.875,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.157},{"interface":"front","average":{"1min":1.468,"5min":1.4490000000000001,"15min":1.446},"min":{"1min":0.95499999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0979999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4990000000000001,"15min":1.502},"min":{"1min":0.95899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.347},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3979999999999999,"15min":1.3999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7869999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.038}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5349999999999999,"15min":1.5389999999999999},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.4119999999999999,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.591,"15min":1.589},"min":{"1min":0.92100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.518}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.544,"15min":1.5509999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0070000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.577,"15min":1.5840000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.266,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.798}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1830000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1,"5min":1.002,"15min":1.002},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.879,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.1439999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.999,"15min":1.0089999999999999},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.6000000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.2450000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.712,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.907,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.712,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.3200000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.365,"15min":1.393},"min":{"1min":0.84599999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.609,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.607},{"interface":"front","average":{"1min":1.337,"5min":1.5209999999999999,"15min":1.552},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7769999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.3660000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.621,"15min":1.661},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8360000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.554},{"interface":"front","average":{"1min":1.341,"5min":1.6799999999999999,"15min":1.736},"min":{"1min":0.91200000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5860000000000001,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.397}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5760000000000001,"15min":1.5960000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.246,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.8320000000000001,"15min":1.8879999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1619999999999999,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.6459999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5960000000000001,"15min":1.6080000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.004,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.7},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.611,"15min":1.639},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.8240000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.522}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":848913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.97399999999999998,"15min":0.96999999999999997},"min":{"1min":0.53800000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6919999999999999,"5min":2.452,"15min":2.452},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.056,"15min":1.0740000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3360000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.88100000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2529999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6950000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.113,"15min":1.131},"min":{"1min":0.498,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":3.411,"15min":3.411},"last":1.2290000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.645,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.419},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.258,"15min":1.264},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.579,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.0669999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.446,"15min":1.452},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7949999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.575,"15min":1.605},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9379999999999999,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.6599999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.532,"15min":1.5469999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0150000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5469999999999999,"15min":1.5680000000000001},"min":{"1min":0.876,"5min":0.875,"15min":0.875},"max":{"1min":2.0019999999999998,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.4790000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.9039999999999999,"15min":1.9870000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0510000000000002,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.7989999999999999,"15min":1.847},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9470000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.393}]},{"osd":7,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.95599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0379999999999998,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.708},{"interface":"front","average":{"1min":1.536,"5min":1.841,"15min":1.8919999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0609999999999999,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.5289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:53.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:54.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.152+0000 7f4f46aea640 1 Processor -- start 2023-11-24T06:16:54.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.152+0000 7f4f46aea640 1 -- start start 2023-11-24T06:16:54.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.154+0000 7f4f46aea640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f40143870 0x7f4f40146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.154+0000 7f4f46aea640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40161080 0x7f4f400b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.154+0000 7f4f46aea640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f40161510 con 0x7f4f40146eb0 2023-11-24T06:16:54.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.154+0000 7f4f46aea640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f40070460 con 0x7f4f40143870 2023-11-24T06:16:54.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.154+0000 7f4f46aea640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f401617f0 con 0x7f4f40161080 2023-11-24T06:16:54.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.155+0000 7f4f45ae8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f40143870 0x7f4f40146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.155+0000 7f4f452e7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40161080 0x7f4f400b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.155+0000 7f4f45ae8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f40143870 0x7f4f40146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:48520/0 (socket says 172.21.15.37:48520) 2023-11-24T06:16:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.155+0000 7f4f45ae8640 1 -- 172.21.15.37:0/2219462223 learned_addr learned my addr 172.21.15.37:0/2219462223 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.156+0000 7f4f44ae6640 1 -- 172.21.15.37:0/2219462223 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264081907 0 0) 0x7f4f40161510 con 0x7f4f40146eb0 2023-11-24T06:16:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.156+0000 7f4f452e7640 1 -- 172.21.15.37:0/2219462223 >> v2:172.21.15.188:3300/0 conn(0x7f4f40143870 msgr2=0x7f4f40146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.156+0000 7f4f452e7640 1 --2- 172.21.15.37:0/2219462223 >> v2:172.21.15.188:3300/0 conn(0x7f4f40143870 0x7f4f40146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.156+0000 7f4f452e7640 1 -- 172.21.15.37:0/2219462223 >> v1:172.21.15.188:6789/0 conn(0x7f4f40146eb0 legacy=0x7f4f4006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.156+0000 7f4f452e7640 1 -- 172.21.15.37:0/2219462223 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40161ad0 con 0x7f4f40161080 2023-11-24T06:16:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.157+0000 7f4f452e7640 1 --2- 172.21.15.37:0/2219462223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40161080 0x7f4f400b0a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4f300097a0 tx=0x7f4f3002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6748fbb733e91a16 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f44ae6640 1 -- 172.21.15.37:0/2219462223 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30031830 con 0x7f4f40161080 2023-11-24T06:16:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f44ae6640 1 -- 172.21.15.37:0/2219462223 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30031990 con 0x7f4f40161080 2023-11-24T06:16:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f44ae6640 1 -- 172.21.15.37:0/2219462223 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30031d20 con 0x7f4f40161080 2023-11-24T06:16:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f46aea640 1 -- 172.21.15.37:0/2219462223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40161080 msgr2=0x7f4f400b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f46aea640 1 --2- 172.21.15.37:0/2219462223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40161080 0x7f4f400b0a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4f300097a0 tx=0x7f4f3002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f46aea640 1 -- 172.21.15.37:0/2219462223 shutdown_connections 2023-11-24T06:16:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f46aea640 1 --2- 172.21.15.37:0/2219462223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40161080 0x7f4f400b0a70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f46aea640 1 --2- 172.21.15.37:0/2219462223 >> v2:172.21.15.188:3300/0 conn(0x7f4f40143870 0x7f4f40146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.158+0000 7f4f46aea640 1 -- 172.21.15.37:0/2219462223 >> 172.21.15.37:0/2219462223 conn(0x7f4f400cb830 msgr2=0x7f4f400cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.159+0000 7f4f46aea640 1 -- 172.21.15.37:0/2219462223 shutdown_connections 2023-11-24T06:16:54.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.159+0000 7f4f46aea640 1 -- 172.21.15.37:0/2219462223 wait complete. 2023-11-24T06:16:54.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.160+0000 7f4f46aea640 1 Processor -- start 2023-11-24T06:16:54.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.161+0000 7f4f46aea640 1 -- start start 2023-11-24T06:16:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.161+0000 7f4f46aea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f40143870 0x7f4f4015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f46aea640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40146eb0 0x7f4f401e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f46aea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f401e9420 0x7f4f401e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f46aea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f401f35c0 con 0x7f4f401e9420 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f46aea640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f401e98b0 con 0x7f4f40143870 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f46aea640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f401e9d80 con 0x7f4f40146eb0 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f462e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f401e9420 0x7f4f401e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f462e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f401e9420 0x7f4f401e6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43648/0 (socket says 172.21.15.37:43648) 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f462e9640 1 -- 172.21.15.37:0/1236924286 learned_addr learned my addr 172.21.15.37:0/1236924286 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f45ae8640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f40143870 0x7f4f4015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f452e7640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40146eb0 0x7f4f401e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f462e9640 1 -- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40146eb0 msgr2=0x7f4f401e8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f462e9640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40146eb0 0x7f4f401e8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f462e9640 1 -- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f40143870 msgr2=0x7f4f4015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.162+0000 7f4f462e9640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f40143870 0x7f4f4015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.163+0000 7f4f462e9640 1 -- 172.21.15.37:0/1236924286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f30009400 con 0x7f4f401e9420 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.163+0000 7f4f462e9640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f401e9420 0x7f4f401e6ec0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800c750 tx=0x7f4f3800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.163+0000 7f4f367fc640 1 -- 172.21.15.37:0/1236924286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38003da0 con 0x7f4f401e9420 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.163+0000 7f4f367fc640 1 -- 172.21.15.37:0/1236924286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3800ce60 con 0x7f4f401e9420 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.163+0000 7f4f367fc640 1 -- 172.21.15.37:0/1236924286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380052b0 con 0x7f4f401e9420 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.163+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f401e9aa0 con 0x7f4f401e9420 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.163+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4015e690 con 0x7f4f401e9420 2023-11-24T06:16:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.164+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f400cbc10 con 0x7f4f401e9420 2023-11-24T06:16:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.165+0000 7f4f367fc640 1 -- 172.21.15.37:0/1236924286 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f38005410 con 0x7f4f401e9420 2023-11-24T06:16:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.166+0000 7f4f367fc640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f2406ae70 0x7f4f2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.166+0000 7f4f367fc640 1 -- 172.21.15.37:0/1236924286 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f38088f00 con 0x7f4f401e9420 2023-11-24T06:16:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.167+0000 7f4f45ae8640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f2406ae70 0x7f4f2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.167+0000 7f4f45ae8640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f2406ae70 0x7f4f2406d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009b60 tx=0x7f4f3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.171+0000 7f4f367fc640 1 -- 172.21.15.37:0/1236924286 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f38053f10 con 0x7f4f401e9420 2023-11-24T06:16:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.361+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f4006e280 con 0x7f4f2406ae70 2023-11-24T06:16:54.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.373+0000 7f4f367fc640 1 -- 172.21.15.37:0/1236924286 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283645 (secure 0 0 0) 0x7f4f3c011a60 con 0x7f4f2406ae70 2023-11-24T06:16:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:16:54.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f2406ae70 msgr2=0x7f4f2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f2406ae70 0x7f4f2406d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009b60 tx=0x7f4f3c008040 comp rx=0 tx=0).stop 2023-11-24T06:16:54.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f401e9420 msgr2=0x7f4f401e6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f401e9420 0x7f4f401e6ec0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800c750 tx=0x7f4f3800cc10 comp rx=0 tx=0).stop 2023-11-24T06:16:54.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 shutdown_connections 2023-11-24T06:16:54.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f2406ae70 0x7f4f2406d330 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f401e9420 0x7f4f401e6ec0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f40146eb0 0x7f4f401e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 --2- 172.21.15.37:0/1236924286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f40143870 0x7f4f4015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.380+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 >> 172.21.15.37:0/1236924286 conn(0x7f4f400cb830 msgr2=0x7f4f40144ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:54.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.381+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 shutdown_connections 2023-11-24T06:16:54.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.381+0000 7f4f46aea640 1 -- 172.21.15.37:0/1236924286 wait complete. 2023-11-24T06:16:54.403 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-11-24T06:16:52.852248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230432,"kb_used_data":5928,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744288,"statfs":{"total":773094113280,"available":772858150912,"internally_reserved":0,"allocated":6070272,"data_stored":3249096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002017"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.888238+0000","last_change":"2023-11-24T06:16:48.888238+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.888238+0000","last_undegraded":"2023-11-24T06:16:48.888238+0000","last_fullsized":"2023-11-24T06:16:48.888238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:54.224214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882218+0000","last_change":"2023-11-24T06:16:48.882218+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882218+0000","last_undegraded":"2023-11-24T06:16:48.882218+0000","last_fullsized":"2023-11-24T06:16:48.882218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:20:49.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.866046+0000","last_change":"2023-11-24T06:16:47.866046+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.866046+0000","last_undegraded":"2023-11-24T06:16:47.866046+0000","last_fullsized":"2023-11-24T06:16:47.866046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866210+0000","last_change":"2023-11-24T06:16:48.866210+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866210+0000","last_undegraded":"2023-11-24T06:16:48.866210+0000","last_fullsized":"2023-11-24T06:16:48.866210+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:39:38.395169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.881698+0000","last_change":"2023-11-24T06:16:48.881698+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.881698+0000","last_undegraded":"2023-11-24T06:16:48.881698+0000","last_fullsized":"2023-11-24T06:16:48.881698+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:17:53.485974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852166+0000","last_change":"2023-11-24T06:16:47.852166+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852166+0000","last_undegraded":"2023-11-24T06:16:47.852166+0000","last_fullsized":"2023-11-24T06:16:47.852166+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869228+0000","last_change":"2023-11-24T06:16:48.869228+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869228+0000","last_undegraded":"2023-11-24T06:16:48.869228+0000","last_fullsized":"2023-11-24T06:16:48.869228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:06.358345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.877814+0000","last_change":"2023-11-24T06:16:48.877814+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.877814+0000","last_undegraded":"2023-11-24T06:16:48.877814+0000","last_fullsized":"2023-11-24T06:16:48.877814+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869253+0000","last_change":"2023-11-24T06:16:48.869253+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869253+0000","last_undegraded":"2023-11-24T06:16:48.869253+0000","last_fullsized":"2023-11-24T06:16:48.869253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.888135+0000","last_change":"2023-11-24T06:16:48.888135+0000","last_active":"2023-11-24T06:16:48.888135+0000","last_peered":"2023-11-24T06:16:48.888135+0000","last_clean":"2023-11-24T06:16:48.888135+0000","last_became_active":"2023-11-24T06:16:48.887851+0000","last_became_peered":"2023-11-24T06:16:48.887851+0000","last_unstale":"2023-11-24T06:16:48.888135+0000","last_undegraded":"2023-11-24T06:16:48.888135+0000","last_fullsized":"2023-11-24T06:16:48.888135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:29.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.865859+0000","last_change":"2023-11-24T06:16:48.865859+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.865859+0000","last_undegraded":"2023-11-24T06:16:48.865859+0000","last_fullsized":"2023-11-24T06:16:48.865859+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866143+0000","last_change":"2023-11-24T06:16:48.866143+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866143+0000","last_undegraded":"2023-11-24T06:16:48.866143+0000","last_fullsized":"2023-11-24T06:16:48.866143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.854247+0000","last_change":"2023-11-24T06:16:47.854247+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.854247+0000","last_undegraded":"2023-11-24T06:16:47.854247+0000","last_fullsized":"2023-11-24T06:16:47.854247+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.870028+0000","last_change":"2023-11-24T06:16:48.870028+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.870028+0000","last_undegraded":"2023-11-24T06:16:48.870028+0000","last_fullsized":"2023-11-24T06:16:48.870028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:29.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868735+0000","last_change":"2023-11-24T06:16:48.868735+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868735+0000","last_undegraded":"2023-11-24T06:16:48.868735+0000","last_fullsized":"2023-11-24T06:16:48.868735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:53.231928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852897+0000","last_change":"2023-11-24T06:16:47.852897+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852897+0000","last_undegraded":"2023-11-24T06:16:47.852897+0000","last_fullsized":"2023-11-24T06:16:47.852897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.887667+0000","last_change":"2023-11-24T06:16:48.887667+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.887667+0000","last_undegraded":"2023-11-24T06:16:48.887667+0000","last_fullsized":"2023-11-24T06:16:48.887667+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:28:32.474805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.866187+0000","last_change":"2023-11-24T06:16:47.866187+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.866187+0000","last_undegraded":"2023-11-24T06:16:47.866187+0000","last_fullsized":"2023-11-24T06:16:47.866187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.890640+0000","last_change":"2023-11-24T06:16:48.890640+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.890640+0000","last_undegraded":"2023-11-24T06:16:48.890640+0000","last_fullsized":"2023-11-24T06:16:48.890640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:31:56.753495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.880622+0000","last_change":"2023-11-24T06:16:48.880622+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.880622+0000","last_undegraded":"2023-11-24T06:16:48.880622+0000","last_fullsized":"2023-11-24T06:16:48.880622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:32.077444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.865010+0000","last_change":"2023-11-24T06:16:47.865010+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.865010+0000","last_undegraded":"2023-11-24T06:16:47.865010+0000","last_fullsized":"2023-11-24T06:16:47.865010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.879338+0000","last_change":"2023-11-24T06:16:48.879338+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.879338+0000","last_undegraded":"2023-11-24T06:16:48.879338+0000","last_fullsized":"2023-11-24T06:16:48.879338+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.861382+0000","last_change":"2023-11-24T06:16:47.861382+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.861382+0000","last_undegraded":"2023-11-24T06:16:47.861382+0000","last_fullsized":"2023-11-24T06:16:47.861382+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.853738+0000","last_change":"2023-11-24T06:16:47.853738+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.853738+0000","last_undegraded":"2023-11-24T06:16:47.853738+0000","last_fullsized":"2023-11-24T06:16:47.853738+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.884018+0000","last_change":"2023-11-24T06:16:48.884018+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.884018+0000","last_undegraded":"2023-11-24T06:16:48.884018+0000","last_fullsized":"2023-11-24T06:16:48.884018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:27:51.044525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.873446+0000","last_change":"2023-11-24T06:16:48.873446+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.873446+0000","last_undegraded":"2023-11-24T06:16:48.873446+0000","last_fullsized":"2023-11-24T06:16:48.873446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:42.334420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863359+0000","last_change":"2023-11-24T06:16:47.863359+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863359+0000","last_undegraded":"2023-11-24T06:16:47.863359+0000","last_fullsized":"2023-11-24T06:16:47.863359+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882110+0000","last_change":"2023-11-24T06:16:48.882110+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882110+0000","last_undegraded":"2023-11-24T06:16:48.882110+0000","last_fullsized":"2023-11-24T06:16:48.882110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:20.275650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.882757+0000","last_change":"2023-11-24T06:16:48.882757+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.882757+0000","last_undegraded":"2023-11-24T06:16:48.882757+0000","last_fullsized":"2023-11-24T06:16:48.882757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:20.197865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863533+0000","last_change":"2023-11-24T06:16:47.863533+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863533+0000","last_undegraded":"2023-11-24T06:16:47.863533+0000","last_fullsized":"2023-11-24T06:16:47.863533+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878935+0000","last_change":"2023-11-24T06:16:48.878935+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878935+0000","last_undegraded":"2023-11-24T06:16:48.878935+0000","last_fullsized":"2023-11-24T06:16:48.878935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:05.112330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852241+0000","last_change":"2023-11-24T06:16:47.852241+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852241+0000","last_undegraded":"2023-11-24T06:16:47.852241+0000","last_fullsized":"2023-11-24T06:16:47.852241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.855447+0000","last_change":"2023-11-24T06:16:47.855447+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.855447+0000","last_undegraded":"2023-11-24T06:16:47.855447+0000","last_fullsized":"2023-11-24T06:16:47.855447+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876100+0000","last_change":"2023-11-24T06:16:47.870996+0000","last_active":"2023-11-24T06:16:47.876100+0000","last_peered":"2023-11-24T06:16:47.876100+0000","last_clean":"2023-11-24T06:16:47.876100+0000","last_became_active":"2023-11-24T06:16:47.870728+0000","last_became_peered":"2023-11-24T06:16:47.870728+0000","last_unstale":"2023-11-24T06:16:47.876100+0000","last_undegraded":"2023-11-24T06:16:47.876100+0000","last_fullsized":"2023-11-24T06:16:47.876100+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866318+0000","last_change":"2023-11-24T06:16:48.866318+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866318+0000","last_undegraded":"2023-11-24T06:16:48.866318+0000","last_fullsized":"2023-11-24T06:16:48.866318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:09.576866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.882499+0000","last_change":"2023-11-24T06:16:47.873548+0000","last_active":"2023-11-24T06:16:48.882499+0000","last_peered":"2023-11-24T06:16:48.882499+0000","last_clean":"2023-11-24T06:16:48.882499+0000","last_became_active":"2023-11-24T06:16:47.873228+0000","last_became_peered":"2023-11-24T06:16:47.873228+0000","last_unstale":"2023-11-24T06:16:48.882499+0000","last_undegraded":"2023-11-24T06:16:48.882499+0000","last_fullsized":"2023-11-24T06:16:48.882499+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:26.312030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.859889+0000","last_change":"2023-11-24T06:16:47.859889+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.859889+0000","last_undegraded":"2023-11-24T06:16:47.859889+0000","last_fullsized":"2023-11-24T06:16:47.859889+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875830+0000","last_change":"2023-11-24T06:16:47.869007+0000","last_active":"2023-11-24T06:16:47.875830+0000","last_peered":"2023-11-24T06:16:47.875830+0000","last_clean":"2023-11-24T06:16:47.875830+0000","last_became_active":"2023-11-24T06:16:47.868662+0000","last_became_peered":"2023-11-24T06:16:47.868662+0000","last_unstale":"2023-11-24T06:16:47.875830+0000","last_undegraded":"2023-11-24T06:16:47.875830+0000","last_fullsized":"2023-11-24T06:16:47.875830+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:05.353200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.861396+0000","last_change":"2023-11-24T06:16:47.861396+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.861396+0000","last_undegraded":"2023-11-24T06:16:47.861396+0000","last_fullsized":"2023-11-24T06:16:47.861396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.873856+0000","last_change":"2023-11-24T06:16:47.871257+0000","last_active":"2023-11-24T06:16:48.873856+0000","last_peered":"2023-11-24T06:16:48.873856+0000","last_clean":"2023-11-24T06:16:48.873856+0000","last_became_active":"2023-11-24T06:16:47.870777+0000","last_became_peered":"2023-11-24T06:16:47.870777+0000","last_unstale":"2023-11-24T06:16:48.873856+0000","last_undegraded":"2023-11-24T06:16:48.873856+0000","last_fullsized":"2023-11-24T06:16:48.873856+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:54.500222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878811+0000","last_change":"2023-11-24T06:16:48.878811+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878811+0000","last_undegraded":"2023-11-24T06:16:48.878811+0000","last_fullsized":"2023-11-24T06:16:48.878811+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.872075+0000","last_change":"2023-11-24T06:16:47.863936+0000","last_active":"2023-11-24T06:16:48.872075+0000","last_peered":"2023-11-24T06:16:48.872075+0000","last_clean":"2023-11-24T06:16:48.872075+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.872075+0000","last_undegraded":"2023-11-24T06:16:48.872075+0000","last_fullsized":"2023-11-24T06:16:48.872075+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.881642+0000","last_change":"2023-11-24T06:16:48.881642+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.881642+0000","last_undegraded":"2023-11-24T06:16:48.881642+0000","last_fullsized":"2023-11-24T06:16:48.881642+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:09:36.957387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875847+0000","last_change":"2023-11-24T06:16:47.869191+0000","last_active":"2023-11-24T06:16:47.875847+0000","last_peered":"2023-11-24T06:16:47.875847+0000","last_clean":"2023-11-24T06:16:47.875847+0000","last_became_active":"2023-11-24T06:16:47.868879+0000","last_became_peered":"2023-11-24T06:16:47.868879+0000","last_unstale":"2023-11-24T06:16:47.875847+0000","last_undegraded":"2023-11-24T06:16:47.875847+0000","last_fullsized":"2023-11-24T06:16:47.875847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:55.803447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852539+0000","last_change":"2023-11-24T06:16:47.852539+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852539+0000","last_undegraded":"2023-11-24T06:16:47.852539+0000","last_fullsized":"2023-11-24T06:16:47.852539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867085+0000","last_change":"2023-11-24T06:16:47.858024+0000","last_active":"2023-11-24T06:16:48.867085+0000","last_peered":"2023-11-24T06:16:48.867085+0000","last_clean":"2023-11-24T06:16:48.867085+0000","last_became_active":"2023-11-24T06:16:47.856960+0000","last_became_peered":"2023-11-24T06:16:47.856960+0000","last_unstale":"2023-11-24T06:16:48.867085+0000","last_undegraded":"2023-11-24T06:16:48.867085+0000","last_fullsized":"2023-11-24T06:16:48.867085+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:56.432004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.883129+0000","last_change":"2023-11-24T06:16:48.883129+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.883129+0000","last_undegraded":"2023-11-24T06:16:48.883129+0000","last_fullsized":"2023-11-24T06:16:48.883129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:39.715380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.873497+0000","last_change":"2023-11-24T06:16:47.862985+0000","last_active":"2023-11-24T06:16:48.873497+0000","last_peered":"2023-11-24T06:16:48.873497+0000","last_clean":"2023-11-24T06:16:48.873497+0000","last_became_active":"2023-11-24T06:16:47.862698+0000","last_became_peered":"2023-11-24T06:16:47.862698+0000","last_unstale":"2023-11-24T06:16:48.873497+0000","last_undegraded":"2023-11-24T06:16:48.873497+0000","last_fullsized":"2023-11-24T06:16:48.873497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:40.831546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868830+0000","last_change":"2023-11-24T06:16:48.868830+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868830+0000","last_undegraded":"2023-11-24T06:16:48.868830+0000","last_fullsized":"2023-11-24T06:16:48.868830+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:56.808592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.878458+0000","last_change":"2023-11-24T06:16:47.876806+0000","last_active":"2023-11-24T06:16:47.878458+0000","last_peered":"2023-11-24T06:16:47.878458+0000","last_clean":"2023-11-24T06:16:47.878458+0000","last_became_active":"2023-11-24T06:16:47.876538+0000","last_became_peered":"2023-11-24T06:16:47.876538+0000","last_unstale":"2023-11-24T06:16:47.878458+0000","last_undegraded":"2023-11-24T06:16:47.878458+0000","last_fullsized":"2023-11-24T06:16:47.878458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:59.976124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863834+0000","last_change":"2023-11-24T06:16:47.863834+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863834+0000","last_undegraded":"2023-11-24T06:16:47.863834+0000","last_fullsized":"2023-11-24T06:16:47.863834+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.883404+0000","last_change":"2023-11-24T06:16:47.866036+0000","last_active":"2023-11-24T06:16:48.883404+0000","last_peered":"2023-11-24T06:16:48.883404+0000","last_clean":"2023-11-24T06:16:48.883404+0000","last_became_active":"2023-11-24T06:16:47.865636+0000","last_became_peered":"2023-11-24T06:16:47.865636+0000","last_unstale":"2023-11-24T06:16:48.883404+0000","last_undegraded":"2023-11-24T06:16:48.883404+0000","last_fullsized":"2023-11-24T06:16:48.883404+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.426322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.887175+0000","last_change":"2023-11-24T06:16:48.884882+0000","last_active":"2023-11-24T06:16:48.887175+0000","last_peered":"2023-11-24T06:16:48.887175+0000","last_clean":"2023-11-24T06:16:48.887175+0000","last_became_active":"2023-11-24T06:16:48.884435+0000","last_became_peered":"2023-11-24T06:16:48.884435+0000","last_unstale":"2023-11-24T06:16:48.887175+0000","last_undegraded":"2023-11-24T06:16:48.887175+0000","last_fullsized":"2023-11-24T06:16:48.887175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:43:56.808592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.878469+0000","last_change":"2023-11-24T06:16:47.876849+0000","last_active":"2023-11-24T06:16:47.878469+0000","last_peered":"2023-11-24T06:16:47.878469+0000","last_clean":"2023-11-24T06:16:47.878469+0000","last_became_active":"2023-11-24T06:16:47.876481+0000","last_became_peered":"2023-11-24T06:16:47.876481+0000","last_unstale":"2023-11-24T06:16:47.878469+0000","last_undegraded":"2023-11-24T06:16:47.878469+0000","last_fullsized":"2023-11-24T06:16:47.878469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:25.375717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.865500+0000","last_change":"2023-11-24T06:16:47.865500+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.865500+0000","last_undegraded":"2023-11-24T06:16:47.865500+0000","last_fullsized":"2023-11-24T06:16:47.865500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.874905+0000","last_change":"2023-11-24T06:16:47.871704+0000","last_active":"2023-11-24T06:16:48.874905+0000","last_peered":"2023-11-24T06:16:48.874905+0000","last_clean":"2023-11-24T06:16:48.874905+0000","last_became_active":"2023-11-24T06:16:47.870074+0000","last_became_peered":"2023-11-24T06:16:47.870074+0000","last_unstale":"2023-11-24T06:16:48.874905+0000","last_undegraded":"2023-11-24T06:16:48.874905+0000","last_fullsized":"2023-11-24T06:16:48.874905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:17.477112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.866162+0000","last_change":"2023-11-24T06:16:48.866162+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.866162+0000","last_undegraded":"2023-11-24T06:16:48.866162+0000","last_fullsized":"2023-11-24T06:16:48.866162+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:26.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.881918+0000","last_change":"2023-11-24T06:16:47.863197+0000","last_active":"2023-11-24T06:16:48.881918+0000","last_peered":"2023-11-24T06:16:48.881918+0000","last_clean":"2023-11-24T06:16:48.881918+0000","last_became_active":"2023-11-24T06:16:47.862546+0000","last_became_peered":"2023-11-24T06:16:47.862546+0000","last_unstale":"2023-11-24T06:16:48.881918+0000","last_undegraded":"2023-11-24T06:16:48.881918+0000","last_fullsized":"2023-11-24T06:16:48.881918+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:57.415614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863994+0000","last_change":"2023-11-24T06:16:47.863994+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863994+0000","last_undegraded":"2023-11-24T06:16:47.863994+0000","last_fullsized":"2023-11-24T06:16:47.863994+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875130+0000","last_change":"2023-11-24T06:16:47.870027+0000","last_active":"2023-11-24T06:16:47.875130+0000","last_peered":"2023-11-24T06:16:47.875130+0000","last_clean":"2023-11-24T06:16:47.875130+0000","last_became_active":"2023-11-24T06:16:47.869101+0000","last_became_peered":"2023-11-24T06:16:47.869101+0000","last_unstale":"2023-11-24T06:16:47.875130+0000","last_undegraded":"2023-11-24T06:16:47.875130+0000","last_fullsized":"2023-11-24T06:16:47.875130+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:40.094063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.872366+0000","last_change":"2023-11-24T06:16:48.872366+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.872366+0000","last_undegraded":"2023-11-24T06:16:48.872366+0000","last_fullsized":"2023-11-24T06:16:48.872366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867406+0000","last_change":"2023-11-24T06:16:47.872547+0000","last_active":"2023-11-24T06:16:48.867406+0000","last_peered":"2023-11-24T06:16:48.867406+0000","last_clean":"2023-11-24T06:16:48.867406+0000","last_became_active":"2023-11-24T06:16:47.872211+0000","last_became_peered":"2023-11-24T06:16:47.872211+0000","last_unstale":"2023-11-24T06:16:48.867406+0000","last_undegraded":"2023-11-24T06:16:48.867406+0000","last_fullsized":"2023-11-24T06:16:48.867406+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:48.204786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.860832+0000","last_change":"2023-11-24T06:16:47.860832+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.860832+0000","last_undegraded":"2023-11-24T06:16:47.860832+0000","last_fullsized":"2023-11-24T06:16:47.860832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876015+0000","last_change":"2023-11-24T06:16:47.874455+0000","last_active":"2023-11-24T06:16:47.876015+0000","last_peered":"2023-11-24T06:16:47.876015+0000","last_clean":"2023-11-24T06:16:47.876015+0000","last_became_active":"2023-11-24T06:16:47.873907+0000","last_became_peered":"2023-11-24T06:16:47.873907+0000","last_unstale":"2023-11-24T06:16:47.876015+0000","last_undegraded":"2023-11-24T06:16:47.876015+0000","last_fullsized":"2023-11-24T06:16:47.876015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:34.104751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.864486+0000","last_change":"2023-11-24T06:16:47.864486+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.864486+0000","last_undegraded":"2023-11-24T06:16:47.864486+0000","last_fullsized":"2023-11-24T06:16:47.864486+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.888073+0000","last_change":"2023-11-24T06:16:47.862458+0000","last_active":"2023-11-24T06:16:48.888073+0000","last_peered":"2023-11-24T06:16:48.888073+0000","last_clean":"2023-11-24T06:16:48.888073+0000","last_became_active":"2023-11-24T06:16:47.862117+0000","last_became_peered":"2023-11-24T06:16:47.862117+0000","last_unstale":"2023-11-24T06:16:48.888073+0000","last_undegraded":"2023-11-24T06:16:48.888073+0000","last_fullsized":"2023-11-24T06:16:48.888073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:16:29.279401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.870396+0000","last_change":"2023-11-24T06:16:48.870396+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.870396+0000","last_undegraded":"2023-11-24T06:16:48.870396+0000","last_fullsized":"2023-11-24T06:16:48.870396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:54.444313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875979+0000","last_change":"2023-11-24T06:16:47.870009+0000","last_active":"2023-11-24T06:16:47.875979+0000","last_peered":"2023-11-24T06:16:47.875979+0000","last_clean":"2023-11-24T06:16:47.875979+0000","last_became_active":"2023-11-24T06:16:47.869406+0000","last_became_peered":"2023-11-24T06:16:47.869406+0000","last_unstale":"2023-11-24T06:16:47.875979+0000","last_undegraded":"2023-11-24T06:16:47.875979+0000","last_fullsized":"2023-11-24T06:16:47.875979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:23:28.253114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878781+0000","last_change":"2023-11-24T06:16:48.878781+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878781+0000","last_undegraded":"2023-11-24T06:16:48.878781+0000","last_fullsized":"2023-11-24T06:16:48.878781+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.866611+0000","last_change":"2023-11-24T06:16:47.873847+0000","last_active":"2023-11-24T06:16:48.866611+0000","last_peered":"2023-11-24T06:16:48.866611+0000","last_clean":"2023-11-24T06:16:48.866611+0000","last_became_active":"2023-11-24T06:16:47.873471+0000","last_became_peered":"2023-11-24T06:16:47.873471+0000","last_unstale":"2023-11-24T06:16:48.866611+0000","last_undegraded":"2023-11-24T06:16:48.866611+0000","last_fullsized":"2023-11-24T06:16:48.866611+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:20.193807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.864888+0000","last_change":"2023-11-24T06:16:47.864888+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.864888+0000","last_undegraded":"2023-11-24T06:16:47.864888+0000","last_fullsized":"2023-11-24T06:16:47.864888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.875891+0000","last_change":"2023-11-24T06:16:47.869212+0000","last_active":"2023-11-24T06:16:47.875891+0000","last_peered":"2023-11-24T06:16:47.875891+0000","last_clean":"2023-11-24T06:16:47.875891+0000","last_became_active":"2023-11-24T06:16:47.868677+0000","last_became_peered":"2023-11-24T06:16:47.868677+0000","last_unstale":"2023-11-24T06:16:47.875891+0000","last_undegraded":"2023-11-24T06:16:47.875891+0000","last_fullsized":"2023-11-24T06:16:47.875891+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.868427+0000","last_change":"2023-11-24T06:16:48.868427+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.868427+0000","last_undegraded":"2023-11-24T06:16:48.868427+0000","last_fullsized":"2023-11-24T06:16:48.868427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.143846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.883045+0000","last_change":"2023-11-24T06:16:47.859062+0000","last_active":"2023-11-24T06:16:48.883045+0000","last_peered":"2023-11-24T06:16:48.883045+0000","last_clean":"2023-11-24T06:16:48.883045+0000","last_became_active":"2023-11-24T06:16:47.858688+0000","last_became_peered":"2023-11-24T06:16:47.858688+0000","last_unstale":"2023-11-24T06:16:48.883045+0000","last_undegraded":"2023-11-24T06:16:48.883045+0000","last_fullsized":"2023-11-24T06:16:48.883045+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:52.914802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.855859+0000","last_change":"2023-11-24T06:16:47.855859+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.855859+0000","last_undegraded":"2023-11-24T06:16:47.855859+0000","last_fullsized":"2023-11-24T06:16:47.855859+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864878+0000","last_change":"2023-11-24T06:16:47.863548+0000","last_active":"2023-11-24T06:16:48.864878+0000","last_peered":"2023-11-24T06:16:48.864878+0000","last_clean":"2023-11-24T06:16:48.864878+0000","last_became_active":"2023-11-24T06:16:47.863229+0000","last_became_peered":"2023-11-24T06:16:47.863229+0000","last_unstale":"2023-11-24T06:16:48.864878+0000","last_undegraded":"2023-11-24T06:16:48.864878+0000","last_fullsized":"2023-11-24T06:16:48.864878+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:00.282582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.856807+0000","last_change":"2023-11-24T06:16:47.856807+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.856807+0000","last_undegraded":"2023-11-24T06:16:47.856807+0000","last_fullsized":"2023-11-24T06:16:47.856807+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.867790+0000","last_change":"2023-11-24T06:16:47.864670+0000","last_active":"2023-11-24T06:16:48.867790+0000","last_peered":"2023-11-24T06:16:48.867790+0000","last_clean":"2023-11-24T06:16:48.867790+0000","last_became_active":"2023-11-24T06:16:47.864390+0000","last_became_peered":"2023-11-24T06:16:47.864390+0000","last_unstale":"2023-11-24T06:16:48.867790+0000","last_undegraded":"2023-11-24T06:16:48.867790+0000","last_fullsized":"2023-11-24T06:16:48.867790+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:26:28.591350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.867777+0000","last_change":"2023-11-24T06:16:48.867777+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.867777+0000","last_undegraded":"2023-11-24T06:16:48.867777+0000","last_fullsized":"2023-11-24T06:16:48.867777+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:07.956711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.866364+0000","last_change":"2023-11-24T06:16:47.863613+0000","last_active":"2023-11-24T06:16:48.866364+0000","last_peered":"2023-11-24T06:16:48.866364+0000","last_clean":"2023-11-24T06:16:48.866364+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.866364+0000","last_undegraded":"2023-11-24T06:16:48.866364+0000","last_fullsized":"2023-11-24T06:16:48.866364+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.869296+0000","last_change":"2023-11-24T06:16:48.869296+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.869296+0000","last_undegraded":"2023-11-24T06:16:48.869296+0000","last_fullsized":"2023-11-24T06:16:48.869296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:03.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.876001+0000","last_change":"2023-11-24T06:16:47.870072+0000","last_active":"2023-11-24T06:16:47.876001+0000","last_peered":"2023-11-24T06:16:47.876001+0000","last_clean":"2023-11-24T06:16:47.876001+0000","last_became_active":"2023-11-24T06:16:47.869378+0000","last_became_peered":"2023-11-24T06:16:47.869378+0000","last_unstale":"2023-11-24T06:16:47.876001+0000","last_undegraded":"2023-11-24T06:16:47.876001+0000","last_fullsized":"2023-11-24T06:16:47.876001+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:57.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.887076+0000","last_change":"2023-11-24T06:16:48.887076+0000","last_active":"2023-11-24T06:16:48.887076+0000","last_peered":"2023-11-24T06:16:48.887076+0000","last_clean":"2023-11-24T06:16:48.887076+0000","last_became_active":"2023-11-24T06:16:48.886197+0000","last_became_peered":"2023-11-24T06:16:48.886197+0000","last_unstale":"2023-11-24T06:16:48.887076+0000","last_undegraded":"2023-11-24T06:16:48.887076+0000","last_fullsized":"2023-11-24T06:16:48.887076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:06.358345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.867040+0000","last_change":"2023-11-24T06:16:47.861764+0000","last_active":"2023-11-24T06:16:47.867040+0000","last_peered":"2023-11-24T06:16:47.867040+0000","last_clean":"2023-11-24T06:16:47.867040+0000","last_became_active":"2023-11-24T06:16:47.861429+0000","last_became_peered":"2023-11-24T06:16:47.861429+0000","last_unstale":"2023-11-24T06:16:47.867040+0000","last_undegraded":"2023-11-24T06:16:47.867040+0000","last_fullsized":"2023-11-24T06:16:47.867040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:29.319849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.852446+0000","last_change":"2023-11-24T06:16:47.852446+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.852446+0000","last_undegraded":"2023-11-24T06:16:47.852446+0000","last_fullsized":"2023-11-24T06:16:47.852446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.872583+0000","last_change":"2023-11-24T06:16:47.859106+0000","last_active":"2023-11-24T06:16:48.872583+0000","last_peered":"2023-11-24T06:16:48.872583+0000","last_clean":"2023-11-24T06:16:48.872583+0000","last_became_active":"2023-11-24T06:16:47.858851+0000","last_became_peered":"2023-11-24T06:16:47.858851+0000","last_unstale":"2023-11-24T06:16:48.872583+0000","last_undegraded":"2023-11-24T06:16:48.872583+0000","last_fullsized":"2023-11-24T06:16:48.872583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.878050+0000","last_change":"2023-11-24T06:16:48.878050+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.878050+0000","last_undegraded":"2023-11-24T06:16:48.878050+0000","last_fullsized":"2023-11-24T06:16:48.878050+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864999+0000","last_change":"2023-11-24T06:16:47.867455+0000","last_active":"2023-11-24T06:16:48.864999+0000","last_peered":"2023-11-24T06:16:48.864999+0000","last_clean":"2023-11-24T06:16:48.864999+0000","last_became_active":"2023-11-24T06:16:47.867160+0000","last_became_peered":"2023-11-24T06:16:47.867160+0000","last_unstale":"2023-11-24T06:16:48.864999+0000","last_undegraded":"2023-11-24T06:16:48.864999+0000","last_fullsized":"2023-11-24T06:16:48.864999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:48.066853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-24T06:16:47.863041+0000","last_change":"2023-11-24T06:16:47.863041+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:47.863041+0000","last_undegraded":"2023-11-24T06:16:47.863041+0000","last_fullsized":"2023-11-24T06:16:47.863041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.870718+0000","last_change":"2023-11-24T06:16:47.869254+0000","last_active":"2023-11-24T06:16:48.870718+0000","last_peered":"2023-11-24T06:16:48.870718+0000","last_clean":"2023-11-24T06:16:48.870718+0000","last_became_active":"2023-11-24T06:16:47.868976+0000","last_became_peered":"2023-11-24T06:16:47.868976+0000","last_unstale":"2023-11-24T06:16:48.870718+0000","last_undegraded":"2023-11-24T06:16:48.870718+0000","last_fullsized":"2023-11-24T06:16:48.870718+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.889009+0000","last_change":"2023-11-24T06:16:48.889009+0000","last_active":"2023-11-24T06:16:48.889009+0000","last_peered":"2023-11-24T06:16:48.889009+0000","last_clean":"2023-11-24T06:16:48.889009+0000","last_became_active":"2023-11-24T06:16:48.888731+0000","last_became_peered":"2023-11-24T06:16:48.888731+0000","last_unstale":"2023-11-24T06:16:48.889009+0000","last_undegraded":"2023-11-24T06:16:48.889009+0000","last_fullsized":"2023-11-24T06:16:48.889009+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:53.231928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.864877+0000","last_change":"2023-11-24T06:16:47.869741+0000","last_active":"2023-11-24T06:16:48.864877+0000","last_peered":"2023-11-24T06:16:48.864877+0000","last_clean":"2023-11-24T06:16:48.864877+0000","last_became_active":"2023-11-24T06:16:47.869465+0000","last_became_peered":"2023-11-24T06:16:47.869465+0000","last_unstale":"2023-11-24T06:16:48.864877+0000","last_undegraded":"2023-11-24T06:16:48.864877+0000","last_fullsized":"2023-11-24T06:16:48.864877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:06.921054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":4,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.887384+0000","last_change":"2023-11-24T06:16:48.876908+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.887384+0000","last_undegraded":"2023-11-24T06:16:48.887384+0000","last_fullsized":"2023-11-24T06:16:48.887384+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.886988+0000","last_change":"2023-11-24T06:16:47.871713+0000","last_active":"2023-11-24T06:16:48.886988+0000","last_peered":"2023-11-24T06:16:48.886988+0000","last_clean":"2023-11-24T06:16:48.886988+0000","last_became_active":"2023-11-24T06:16:47.870883+0000","last_became_peered":"2023-11-24T06:16:47.870883+0000","last_unstale":"2023-11-24T06:16:48.886988+0000","last_undegraded":"2023-11-24T06:16:48.886988+0000","last_fullsized":"2023-11-24T06:16:48.886988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:19:32.348025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":3,"reported_epoch":52,"state":"creating+activating","last_fresh":"2023-11-24T06:16:48.876562+0000","last_change":"2023-11-24T06:16:48.876562+0000","last_active":"2023-11-24T06:16:47.825983+0000","last_peered":"2023-11-24T06:16:47.825983+0000","last_clean":"2023-11-24T06:16:47.825983+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T06:16:48.876562+0000","last_undegraded":"2023-11-24T06:16:48.876562+0000","last_fullsized":"2023-11-24T06:16:48.876562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-24T06:16:47.872126+0000","last_change":"2023-11-24T06:16:47.868677+0000","last_active":"2023-11-24T06:16:47.872126+0000","last_peered":"2023-11-24T06:16:47.872126+0000","last_clean":"2023-11-24T06:16:47.872126+0000","last_became_active":"2023-11-24T06:16:47.868343+0000","last_became_peered":"2023-11-24T06:16:47.868343+0000","last_unstale":"2023-11-24T06:16:47.872126+0000","last_undegraded":"2023-11-24T06:16:47.872126+0000","last_fullsized":"2023-11-24T06:16:47.872126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:23.063822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-24T06:16:46.845772+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:16:46.845772+0000","last_peered":"2023-11-24T06:16:46.845772+0000","last_clean":"2023-11-24T06:16:46.845772+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:16:46.845772+0000","last_undegraded":"2023-11-24T06:16:46.845772+0000","last_fullsized":"2023-11-24T06:16:46.845772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1204224,"data_stored":848913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.012,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.24}]},{"osd":1,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.536,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.171},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2430000000000001},"min":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.6220000000000001,"5min":2.004,"15min":2.004},"last":1.014}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.198},"min":{"1min":0.79700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.288},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1579999999999999,"15min":1.153},"min":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.637,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.107}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.234,"15min":1.23},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8069999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.337,"15min":1.339},"min":{"1min":0.95999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.71,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.472}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.351,"15min":1.347},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.454,"5min":1.4590000000000001,"15min":1.46},"min":{"1min":1.139,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.873,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.7050000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4430000000000001,"15min":1.4390000000000001},"min":{"1min":0.89800000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.704,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.4790000000000001,"15min":1.4850000000000001},"min":{"1min":1.0980000000000001,"5min":1.022,"15min":1.022},"max":{"1min":1.8300000000000001,"5min":1.944,"15min":1.944},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5429999999999999,"15min":1.55},"min":{"1min":1.042,"5min":0.623,"15min":0.623},"max":{"1min":1.7589999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.379},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.476,"15min":1.48},"min":{"1min":0.95699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6859999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.7949999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.72699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.52,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.0269999999999999,"15min":1.016},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.135}]},{"osd":1,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5660000000000001,"5min":1.615,"15min":1.615},"last":1.012},{"interface":"front","average":{"1min":1.145,"5min":1.181,"15min":1.1870000000000001},"min":{"1min":0.76100000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6419999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.2370000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.323,"15min":1.325},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9339999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.351,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.645,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.367}]},{"osd":3,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.359,"15min":1.3779999999999999},"min":{"1min":0.90300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0350000000000001,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.296,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9119999999999999,"5min":2.056,"15min":2.056},"last":1.302}]},{"osd":4,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4470000000000001,"15min":1.456},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8029999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.506,"5min":1.5389999999999999,"15min":1.5449999999999999},"min":{"1min":0.80500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0219999999999998,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.5780000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.4650000000000001},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.825,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.635,"15min":1.641},"min":{"1min":0.71399999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0649999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.518}]},{"osd":7,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.5509999999999999,"15min":1.5389999999999999},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9079999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.665},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.498,"15min":1.484},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.024,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.8200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0449999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.464,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5429999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.5429999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1579999999999999,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.619,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.292,"15min":1.3069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.542,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.3029999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2629999999999999,"15min":1.2709999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.444},"min":{"1min":0.98199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0720000000000001,"5min":2.198,"15min":2.198},"last":1.4099999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6359999999999999,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.028},{"interface":"front","average":{"1min":1.407,"5min":1.4450000000000001,"15min":1.4510000000000001},"min":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.9470000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6659999999999999,"5min":2.427,"15min":2.427},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4670000000000001,"15min":1.4830000000000001},"min":{"1min":0.83299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8680000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.5780000000000001,"15min":1.5940000000000001},"min":{"1min":1.1000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8029999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.587,"15min":1.6200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8069999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.6739999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.651,"15min":1.663},"min":{"1min":1.042,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0230000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.706,"15min":1.712},"min":{"1min":1.234,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1789999999999998,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.6180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0129999999999999,"15min":0.997},"min":{"1min":0.69699999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.073,"15min":1.069},"min":{"1min":0.77800000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.115}]},{"osd":1,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.083,"15min":1.0780000000000001},"min":{"1min":0.73399999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.88900000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.71,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.383}]},{"osd":2,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.216,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.766,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.87},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.232,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5820000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.339},"min":{"1min":0.95099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.643,"5min":2.089,"15min":2.089},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3360000000000001,"15min":1.337},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.873,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.167}]},{"osd":5,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3899999999999999,"15min":1.4019999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.234}]},{"osd":6,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.6100000000000001,"15min":1.6240000000000001},"min":{"1min":1.1819999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2730000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.5840000000000001,"15min":1.595},"min":{"1min":1.0920000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.1789999999999998,"5min":2.222,"15min":2.222},"last":1.339}]},{"osd":7,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.5069999999999999,"15min":1.524},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.3},{"interface":"front","average":{"1min":1.595,"5min":1.7030000000000001,"15min":1.7210000000000001},"min":{"1min":1.2729999999999999,"5min":1.157,"15min":1.157},"max":{"1min":2.0190000000000001,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.591}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.363,"5min":1.71,"15min":1.71},"last":1.268},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.2010000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":0.98099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.242,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.97399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8859999999999999,"5min":1.998,"15min":1.998},"last":1.556}]},{"osd":2,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.673,"5min":1.802,"15min":1.802},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1000000000000001,"15min":1.095},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.667,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.706}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":9.7599999999999998,"15min":11.188000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.833,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.4139999999999999,"15min":1.448},"min":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.714,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.095}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.4450000000000001,"15min":1.4770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9370000000000001,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.399,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9159999999999999,"5min":4.274,"15min":4.274},"last":1.9410000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.7669999999999999,"15min":1.825},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.1190000000000002,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":2.0190000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.399,"15min":1.4219999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0369999999999999,"5min":3.157,"15min":3.157},"last":1.623}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5389999999999999,"15min":1.5680000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1709999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1829999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.6850000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2190000000000001,"5min":1.304,"15min":1.304},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.3109999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0589999999999999,"15min":1.0680000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6879999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.357,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.131,"15min":1.137},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6950000000000001,"5min":2.355,"15min":2.355},"last":1.278},{"interface":"front","average":{"1min":1.159,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.24}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3,"15min":1.294},"min":{"1min":0.85499999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.875,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.157},{"interface":"front","average":{"1min":1.468,"5min":1.4490000000000001,"15min":1.446},"min":{"1min":0.95499999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0979999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4990000000000001,"15min":1.502},"min":{"1min":0.95899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.347},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3979999999999999,"15min":1.3999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7869999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.038}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5349999999999999,"15min":1.5389999999999999},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.4119999999999999,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.591,"15min":1.589},"min":{"1min":0.92100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.518}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.544,"15min":1.5509999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0070000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.577,"15min":1.5840000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.266,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.798}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":258545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1830000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1,"5min":1.002,"15min":1.002},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.879,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.1439999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.999,"15min":1.0089999999999999},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.6000000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.2450000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.712,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.907,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.712,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.3200000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.365,"15min":1.393},"min":{"1min":0.84599999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.609,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.607},{"interface":"front","average":{"1min":1.337,"5min":1.5209999999999999,"15min":1.552},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7769999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.3660000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.621,"15min":1.661},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8360000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.554},{"interface":"front","average":{"1min":1.341,"5min":1.6799999999999999,"15min":1.736},"min":{"1min":0.91200000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5860000000000001,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.397}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5760000000000001,"15min":1.5960000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.246,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.8320000000000001,"15min":1.8879999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1619999999999999,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.6459999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5960000000000001,"15min":1.6080000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.004,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.7},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.611,"15min":1.639},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.8240000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.522}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":848913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.97399999999999998,"15min":0.96999999999999997},"min":{"1min":0.53800000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6919999999999999,"5min":2.452,"15min":2.452},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.056,"15min":1.0740000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3360000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.88100000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2529999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6950000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.113,"15min":1.131},"min":{"1min":0.498,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":3.411,"15min":3.411},"last":1.2290000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.645,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.419},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.258,"15min":1.264},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.579,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.0669999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.446,"15min":1.452},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7949999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.575,"15min":1.605},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9379999999999999,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.6599999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.532,"15min":1.5469999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0150000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5469999999999999,"15min":1.5680000000000001},"min":{"1min":0.876,"5min":0.875,"15min":0.875},"max":{"1min":2.0019999999999998,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.4790000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.9039999999999999,"15min":1.9870000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0510000000000002,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.7989999999999999,"15min":1.847},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9470000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.393}]},{"osd":7,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.95599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0379999999999998,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.708},{"interface":"front","average":{"1min":1.536,"5min":1.841,"15min":1.8919999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0609999999999999,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.5289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:54.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-11-24T06:16:54.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.888238+0000', 'last_change': '2023-11-24T06:16:48.888238+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.888238+0000', 'last_undegraded': '2023-11-24T06:16:48.888238+0000', 'last_fullsized': '2023-11-24T06:16:48.888238+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T11:29:54.224214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:16:54.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-11-24T06:16:54.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.882218+0000', 'last_change': '2023-11-24T06:16:48.882218+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.882218+0000', 'last_undegraded': '2023-11-24T06:16:48.882218+0000', 'last_fullsized': '2023-11-24T06:16:48.882218+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T06:20:49.541590+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.866046+0000', 'last_change': '2023-11-24T06:16:47.866046+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.866046+0000', 'last_undegraded': '2023-11-24T06:16:47.866046+0000', 'last_fullsized': '2023-11-24T06:16:47.866046+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.866210+0000', 'last_change': '2023-11-24T06:16:48.866210+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.866210+0000', 'last_undegraded': '2023-11-24T06:16:48.866210+0000', 'last_fullsized': '2023-11-24T06:16:48.866210+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T15:39:38.395169+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.881698+0000', 'last_change': '2023-11-24T06:16:48.881698+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.881698+0000', 'last_undegraded': '2023-11-24T06:16:48.881698+0000', 'last_fullsized': '2023-11-24T06:16:48.881698+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T08:17:53.485974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.852166+0000', 'last_change': '2023-11-24T06:16:47.852166+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.852166+0000', 'last_undegraded': '2023-11-24T06:16:47.852166+0000', 'last_fullsized': '2023-11-24T06:16:47.852166+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-11-24T06:16:54.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.869228+0000', 'last_change': '2023-11-24T06:16:48.869228+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.869228+0000', 'last_undegraded': '2023-11-24T06:16:48.869228+0000', 'last_fullsized': '2023-11-24T06:16:48.869228+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T18:13:06.358345+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.877814+0000', 'last_change': '2023-11-24T06:16:48.877814+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.877814+0000', 'last_undegraded': '2023-11-24T06:16:48.877814+0000', 'last_fullsized': '2023-11-24T06:16:48.877814+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.869253+0000', 'last_change': '2023-11-24T06:16:48.869253+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.869253+0000', 'last_undegraded': '2023-11-24T06:16:48.869253+0000', 'last_fullsized': '2023-11-24T06:16:48.869253+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.865859+0000', 'last_change': '2023-11-24T06:16:48.865859+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.865859+0000', 'last_undegraded': '2023-11-24T06:16:48.865859+0000', 'last_fullsized': '2023-11-24T06:16:48.865859+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T16:36:58.891919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.866143+0000', 'last_change': '2023-11-24T06:16:48.866143+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.866143+0000', 'last_undegraded': '2023-11-24T06:16:48.866143+0000', 'last_fullsized': '2023-11-24T06:16:48.866143+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.854247+0000', 'last_change': '2023-11-24T06:16:47.854247+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.854247+0000', 'last_undegraded': '2023-11-24T06:16:47.854247+0000', 'last_fullsized': '2023-11-24T06:16:47.854247+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.870028+0000', 'last_change': '2023-11-24T06:16:48.870028+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.870028+0000', 'last_undegraded': '2023-11-24T06:16:48.870028+0000', 'last_fullsized': '2023-11-24T06:16:48.870028+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T10:23:29.258259+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.868735+0000', 'last_change': '2023-11-24T06:16:48.868735+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.868735+0000', 'last_undegraded': '2023-11-24T06:16:48.868735+0000', 'last_fullsized': '2023-11-24T06:16:48.868735+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T14:35:53.231928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': ['4', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.852897+0000', 'last_change': '2023-11-24T06:16:47.852897+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.852897+0000', 'last_undegraded': '2023-11-24T06:16:47.852897+0000', 'last_fullsized': '2023-11-24T06:16:47.852897+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-11-24T06:16:54.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.887667+0000', 'last_change': '2023-11-24T06:16:48.887667+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.887667+0000', 'last_undegraded': '2023-11-24T06:16:48.887667+0000', 'last_fullsized': '2023-11-24T06:16:48.887667+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T13:28:32.474805+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.866187+0000', 'last_change': '2023-11-24T06:16:47.866187+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.866187+0000', 'last_undegraded': '2023-11-24T06:16:47.866187+0000', 'last_fullsized': '2023-11-24T06:16:47.866187+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.890640+0000', 'last_change': '2023-11-24T06:16:48.890640+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.890640+0000', 'last_undegraded': '2023-11-24T06:16:48.890640+0000', 'last_fullsized': '2023-11-24T06:16:48.890640+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T10:31:56.753495+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.880622+0000', 'last_change': '2023-11-24T06:16:48.880622+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.880622+0000', 'last_undegraded': '2023-11-24T06:16:48.880622+0000', 'last_fullsized': '2023-11-24T06:16:48.880622+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T14:47:32.077444+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.865010+0000', 'last_change': '2023-11-24T06:16:47.865010+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.865010+0000', 'last_undegraded': '2023-11-24T06:16:47.865010+0000', 'last_fullsized': '2023-11-24T06:16:47.865010+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-11-24T06:16:54.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.879338+0000', 'last_change': '2023-11-24T06:16:48.879338+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.879338+0000', 'last_undegraded': '2023-11-24T06:16:48.879338+0000', 'last_fullsized': '2023-11-24T06:16:48.879338+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.861382+0000', 'last_change': '2023-11-24T06:16:47.861382+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.861382+0000', 'last_undegraded': '2023-11-24T06:16:47.861382+0000', 'last_fullsized': '2023-11-24T06:16:47.861382+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.853738+0000', 'last_change': '2023-11-24T06:16:47.853738+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.853738+0000', 'last_undegraded': '2023-11-24T06:16:47.853738+0000', 'last_fullsized': '2023-11-24T06:16:47.853738+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.884018+0000', 'last_change': '2023-11-24T06:16:48.884018+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.884018+0000', 'last_undegraded': '2023-11-24T06:16:48.884018+0000', 'last_fullsized': '2023-11-24T06:16:48.884018+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T12:27:51.044525+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.873446+0000', 'last_change': '2023-11-24T06:16:48.873446+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.873446+0000', 'last_undegraded': '2023-11-24T06:16:48.873446+0000', 'last_fullsized': '2023-11-24T06:16:48.873446+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T15:15:42.334420+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': ['5', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-11-24T06:16:54.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.863359+0000', 'last_change': '2023-11-24T06:16:47.863359+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.863359+0000', 'last_undegraded': '2023-11-24T06:16:47.863359+0000', 'last_fullsized': '2023-11-24T06:16:47.863359+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.882110+0000', 'last_change': '2023-11-24T06:16:48.882110+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.882110+0000', 'last_undegraded': '2023-11-24T06:16:48.882110+0000', 'last_fullsized': '2023-11-24T06:16:48.882110+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T17:56:20.275650+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.882757+0000', 'last_change': '2023-11-24T06:16:48.882757+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.882757+0000', 'last_undegraded': '2023-11-24T06:16:48.882757+0000', 'last_fullsized': '2023-11-24T06:16:48.882757+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T08:05:20.197865+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.863533+0000', 'last_change': '2023-11-24T06:16:47.863533+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.863533+0000', 'last_undegraded': '2023-11-24T06:16:47.863533+0000', 'last_fullsized': '2023-11-24T06:16:47.863533+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.878935+0000', 'last_change': '2023-11-24T06:16:48.878935+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.878935+0000', 'last_undegraded': '2023-11-24T06:16:48.878935+0000', 'last_fullsized': '2023-11-24T06:16:48.878935+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T08:56:05.112330+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-11-24T06:16:54.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.852241+0000', 'last_change': '2023-11-24T06:16:47.852241+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.852241+0000', 'last_undegraded': '2023-11-24T06:16:47.852241+0000', 'last_fullsized': '2023-11-24T06:16:47.852241+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.855447+0000', 'last_change': '2023-11-24T06:16:47.855447+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.855447+0000', 'last_undegraded': '2023-11-24T06:16:47.855447+0000', 'last_fullsized': '2023-11-24T06:16:47.855447+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.866318+0000', 'last_change': '2023-11-24T06:16:48.866318+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.866318+0000', 'last_undegraded': '2023-11-24T06:16:48.866318+0000', 'last_fullsized': '2023-11-24T06:16:48.866318+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T12:24:09.576866+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.859889+0000', 'last_change': '2023-11-24T06:16:47.859889+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.859889+0000', 'last_undegraded': '2023-11-24T06:16:47.859889+0000', 'last_fullsized': '2023-11-24T06:16:47.859889+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.861396+0000', 'last_change': '2023-11-24T06:16:47.861396+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.861396+0000', 'last_undegraded': '2023-11-24T06:16:47.861396+0000', 'last_fullsized': '2023-11-24T06:16:47.861396+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-11-24T06:16:54.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.878811+0000', 'last_change': '2023-11-24T06:16:48.878811+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.878811+0000', 'last_undegraded': '2023-11-24T06:16:48.878811+0000', 'last_fullsized': '2023-11-24T06:16:48.878811+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.881642+0000', 'last_change': '2023-11-24T06:16:48.881642+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.881642+0000', 'last_undegraded': '2023-11-24T06:16:48.881642+0000', 'last_fullsized': '2023-11-24T06:16:48.881642+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T13:09:36.957387+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.852539+0000', 'last_change': '2023-11-24T06:16:47.852539+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.852539+0000', 'last_undegraded': '2023-11-24T06:16:47.852539+0000', 'last_fullsized': '2023-11-24T06:16:47.852539+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.883129+0000', 'last_change': '2023-11-24T06:16:48.883129+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.883129+0000', 'last_undegraded': '2023-11-24T06:16:48.883129+0000', 'last_fullsized': '2023-11-24T06:16:48.883129+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:53:39.715380+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.868830+0000', 'last_change': '2023-11-24T06:16:48.868830+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.868830+0000', 'last_undegraded': '2023-11-24T06:16:48.868830+0000', 'last_fullsized': '2023-11-24T06:16:48.868830+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T10:43:56.808592+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': ['4', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:54.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.863834+0000', 'last_change': '2023-11-24T06:16:47.863834+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.863834+0000', 'last_undegraded': '2023-11-24T06:16:47.863834+0000', 'last_fullsized': '2023-11-24T06:16:47.863834+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.865500+0000', 'last_change': '2023-11-24T06:16:47.865500+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.865500+0000', 'last_undegraded': '2023-11-24T06:16:47.865500+0000', 'last_fullsized': '2023-11-24T06:16:47.865500+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.866162+0000', 'last_change': '2023-11-24T06:16:48.866162+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.866162+0000', 'last_undegraded': '2023-11-24T06:16:48.866162+0000', 'last_fullsized': '2023-11-24T06:16:48.866162+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T17:01:26.380862+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.863994+0000', 'last_change': '2023-11-24T06:16:47.863994+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.863994+0000', 'last_undegraded': '2023-11-24T06:16:47.863994+0000', 'last_fullsized': '2023-11-24T06:16:47.863994+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.872366+0000', 'last_change': '2023-11-24T06:16:48.872366+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.872366+0000', 'last_undegraded': '2023-11-24T06:16:48.872366+0000', 'last_fullsized': '2023-11-24T06:16:48.872366+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T14:38:38.185771+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T06:16:54.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.860832+0000', 'last_change': '2023-11-24T06:16:47.860832+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.860832+0000', 'last_undegraded': '2023-11-24T06:16:47.860832+0000', 'last_fullsized': '2023-11-24T06:16:47.860832+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.864486+0000', 'last_change': '2023-11-24T06:16:47.864486+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.864486+0000', 'last_undegraded': '2023-11-24T06:16:47.864486+0000', 'last_fullsized': '2023-11-24T06:16:47.864486+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.870396+0000', 'last_change': '2023-11-24T06:16:48.870396+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.870396+0000', 'last_undegraded': '2023-11-24T06:16:48.870396+0000', 'last_fullsized': '2023-11-24T06:16:48.870396+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T11:28:54.444313+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.878781+0000', 'last_change': '2023-11-24T06:16:48.878781+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.878781+0000', 'last_undegraded': '2023-11-24T06:16:48.878781+0000', 'last_fullsized': '2023-11-24T06:16:48.878781+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-11-24T06:16:54.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.864888+0000', 'last_change': '2023-11-24T06:16:47.864888+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.864888+0000', 'last_undegraded': '2023-11-24T06:16:47.864888+0000', 'last_fullsized': '2023-11-24T06:16:47.864888+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.868427+0000', 'last_change': '2023-11-24T06:16:48.868427+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.868427+0000', 'last_undegraded': '2023-11-24T06:16:48.868427+0000', 'last_fullsized': '2023-11-24T06:16:48.868427+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T07:25:51.143846+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.855859+0000', 'last_change': '2023-11-24T06:16:47.855859+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.855859+0000', 'last_undegraded': '2023-11-24T06:16:47.855859+0000', 'last_fullsized': '2023-11-24T06:16:47.855859+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.856807+0000', 'last_change': '2023-11-24T06:16:47.856807+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.856807+0000', 'last_undegraded': '2023-11-24T06:16:47.856807+0000', 'last_fullsized': '2023-11-24T06:16:47.856807+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.867777+0000', 'last_change': '2023-11-24T06:16:48.867777+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.867777+0000', 'last_undegraded': '2023-11-24T06:16:48.867777+0000', 'last_fullsized': '2023-11-24T06:16:48.867777+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T11:35:07.956711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-11-24T06:16:54.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.869296+0000', 'last_change': '2023-11-24T06:16:48.869296+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.869296+0000', 'last_undegraded': '2023-11-24T06:16:48.869296+0000', 'last_fullsized': '2023-11-24T06:16:48.869296+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T12:17:03.506194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.852446+0000', 'last_change': '2023-11-24T06:16:47.852446+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.852446+0000', 'last_undegraded': '2023-11-24T06:16:47.852446+0000', 'last_fullsized': '2023-11-24T06:16:47.852446+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.878050+0000', 'last_change': '2023-11-24T06:16:48.878050+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.878050+0000', 'last_undegraded': '2023-11-24T06:16:48.878050+0000', 'last_fullsized': '2023-11-24T06:16:48.878050+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-11-24T06:16:47.863041+0000', 'last_change': '2023-11-24T06:16:47.863041+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:47.863041+0000', 'last_undegraded': '2023-11-24T06:16:47.863041+0000', 'last_fullsized': '2023-11-24T06:16:47.863041+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.887384+0000', 'last_change': '2023-11-24T06:16:48.876908+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.887384+0000', 'last_undegraded': '2023-11-24T06:16:48.887384+0000', 'last_fullsized': '2023-11-24T06:16:48.887384+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-11-24T06:16:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 52, 'state': 'creating+activating', 'last_fresh': '2023-11-24T06:16:48.876562+0000', 'last_change': '2023-11-24T06:16:48.876562+0000', 'last_active': '2023-11-24T06:16:47.825983+0000', 'last_peered': '2023-11-24T06:16:47.825983+0000', 'last_clean': '2023-11-24T06:16:47.825983+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T06:16:48.876562+0000', 'last_undegraded': '2023-11-24T06:16:48.876562+0000', 'last_fullsized': '2023-11-24T06:16:48.876562+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'last_clean_scrub_stamp': '2023-11-24T06:16:47.825983+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-24T06:16:54.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T06:16:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.669+0000 7fe7615cf640 1 Processor -- start 2023-11-24T06:16:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.669+0000 7fe7615cf640 1 -- start start 2023-11-24T06:16:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.671+0000 7fe7615cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c15c410 0x7fe75c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.671+0000 7fe7615cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe75c0b1de0 0x7fe75c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.671+0000 7fe7615cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c15bf80 con 0x7fe75c144b30 2023-11-24T06:16:54.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.671+0000 7fe7615cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0b27b0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.671+0000 7fe7615cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0b1560 con 0x7fe75c15c410 2023-11-24T06:16:54.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.672+0000 7fe760dce640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe75c0b1de0 0x7fe75c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.672+0000 7fe753fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c15c410 0x7fe75c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.672+0000 7fe75bfff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe75c144b30 0x7fe75c0b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:40952/0 (socket says 172.21.15.37:40952) 2023-11-24T06:16:54.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.672+0000 7fe75bfff640 1 -- 172.21.15.37:0/29237349 learned_addr learned my addr 172.21.15.37:0/29237349 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:54.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.673+0000 7fe760dce640 1 -- 172.21.15.37:0/29237349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c15c410 msgr2=0x7fe75c15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.673+0000 7fe760dce640 1 --2- 172.21.15.37:0/29237349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c15c410 0x7fe75c15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.673+0000 7fe760dce640 1 -- 172.21.15.37:0/29237349 >> v1:172.21.15.188:6789/0 conn(0x7fe75c144b30 legacy=0x7fe75c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.673+0000 7fe760dce640 1 -- 172.21.15.37:0/29237349 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0b1280 con 0x7fe75c0b1de0 2023-11-24T06:16:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.674+0000 7fe760dce640 1 --2- 172.21.15.37:0/29237349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c0b1de0 0x7fe75c0b2270 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe754009d90 tx=0x7fe75402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12ac380b067628fc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.675+0000 7fe75b7fe640 1 -- 172.21.15.37:0/29237349 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75402cc60 con 0x7fe75c0b1de0 2023-11-24T06:16:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.675+0000 7fe75b7fe640 1 -- 172.21.15.37:0/29237349 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75402cdc0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.675+0000 7fe75b7fe640 1 -- 172.21.15.37:0/29237349 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754034660 con 0x7fe75c0b1de0 2023-11-24T06:16:54.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 -- 172.21.15.37:0/29237349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c0b1de0 msgr2=0x7fe75c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 --2- 172.21.15.37:0/29237349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c0b1de0 0x7fe75c0b2270 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe754009d90 tx=0x7fe75402beb0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 -- 172.21.15.37:0/29237349 shutdown_connections 2023-11-24T06:16:54.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 --2- 172.21.15.37:0/29237349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c0b1de0 0x7fe75c0b2270 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 --2- 172.21.15.37:0/29237349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c15c410 0x7fe75c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 -- 172.21.15.37:0/29237349 >> 172.21.15.37:0/29237349 conn(0x7fe75c0cb830 msgr2=0x7fe75c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 -- 172.21.15.37:0/29237349 shutdown_connections 2023-11-24T06:16:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.676+0000 7fe7615cf640 1 -- 172.21.15.37:0/29237349 wait complete. 2023-11-24T06:16:54.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.678+0000 7fe7615cf640 1 Processor -- start 2023-11-24T06:16:54.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.678+0000 7fe7615cf640 1 -- start start 2023-11-24T06:16:54.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe7615cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe75c0b1de0 0x7fe75c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe7615cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c144b30 0x7fe75c1425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe7615cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c15c410 0x7fe75c1ee990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe7615cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c1421a0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe7615cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c1ef960 con 0x7fe75c15c410 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe7615cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c1ef3a0 con 0x7fe75c144b30 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe75bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe75c0b1de0 0x7fe75c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe75bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe75c0b1de0 0x7fe75c15a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43664/0 (socket says 172.21.15.37:43664) 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe75bfff640 1 -- 172.21.15.37:0/4246953217 learned_addr learned my addr 172.21.15.37:0/4246953217 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe760dce640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c15c410 0x7fe75c1ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.680+0000 7fe753fff640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c144b30 0x7fe75c1425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe75bfff640 1 -- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c144b30 msgr2=0x7fe75c1425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe75bfff640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c144b30 0x7fe75c1425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe75bfff640 1 -- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c15c410 msgr2=0x7fe75c1ee990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe75bfff640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c15c410 0x7fe75c1ee990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe75bfff640 1 -- 172.21.15.37:0/4246953217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754009a70 con 0x7fe75c0b1de0 2023-11-24T06:16:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe75bfff640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe75c0b1de0 0x7fe75c15a990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c400 tx=0x7fe74c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe7597fa640 1 -- 172.21.15.37:0/4246953217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c005ce0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe7597fa640 1 -- 172.21.15.37:0/4246953217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c005e40 con 0x7fe75c0b1de0 2023-11-24T06:16:54.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c1ef680 con 0x7fe75c0b1de0 2023-11-24T06:16:54.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.681+0000 7fe7597fa640 1 -- 172.21.15.37:0/4246953217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0072d0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.682+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c15aed0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.683+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c0b3610 con 0x7fe75c0b1de0 2023-11-24T06:16:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.684+0000 7fe7597fa640 1 -- 172.21.15.37:0/4246953217 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe74c0074f0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.685+0000 7fe7597fa640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe73c06ae40 0x7fe73c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:54.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.685+0000 7fe7597fa640 1 -- 172.21.15.37:0/4246953217 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe74c088ba0 con 0x7fe75c0b1de0 2023-11-24T06:16:54.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.685+0000 7fe753fff640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe73c06ae40 0x7fe73c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:54.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.686+0000 7fe753fff640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe73c06ae40 0x7fe73c06d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe75c15d7e0 tx=0x7fe744008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:54.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.689+0000 7fe7597fa640 1 -- 172.21.15.37:0/4246953217 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe75c0b3610 con 0x7fe75c0b1de0 2023-11-24T06:16:54.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.958+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe75c0b3610 con 0x7fe75c0b1de0 2023-11-24T06:16:54.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.959+0000 7fe7597fa640 1 -- 172.21.15.37:0/4246953217 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7fe75c0b3610 con 0x7fe75c0b1de0 2023-11-24T06:16:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:54.962 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1700806478,"num_in_osds":8,"osd_in_since":1700806469,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":240492544,"bytes_avail":772853620736,"bytes_total":773094113280,"write_bytes_sec":2042,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5568}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-24T06:16:32.846640+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-24T06:16:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe73c06ae40 msgr2=0x7fe73c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe73c06ae40 0x7fe73c06d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe75c15d7e0 tx=0x7fe744008040 comp rx=0 tx=0).stop 2023-11-24T06:16:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe75c0b1de0 msgr2=0x7fe75c15a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe75c0b1de0 0x7fe75c15a990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c400 tx=0x7fe74c00c8c0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 shutdown_connections 2023-11-24T06:16:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe73c06ae40 0x7fe73c06d300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75c15c410 0x7fe75c1ee990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75c144b30 0x7fe75c1425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 --2- 172.21.15.37:0/4246953217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe75c0b1de0 0x7fe75c15a990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 >> 172.21.15.37:0/4246953217 conn(0x7fe75c0cb830 msgr2=0x7fe75c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 shutdown_connections 2023-11-24T06:16:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:54.962+0000 7fe7615cf640 1 -- 172.21.15.37:0/4246953217 wait complete. 2023-11-24T06:16:54.983 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T06:16:54.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:55.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.200+0000 7f6974fe2640 1 Processor -- start 2023-11-24T06:16:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.200+0000 7f6974fe2640 1 -- start start 2023-11-24T06:16:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.202+0000 7f6974fe2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f697015c410 0x7f697015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.202+0000 7f6974fe2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697015bf80 con 0x7f69700b1de0 2023-11-24T06:16:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.202+0000 7f6974fe2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69700b1560 con 0x7f6970144b30 2023-11-24T06:16:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.202+0000 7f6974fe2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69700b1280 con 0x7f697015c410 2023-11-24T06:16:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.202+0000 7f696effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f697015c410 0x7f697015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.202+0000 7f696ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f69700b1de0 0x7f69700b3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43210/0 (socket says 172.21.15.37:43210) 2023-11-24T06:16:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.202+0000 7f696ffff640 1 -- 172.21.15.37:0/1089912803 learned_addr learned my addr 172.21.15.37:0/1089912803 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:55.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.203+0000 7f696effd640 1 -- 172.21.15.37:0/1089912803 >> v1:172.21.15.188:6789/0 conn(0x7f6970144b30 legacy=0x7f69700b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:55.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.203+0000 7f696effd640 1 -- 172.21.15.37:0/1089912803 >> v1:172.21.15.37:6789/0 conn(0x7f69700b1de0 legacy=0x7f69700b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.203+0000 7f696e7fc640 1 -- 172.21.15.37:0/1089912803 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993407389 0 0) 0x7f697015bf80 con 0x7f69700b1de0 2023-11-24T06:16:55.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.203+0000 7f696effd640 1 -- 172.21.15.37:0/1089912803 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697015b930 con 0x7f697015c410 2023-11-24T06:16:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.204+0000 7f696effd640 1 --2- 172.21.15.37:0/1089912803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f697015c410 0x7f697015f920 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f69640097a0 tx=0x7f696402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1055ff4e3a8108f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.204+0000 7f696e7fc640 1 -- 172.21.15.37:0/1089912803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964031830 con 0x7f697015c410 2023-11-24T06:16:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.204+0000 7f696e7fc640 1 -- 172.21.15.37:0/1089912803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964031990 con 0x7f697015c410 2023-11-24T06:16:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.204+0000 7f696e7fc640 1 -- 172.21.15.37:0/1089912803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964031d20 con 0x7f697015c410 2023-11-24T06:16:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.205+0000 7f6974fe2640 1 -- 172.21.15.37:0/1089912803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f697015c410 msgr2=0x7f697015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.205+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1089912803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f697015c410 0x7f697015f920 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f69640097a0 tx=0x7f696402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.205+0000 7f6974fe2640 1 -- 172.21.15.37:0/1089912803 shutdown_connections 2023-11-24T06:16:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.205+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1089912803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f697015c410 0x7f697015f920 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.205+0000 7f6974fe2640 1 -- 172.21.15.37:0/1089912803 >> 172.21.15.37:0/1089912803 conn(0x7f69700cb830 msgr2=0x7f69700cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.205+0000 7f6974fe2640 1 -- 172.21.15.37:0/1089912803 shutdown_connections 2023-11-24T06:16:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.205+0000 7f6974fe2640 1 -- 172.21.15.37:0/1089912803 wait complete. 2023-11-24T06:16:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.207+0000 7f6974fe2640 1 Processor -- start 2023-11-24T06:16:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.207+0000 7f6974fe2640 1 -- start start 2023-11-24T06:16:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f6974fe2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69700b1de0 0x7f697013e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f6974fe2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6970144b30 0x7f69701408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f6974fe2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f697015c410 0x7f697006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f6974fe2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69701f2f50 con 0x7f6970144b30 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f6974fe2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6970141f30 con 0x7f697015c410 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f6974fe2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697013ed60 con 0x7f69700b1de0 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f696effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6970144b30 0x7f69701408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f696effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6970144b30 0x7f69701408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43686/0 (socket says 172.21.15.37:43686) 2023-11-24T06:16:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.208+0000 7f696effd640 1 -- 172.21.15.37:0/1830595788 learned_addr learned my addr 172.21.15.37:0/1830595788 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696ffff640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f697015c410 0x7f697006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696effd640 1 -- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69700b1de0 msgr2=0x7f697013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696effd640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69700b1de0 0x7f697013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696effd640 1 -- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f697015c410 msgr2=0x7f697006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696effd640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f697015c410 0x7f697006c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696effd640 1 -- 172.21.15.37:0/1830595788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964009400 con 0x7f6970144b30 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696ffff640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f697015c410 0x7f697006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f696effd640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6970144b30 0x7f69701408f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f69640098c0 tx=0x7f69640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f6957fff640 1 -- 172.21.15.37:0/1830595788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696403ba70 con 0x7f6970144b30 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f6957fff640 1 -- 172.21.15.37:0/1830595788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696403bbf0 con 0x7f6970144b30 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69701413b0 con 0x7f6970144b30 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.209+0000 7f6957fff640 1 -- 172.21.15.37:0/1830595788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640453f0 con 0x7f6970144b30 2023-11-24T06:16:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.210+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6970141970 con 0x7f6970144b30 2023-11-24T06:16:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.211+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697004e840 con 0x7f6970144b30 2023-11-24T06:16:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.212+0000 7f6957fff640 1 -- 172.21.15.37:0/1830595788 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f696404e450 con 0x7f6970144b30 2023-11-24T06:16:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.213+0000 7f6957fff640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f695c06ae70 0x7f695c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.213+0000 7f6957fff640 1 -- 172.21.15.37:0/1830595788 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69640ab890 con 0x7f6970144b30 2023-11-24T06:16:55.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.213+0000 7f696f7fe640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f695c06ae70 0x7f695c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:55.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.214+0000 7f696f7fe640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f695c06ae70 0x7f695c06d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6960006fd0 tx=0x7f6960006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:55.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.217+0000 7f6957fff640 1 -- 172.21.15.37:0/1830595788 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6964076940 con 0x7f6970144b30 2023-11-24T06:16:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.413+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69701f3090 con 0x7f695c06ae70 2023-11-24T06:16:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.436+0000 7f6957fff640 1 -- 172.21.15.37:0/1830595788 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286974 (secure 0 0 0) 0x7f69701f3090 con 0x7f695c06ae70 2023-11-24T06:16:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:55.444 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:16:55.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f695c06ae70 msgr2=0x7f695c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f695c06ae70 0x7f695c06d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6960006fd0 tx=0x7f6960006bc0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6970144b30 msgr2=0x7f69701408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6970144b30 0x7f69701408f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f69640098c0 tx=0x7f69640046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 shutdown_connections 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f695c06ae70 0x7f695c06d330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f697015c410 0x7f697006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6970144b30 0x7f69701408f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 --2- 172.21.15.37:0/1830595788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69700b1de0 0x7f697013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 >> 172.21.15.37:0/1830595788 conn(0x7f69700cb830 msgr2=0x7f69700cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:55.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 shutdown_connections 2023-11-24T06:16:55.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:55.443+0000 7f6974fe2640 1 -- 172.21.15.37:0/1830595788 wait complete. 2023-11-24T06:16:55.465 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-11-24T06:16:54.852827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234856,"kb_used_data":6184,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739864,"statfs":{"total":773094113280,"available":772853620736,"internally_reserved":0,"allocated":6332416,"data_stored":3358516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.017594"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731142+0000","last_change":"2023-11-24T06:16:48.913545+0000","last_active":"2023-11-24T06:16:50.731142+0000","last_peered":"2023-11-24T06:16:50.731142+0000","last_clean":"2023-11-24T06:16:50.731142+0000","last_became_active":"2023-11-24T06:16:48.913227+0000","last_became_peered":"2023-11-24T06:16:48.913227+0000","last_unstale":"2023-11-24T06:16:50.731142+0000","last_undegraded":"2023-11-24T06:16:50.731142+0000","last_fullsized":"2023-11-24T06:16:50.731142+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:30.324994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732865+0000","last_change":"2023-11-24T06:16:48.895599+0000","last_active":"2023-11-24T06:16:50.732865+0000","last_peered":"2023-11-24T06:16:50.732865+0000","last_clean":"2023-11-24T06:16:50.732865+0000","last_became_active":"2023-11-24T06:16:48.893366+0000","last_became_peered":"2023-11-24T06:16:48.893366+0000","last_unstale":"2023-11-24T06:16:50.732865+0000","last_undegraded":"2023-11-24T06:16:50.732865+0000","last_fullsized":"2023-11-24T06:16:50.732865+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:06.111030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730318+0000","last_change":"2023-11-24T06:16:48.898042+0000","last_active":"2023-11-24T06:16:50.730318+0000","last_peered":"2023-11-24T06:16:50.730318+0000","last_clean":"2023-11-24T06:16:50.730318+0000","last_became_active":"2023-11-24T06:16:48.897767+0000","last_became_peered":"2023-11-24T06:16:48.897767+0000","last_unstale":"2023-11-24T06:16:50.730318+0000","last_undegraded":"2023-11-24T06:16:50.730318+0000","last_fullsized":"2023-11-24T06:16:50.730318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889413+0000","last_change":"2023-11-24T06:16:48.900822+0000","last_active":"2023-11-24T06:16:49.889413+0000","last_peered":"2023-11-24T06:16:49.889413+0000","last_clean":"2023-11-24T06:16:49.889413+0000","last_became_active":"2023-11-24T06:16:48.900488+0000","last_became_peered":"2023-11-24T06:16:48.900488+0000","last_unstale":"2023-11-24T06:16:49.889413+0000","last_undegraded":"2023-11-24T06:16:49.889413+0000","last_fullsized":"2023-11-24T06:16:49.889413+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730127+0000","last_change":"2023-11-24T06:16:48.913932+0000","last_active":"2023-11-24T06:16:50.730127+0000","last_peered":"2023-11-24T06:16:50.730127+0000","last_clean":"2023-11-24T06:16:50.730127+0000","last_became_active":"2023-11-24T06:16:48.913634+0000","last_became_peered":"2023-11-24T06:16:48.913634+0000","last_unstale":"2023-11-24T06:16:50.730127+0000","last_undegraded":"2023-11-24T06:16:50.730127+0000","last_fullsized":"2023-11-24T06:16:50.730127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:28:01.018131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.505006+0000","last_change":"2023-11-24T06:16:48.921349+0000","last_active":"2023-11-24T06:16:50.505006+0000","last_peered":"2023-11-24T06:16:50.505006+0000","last_clean":"2023-11-24T06:16:50.505006+0000","last_became_active":"2023-11-24T06:16:48.920798+0000","last_became_peered":"2023-11-24T06:16:48.920798+0000","last_unstale":"2023-11-24T06:16:50.505006+0000","last_undegraded":"2023-11-24T06:16:50.505006+0000","last_fullsized":"2023-11-24T06:16:50.505006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887009+0000","last_change":"2023-11-24T06:16:48.879954+0000","last_active":"2023-11-24T06:16:49.887009+0000","last_peered":"2023-11-24T06:16:49.887009+0000","last_clean":"2023-11-24T06:16:49.887009+0000","last_became_active":"2023-11-24T06:16:48.879380+0000","last_became_peered":"2023-11-24T06:16:48.879380+0000","last_unstale":"2023-11-24T06:16:49.887009+0000","last_undegraded":"2023-11-24T06:16:49.887009+0000","last_fullsized":"2023-11-24T06:16:49.887009+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:35.109896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730194+0000","last_change":"2023-11-24T06:16:48.897361+0000","last_active":"2023-11-24T06:16:50.730194+0000","last_peered":"2023-11-24T06:16:50.730194+0000","last_clean":"2023-11-24T06:16:50.730194+0000","last_became_active":"2023-11-24T06:16:48.896864+0000","last_became_peered":"2023-11-24T06:16:48.896864+0000","last_unstale":"2023-11-24T06:16:50.730194+0000","last_undegraded":"2023-11-24T06:16:50.730194+0000","last_fullsized":"2023-11-24T06:16:50.730194+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:06.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889597+0000","last_change":"2023-11-24T06:16:48.907645+0000","last_active":"2023-11-24T06:16:49.889597+0000","last_peered":"2023-11-24T06:16:49.889597+0000","last_clean":"2023-11-24T06:16:49.889597+0000","last_became_active":"2023-11-24T06:16:48.907356+0000","last_became_peered":"2023-11-24T06:16:48.907356+0000","last_unstale":"2023-11-24T06:16:49.889597+0000","last_undegraded":"2023-11-24T06:16:49.889597+0000","last_fullsized":"2023-11-24T06:16:49.889597+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:57.437149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884514+0000","last_change":"2023-11-24T06:16:48.888135+0000","last_active":"2023-11-24T06:16:49.884514+0000","last_peered":"2023-11-24T06:16:49.884514+0000","last_clean":"2023-11-24T06:16:49.884514+0000","last_became_active":"2023-11-24T06:16:48.887851+0000","last_became_peered":"2023-11-24T06:16:48.887851+0000","last_unstale":"2023-11-24T06:16:49.884514+0000","last_undegraded":"2023-11-24T06:16:49.884514+0000","last_fullsized":"2023-11-24T06:16:49.884514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:18.482257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884922+0000","last_change":"2023-11-24T06:16:48.893169+0000","last_active":"2023-11-24T06:16:49.884922+0000","last_peered":"2023-11-24T06:16:49.884922+0000","last_clean":"2023-11-24T06:16:49.884922+0000","last_became_active":"2023-11-24T06:16:48.892881+0000","last_became_peered":"2023-11-24T06:16:48.892881+0000","last_unstale":"2023-11-24T06:16:49.884922+0000","last_undegraded":"2023-11-24T06:16:49.884922+0000","last_fullsized":"2023-11-24T06:16:49.884922+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889644+0000","last_change":"2023-11-24T06:16:48.888588+0000","last_active":"2023-11-24T06:16:49.889644+0000","last_peered":"2023-11-24T06:16:49.889644+0000","last_clean":"2023-11-24T06:16:49.889644+0000","last_became_active":"2023-11-24T06:16:48.888314+0000","last_became_peered":"2023-11-24T06:16:48.888314+0000","last_unstale":"2023-11-24T06:16:49.889644+0000","last_undegraded":"2023-11-24T06:16:49.889644+0000","last_fullsized":"2023-11-24T06:16:49.889644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.510456+0000","last_change":"2023-11-24T06:16:48.903305+0000","last_active":"2023-11-24T06:16:50.510456+0000","last_peered":"2023-11-24T06:16:50.510456+0000","last_clean":"2023-11-24T06:16:50.510456+0000","last_became_active":"2023-11-24T06:16:48.902952+0000","last_became_peered":"2023-11-24T06:16:48.902952+0000","last_unstale":"2023-11-24T06:16:50.510456+0000","last_undegraded":"2023-11-24T06:16:50.510456+0000","last_fullsized":"2023-11-24T06:16:50.510456+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:49.759918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887652+0000","last_change":"2023-11-24T06:16:48.892428+0000","last_active":"2023-11-24T06:16:49.887652+0000","last_peered":"2023-11-24T06:16:49.887652+0000","last_clean":"2023-11-24T06:16:49.887652+0000","last_became_active":"2023-11-24T06:16:48.892155+0000","last_became_peered":"2023-11-24T06:16:48.892155+0000","last_unstale":"2023-11-24T06:16:49.887652+0000","last_undegraded":"2023-11-24T06:16:49.887652+0000","last_fullsized":"2023-11-24T06:16:49.887652+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:26.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887350+0000","last_change":"2023-11-24T06:16:48.888393+0000","last_active":"2023-11-24T06:16:49.887350+0000","last_peered":"2023-11-24T06:16:49.887350+0000","last_clean":"2023-11-24T06:16:49.887350+0000","last_became_active":"2023-11-24T06:16:48.888094+0000","last_became_peered":"2023-11-24T06:16:48.888094+0000","last_unstale":"2023-11-24T06:16:49.887350+0000","last_undegraded":"2023-11-24T06:16:49.887350+0000","last_fullsized":"2023-11-24T06:16:49.887350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504416+0000","last_change":"2023-11-24T06:16:48.908245+0000","last_active":"2023-11-24T06:16:50.504416+0000","last_peered":"2023-11-24T06:16:50.504416+0000","last_clean":"2023-11-24T06:16:50.504416+0000","last_became_active":"2023-11-24T06:16:48.907960+0000","last_became_peered":"2023-11-24T06:16:48.907960+0000","last_unstale":"2023-11-24T06:16:50.504416+0000","last_undegraded":"2023-11-24T06:16:50.504416+0000","last_fullsized":"2023-11-24T06:16:50.504416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:33.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732701+0000","last_change":"2023-11-24T06:16:48.907441+0000","last_active":"2023-11-24T06:16:50.732701+0000","last_peered":"2023-11-24T06:16:50.732701+0000","last_clean":"2023-11-24T06:16:50.732701+0000","last_became_active":"2023-11-24T06:16:48.906560+0000","last_became_peered":"2023-11-24T06:16:48.906560+0000","last_unstale":"2023-11-24T06:16:50.732701+0000","last_undegraded":"2023-11-24T06:16:50.732701+0000","last_fullsized":"2023-11-24T06:16:50.732701+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:49:44.627528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730579+0000","last_change":"2023-11-24T06:16:48.916909+0000","last_active":"2023-11-24T06:16:50.730579+0000","last_peered":"2023-11-24T06:16:50.730579+0000","last_clean":"2023-11-24T06:16:50.730579+0000","last_became_active":"2023-11-24T06:16:48.916641+0000","last_became_peered":"2023-11-24T06:16:48.916641+0000","last_unstale":"2023-11-24T06:16:50.730579+0000","last_undegraded":"2023-11-24T06:16:50.730579+0000","last_fullsized":"2023-11-24T06:16:50.730579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:32.077444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730590+0000","last_change":"2023-11-24T06:16:48.912392+0000","last_active":"2023-11-24T06:16:50.730590+0000","last_peered":"2023-11-24T06:16:50.730590+0000","last_clean":"2023-11-24T06:16:50.730590+0000","last_became_active":"2023-11-24T06:16:48.911964+0000","last_became_peered":"2023-11-24T06:16:48.911964+0000","last_unstale":"2023-11-24T06:16:50.730590+0000","last_undegraded":"2023-11-24T06:16:50.730590+0000","last_fullsized":"2023-11-24T06:16:50.730590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:41.099208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732471+0000","last_change":"2023-11-24T06:16:48.907459+0000","last_active":"2023-11-24T06:16:50.732471+0000","last_peered":"2023-11-24T06:16:50.732471+0000","last_clean":"2023-11-24T06:16:50.732471+0000","last_became_active":"2023-11-24T06:16:48.907162+0000","last_became_peered":"2023-11-24T06:16:48.907162+0000","last_unstale":"2023-11-24T06:16:50.732471+0000","last_undegraded":"2023-11-24T06:16:50.732471+0000","last_fullsized":"2023-11-24T06:16:50.732471+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:59.372732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730205+0000","last_change":"2023-11-24T06:16:48.905138+0000","last_active":"2023-11-24T06:16:50.730205+0000","last_peered":"2023-11-24T06:16:50.730205+0000","last_clean":"2023-11-24T06:16:50.730205+0000","last_became_active":"2023-11-24T06:16:48.904811+0000","last_became_peered":"2023-11-24T06:16:48.904811+0000","last_unstale":"2023-11-24T06:16:50.730205+0000","last_undegraded":"2023-11-24T06:16:50.730205+0000","last_fullsized":"2023-11-24T06:16:50.730205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730895+0000","last_change":"2023-11-24T06:16:48.901835+0000","last_active":"2023-11-24T06:16:50.730895+0000","last_peered":"2023-11-24T06:16:50.730895+0000","last_clean":"2023-11-24T06:16:50.730895+0000","last_became_active":"2023-11-24T06:16:48.901132+0000","last_became_peered":"2023-11-24T06:16:48.901132+0000","last_unstale":"2023-11-24T06:16:50.730895+0000","last_undegraded":"2023-11-24T06:16:50.730895+0000","last_fullsized":"2023-11-24T06:16:50.730895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:00:31.668493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730094+0000","last_change":"2023-11-24T06:16:48.911955+0000","last_active":"2023-11-24T06:16:50.730094+0000","last_peered":"2023-11-24T06:16:50.730094+0000","last_clean":"2023-11-24T06:16:50.730094+0000","last_became_active":"2023-11-24T06:16:48.911607+0000","last_became_peered":"2023-11-24T06:16:48.911607+0000","last_unstale":"2023-11-24T06:16:50.730094+0000","last_undegraded":"2023-11-24T06:16:50.730094+0000","last_fullsized":"2023-11-24T06:16:50.730094+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.510348+0000","last_change":"2023-11-24T06:16:48.916913+0000","last_active":"2023-11-24T06:16:50.510348+0000","last_peered":"2023-11-24T06:16:50.510348+0000","last_clean":"2023-11-24T06:16:50.510348+0000","last_became_active":"2023-11-24T06:16:48.916319+0000","last_became_peered":"2023-11-24T06:16:48.916319+0000","last_unstale":"2023-11-24T06:16:50.510348+0000","last_undegraded":"2023-11-24T06:16:50.510348+0000","last_fullsized":"2023-11-24T06:16:50.510348+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:13:19.985350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731425+0000","last_change":"2023-11-24T06:16:48.915513+0000","last_active":"2023-11-24T06:16:50.731425+0000","last_peered":"2023-11-24T06:16:50.731425+0000","last_clean":"2023-11-24T06:16:50.731425+0000","last_became_active":"2023-11-24T06:16:48.915257+0000","last_became_peered":"2023-11-24T06:16:48.915257+0000","last_unstale":"2023-11-24T06:16:50.731425+0000","last_undegraded":"2023-11-24T06:16:50.731425+0000","last_fullsized":"2023-11-24T06:16:50.731425+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:59.778090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.888650+0000","last_change":"2023-11-24T06:16:48.883233+0000","last_active":"2023-11-24T06:16:49.888650+0000","last_peered":"2023-11-24T06:16:49.888650+0000","last_clean":"2023-11-24T06:16:49.888650+0000","last_became_active":"2023-11-24T06:16:48.882746+0000","last_became_peered":"2023-11-24T06:16:48.882746+0000","last_unstale":"2023-11-24T06:16:49.888650+0000","last_undegraded":"2023-11-24T06:16:49.888650+0000","last_fullsized":"2023-11-24T06:16:49.888650+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:33.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504815+0000","last_change":"2023-11-24T06:16:48.909541+0000","last_active":"2023-11-24T06:16:50.504815+0000","last_peered":"2023-11-24T06:16:50.504815+0000","last_clean":"2023-11-24T06:16:50.504815+0000","last_became_active":"2023-11-24T06:16:48.909260+0000","last_became_peered":"2023-11-24T06:16:48.909260+0000","last_unstale":"2023-11-24T06:16:50.504815+0000","last_undegraded":"2023-11-24T06:16:50.504815+0000","last_fullsized":"2023-11-24T06:16:50.504815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730334+0000","last_change":"2023-11-24T06:16:48.905762+0000","last_active":"2023-11-24T06:16:50.730334+0000","last_peered":"2023-11-24T06:16:50.730334+0000","last_clean":"2023-11-24T06:16:50.730334+0000","last_became_active":"2023-11-24T06:16:48.905503+0000","last_became_peered":"2023-11-24T06:16:48.905503+0000","last_unstale":"2023-11-24T06:16:50.730334+0000","last_undegraded":"2023-11-24T06:16:50.730334+0000","last_fullsized":"2023-11-24T06:16:50.730334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:24.068967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732567+0000","last_change":"2023-11-24T06:16:48.903319+0000","last_active":"2023-11-24T06:16:50.732567+0000","last_peered":"2023-11-24T06:16:50.732567+0000","last_clean":"2023-11-24T06:16:50.732567+0000","last_became_active":"2023-11-24T06:16:48.903054+0000","last_became_peered":"2023-11-24T06:16:48.903054+0000","last_unstale":"2023-11-24T06:16:50.732567+0000","last_undegraded":"2023-11-24T06:16:50.732567+0000","last_fullsized":"2023-11-24T06:16:50.732567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:37.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730374+0000","last_change":"2023-11-24T06:16:48.897749+0000","last_active":"2023-11-24T06:16:50.730374+0000","last_peered":"2023-11-24T06:16:50.730374+0000","last_clean":"2023-11-24T06:16:50.730374+0000","last_became_active":"2023-11-24T06:16:48.897428+0000","last_became_peered":"2023-11-24T06:16:48.897428+0000","last_unstale":"2023-11-24T06:16:50.730374+0000","last_undegraded":"2023-11-24T06:16:50.730374+0000","last_fullsized":"2023-11-24T06:16:50.730374+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.729407+0000","last_change":"2023-11-24T06:16:48.900860+0000","last_active":"2023-11-24T06:16:50.729407+0000","last_peered":"2023-11-24T06:16:50.729407+0000","last_clean":"2023-11-24T06:16:50.729407+0000","last_became_active":"2023-11-24T06:16:48.900335+0000","last_became_peered":"2023-11-24T06:16:48.900335+0000","last_unstale":"2023-11-24T06:16:50.729407+0000","last_undegraded":"2023-11-24T06:16:50.729407+0000","last_fullsized":"2023-11-24T06:16:50.729407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:20.085808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504228+0000","last_change":"2023-11-24T06:16:48.920906+0000","last_active":"2023-11-24T06:16:50.504228+0000","last_peered":"2023-11-24T06:16:50.504228+0000","last_clean":"2023-11-24T06:16:50.504228+0000","last_became_active":"2023-11-24T06:16:48.919808+0000","last_became_peered":"2023-11-24T06:16:48.919808+0000","last_unstale":"2023-11-24T06:16:50.504228+0000","last_undegraded":"2023-11-24T06:16:50.504228+0000","last_fullsized":"2023-11-24T06:16:50.504228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:55.505367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504907+0000","last_change":"2023-11-24T06:16:48.922108+0000","last_active":"2023-11-24T06:16:50.504907+0000","last_peered":"2023-11-24T06:16:50.504907+0000","last_clean":"2023-11-24T06:16:50.504907+0000","last_became_active":"2023-11-24T06:16:48.921158+0000","last_became_peered":"2023-11-24T06:16:48.921158+0000","last_unstale":"2023-11-24T06:16:50.504907+0000","last_undegraded":"2023-11-24T06:16:50.504907+0000","last_fullsized":"2023-11-24T06:16:50.504907+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.924912+0000","last_change":"2023-11-24T06:16:47.870996+0000","last_active":"2023-11-24T06:16:48.924912+0000","last_peered":"2023-11-24T06:16:48.924912+0000","last_clean":"2023-11-24T06:16:48.924912+0000","last_became_active":"2023-11-24T06:16:47.870728+0000","last_became_peered":"2023-11-24T06:16:47.870728+0000","last_unstale":"2023-11-24T06:16:48.924912+0000","last_undegraded":"2023-11-24T06:16:48.924912+0000","last_fullsized":"2023-11-24T06:16:48.924912+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884607+0000","last_change":"2023-11-24T06:16:48.896573+0000","last_active":"2023-11-24T06:16:49.884607+0000","last_peered":"2023-11-24T06:16:49.884607+0000","last_clean":"2023-11-24T06:16:49.884607+0000","last_became_active":"2023-11-24T06:16:48.896114+0000","last_became_peered":"2023-11-24T06:16:48.896114+0000","last_unstale":"2023-11-24T06:16:49.884607+0000","last_undegraded":"2023-11-24T06:16:49.884607+0000","last_fullsized":"2023-11-24T06:16:49.884607+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:35.109896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.915743+0000","last_change":"2023-11-24T06:16:47.873548+0000","last_active":"2023-11-24T06:16:48.915743+0000","last_peered":"2023-11-24T06:16:48.915743+0000","last_clean":"2023-11-24T06:16:48.915743+0000","last_became_active":"2023-11-24T06:16:47.873228+0000","last_became_peered":"2023-11-24T06:16:47.873228+0000","last_unstale":"2023-11-24T06:16:48.915743+0000","last_undegraded":"2023-11-24T06:16:48.915743+0000","last_fullsized":"2023-11-24T06:16:48.915743+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:26.312030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504745+0000","last_change":"2023-11-24T06:16:48.910599+0000","last_active":"2023-11-24T06:16:50.504745+0000","last_peered":"2023-11-24T06:16:50.504745+0000","last_clean":"2023-11-24T06:16:50.504745+0000","last_became_active":"2023-11-24T06:16:48.910163+0000","last_became_peered":"2023-11-24T06:16:48.910163+0000","last_unstale":"2023-11-24T06:16:50.504745+0000","last_undegraded":"2023-11-24T06:16:50.504745+0000","last_fullsized":"2023-11-24T06:16:50.504745+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.922461+0000","last_change":"2023-11-24T06:16:47.869007+0000","last_active":"2023-11-24T06:16:48.922461+0000","last_peered":"2023-11-24T06:16:48.922461+0000","last_clean":"2023-11-24T06:16:48.922461+0000","last_became_active":"2023-11-24T06:16:47.868662+0000","last_became_peered":"2023-11-24T06:16:47.868662+0000","last_unstale":"2023-11-24T06:16:48.922461+0000","last_undegraded":"2023-11-24T06:16:48.922461+0000","last_fullsized":"2023-11-24T06:16:48.922461+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:50.138700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504844+0000","last_change":"2023-11-24T06:16:48.910599+0000","last_active":"2023-11-24T06:16:50.504844+0000","last_peered":"2023-11-24T06:16:50.504844+0000","last_clean":"2023-11-24T06:16:50.504844+0000","last_became_active":"2023-11-24T06:16:48.910244+0000","last_became_peered":"2023-11-24T06:16:48.910244+0000","last_unstale":"2023-11-24T06:16:50.504844+0000","last_undegraded":"2023-11-24T06:16:50.504844+0000","last_fullsized":"2023-11-24T06:16:50.504844+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.914357+0000","last_change":"2023-11-24T06:16:47.871257+0000","last_active":"2023-11-24T06:16:48.914357+0000","last_peered":"2023-11-24T06:16:48.914357+0000","last_clean":"2023-11-24T06:16:48.914357+0000","last_became_active":"2023-11-24T06:16:47.870777+0000","last_became_peered":"2023-11-24T06:16:47.870777+0000","last_unstale":"2023-11-24T06:16:48.914357+0000","last_undegraded":"2023-11-24T06:16:48.914357+0000","last_fullsized":"2023-11-24T06:16:48.914357+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:54.500222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731023+0000","last_change":"2023-11-24T06:16:48.898179+0000","last_active":"2023-11-24T06:16:50.731023+0000","last_peered":"2023-11-24T06:16:50.731023+0000","last_clean":"2023-11-24T06:16:50.731023+0000","last_became_active":"2023-11-24T06:16:48.897817+0000","last_became_peered":"2023-11-24T06:16:48.897817+0000","last_unstale":"2023-11-24T06:16:50.731023+0000","last_undegraded":"2023-11-24T06:16:50.731023+0000","last_fullsized":"2023-11-24T06:16:50.731023+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:23.856483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.914658+0000","last_change":"2023-11-24T06:16:47.863936+0000","last_active":"2023-11-24T06:16:48.914658+0000","last_peered":"2023-11-24T06:16:48.914658+0000","last_clean":"2023-11-24T06:16:48.914658+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.914658+0000","last_undegraded":"2023-11-24T06:16:48.914658+0000","last_fullsized":"2023-11-24T06:16:48.914658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732389+0000","last_change":"2023-11-24T06:16:48.906662+0000","last_active":"2023-11-24T06:16:50.732389+0000","last_peered":"2023-11-24T06:16:50.732389+0000","last_clean":"2023-11-24T06:16:50.732389+0000","last_became_active":"2023-11-24T06:16:48.906358+0000","last_became_peered":"2023-11-24T06:16:48.906358+0000","last_unstale":"2023-11-24T06:16:50.732389+0000","last_undegraded":"2023-11-24T06:16:50.732389+0000","last_fullsized":"2023-11-24T06:16:50.732389+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:30.474813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.920119+0000","last_change":"2023-11-24T06:16:47.869191+0000","last_active":"2023-11-24T06:16:48.920119+0000","last_peered":"2023-11-24T06:16:48.920119+0000","last_clean":"2023-11-24T06:16:48.920119+0000","last_became_active":"2023-11-24T06:16:47.868879+0000","last_became_peered":"2023-11-24T06:16:47.868879+0000","last_unstale":"2023-11-24T06:16:48.920119+0000","last_undegraded":"2023-11-24T06:16:48.920119+0000","last_fullsized":"2023-11-24T06:16:48.920119+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:25.375717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.510778+0000","last_change":"2023-11-24T06:16:48.895030+0000","last_active":"2023-11-24T06:16:50.510778+0000","last_peered":"2023-11-24T06:16:50.510778+0000","last_clean":"2023-11-24T06:16:50.510778+0000","last_became_active":"2023-11-24T06:16:48.894763+0000","last_became_peered":"2023-11-24T06:16:48.894763+0000","last_unstale":"2023-11-24T06:16:50.510778+0000","last_undegraded":"2023-11-24T06:16:50.510778+0000","last_fullsized":"2023-11-24T06:16:50.510778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:58:43.375446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.880141+0000","last_change":"2023-11-24T06:16:47.858024+0000","last_active":"2023-11-24T06:16:48.880141+0000","last_peered":"2023-11-24T06:16:48.880141+0000","last_clean":"2023-11-24T06:16:48.880141+0000","last_became_active":"2023-11-24T06:16:47.856960+0000","last_became_peered":"2023-11-24T06:16:47.856960+0000","last_unstale":"2023-11-24T06:16:48.880141+0000","last_undegraded":"2023-11-24T06:16:48.880141+0000","last_fullsized":"2023-11-24T06:16:48.880141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:56.432004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730970+0000","last_change":"2023-11-24T06:16:48.895103+0000","last_active":"2023-11-24T06:16:50.730970+0000","last_peered":"2023-11-24T06:16:50.730970+0000","last_clean":"2023-11-24T06:16:50.730970+0000","last_became_active":"2023-11-24T06:16:48.894644+0000","last_became_peered":"2023-11-24T06:16:48.894644+0000","last_unstale":"2023-11-24T06:16:50.730970+0000","last_undegraded":"2023-11-24T06:16:50.730970+0000","last_fullsized":"2023-11-24T06:16:50.730970+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:26.856867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.875899+0000","last_change":"2023-11-24T06:16:47.862985+0000","last_active":"2023-11-24T06:16:48.875899+0000","last_peered":"2023-11-24T06:16:48.875899+0000","last_clean":"2023-11-24T06:16:48.875899+0000","last_became_active":"2023-11-24T06:16:47.862698+0000","last_became_peered":"2023-11-24T06:16:47.862698+0000","last_unstale":"2023-11-24T06:16:48.875899+0000","last_undegraded":"2023-11-24T06:16:48.875899+0000","last_fullsized":"2023-11-24T06:16:48.875899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:40.831546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889218+0000","last_change":"2023-11-24T06:16:48.891060+0000","last_active":"2023-11-24T06:16:49.889218+0000","last_peered":"2023-11-24T06:16:49.889218+0000","last_clean":"2023-11-24T06:16:49.889218+0000","last_became_active":"2023-11-24T06:16:48.890385+0000","last_became_peered":"2023-11-24T06:16:48.890385+0000","last_unstale":"2023-11-24T06:16:49.889218+0000","last_undegraded":"2023-11-24T06:16:49.889218+0000","last_fullsized":"2023-11-24T06:16:49.889218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:21.198952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.891171+0000","last_change":"2023-11-24T06:16:47.876806+0000","last_active":"2023-11-24T06:16:48.891171+0000","last_peered":"2023-11-24T06:16:48.891171+0000","last_clean":"2023-11-24T06:16:48.891171+0000","last_became_active":"2023-11-24T06:16:47.876538+0000","last_became_peered":"2023-11-24T06:16:47.876538+0000","last_unstale":"2023-11-24T06:16:48.891171+0000","last_undegraded":"2023-11-24T06:16:48.891171+0000","last_fullsized":"2023-11-24T06:16:48.891171+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:14.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731316+0000","last_change":"2023-11-24T06:16:48.915135+0000","last_active":"2023-11-24T06:16:50.731316+0000","last_peered":"2023-11-24T06:16:50.731316+0000","last_clean":"2023-11-24T06:16:50.731316+0000","last_became_active":"2023-11-24T06:16:48.914916+0000","last_became_peered":"2023-11-24T06:16:48.914916+0000","last_unstale":"2023-11-24T06:16:50.731316+0000","last_undegraded":"2023-11-24T06:16:50.731316+0000","last_fullsized":"2023-11-24T06:16:50.731316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:20.197865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.890709+0000","last_change":"2023-11-24T06:16:47.866036+0000","last_active":"2023-11-24T06:16:48.890709+0000","last_peered":"2023-11-24T06:16:48.890709+0000","last_clean":"2023-11-24T06:16:48.890709+0000","last_became_active":"2023-11-24T06:16:47.865636+0000","last_became_peered":"2023-11-24T06:16:47.865636+0000","last_unstale":"2023-11-24T06:16:48.890709+0000","last_undegraded":"2023-11-24T06:16:48.890709+0000","last_fullsized":"2023-11-24T06:16:48.890709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.426322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884260+0000","last_change":"2023-11-24T06:16:48.884882+0000","last_active":"2023-11-24T06:16:49.884260+0000","last_peered":"2023-11-24T06:16:49.884260+0000","last_clean":"2023-11-24T06:16:49.884260+0000","last_became_active":"2023-11-24T06:16:48.884435+0000","last_became_peered":"2023-11-24T06:16:48.884435+0000","last_unstale":"2023-11-24T06:16:49.884260+0000","last_undegraded":"2023-11-24T06:16:49.884260+0000","last_fullsized":"2023-11-24T06:16:49.884260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:41.836691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.915314+0000","last_change":"2023-11-24T06:16:47.876849+0000","last_active":"2023-11-24T06:16:48.915314+0000","last_peered":"2023-11-24T06:16:48.915314+0000","last_clean":"2023-11-24T06:16:48.915314+0000","last_became_active":"2023-11-24T06:16:47.876481+0000","last_became_peered":"2023-11-24T06:16:47.876481+0000","last_unstale":"2023-11-24T06:16:48.915314+0000","last_undegraded":"2023-11-24T06:16:48.915314+0000","last_fullsized":"2023-11-24T06:16:48.915314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731074+0000","last_change":"2023-11-24T06:16:48.906432+0000","last_active":"2023-11-24T06:16:50.731074+0000","last_peered":"2023-11-24T06:16:50.731074+0000","last_clean":"2023-11-24T06:16:50.731074+0000","last_became_active":"2023-11-24T06:16:48.905770+0000","last_became_peered":"2023-11-24T06:16:48.905770+0000","last_unstale":"2023-11-24T06:16:50.731074+0000","last_undegraded":"2023-11-24T06:16:50.731074+0000","last_fullsized":"2023-11-24T06:16:50.731074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:52.431467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.924579+0000","last_change":"2023-11-24T06:16:47.871704+0000","last_active":"2023-11-24T06:16:48.924579+0000","last_peered":"2023-11-24T06:16:48.924579+0000","last_clean":"2023-11-24T06:16:48.924579+0000","last_became_active":"2023-11-24T06:16:47.870074+0000","last_became_peered":"2023-11-24T06:16:47.870074+0000","last_unstale":"2023-11-24T06:16:48.924579+0000","last_undegraded":"2023-11-24T06:16:48.924579+0000","last_fullsized":"2023-11-24T06:16:48.924579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:17.477112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.888852+0000","last_change":"2023-11-24T06:16:48.887127+0000","last_active":"2023-11-24T06:16:49.888852+0000","last_peered":"2023-11-24T06:16:49.888852+0000","last_clean":"2023-11-24T06:16:49.888852+0000","last_became_active":"2023-11-24T06:16:48.886835+0000","last_became_peered":"2023-11-24T06:16:48.886835+0000","last_unstale":"2023-11-24T06:16:49.888852+0000","last_undegraded":"2023-11-24T06:16:49.888852+0000","last_fullsized":"2023-11-24T06:16:49.888852+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.921291+0000","last_change":"2023-11-24T06:16:47.863197+0000","last_active":"2023-11-24T06:16:48.921291+0000","last_peered":"2023-11-24T06:16:48.921291+0000","last_clean":"2023-11-24T06:16:48.921291+0000","last_became_active":"2023-11-24T06:16:47.862546+0000","last_became_peered":"2023-11-24T06:16:47.862546+0000","last_unstale":"2023-11-24T06:16:48.921291+0000","last_undegraded":"2023-11-24T06:16:48.921291+0000","last_fullsized":"2023-11-24T06:16:48.921291+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:57.415614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730614+0000","last_change":"2023-11-24T06:16:48.899616+0000","last_active":"2023-11-24T06:16:50.730614+0000","last_peered":"2023-11-24T06:16:50.730614+0000","last_clean":"2023-11-24T06:16:50.730614+0000","last_became_active":"2023-11-24T06:16:48.899337+0000","last_became_peered":"2023-11-24T06:16:48.899337+0000","last_unstale":"2023-11-24T06:16:50.730614+0000","last_undegraded":"2023-11-24T06:16:50.730614+0000","last_fullsized":"2023-11-24T06:16:50.730614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:09:36.957387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.879332+0000","last_change":"2023-11-24T06:16:47.870027+0000","last_active":"2023-11-24T06:16:48.879332+0000","last_peered":"2023-11-24T06:16:48.879332+0000","last_clean":"2023-11-24T06:16:48.879332+0000","last_became_active":"2023-11-24T06:16:47.869101+0000","last_became_peered":"2023-11-24T06:16:47.869101+0000","last_unstale":"2023-11-24T06:16:48.879332+0000","last_undegraded":"2023-11-24T06:16:48.879332+0000","last_fullsized":"2023-11-24T06:16:48.879332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:33.578617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887916+0000","last_change":"2023-11-24T06:16:48.893887+0000","last_active":"2023-11-24T06:16:49.887916+0000","last_peered":"2023-11-24T06:16:49.887916+0000","last_clean":"2023-11-24T06:16:49.887916+0000","last_became_active":"2023-11-24T06:16:48.893525+0000","last_became_peered":"2023-11-24T06:16:48.893525+0000","last_unstale":"2023-11-24T06:16:49.887916+0000","last_undegraded":"2023-11-24T06:16:49.887916+0000","last_fullsized":"2023-11-24T06:16:49.887916+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:39:38.395169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.880164+0000","last_change":"2023-11-24T06:16:47.872547+0000","last_active":"2023-11-24T06:16:48.880164+0000","last_peered":"2023-11-24T06:16:48.880164+0000","last_clean":"2023-11-24T06:16:48.880164+0000","last_became_active":"2023-11-24T06:16:47.872211+0000","last_became_peered":"2023-11-24T06:16:47.872211+0000","last_unstale":"2023-11-24T06:16:48.880164+0000","last_undegraded":"2023-11-24T06:16:48.880164+0000","last_fullsized":"2023-11-24T06:16:48.880164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:48.204786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730290+0000","last_change":"2023-11-24T06:16:48.912149+0000","last_active":"2023-11-24T06:16:50.730290+0000","last_peered":"2023-11-24T06:16:50.730290+0000","last_clean":"2023-11-24T06:16:50.730290+0000","last_became_active":"2023-11-24T06:16:48.911881+0000","last_became_peered":"2023-11-24T06:16:48.911881+0000","last_unstale":"2023-11-24T06:16:50.730290+0000","last_undegraded":"2023-11-24T06:16:50.730290+0000","last_fullsized":"2023-11-24T06:16:50.730290+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.912043+0000","last_change":"2023-11-24T06:16:47.874455+0000","last_active":"2023-11-24T06:16:48.912043+0000","last_peered":"2023-11-24T06:16:48.912043+0000","last_clean":"2023-11-24T06:16:48.912043+0000","last_became_active":"2023-11-24T06:16:47.873907+0000","last_became_peered":"2023-11-24T06:16:47.873907+0000","last_unstale":"2023-11-24T06:16:48.912043+0000","last_undegraded":"2023-11-24T06:16:48.912043+0000","last_fullsized":"2023-11-24T06:16:48.912043+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:32.075614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730973+0000","last_change":"2023-11-24T06:16:48.902937+0000","last_active":"2023-11-24T06:16:50.730973+0000","last_peered":"2023-11-24T06:16:50.730973+0000","last_clean":"2023-11-24T06:16:50.730973+0000","last_became_active":"2023-11-24T06:16:48.902630+0000","last_became_peered":"2023-11-24T06:16:48.902630+0000","last_unstale":"2023-11-24T06:16:50.730973+0000","last_undegraded":"2023-11-24T06:16:50.730973+0000","last_fullsized":"2023-11-24T06:16:50.730973+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:27.317175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.920600+0000","last_change":"2023-11-24T06:16:47.862458+0000","last_active":"2023-11-24T06:16:48.920600+0000","last_peered":"2023-11-24T06:16:48.920600+0000","last_clean":"2023-11-24T06:16:48.920600+0000","last_became_active":"2023-11-24T06:16:47.862117+0000","last_became_peered":"2023-11-24T06:16:47.862117+0000","last_unstale":"2023-11-24T06:16:48.920600+0000","last_undegraded":"2023-11-24T06:16:48.920600+0000","last_fullsized":"2023-11-24T06:16:48.920600+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:16:29.279401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.888653+0000","last_change":"2023-11-24T06:16:48.886388+0000","last_active":"2023-11-24T06:16:49.888653+0000","last_peered":"2023-11-24T06:16:49.888653+0000","last_clean":"2023-11-24T06:16:49.888653+0000","last_became_active":"2023-11-24T06:16:48.886072+0000","last_became_peered":"2023-11-24T06:16:48.886072+0000","last_unstale":"2023-11-24T06:16:49.888653+0000","last_undegraded":"2023-11-24T06:16:49.888653+0000","last_fullsized":"2023-11-24T06:16:49.888653+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.924082+0000","last_change":"2023-11-24T06:16:47.870009+0000","last_active":"2023-11-24T06:16:48.924082+0000","last_peered":"2023-11-24T06:16:48.924082+0000","last_clean":"2023-11-24T06:16:48.924082+0000","last_became_active":"2023-11-24T06:16:47.869406+0000","last_became_peered":"2023-11-24T06:16:47.869406+0000","last_unstale":"2023-11-24T06:16:48.924082+0000","last_undegraded":"2023-11-24T06:16:48.924082+0000","last_fullsized":"2023-11-24T06:16:48.924082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:02.501049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732573+0000","last_change":"2023-11-24T06:16:48.895309+0000","last_active":"2023-11-24T06:16:50.732573+0000","last_peered":"2023-11-24T06:16:50.732573+0000","last_clean":"2023-11-24T06:16:50.732573+0000","last_became_active":"2023-11-24T06:16:48.894921+0000","last_became_peered":"2023-11-24T06:16:48.894921+0000","last_unstale":"2023-11-24T06:16:50.732573+0000","last_undegraded":"2023-11-24T06:16:50.732573+0000","last_fullsized":"2023-11-24T06:16:50.732573+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:38.154217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.917315+0000","last_change":"2023-11-24T06:16:47.873847+0000","last_active":"2023-11-24T06:16:48.917315+0000","last_peered":"2023-11-24T06:16:48.917315+0000","last_clean":"2023-11-24T06:16:48.917315+0000","last_became_active":"2023-11-24T06:16:47.873471+0000","last_became_peered":"2023-11-24T06:16:47.873471+0000","last_unstale":"2023-11-24T06:16:48.917315+0000","last_undegraded":"2023-11-24T06:16:48.917315+0000","last_fullsized":"2023-11-24T06:16:48.917315+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:20.193807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730873+0000","last_change":"2023-11-24T06:16:48.906615+0000","last_active":"2023-11-24T06:16:50.730873+0000","last_peered":"2023-11-24T06:16:50.730873+0000","last_clean":"2023-11-24T06:16:50.730873+0000","last_became_active":"2023-11-24T06:16:48.906147+0000","last_became_peered":"2023-11-24T06:16:48.906147+0000","last_unstale":"2023-11-24T06:16:50.730873+0000","last_undegraded":"2023-11-24T06:16:50.730873+0000","last_fullsized":"2023-11-24T06:16:50.730873+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:20:49.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.898383+0000","last_change":"2023-11-24T06:16:47.869212+0000","last_active":"2023-11-24T06:16:48.898383+0000","last_peered":"2023-11-24T06:16:48.898383+0000","last_clean":"2023-11-24T06:16:48.898383+0000","last_became_active":"2023-11-24T06:16:47.868677+0000","last_became_peered":"2023-11-24T06:16:47.868677+0000","last_unstale":"2023-11-24T06:16:48.898383+0000","last_undegraded":"2023-11-24T06:16:48.898383+0000","last_fullsized":"2023-11-24T06:16:48.898383+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:06.951566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889204+0000","last_change":"2023-11-24T06:16:48.886579+0000","last_active":"2023-11-24T06:16:49.889204+0000","last_peered":"2023-11-24T06:16:49.889204+0000","last_clean":"2023-11-24T06:16:49.889204+0000","last_became_active":"2023-11-24T06:16:48.886267+0000","last_became_peered":"2023-11-24T06:16:48.886267+0000","last_unstale":"2023-11-24T06:16:49.889204+0000","last_undegraded":"2023-11-24T06:16:49.889204+0000","last_fullsized":"2023-11-24T06:16:49.889204+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.916366+0000","last_change":"2023-11-24T06:16:47.859062+0000","last_active":"2023-11-24T06:16:48.916366+0000","last_peered":"2023-11-24T06:16:48.916366+0000","last_clean":"2023-11-24T06:16:48.916366+0000","last_became_active":"2023-11-24T06:16:47.858688+0000","last_became_peered":"2023-11-24T06:16:47.858688+0000","last_unstale":"2023-11-24T06:16:48.916366+0000","last_undegraded":"2023-11-24T06:16:48.916366+0000","last_fullsized":"2023-11-24T06:16:48.916366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:52.914802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504436+0000","last_change":"2023-11-24T06:16:48.916325+0000","last_active":"2023-11-24T06:16:50.504436+0000","last_peered":"2023-11-24T06:16:50.504436+0000","last_clean":"2023-11-24T06:16:50.504436+0000","last_became_active":"2023-11-24T06:16:48.916012+0000","last_became_peered":"2023-11-24T06:16:48.916012+0000","last_unstale":"2023-11-24T06:16:50.504436+0000","last_undegraded":"2023-11-24T06:16:50.504436+0000","last_fullsized":"2023-11-24T06:16:50.504436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.892116+0000","last_change":"2023-11-24T06:16:47.863548+0000","last_active":"2023-11-24T06:16:48.892116+0000","last_peered":"2023-11-24T06:16:48.892116+0000","last_clean":"2023-11-24T06:16:48.892116+0000","last_became_active":"2023-11-24T06:16:47.863229+0000","last_became_peered":"2023-11-24T06:16:47.863229+0000","last_unstale":"2023-11-24T06:16:48.892116+0000","last_undegraded":"2023-11-24T06:16:48.892116+0000","last_fullsized":"2023-11-24T06:16:48.892116+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:00.282582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504054+0000","last_change":"2023-11-24T06:16:48.919996+0000","last_active":"2023-11-24T06:16:50.504054+0000","last_peered":"2023-11-24T06:16:50.504054+0000","last_clean":"2023-11-24T06:16:50.504054+0000","last_became_active":"2023-11-24T06:16:48.919705+0000","last_became_peered":"2023-11-24T06:16:48.919705+0000","last_unstale":"2023-11-24T06:16:50.504054+0000","last_undegraded":"2023-11-24T06:16:50.504054+0000","last_fullsized":"2023-11-24T06:16:50.504054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:42.334420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.878717+0000","last_change":"2023-11-24T06:16:47.864670+0000","last_active":"2023-11-24T06:16:48.878717+0000","last_peered":"2023-11-24T06:16:48.878717+0000","last_clean":"2023-11-24T06:16:48.878717+0000","last_became_active":"2023-11-24T06:16:47.864390+0000","last_became_peered":"2023-11-24T06:16:47.864390+0000","last_unstale":"2023-11-24T06:16:48.878717+0000","last_undegraded":"2023-11-24T06:16:48.878717+0000","last_fullsized":"2023-11-24T06:16:48.878717+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:26:28.591350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889060+0000","last_change":"2023-11-24T06:16:48.900948+0000","last_active":"2023-11-24T06:16:49.889060+0000","last_peered":"2023-11-24T06:16:49.889060+0000","last_clean":"2023-11-24T06:16:49.889060+0000","last_became_active":"2023-11-24T06:16:48.900474+0000","last_became_peered":"2023-11-24T06:16:48.900474+0000","last_unstale":"2023-11-24T06:16:49.889060+0000","last_undegraded":"2023-11-24T06:16:49.889060+0000","last_fullsized":"2023-11-24T06:16:49.889060+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.917578+0000","last_change":"2023-11-24T06:16:47.863613+0000","last_active":"2023-11-24T06:16:48.917578+0000","last_peered":"2023-11-24T06:16:48.917578+0000","last_clean":"2023-11-24T06:16:48.917578+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.917578+0000","last_undegraded":"2023-11-24T06:16:48.917578+0000","last_fullsized":"2023-11-24T06:16:48.917578+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889031+0000","last_change":"2023-11-24T06:16:48.896370+0000","last_active":"2023-11-24T06:16:49.889031+0000","last_peered":"2023-11-24T06:16:49.889031+0000","last_clean":"2023-11-24T06:16:49.889031+0000","last_became_active":"2023-11-24T06:16:48.895454+0000","last_became_peered":"2023-11-24T06:16:48.895454+0000","last_unstale":"2023-11-24T06:16:49.889031+0000","last_undegraded":"2023-11-24T06:16:49.889031+0000","last_fullsized":"2023-11-24T06:16:49.889031+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.505170+0000","last_change":"2023-11-24T06:16:47.870072+0000","last_active":"2023-11-24T06:16:50.505170+0000","last_peered":"2023-11-24T06:16:50.505170+0000","last_clean":"2023-11-24T06:16:50.505170+0000","last_became_active":"2023-11-24T06:16:47.869378+0000","last_became_peered":"2023-11-24T06:16:47.869378+0000","last_unstale":"2023-11-24T06:16:50.505170+0000","last_undegraded":"2023-11-24T06:16:50.505170+0000","last_fullsized":"2023-11-24T06:16:50.505170+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:53.439168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884526+0000","last_change":"2023-11-24T06:16:48.887076+0000","last_active":"2023-11-24T06:16:49.884526+0000","last_peered":"2023-11-24T06:16:49.884526+0000","last_clean":"2023-11-24T06:16:49.884526+0000","last_became_active":"2023-11-24T06:16:48.886197+0000","last_became_peered":"2023-11-24T06:16:48.886197+0000","last_unstale":"2023-11-24T06:16:49.884526+0000","last_undegraded":"2023-11-24T06:16:49.884526+0000","last_fullsized":"2023-11-24T06:16:49.884526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:14.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.879171+0000","last_change":"2023-11-24T06:16:47.861764+0000","last_active":"2023-11-24T06:16:48.879171+0000","last_peered":"2023-11-24T06:16:48.879171+0000","last_clean":"2023-11-24T06:16:48.879171+0000","last_became_active":"2023-11-24T06:16:47.861429+0000","last_became_peered":"2023-11-24T06:16:47.861429+0000","last_unstale":"2023-11-24T06:16:48.879171+0000","last_undegraded":"2023-11-24T06:16:48.879171+0000","last_fullsized":"2023-11-24T06:16:48.879171+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:37:57.635600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.505254+0000","last_change":"2023-11-24T06:16:48.910700+0000","last_active":"2023-11-24T06:16:50.505254+0000","last_peered":"2023-11-24T06:16:50.505254+0000","last_clean":"2023-11-24T06:16:50.505254+0000","last_became_active":"2023-11-24T06:16:48.910427+0000","last_became_peered":"2023-11-24T06:16:48.910427+0000","last_unstale":"2023-11-24T06:16:50.505254+0000","last_undegraded":"2023-11-24T06:16:50.505254+0000","last_fullsized":"2023-11-24T06:16:50.505254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.880429+0000","last_change":"2023-11-24T06:16:47.859106+0000","last_active":"2023-11-24T06:16:48.880429+0000","last_peered":"2023-11-24T06:16:48.880429+0000","last_clean":"2023-11-24T06:16:48.880429+0000","last_became_active":"2023-11-24T06:16:47.858851+0000","last_became_peered":"2023-11-24T06:16:47.858851+0000","last_unstale":"2023-11-24T06:16:48.880429+0000","last_undegraded":"2023-11-24T06:16:48.880429+0000","last_fullsized":"2023-11-24T06:16:48.880429+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731409+0000","last_change":"2023-11-24T06:16:48.902068+0000","last_active":"2023-11-24T06:16:50.731409+0000","last_peered":"2023-11-24T06:16:50.731409+0000","last_clean":"2023-11-24T06:16:50.731409+0000","last_became_active":"2023-11-24T06:16:48.901578+0000","last_became_peered":"2023-11-24T06:16:48.901578+0000","last_unstale":"2023-11-24T06:16:50.731409+0000","last_undegraded":"2023-11-24T06:16:50.731409+0000","last_fullsized":"2023-11-24T06:16:50.731409+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:42.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.892132+0000","last_change":"2023-11-24T06:16:47.867455+0000","last_active":"2023-11-24T06:16:48.892132+0000","last_peered":"2023-11-24T06:16:48.892132+0000","last_clean":"2023-11-24T06:16:48.892132+0000","last_became_active":"2023-11-24T06:16:47.867160+0000","last_became_peered":"2023-11-24T06:16:47.867160+0000","last_unstale":"2023-11-24T06:16:48.892132+0000","last_undegraded":"2023-11-24T06:16:48.892132+0000","last_fullsized":"2023-11-24T06:16:48.892132+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:48.066853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730790+0000","last_change":"2023-11-24T06:16:48.912483+0000","last_active":"2023-11-24T06:16:50.730790+0000","last_peered":"2023-11-24T06:16:50.730790+0000","last_clean":"2023-11-24T06:16:50.730790+0000","last_became_active":"2023-11-24T06:16:48.912236+0000","last_became_peered":"2023-11-24T06:16:48.912236+0000","last_unstale":"2023-11-24T06:16:50.730790+0000","last_undegraded":"2023-11-24T06:16:50.730790+0000","last_fullsized":"2023-11-24T06:16:50.730790+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:58.420759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.876209+0000","last_change":"2023-11-24T06:16:47.869254+0000","last_active":"2023-11-24T06:16:48.876209+0000","last_peered":"2023-11-24T06:16:48.876209+0000","last_clean":"2023-11-24T06:16:48.876209+0000","last_became_active":"2023-11-24T06:16:47.868976+0000","last_became_peered":"2023-11-24T06:16:47.868976+0000","last_unstale":"2023-11-24T06:16:48.876209+0000","last_undegraded":"2023-11-24T06:16:48.876209+0000","last_fullsized":"2023-11-24T06:16:48.876209+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884015+0000","last_change":"2023-11-24T06:16:48.889009+0000","last_active":"2023-11-24T06:16:49.884015+0000","last_peered":"2023-11-24T06:16:49.884015+0000","last_clean":"2023-11-24T06:16:49.884015+0000","last_became_active":"2023-11-24T06:16:48.888731+0000","last_became_peered":"2023-11-24T06:16:48.888731+0000","last_unstale":"2023-11-24T06:16:49.884015+0000","last_undegraded":"2023-11-24T06:16:49.884015+0000","last_fullsized":"2023-11-24T06:16:49.884015+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.892100+0000","last_change":"2023-11-24T06:16:47.869741+0000","last_active":"2023-11-24T06:16:48.892100+0000","last_peered":"2023-11-24T06:16:48.892100+0000","last_clean":"2023-11-24T06:16:48.892100+0000","last_became_active":"2023-11-24T06:16:47.869465+0000","last_became_peered":"2023-11-24T06:16:47.869465+0000","last_unstale":"2023-11-24T06:16:48.892100+0000","last_undegraded":"2023-11-24T06:16:48.892100+0000","last_fullsized":"2023-11-24T06:16:48.892100+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:06.921054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731197+0000","last_change":"2023-11-24T06:16:48.894928+0000","last_active":"2023-11-24T06:16:50.731197+0000","last_peered":"2023-11-24T06:16:50.731197+0000","last_clean":"2023-11-24T06:16:50.731197+0000","last_became_active":"2023-11-24T06:16:48.894302+0000","last_became_peered":"2023-11-24T06:16:48.894302+0000","last_unstale":"2023-11-24T06:16:50.731197+0000","last_undegraded":"2023-11-24T06:16:50.731197+0000","last_fullsized":"2023-11-24T06:16:50.731197+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:09:34.986336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.890142+0000","last_change":"2023-11-24T06:16:47.871713+0000","last_active":"2023-11-24T06:16:48.890142+0000","last_peered":"2023-11-24T06:16:48.890142+0000","last_clean":"2023-11-24T06:16:48.890142+0000","last_became_active":"2023-11-24T06:16:47.870883+0000","last_became_peered":"2023-11-24T06:16:47.870883+0000","last_unstale":"2023-11-24T06:16:48.890142+0000","last_undegraded":"2023-11-24T06:16:48.890142+0000","last_fullsized":"2023-11-24T06:16:48.890142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:19:32.348025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730704+0000","last_change":"2023-11-24T06:16:48.907440+0000","last_active":"2023-11-24T06:16:50.730704+0000","last_peered":"2023-11-24T06:16:50.730704+0000","last_clean":"2023-11-24T06:16:50.730704+0000","last_became_active":"2023-11-24T06:16:48.907171+0000","last_became_peered":"2023-11-24T06:16:48.907171+0000","last_unstale":"2023-11-24T06:16:50.730704+0000","last_undegraded":"2023-11-24T06:16:50.730704+0000","last_fullsized":"2023-11-24T06:16:50.730704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:42.085950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.877214+0000","last_change":"2023-11-24T06:16:47.868677+0000","last_active":"2023-11-24T06:16:48.877214+0000","last_peered":"2023-11-24T06:16:48.877214+0000","last_clean":"2023-11-24T06:16:48.877214+0000","last_became_active":"2023-11-24T06:16:47.868343+0000","last_became_peered":"2023-11-24T06:16:47.868343+0000","last_unstale":"2023-11-24T06:16:48.877214+0000","last_undegraded":"2023-11-24T06:16:48.877214+0000","last_fullsized":"2023-11-24T06:16:48.877214+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:58.772945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.890528+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:16:48.890528+0000","last_peered":"2023-11-24T06:16:48.890528+0000","last_clean":"2023-11-24T06:16:48.890528+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:16:48.890528+0000","last_undegraded":"2023-11-24T06:16:48.890528+0000","last_fullsized":"2023-11-24T06:16:48.890528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1236992,"data_stored":862148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.012,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.536,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.079},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2430000000000001},"min":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.6220000000000001,"5min":2.004,"15min":2.004},"last":1.242}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.198},"min":{"1min":0.79700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1579999999999999,"15min":1.153},"min":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.637,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.90000000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.234,"15min":1.23},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8069999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.337,"15min":1.339},"min":{"1min":0.95999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.71,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.135}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.351,"15min":1.347},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.4590000000000001,"15min":1.46},"min":{"1min":1.139,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.873,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.5129999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4430000000000001,"15min":1.4390000000000001},"min":{"1min":0.89800000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.704,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.4790000000000001,"15min":1.4850000000000001},"min":{"1min":1.0980000000000001,"5min":1.022,"15min":1.022},"max":{"1min":1.8300000000000001,"5min":1.944,"15min":1.944},"last":1.206}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5429999999999999,"15min":1.55},"min":{"1min":1.042,"5min":0.623,"15min":0.623},"max":{"1min":1.7589999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.476,"15min":1.48},"min":{"1min":0.95699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6859999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.7509999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":271620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.72699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.52,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0269999999999999,"15min":1.016},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5660000000000001,"5min":1.615,"15min":1.615},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.181,"15min":1.1870000000000001},"min":{"1min":0.76100000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6419999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.206}]},{"osd":2,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.323,"15min":1.325},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9339999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.254},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.351,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.645,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.278}]},{"osd":3,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.359,"15min":1.3779999999999999},"min":{"1min":0.90300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0350000000000001,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.099},{"interface":"front","average":{"1min":1.296,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9119999999999999,"5min":2.056,"15min":2.056},"last":1.373}]},{"osd":4,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4470000000000001,"15min":1.456},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8029999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.5389999999999999,"15min":1.5449999999999999},"min":{"1min":0.80500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0219999999999998,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.474}]},{"osd":5,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.4650000000000001},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.825,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.635,"15min":1.641},"min":{"1min":0.71399999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0649999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.585}]},{"osd":7,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.5509999999999999,"15min":1.5389999999999999},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9079999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.498,"15min":1.484},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.024,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.528}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":643072,"data_stored":272272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0449999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.464,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5429999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.389}]},{"osd":1,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1579999999999999,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.619,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.292,"15min":1.3069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.542,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.2430000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2629999999999999,"15min":1.2709999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.002},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.444},"min":{"1min":0.98199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0720000000000001,"5min":2.198,"15min":2.198},"last":1.5960000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6359999999999999,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.4450000000000001,"15min":1.4510000000000001},"min":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.9470000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.96699999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6659999999999999,"5min":2.427,"15min":2.427},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4670000000000001,"15min":1.4830000000000001},"min":{"1min":0.83299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8680000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.625}]},{"osd":6,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.5780000000000001,"15min":1.5940000000000001},"min":{"1min":1.1000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8029999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.587,"15min":1.6200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8069999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.5009999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.651,"15min":1.663},"min":{"1min":1.042,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0230000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.706,"15min":1.712},"min":{"1min":1.234,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1789999999999998,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.6739999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":273232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0129999999999999,"15min":0.997},"min":{"1min":0.69699999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1},{"interface":"front","average":{"1min":1.101,"5min":1.073,"15min":1.069},"min":{"1min":0.77800000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.052}]},{"osd":1,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.083,"15min":1.0780000000000001},"min":{"1min":0.73399999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.88900000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.71,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.53}]},{"osd":2,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.216,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.766,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.232,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5820000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.91200000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.339},"min":{"1min":0.95099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.643,"5min":2.089,"15min":2.089},"last":1.097},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3360000000000001,"15min":1.337},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.873,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.254},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3899999999999999,"15min":1.4019999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2070000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.6100000000000001,"15min":1.6240000000000001},"min":{"1min":1.1819999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2730000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.405},{"interface":"front","average":{"1min":1.52,"5min":1.5840000000000001,"15min":1.595},"min":{"1min":1.0920000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.1789999999999998,"5min":2.222,"15min":2.222},"last":1.304}]},{"osd":7,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.5069999999999999,"15min":1.524},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.629},{"interface":"front","average":{"1min":1.595,"5min":1.7030000000000001,"15min":1.7210000000000001},"min":{"1min":1.2729999999999999,"5min":1.157,"15min":1.157},"max":{"1min":2.0190000000000001,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.6679999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":271676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.363,"5min":1.71,"15min":1.71},"last":0.751},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.054}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":0.98099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.242,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.874},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.97399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8859999999999999,"5min":1.998,"15min":1.998},"last":1.4059999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.673,"5min":1.802,"15min":1.802},"last":1.127},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1000000000000001,"15min":1.095},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.667,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.238}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":9.7599999999999998,"15min":11.188000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.833,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.464},{"interface":"front","average":{"1min":1.208,"5min":1.4139999999999999,"15min":1.448},"min":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.714,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.4450000000000001,"15min":1.4770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9370000000000001,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.399,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9159999999999999,"5min":4.274,"15min":4.274},"last":1.52}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.7669999999999999,"15min":1.825},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.1190000000000002,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.641},{"interface":"front","average":{"1min":1.26,"5min":1.399,"15min":1.4219999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0369999999999999,"5min":3.157,"15min":3.157},"last":1.3080000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5389999999999999,"15min":1.5680000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1709999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1829999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.5940000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":271676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2190000000000001,"5min":1.304,"15min":1.304},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.329}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0589999999999999,"15min":1.0680000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6879999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.357,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.131,"15min":1.137},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6950000000000001,"5min":2.355,"15min":2.355},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.159,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.03}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3,"15min":1.294},"min":{"1min":0.85499999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.875,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.4490000000000001,"15min":1.446},"min":{"1min":0.95499999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0979999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.296}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4990000000000001,"15min":1.502},"min":{"1min":0.95899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3979999999999999,"15min":1.3999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7869999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.647}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5349999999999999,"15min":1.5389999999999999},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.4119999999999999,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.591,"15min":1.589},"min":{"1min":0.92100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.512}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.544,"15min":1.5509999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0070000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":2.0019999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.577,"15min":1.5840000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.266,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.387}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":271710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1830000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1,"5min":1.002,"15min":1.002},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.879,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.95199999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.999,"15min":1.0089999999999999},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.6000000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.2450000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.712,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.361}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.907,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.712,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.365,"15min":1.393},"min":{"1min":0.84599999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.609,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.117},{"interface":"front","average":{"1min":1.337,"5min":1.5209999999999999,"15min":1.552},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7769999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.4259999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.621,"15min":1.661},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8360000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.6799999999999999,"15min":1.736},"min":{"1min":0.91200000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5860000000000001,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.2110000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5760000000000001,"15min":1.5960000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.246,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.492,"5min":1.8320000000000001,"15min":1.8879999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1619999999999999,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5960000000000001,"15min":1.6080000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.004,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.611,"15min":1.639},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.8240000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.3220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":864182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.97399999999999998,"15min":0.96999999999999997},"min":{"1min":0.53800000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6919999999999999,"5min":2.452,"15min":2.452},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.056,"15min":1.0740000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3360000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2529999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6950000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.113,"15min":1.131},"min":{"1min":0.498,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":3.411,"15min":3.411},"last":1.1339999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.645,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.258,"15min":1.264},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.579,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.446,"15min":1.452},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7949999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.448},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.575,"15min":1.605},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9379999999999999,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.532,"15min":1.5469999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0150000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5469999999999999,"15min":1.5680000000000001},"min":{"1min":0.876,"5min":0.875,"15min":0.875},"max":{"1min":2.0019999999999998,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.55}]},{"osd":6,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.9039999999999999,"15min":1.9870000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0510000000000002,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.077},{"interface":"front","average":{"1min":1.514,"5min":1.7989999999999999,"15min":1.847},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9470000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":0.91800000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.95599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0379999999999998,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.615},{"interface":"front","average":{"1min":1.536,"5min":1.841,"15min":1.8919999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0609999999999999,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.88100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:58.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:16:58.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.712+0000 7f1f87272640 1 Processor -- start 2023-11-24T06:16:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.712+0000 7f1f87272640 1 -- start start 2023-11-24T06:16:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.713+0000 7f1f87272640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1f80144b30 0x7f1f8015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.713+0000 7f1f87272640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f8015c410 0x7f1f800b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.713+0000 7f1f87272640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8015bf80 con 0x7f1f800b1de0 2023-11-24T06:16:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.713+0000 7f1f87272640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800b1560 con 0x7f1f8015c410 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.713+0000 7f1f87272640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800b0fb0 con 0x7f1f80144b30 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f85a6f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f8015c410 0x7f1f800b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f85a6f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f8015c410 0x7f1f800b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43694/0 (socket says 172.21.15.37:43694) 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f85a6f640 1 -- 172.21.15.37:0/676748160 learned_addr learned my addr 172.21.15.37:0/676748160 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f86a71640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1f800b1de0 0x7f1f8006c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43214/0 (socket says 172.21.15.37:43214) 2023-11-24T06:16:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f86270640 1 --2- 172.21.15.37:0/676748160 >> v2:172.21.15.188:3300/0 conn(0x7f1f80144b30 0x7f1f8015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f85a6f640 1 -- 172.21.15.37:0/676748160 >> v2:172.21.15.188:3300/0 conn(0x7f1f80144b30 msgr2=0x7f1f8015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f85a6f640 1 --2- 172.21.15.37:0/676748160 >> v2:172.21.15.188:3300/0 conn(0x7f1f80144b30 0x7f1f8015f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f85a6f640 1 -- 172.21.15.37:0/676748160 >> v1:172.21.15.37:6789/0 conn(0x7f1f800b1de0 legacy=0x7f1f8006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.714+0000 7f1f85a6f640 1 -- 172.21.15.37:0/676748160 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800b1280 con 0x7f1f8015c410 2023-11-24T06:16:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.716+0000 7f1f85a6f640 1 --2- 172.21.15.37:0/676748160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8015c410 0x7f1f800b0a70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006f690 tx=0x7f1f7002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f7a4a56b0f48c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.716+0000 7f1f8526e640 1 -- 172.21.15.37:0/676748160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70030860 con 0x7f1f8015c410 2023-11-24T06:16:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.716+0000 7f1f8526e640 1 -- 172.21.15.37:0/676748160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f700309c0 con 0x7f1f8015c410 2023-11-24T06:16:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.716+0000 7f1f8526e640 1 -- 172.21.15.37:0/676748160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70030d50 con 0x7f1f8015c410 2023-11-24T06:16:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.716+0000 7f1f87272640 1 -- 172.21.15.37:0/676748160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8015c410 msgr2=0x7f1f800b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.716+0000 7f1f87272640 1 --2- 172.21.15.37:0/676748160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8015c410 0x7f1f800b0a70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006f690 tx=0x7f1f7002b9a0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.717+0000 7f1f87272640 1 -- 172.21.15.37:0/676748160 shutdown_connections 2023-11-24T06:16:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.717+0000 7f1f87272640 1 --2- 172.21.15.37:0/676748160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8015c410 0x7f1f800b0a70 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.717+0000 7f1f87272640 1 --2- 172.21.15.37:0/676748160 >> v2:172.21.15.188:3300/0 conn(0x7f1f80144b30 0x7f1f8015f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.717+0000 7f1f87272640 1 -- 172.21.15.37:0/676748160 >> 172.21.15.37:0/676748160 conn(0x7f1f800cb830 msgr2=0x7f1f800cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.717+0000 7f1f87272640 1 -- 172.21.15.37:0/676748160 shutdown_connections 2023-11-24T06:16:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.717+0000 7f1f87272640 1 -- 172.21.15.37:0/676748160 wait complete. 2023-11-24T06:16:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.718+0000 7f1f87272640 1 Processor -- start 2023-11-24T06:16:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.719+0000 7f1f87272640 1 -- start start 2023-11-24T06:16:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.719+0000 7f1f87272640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f800b1de0 0x7f1f800a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.719+0000 7f1f87272640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f80144b30 0x7f1f80133520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.719+0000 7f1f87272640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f8015c410 0x7f1f800b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.719+0000 7f1f87272640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801319c0 con 0x7f1f80144b30 2023-11-24T06:16:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.719+0000 7f1f87272640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80133fb0 con 0x7f1f8015c410 2023-11-24T06:16:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.719+0000 7f1f87272640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80134290 con 0x7f1f800b1de0 2023-11-24T06:16:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f80144b30 0x7f1f80133520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f80144b30 0x7f1f80133520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43708/0 (socket says 172.21.15.37:43708) 2023-11-24T06:16:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 -- 172.21.15.37:0/4183435523 learned_addr learned my addr 172.21.15.37:0/4183435523 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f86a71640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f8015c410 0x7f1f800b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f86270640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f800b1de0 0x7f1f800a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 -- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f800b1de0 msgr2=0x7f1f800a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f800b1de0 0x7f1f800a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 -- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f8015c410 msgr2=0x7f1f800b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f8015c410 0x7f1f800b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.720+0000 7f1f85a6f640 1 -- 172.21.15.37:0/4183435523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f700094d0 con 0x7f1f80144b30 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.721+0000 7f1f85a6f640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f80144b30 0x7f1f80133520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1f7002b9e0 tx=0x7f1f700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.721+0000 7f1f76ffd640 1 -- 172.21.15.37:0/4183435523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7003e070 con 0x7f1f80144b30 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.721+0000 7f1f76ffd640 1 -- 172.21.15.37:0/4183435523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f700398d0 con 0x7f1f80144b30 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.721+0000 7f1f76ffd640 1 -- 172.21.15.37:0/4183435523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70039c80 con 0x7f1f80144b30 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.721+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f80131650 con 0x7f1f80144b30 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.721+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8013f740 con 0x7f1f80144b30 2023-11-24T06:16:58.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.722+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8013f930 con 0x7f1f80144b30 2023-11-24T06:16:58.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.723+0000 7f1f76ffd640 1 -- 172.21.15.37:0/4183435523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f70042070 con 0x7f1f80144b30 2023-11-24T06:16:58.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.724+0000 7f1f76ffd640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f6406ae70 0x7f1f6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:58.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.724+0000 7f1f76ffd640 1 -- 172.21.15.37:0/4183435523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f700ab2b0 con 0x7f1f80144b30 2023-11-24T06:16:58.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.724+0000 7f1f86270640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f6406ae70 0x7f1f6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:58.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.725+0000 7f1f86270640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f6406ae70 0x7f1f6406d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c006fd0 tx=0x7f1f7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:58.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.729+0000 7f1f76ffd640 1 -- 172.21.15.37:0/4183435523 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f8013f930 con 0x7f1f80144b30 2023-11-24T06:16:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.924+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f80072630 con 0x7f1f6406ae70 2023-11-24T06:16:58.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.939+0000 7f1f76ffd640 1 -- 172.21.15.37:0/4183435523 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286974 (secure 0 0 0) 0x7f1f80072630 con 0x7f1f6406ae70 2023-11-24T06:16:58.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:16:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f6406ae70 msgr2=0x7f1f6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f6406ae70 0x7f1f6406d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c006fd0 tx=0x7f1f7c008040 comp rx=0 tx=0).stop 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f80144b30 msgr2=0x7f1f80133520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f80144b30 0x7f1f80133520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1f7002b9e0 tx=0x7f1f700046c0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 shutdown_connections 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1f6406ae70 0x7f1f6406d330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f8015c410 0x7f1f800b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f80144b30 0x7f1f80133520 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 --2- 172.21.15.37:0/4183435523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f800b1de0 0x7f1f800a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:58.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 >> 172.21.15.37:0/4183435523 conn(0x7f1f800cb830 msgr2=0x7f1f80071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:58.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 shutdown_connections 2023-11-24T06:16:58.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:58.946+0000 7f1f87272640 1 -- 172.21.15.37:0/4183435523 wait complete. 2023-11-24T06:16:58.972 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-11-24T06:16:58.854507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234856,"kb_used_data":6184,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739864,"statfs":{"total":773094113280,"available":772853620736,"internally_reserved":0,"allocated":6332416,"data_stored":3358516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.993760"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731142+0000","last_change":"2023-11-24T06:16:48.913545+0000","last_active":"2023-11-24T06:16:50.731142+0000","last_peered":"2023-11-24T06:16:50.731142+0000","last_clean":"2023-11-24T06:16:50.731142+0000","last_became_active":"2023-11-24T06:16:48.913227+0000","last_became_peered":"2023-11-24T06:16:48.913227+0000","last_unstale":"2023-11-24T06:16:50.731142+0000","last_undegraded":"2023-11-24T06:16:50.731142+0000","last_fullsized":"2023-11-24T06:16:50.731142+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:30.324994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732865+0000","last_change":"2023-11-24T06:16:48.895599+0000","last_active":"2023-11-24T06:16:50.732865+0000","last_peered":"2023-11-24T06:16:50.732865+0000","last_clean":"2023-11-24T06:16:50.732865+0000","last_became_active":"2023-11-24T06:16:48.893366+0000","last_became_peered":"2023-11-24T06:16:48.893366+0000","last_unstale":"2023-11-24T06:16:50.732865+0000","last_undegraded":"2023-11-24T06:16:50.732865+0000","last_fullsized":"2023-11-24T06:16:50.732865+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:06.111030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730318+0000","last_change":"2023-11-24T06:16:48.898042+0000","last_active":"2023-11-24T06:16:50.730318+0000","last_peered":"2023-11-24T06:16:50.730318+0000","last_clean":"2023-11-24T06:16:50.730318+0000","last_became_active":"2023-11-24T06:16:48.897767+0000","last_became_peered":"2023-11-24T06:16:48.897767+0000","last_unstale":"2023-11-24T06:16:50.730318+0000","last_undegraded":"2023-11-24T06:16:50.730318+0000","last_fullsized":"2023-11-24T06:16:50.730318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889413+0000","last_change":"2023-11-24T06:16:48.900822+0000","last_active":"2023-11-24T06:16:49.889413+0000","last_peered":"2023-11-24T06:16:49.889413+0000","last_clean":"2023-11-24T06:16:49.889413+0000","last_became_active":"2023-11-24T06:16:48.900488+0000","last_became_peered":"2023-11-24T06:16:48.900488+0000","last_unstale":"2023-11-24T06:16:49.889413+0000","last_undegraded":"2023-11-24T06:16:49.889413+0000","last_fullsized":"2023-11-24T06:16:49.889413+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730127+0000","last_change":"2023-11-24T06:16:48.913932+0000","last_active":"2023-11-24T06:16:50.730127+0000","last_peered":"2023-11-24T06:16:50.730127+0000","last_clean":"2023-11-24T06:16:50.730127+0000","last_became_active":"2023-11-24T06:16:48.913634+0000","last_became_peered":"2023-11-24T06:16:48.913634+0000","last_unstale":"2023-11-24T06:16:50.730127+0000","last_undegraded":"2023-11-24T06:16:50.730127+0000","last_fullsized":"2023-11-24T06:16:50.730127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:28:01.018131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.505006+0000","last_change":"2023-11-24T06:16:48.921349+0000","last_active":"2023-11-24T06:16:50.505006+0000","last_peered":"2023-11-24T06:16:50.505006+0000","last_clean":"2023-11-24T06:16:50.505006+0000","last_became_active":"2023-11-24T06:16:48.920798+0000","last_became_peered":"2023-11-24T06:16:48.920798+0000","last_unstale":"2023-11-24T06:16:50.505006+0000","last_undegraded":"2023-11-24T06:16:50.505006+0000","last_fullsized":"2023-11-24T06:16:50.505006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:02:55.525111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887009+0000","last_change":"2023-11-24T06:16:48.879954+0000","last_active":"2023-11-24T06:16:49.887009+0000","last_peered":"2023-11-24T06:16:49.887009+0000","last_clean":"2023-11-24T06:16:49.887009+0000","last_became_active":"2023-11-24T06:16:48.879380+0000","last_became_peered":"2023-11-24T06:16:48.879380+0000","last_unstale":"2023-11-24T06:16:49.887009+0000","last_undegraded":"2023-11-24T06:16:49.887009+0000","last_fullsized":"2023-11-24T06:16:49.887009+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:35.109896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730194+0000","last_change":"2023-11-24T06:16:48.897361+0000","last_active":"2023-11-24T06:16:50.730194+0000","last_peered":"2023-11-24T06:16:50.730194+0000","last_clean":"2023-11-24T06:16:50.730194+0000","last_became_active":"2023-11-24T06:16:48.896864+0000","last_became_peered":"2023-11-24T06:16:48.896864+0000","last_unstale":"2023-11-24T06:16:50.730194+0000","last_undegraded":"2023-11-24T06:16:50.730194+0000","last_fullsized":"2023-11-24T06:16:50.730194+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:06.726119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889597+0000","last_change":"2023-11-24T06:16:48.907645+0000","last_active":"2023-11-24T06:16:49.889597+0000","last_peered":"2023-11-24T06:16:49.889597+0000","last_clean":"2023-11-24T06:16:49.889597+0000","last_became_active":"2023-11-24T06:16:48.907356+0000","last_became_peered":"2023-11-24T06:16:48.907356+0000","last_unstale":"2023-11-24T06:16:49.889597+0000","last_undegraded":"2023-11-24T06:16:49.889597+0000","last_fullsized":"2023-11-24T06:16:49.889597+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:57.437149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884514+0000","last_change":"2023-11-24T06:16:48.888135+0000","last_active":"2023-11-24T06:16:49.884514+0000","last_peered":"2023-11-24T06:16:49.884514+0000","last_clean":"2023-11-24T06:16:49.884514+0000","last_became_active":"2023-11-24T06:16:48.887851+0000","last_became_peered":"2023-11-24T06:16:48.887851+0000","last_unstale":"2023-11-24T06:16:49.884514+0000","last_undegraded":"2023-11-24T06:16:49.884514+0000","last_fullsized":"2023-11-24T06:16:49.884514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:18.482257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884922+0000","last_change":"2023-11-24T06:16:48.893169+0000","last_active":"2023-11-24T06:16:49.884922+0000","last_peered":"2023-11-24T06:16:49.884922+0000","last_clean":"2023-11-24T06:16:49.884922+0000","last_became_active":"2023-11-24T06:16:48.892881+0000","last_became_peered":"2023-11-24T06:16:48.892881+0000","last_unstale":"2023-11-24T06:16:49.884922+0000","last_undegraded":"2023-11-24T06:16:49.884922+0000","last_fullsized":"2023-11-24T06:16:49.884922+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889644+0000","last_change":"2023-11-24T06:16:48.888588+0000","last_active":"2023-11-24T06:16:49.889644+0000","last_peered":"2023-11-24T06:16:49.889644+0000","last_clean":"2023-11-24T06:16:49.889644+0000","last_became_active":"2023-11-24T06:16:48.888314+0000","last_became_peered":"2023-11-24T06:16:48.888314+0000","last_unstale":"2023-11-24T06:16:49.889644+0000","last_undegraded":"2023-11-24T06:16:49.889644+0000","last_fullsized":"2023-11-24T06:16:49.889644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.510456+0000","last_change":"2023-11-24T06:16:48.903305+0000","last_active":"2023-11-24T06:16:50.510456+0000","last_peered":"2023-11-24T06:16:50.510456+0000","last_clean":"2023-11-24T06:16:50.510456+0000","last_became_active":"2023-11-24T06:16:48.902952+0000","last_became_peered":"2023-11-24T06:16:48.902952+0000","last_unstale":"2023-11-24T06:16:50.510456+0000","last_undegraded":"2023-11-24T06:16:50.510456+0000","last_fullsized":"2023-11-24T06:16:50.510456+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:49.759918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887652+0000","last_change":"2023-11-24T06:16:48.892428+0000","last_active":"2023-11-24T06:16:49.887652+0000","last_peered":"2023-11-24T06:16:49.887652+0000","last_clean":"2023-11-24T06:16:49.887652+0000","last_became_active":"2023-11-24T06:16:48.892155+0000","last_became_peered":"2023-11-24T06:16:48.892155+0000","last_unstale":"2023-11-24T06:16:49.887652+0000","last_undegraded":"2023-11-24T06:16:49.887652+0000","last_fullsized":"2023-11-24T06:16:49.887652+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:26.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887350+0000","last_change":"2023-11-24T06:16:48.888393+0000","last_active":"2023-11-24T06:16:49.887350+0000","last_peered":"2023-11-24T06:16:49.887350+0000","last_clean":"2023-11-24T06:16:49.887350+0000","last_became_active":"2023-11-24T06:16:48.888094+0000","last_became_peered":"2023-11-24T06:16:48.888094+0000","last_unstale":"2023-11-24T06:16:49.887350+0000","last_undegraded":"2023-11-24T06:16:49.887350+0000","last_fullsized":"2023-11-24T06:16:49.887350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:00.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504416+0000","last_change":"2023-11-24T06:16:48.908245+0000","last_active":"2023-11-24T06:16:50.504416+0000","last_peered":"2023-11-24T06:16:50.504416+0000","last_clean":"2023-11-24T06:16:50.504416+0000","last_became_active":"2023-11-24T06:16:48.907960+0000","last_became_peered":"2023-11-24T06:16:48.907960+0000","last_unstale":"2023-11-24T06:16:50.504416+0000","last_undegraded":"2023-11-24T06:16:50.504416+0000","last_fullsized":"2023-11-24T06:16:50.504416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:33.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732701+0000","last_change":"2023-11-24T06:16:48.907441+0000","last_active":"2023-11-24T06:16:50.732701+0000","last_peered":"2023-11-24T06:16:50.732701+0000","last_clean":"2023-11-24T06:16:50.732701+0000","last_became_active":"2023-11-24T06:16:48.906560+0000","last_became_peered":"2023-11-24T06:16:48.906560+0000","last_unstale":"2023-11-24T06:16:50.732701+0000","last_undegraded":"2023-11-24T06:16:50.732701+0000","last_fullsized":"2023-11-24T06:16:50.732701+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:49:44.627528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730579+0000","last_change":"2023-11-24T06:16:48.916909+0000","last_active":"2023-11-24T06:16:50.730579+0000","last_peered":"2023-11-24T06:16:50.730579+0000","last_clean":"2023-11-24T06:16:50.730579+0000","last_became_active":"2023-11-24T06:16:48.916641+0000","last_became_peered":"2023-11-24T06:16:48.916641+0000","last_unstale":"2023-11-24T06:16:50.730579+0000","last_undegraded":"2023-11-24T06:16:50.730579+0000","last_fullsized":"2023-11-24T06:16:50.730579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:47:32.077444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730590+0000","last_change":"2023-11-24T06:16:48.912392+0000","last_active":"2023-11-24T06:16:50.730590+0000","last_peered":"2023-11-24T06:16:50.730590+0000","last_clean":"2023-11-24T06:16:50.730590+0000","last_became_active":"2023-11-24T06:16:48.911964+0000","last_became_peered":"2023-11-24T06:16:48.911964+0000","last_unstale":"2023-11-24T06:16:50.730590+0000","last_undegraded":"2023-11-24T06:16:50.730590+0000","last_fullsized":"2023-11-24T06:16:50.730590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:41.099208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732471+0000","last_change":"2023-11-24T06:16:48.907459+0000","last_active":"2023-11-24T06:16:50.732471+0000","last_peered":"2023-11-24T06:16:50.732471+0000","last_clean":"2023-11-24T06:16:50.732471+0000","last_became_active":"2023-11-24T06:16:48.907162+0000","last_became_peered":"2023-11-24T06:16:48.907162+0000","last_unstale":"2023-11-24T06:16:50.732471+0000","last_undegraded":"2023-11-24T06:16:50.732471+0000","last_fullsized":"2023-11-24T06:16:50.732471+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:59.372732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730205+0000","last_change":"2023-11-24T06:16:48.905138+0000","last_active":"2023-11-24T06:16:50.730205+0000","last_peered":"2023-11-24T06:16:50.730205+0000","last_clean":"2023-11-24T06:16:50.730205+0000","last_became_active":"2023-11-24T06:16:48.904811+0000","last_became_peered":"2023-11-24T06:16:48.904811+0000","last_unstale":"2023-11-24T06:16:50.730205+0000","last_undegraded":"2023-11-24T06:16:50.730205+0000","last_fullsized":"2023-11-24T06:16:50.730205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730895+0000","last_change":"2023-11-24T06:16:48.901835+0000","last_active":"2023-11-24T06:16:50.730895+0000","last_peered":"2023-11-24T06:16:50.730895+0000","last_clean":"2023-11-24T06:16:50.730895+0000","last_became_active":"2023-11-24T06:16:48.901132+0000","last_became_peered":"2023-11-24T06:16:48.901132+0000","last_unstale":"2023-11-24T06:16:50.730895+0000","last_undegraded":"2023-11-24T06:16:50.730895+0000","last_fullsized":"2023-11-24T06:16:50.730895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:00:31.668493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730094+0000","last_change":"2023-11-24T06:16:48.911955+0000","last_active":"2023-11-24T06:16:50.730094+0000","last_peered":"2023-11-24T06:16:50.730094+0000","last_clean":"2023-11-24T06:16:50.730094+0000","last_became_active":"2023-11-24T06:16:48.911607+0000","last_became_peered":"2023-11-24T06:16:48.911607+0000","last_unstale":"2023-11-24T06:16:50.730094+0000","last_undegraded":"2023-11-24T06:16:50.730094+0000","last_fullsized":"2023-11-24T06:16:50.730094+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.510348+0000","last_change":"2023-11-24T06:16:48.916913+0000","last_active":"2023-11-24T06:16:50.510348+0000","last_peered":"2023-11-24T06:16:50.510348+0000","last_clean":"2023-11-24T06:16:50.510348+0000","last_became_active":"2023-11-24T06:16:48.916319+0000","last_became_peered":"2023-11-24T06:16:48.916319+0000","last_unstale":"2023-11-24T06:16:50.510348+0000","last_undegraded":"2023-11-24T06:16:50.510348+0000","last_fullsized":"2023-11-24T06:16:50.510348+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:13:19.985350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731425+0000","last_change":"2023-11-24T06:16:48.915513+0000","last_active":"2023-11-24T06:16:50.731425+0000","last_peered":"2023-11-24T06:16:50.731425+0000","last_clean":"2023-11-24T06:16:50.731425+0000","last_became_active":"2023-11-24T06:16:48.915257+0000","last_became_peered":"2023-11-24T06:16:48.915257+0000","last_unstale":"2023-11-24T06:16:50.731425+0000","last_undegraded":"2023-11-24T06:16:50.731425+0000","last_fullsized":"2023-11-24T06:16:50.731425+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:59.778090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.888650+0000","last_change":"2023-11-24T06:16:48.883233+0000","last_active":"2023-11-24T06:16:49.888650+0000","last_peered":"2023-11-24T06:16:49.888650+0000","last_clean":"2023-11-24T06:16:49.888650+0000","last_became_active":"2023-11-24T06:16:48.882746+0000","last_became_peered":"2023-11-24T06:16:48.882746+0000","last_unstale":"2023-11-24T06:16:49.888650+0000","last_undegraded":"2023-11-24T06:16:49.888650+0000","last_fullsized":"2023-11-24T06:16:49.888650+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:33.080759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504815+0000","last_change":"2023-11-24T06:16:48.909541+0000","last_active":"2023-11-24T06:16:50.504815+0000","last_peered":"2023-11-24T06:16:50.504815+0000","last_clean":"2023-11-24T06:16:50.504815+0000","last_became_active":"2023-11-24T06:16:48.909260+0000","last_became_peered":"2023-11-24T06:16:48.909260+0000","last_unstale":"2023-11-24T06:16:50.504815+0000","last_undegraded":"2023-11-24T06:16:50.504815+0000","last_fullsized":"2023-11-24T06:16:50.504815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730334+0000","last_change":"2023-11-24T06:16:48.905762+0000","last_active":"2023-11-24T06:16:50.730334+0000","last_peered":"2023-11-24T06:16:50.730334+0000","last_clean":"2023-11-24T06:16:50.730334+0000","last_became_active":"2023-11-24T06:16:48.905503+0000","last_became_peered":"2023-11-24T06:16:48.905503+0000","last_unstale":"2023-11-24T06:16:50.730334+0000","last_undegraded":"2023-11-24T06:16:50.730334+0000","last_fullsized":"2023-11-24T06:16:50.730334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:24.068967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732567+0000","last_change":"2023-11-24T06:16:48.903319+0000","last_active":"2023-11-24T06:16:50.732567+0000","last_peered":"2023-11-24T06:16:50.732567+0000","last_clean":"2023-11-24T06:16:50.732567+0000","last_became_active":"2023-11-24T06:16:48.903054+0000","last_became_peered":"2023-11-24T06:16:48.903054+0000","last_unstale":"2023-11-24T06:16:50.732567+0000","last_undegraded":"2023-11-24T06:16:50.732567+0000","last_fullsized":"2023-11-24T06:16:50.732567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:51:37.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730374+0000","last_change":"2023-11-24T06:16:48.897749+0000","last_active":"2023-11-24T06:16:50.730374+0000","last_peered":"2023-11-24T06:16:50.730374+0000","last_clean":"2023-11-24T06:16:50.730374+0000","last_became_active":"2023-11-24T06:16:48.897428+0000","last_became_peered":"2023-11-24T06:16:48.897428+0000","last_unstale":"2023-11-24T06:16:50.730374+0000","last_undegraded":"2023-11-24T06:16:50.730374+0000","last_fullsized":"2023-11-24T06:16:50.730374+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.729407+0000","last_change":"2023-11-24T06:16:48.900860+0000","last_active":"2023-11-24T06:16:50.729407+0000","last_peered":"2023-11-24T06:16:50.729407+0000","last_clean":"2023-11-24T06:16:50.729407+0000","last_became_active":"2023-11-24T06:16:48.900335+0000","last_became_peered":"2023-11-24T06:16:48.900335+0000","last_unstale":"2023-11-24T06:16:50.729407+0000","last_undegraded":"2023-11-24T06:16:50.729407+0000","last_fullsized":"2023-11-24T06:16:50.729407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:42:20.085808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504228+0000","last_change":"2023-11-24T06:16:48.920906+0000","last_active":"2023-11-24T06:16:50.504228+0000","last_peered":"2023-11-24T06:16:50.504228+0000","last_clean":"2023-11-24T06:16:50.504228+0000","last_became_active":"2023-11-24T06:16:48.919808+0000","last_became_peered":"2023-11-24T06:16:48.919808+0000","last_unstale":"2023-11-24T06:16:50.504228+0000","last_undegraded":"2023-11-24T06:16:50.504228+0000","last_fullsized":"2023-11-24T06:16:50.504228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:55.505367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504907+0000","last_change":"2023-11-24T06:16:48.922108+0000","last_active":"2023-11-24T06:16:50.504907+0000","last_peered":"2023-11-24T06:16:50.504907+0000","last_clean":"2023-11-24T06:16:50.504907+0000","last_became_active":"2023-11-24T06:16:48.921158+0000","last_became_peered":"2023-11-24T06:16:48.921158+0000","last_unstale":"2023-11-24T06:16:50.504907+0000","last_undegraded":"2023-11-24T06:16:50.504907+0000","last_fullsized":"2023-11-24T06:16:50.504907+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.924912+0000","last_change":"2023-11-24T06:16:47.870996+0000","last_active":"2023-11-24T06:16:48.924912+0000","last_peered":"2023-11-24T06:16:48.924912+0000","last_clean":"2023-11-24T06:16:48.924912+0000","last_became_active":"2023-11-24T06:16:47.870728+0000","last_became_peered":"2023-11-24T06:16:47.870728+0000","last_unstale":"2023-11-24T06:16:48.924912+0000","last_undegraded":"2023-11-24T06:16:48.924912+0000","last_fullsized":"2023-11-24T06:16:48.924912+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884607+0000","last_change":"2023-11-24T06:16:48.896573+0000","last_active":"2023-11-24T06:16:49.884607+0000","last_peered":"2023-11-24T06:16:49.884607+0000","last_clean":"2023-11-24T06:16:49.884607+0000","last_became_active":"2023-11-24T06:16:48.896114+0000","last_became_peered":"2023-11-24T06:16:48.896114+0000","last_unstale":"2023-11-24T06:16:49.884607+0000","last_undegraded":"2023-11-24T06:16:49.884607+0000","last_fullsized":"2023-11-24T06:16:49.884607+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:35.109896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.915743+0000","last_change":"2023-11-24T06:16:47.873548+0000","last_active":"2023-11-24T06:16:48.915743+0000","last_peered":"2023-11-24T06:16:48.915743+0000","last_clean":"2023-11-24T06:16:48.915743+0000","last_became_active":"2023-11-24T06:16:47.873228+0000","last_became_peered":"2023-11-24T06:16:47.873228+0000","last_unstale":"2023-11-24T06:16:48.915743+0000","last_undegraded":"2023-11-24T06:16:48.915743+0000","last_fullsized":"2023-11-24T06:16:48.915743+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:26.312030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504745+0000","last_change":"2023-11-24T06:16:48.910599+0000","last_active":"2023-11-24T06:16:50.504745+0000","last_peered":"2023-11-24T06:16:50.504745+0000","last_clean":"2023-11-24T06:16:50.504745+0000","last_became_active":"2023-11-24T06:16:48.910163+0000","last_became_peered":"2023-11-24T06:16:48.910163+0000","last_unstale":"2023-11-24T06:16:50.504745+0000","last_undegraded":"2023-11-24T06:16:50.504745+0000","last_fullsized":"2023-11-24T06:16:50.504745+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.922461+0000","last_change":"2023-11-24T06:16:47.869007+0000","last_active":"2023-11-24T06:16:48.922461+0000","last_peered":"2023-11-24T06:16:48.922461+0000","last_clean":"2023-11-24T06:16:48.922461+0000","last_became_active":"2023-11-24T06:16:47.868662+0000","last_became_peered":"2023-11-24T06:16:47.868662+0000","last_unstale":"2023-11-24T06:16:48.922461+0000","last_undegraded":"2023-11-24T06:16:48.922461+0000","last_fullsized":"2023-11-24T06:16:48.922461+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:50.138700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504844+0000","last_change":"2023-11-24T06:16:48.910599+0000","last_active":"2023-11-24T06:16:50.504844+0000","last_peered":"2023-11-24T06:16:50.504844+0000","last_clean":"2023-11-24T06:16:50.504844+0000","last_became_active":"2023-11-24T06:16:48.910244+0000","last_became_peered":"2023-11-24T06:16:48.910244+0000","last_unstale":"2023-11-24T06:16:50.504844+0000","last_undegraded":"2023-11-24T06:16:50.504844+0000","last_fullsized":"2023-11-24T06:16:50.504844+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.914357+0000","last_change":"2023-11-24T06:16:47.871257+0000","last_active":"2023-11-24T06:16:48.914357+0000","last_peered":"2023-11-24T06:16:48.914357+0000","last_clean":"2023-11-24T06:16:48.914357+0000","last_became_active":"2023-11-24T06:16:47.870777+0000","last_became_peered":"2023-11-24T06:16:47.870777+0000","last_unstale":"2023-11-24T06:16:48.914357+0000","last_undegraded":"2023-11-24T06:16:48.914357+0000","last_fullsized":"2023-11-24T06:16:48.914357+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:54.500222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731023+0000","last_change":"2023-11-24T06:16:48.898179+0000","last_active":"2023-11-24T06:16:50.731023+0000","last_peered":"2023-11-24T06:16:50.731023+0000","last_clean":"2023-11-24T06:16:50.731023+0000","last_became_active":"2023-11-24T06:16:48.897817+0000","last_became_peered":"2023-11-24T06:16:48.897817+0000","last_unstale":"2023-11-24T06:16:50.731023+0000","last_undegraded":"2023-11-24T06:16:50.731023+0000","last_fullsized":"2023-11-24T06:16:50.731023+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:51:23.856483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.914658+0000","last_change":"2023-11-24T06:16:47.863936+0000","last_active":"2023-11-24T06:16:48.914658+0000","last_peered":"2023-11-24T06:16:48.914658+0000","last_clean":"2023-11-24T06:16:48.914658+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.914658+0000","last_undegraded":"2023-11-24T06:16:48.914658+0000","last_fullsized":"2023-11-24T06:16:48.914658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732389+0000","last_change":"2023-11-24T06:16:48.906662+0000","last_active":"2023-11-24T06:16:50.732389+0000","last_peered":"2023-11-24T06:16:50.732389+0000","last_clean":"2023-11-24T06:16:50.732389+0000","last_became_active":"2023-11-24T06:16:48.906358+0000","last_became_peered":"2023-11-24T06:16:48.906358+0000","last_unstale":"2023-11-24T06:16:50.732389+0000","last_undegraded":"2023-11-24T06:16:50.732389+0000","last_fullsized":"2023-11-24T06:16:50.732389+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:30.474813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.920119+0000","last_change":"2023-11-24T06:16:47.869191+0000","last_active":"2023-11-24T06:16:48.920119+0000","last_peered":"2023-11-24T06:16:48.920119+0000","last_clean":"2023-11-24T06:16:48.920119+0000","last_became_active":"2023-11-24T06:16:47.868879+0000","last_became_peered":"2023-11-24T06:16:47.868879+0000","last_unstale":"2023-11-24T06:16:48.920119+0000","last_undegraded":"2023-11-24T06:16:48.920119+0000","last_fullsized":"2023-11-24T06:16:48.920119+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:25.375717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.510778+0000","last_change":"2023-11-24T06:16:48.895030+0000","last_active":"2023-11-24T06:16:50.510778+0000","last_peered":"2023-11-24T06:16:50.510778+0000","last_clean":"2023-11-24T06:16:50.510778+0000","last_became_active":"2023-11-24T06:16:48.894763+0000","last_became_peered":"2023-11-24T06:16:48.894763+0000","last_unstale":"2023-11-24T06:16:50.510778+0000","last_undegraded":"2023-11-24T06:16:50.510778+0000","last_fullsized":"2023-11-24T06:16:50.510778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:58:43.375446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.880141+0000","last_change":"2023-11-24T06:16:47.858024+0000","last_active":"2023-11-24T06:16:48.880141+0000","last_peered":"2023-11-24T06:16:48.880141+0000","last_clean":"2023-11-24T06:16:48.880141+0000","last_became_active":"2023-11-24T06:16:47.856960+0000","last_became_peered":"2023-11-24T06:16:47.856960+0000","last_unstale":"2023-11-24T06:16:48.880141+0000","last_undegraded":"2023-11-24T06:16:48.880141+0000","last_fullsized":"2023-11-24T06:16:48.880141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:56.432004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730970+0000","last_change":"2023-11-24T06:16:48.895103+0000","last_active":"2023-11-24T06:16:50.730970+0000","last_peered":"2023-11-24T06:16:50.730970+0000","last_clean":"2023-11-24T06:16:50.730970+0000","last_became_active":"2023-11-24T06:16:48.894644+0000","last_became_peered":"2023-11-24T06:16:48.894644+0000","last_unstale":"2023-11-24T06:16:50.730970+0000","last_undegraded":"2023-11-24T06:16:50.730970+0000","last_fullsized":"2023-11-24T06:16:50.730970+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:26.856867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.875899+0000","last_change":"2023-11-24T06:16:47.862985+0000","last_active":"2023-11-24T06:16:48.875899+0000","last_peered":"2023-11-24T06:16:48.875899+0000","last_clean":"2023-11-24T06:16:48.875899+0000","last_became_active":"2023-11-24T06:16:47.862698+0000","last_became_peered":"2023-11-24T06:16:47.862698+0000","last_unstale":"2023-11-24T06:16:48.875899+0000","last_undegraded":"2023-11-24T06:16:48.875899+0000","last_fullsized":"2023-11-24T06:16:48.875899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:40.831546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889218+0000","last_change":"2023-11-24T06:16:48.891060+0000","last_active":"2023-11-24T06:16:49.889218+0000","last_peered":"2023-11-24T06:16:49.889218+0000","last_clean":"2023-11-24T06:16:49.889218+0000","last_became_active":"2023-11-24T06:16:48.890385+0000","last_became_peered":"2023-11-24T06:16:48.890385+0000","last_unstale":"2023-11-24T06:16:49.889218+0000","last_undegraded":"2023-11-24T06:16:49.889218+0000","last_fullsized":"2023-11-24T06:16:49.889218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:21.198952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.891171+0000","last_change":"2023-11-24T06:16:47.876806+0000","last_active":"2023-11-24T06:16:48.891171+0000","last_peered":"2023-11-24T06:16:48.891171+0000","last_clean":"2023-11-24T06:16:48.891171+0000","last_became_active":"2023-11-24T06:16:47.876538+0000","last_became_peered":"2023-11-24T06:16:47.876538+0000","last_unstale":"2023-11-24T06:16:48.891171+0000","last_undegraded":"2023-11-24T06:16:48.891171+0000","last_fullsized":"2023-11-24T06:16:48.891171+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:14.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731316+0000","last_change":"2023-11-24T06:16:48.915135+0000","last_active":"2023-11-24T06:16:50.731316+0000","last_peered":"2023-11-24T06:16:50.731316+0000","last_clean":"2023-11-24T06:16:50.731316+0000","last_became_active":"2023-11-24T06:16:48.914916+0000","last_became_peered":"2023-11-24T06:16:48.914916+0000","last_unstale":"2023-11-24T06:16:50.731316+0000","last_undegraded":"2023-11-24T06:16:50.731316+0000","last_fullsized":"2023-11-24T06:16:50.731316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:05:20.197865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.890709+0000","last_change":"2023-11-24T06:16:47.866036+0000","last_active":"2023-11-24T06:16:48.890709+0000","last_peered":"2023-11-24T06:16:48.890709+0000","last_clean":"2023-11-24T06:16:48.890709+0000","last_became_active":"2023-11-24T06:16:47.865636+0000","last_became_peered":"2023-11-24T06:16:47.865636+0000","last_unstale":"2023-11-24T06:16:48.890709+0000","last_undegraded":"2023-11-24T06:16:48.890709+0000","last_fullsized":"2023-11-24T06:16:48.890709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:51.426322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884260+0000","last_change":"2023-11-24T06:16:48.884882+0000","last_active":"2023-11-24T06:16:49.884260+0000","last_peered":"2023-11-24T06:16:49.884260+0000","last_clean":"2023-11-24T06:16:49.884260+0000","last_became_active":"2023-11-24T06:16:48.884435+0000","last_became_peered":"2023-11-24T06:16:48.884435+0000","last_unstale":"2023-11-24T06:16:49.884260+0000","last_undegraded":"2023-11-24T06:16:49.884260+0000","last_fullsized":"2023-11-24T06:16:49.884260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:49:41.836691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.915314+0000","last_change":"2023-11-24T06:16:47.876849+0000","last_active":"2023-11-24T06:16:48.915314+0000","last_peered":"2023-11-24T06:16:48.915314+0000","last_clean":"2023-11-24T06:16:48.915314+0000","last_became_active":"2023-11-24T06:16:47.876481+0000","last_became_peered":"2023-11-24T06:16:47.876481+0000","last_unstale":"2023-11-24T06:16:48.915314+0000","last_undegraded":"2023-11-24T06:16:48.915314+0000","last_fullsized":"2023-11-24T06:16:48.915314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731074+0000","last_change":"2023-11-24T06:16:48.906432+0000","last_active":"2023-11-24T06:16:50.731074+0000","last_peered":"2023-11-24T06:16:50.731074+0000","last_clean":"2023-11-24T06:16:50.731074+0000","last_became_active":"2023-11-24T06:16:48.905770+0000","last_became_peered":"2023-11-24T06:16:48.905770+0000","last_unstale":"2023-11-24T06:16:50.731074+0000","last_undegraded":"2023-11-24T06:16:50.731074+0000","last_fullsized":"2023-11-24T06:16:50.731074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:25:52.431467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.924579+0000","last_change":"2023-11-24T06:16:47.871704+0000","last_active":"2023-11-24T06:16:48.924579+0000","last_peered":"2023-11-24T06:16:48.924579+0000","last_clean":"2023-11-24T06:16:48.924579+0000","last_became_active":"2023-11-24T06:16:47.870074+0000","last_became_peered":"2023-11-24T06:16:47.870074+0000","last_unstale":"2023-11-24T06:16:48.924579+0000","last_undegraded":"2023-11-24T06:16:48.924579+0000","last_fullsized":"2023-11-24T06:16:48.924579+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:01:17.477112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.888852+0000","last_change":"2023-11-24T06:16:48.887127+0000","last_active":"2023-11-24T06:16:49.888852+0000","last_peered":"2023-11-24T06:16:49.888852+0000","last_clean":"2023-11-24T06:16:49.888852+0000","last_became_active":"2023-11-24T06:16:48.886835+0000","last_became_peered":"2023-11-24T06:16:48.886835+0000","last_unstale":"2023-11-24T06:16:49.888852+0000","last_undegraded":"2023-11-24T06:16:49.888852+0000","last_fullsized":"2023-11-24T06:16:49.888852+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:15.605563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.921291+0000","last_change":"2023-11-24T06:16:47.863197+0000","last_active":"2023-11-24T06:16:48.921291+0000","last_peered":"2023-11-24T06:16:48.921291+0000","last_clean":"2023-11-24T06:16:48.921291+0000","last_became_active":"2023-11-24T06:16:47.862546+0000","last_became_peered":"2023-11-24T06:16:47.862546+0000","last_unstale":"2023-11-24T06:16:48.921291+0000","last_undegraded":"2023-11-24T06:16:48.921291+0000","last_fullsized":"2023-11-24T06:16:48.921291+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:57.415614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730614+0000","last_change":"2023-11-24T06:16:48.899616+0000","last_active":"2023-11-24T06:16:50.730614+0000","last_peered":"2023-11-24T06:16:50.730614+0000","last_clean":"2023-11-24T06:16:50.730614+0000","last_became_active":"2023-11-24T06:16:48.899337+0000","last_became_peered":"2023-11-24T06:16:48.899337+0000","last_unstale":"2023-11-24T06:16:50.730614+0000","last_undegraded":"2023-11-24T06:16:50.730614+0000","last_fullsized":"2023-11-24T06:16:50.730614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:09:36.957387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.879332+0000","last_change":"2023-11-24T06:16:47.870027+0000","last_active":"2023-11-24T06:16:48.879332+0000","last_peered":"2023-11-24T06:16:48.879332+0000","last_clean":"2023-11-24T06:16:48.879332+0000","last_became_active":"2023-11-24T06:16:47.869101+0000","last_became_peered":"2023-11-24T06:16:47.869101+0000","last_unstale":"2023-11-24T06:16:48.879332+0000","last_undegraded":"2023-11-24T06:16:48.879332+0000","last_fullsized":"2023-11-24T06:16:48.879332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:20:33.578617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.887916+0000","last_change":"2023-11-24T06:16:48.893887+0000","last_active":"2023-11-24T06:16:49.887916+0000","last_peered":"2023-11-24T06:16:49.887916+0000","last_clean":"2023-11-24T06:16:49.887916+0000","last_became_active":"2023-11-24T06:16:48.893525+0000","last_became_peered":"2023-11-24T06:16:48.893525+0000","last_unstale":"2023-11-24T06:16:49.887916+0000","last_undegraded":"2023-11-24T06:16:49.887916+0000","last_fullsized":"2023-11-24T06:16:49.887916+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:39:38.395169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.880164+0000","last_change":"2023-11-24T06:16:47.872547+0000","last_active":"2023-11-24T06:16:48.880164+0000","last_peered":"2023-11-24T06:16:48.880164+0000","last_clean":"2023-11-24T06:16:48.880164+0000","last_became_active":"2023-11-24T06:16:47.872211+0000","last_became_peered":"2023-11-24T06:16:47.872211+0000","last_unstale":"2023-11-24T06:16:48.880164+0000","last_undegraded":"2023-11-24T06:16:48.880164+0000","last_fullsized":"2023-11-24T06:16:48.880164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:48.204786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730290+0000","last_change":"2023-11-24T06:16:48.912149+0000","last_active":"2023-11-24T06:16:50.730290+0000","last_peered":"2023-11-24T06:16:50.730290+0000","last_clean":"2023-11-24T06:16:50.730290+0000","last_became_active":"2023-11-24T06:16:48.911881+0000","last_became_peered":"2023-11-24T06:16:48.911881+0000","last_unstale":"2023-11-24T06:16:50.730290+0000","last_undegraded":"2023-11-24T06:16:50.730290+0000","last_fullsized":"2023-11-24T06:16:50.730290+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.912043+0000","last_change":"2023-11-24T06:16:47.874455+0000","last_active":"2023-11-24T06:16:48.912043+0000","last_peered":"2023-11-24T06:16:48.912043+0000","last_clean":"2023-11-24T06:16:48.912043+0000","last_became_active":"2023-11-24T06:16:47.873907+0000","last_became_peered":"2023-11-24T06:16:47.873907+0000","last_unstale":"2023-11-24T06:16:48.912043+0000","last_undegraded":"2023-11-24T06:16:48.912043+0000","last_fullsized":"2023-11-24T06:16:48.912043+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:32.075614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730973+0000","last_change":"2023-11-24T06:16:48.902937+0000","last_active":"2023-11-24T06:16:50.730973+0000","last_peered":"2023-11-24T06:16:50.730973+0000","last_clean":"2023-11-24T06:16:50.730973+0000","last_became_active":"2023-11-24T06:16:48.902630+0000","last_became_peered":"2023-11-24T06:16:48.902630+0000","last_unstale":"2023-11-24T06:16:50.730973+0000","last_undegraded":"2023-11-24T06:16:50.730973+0000","last_fullsized":"2023-11-24T06:16:50.730973+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:27.317175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.920600+0000","last_change":"2023-11-24T06:16:47.862458+0000","last_active":"2023-11-24T06:16:48.920600+0000","last_peered":"2023-11-24T06:16:48.920600+0000","last_clean":"2023-11-24T06:16:48.920600+0000","last_became_active":"2023-11-24T06:16:47.862117+0000","last_became_peered":"2023-11-24T06:16:47.862117+0000","last_unstale":"2023-11-24T06:16:48.920600+0000","last_undegraded":"2023-11-24T06:16:48.920600+0000","last_fullsized":"2023-11-24T06:16:48.920600+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:16:29.279401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.888653+0000","last_change":"2023-11-24T06:16:48.886388+0000","last_active":"2023-11-24T06:16:49.888653+0000","last_peered":"2023-11-24T06:16:49.888653+0000","last_clean":"2023-11-24T06:16:49.888653+0000","last_became_active":"2023-11-24T06:16:48.886072+0000","last_became_peered":"2023-11-24T06:16:48.886072+0000","last_unstale":"2023-11-24T06:16:49.888653+0000","last_undegraded":"2023-11-24T06:16:49.888653+0000","last_fullsized":"2023-11-24T06:16:49.888653+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.924082+0000","last_change":"2023-11-24T06:16:47.870009+0000","last_active":"2023-11-24T06:16:48.924082+0000","last_peered":"2023-11-24T06:16:48.924082+0000","last_clean":"2023-11-24T06:16:48.924082+0000","last_became_active":"2023-11-24T06:16:47.869406+0000","last_became_peered":"2023-11-24T06:16:47.869406+0000","last_unstale":"2023-11-24T06:16:48.924082+0000","last_undegraded":"2023-11-24T06:16:48.924082+0000","last_fullsized":"2023-11-24T06:16:48.924082+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:02.501049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.732573+0000","last_change":"2023-11-24T06:16:48.895309+0000","last_active":"2023-11-24T06:16:50.732573+0000","last_peered":"2023-11-24T06:16:50.732573+0000","last_clean":"2023-11-24T06:16:50.732573+0000","last_became_active":"2023-11-24T06:16:48.894921+0000","last_became_peered":"2023-11-24T06:16:48.894921+0000","last_unstale":"2023-11-24T06:16:50.732573+0000","last_undegraded":"2023-11-24T06:16:50.732573+0000","last_fullsized":"2023-11-24T06:16:50.732573+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:54:38.154217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.917315+0000","last_change":"2023-11-24T06:16:47.873847+0000","last_active":"2023-11-24T06:16:48.917315+0000","last_peered":"2023-11-24T06:16:48.917315+0000","last_clean":"2023-11-24T06:16:48.917315+0000","last_became_active":"2023-11-24T06:16:47.873471+0000","last_became_peered":"2023-11-24T06:16:47.873471+0000","last_unstale":"2023-11-24T06:16:48.917315+0000","last_undegraded":"2023-11-24T06:16:48.917315+0000","last_fullsized":"2023-11-24T06:16:48.917315+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:20.193807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730873+0000","last_change":"2023-11-24T06:16:48.906615+0000","last_active":"2023-11-24T06:16:50.730873+0000","last_peered":"2023-11-24T06:16:50.730873+0000","last_clean":"2023-11-24T06:16:50.730873+0000","last_became_active":"2023-11-24T06:16:48.906147+0000","last_became_peered":"2023-11-24T06:16:48.906147+0000","last_unstale":"2023-11-24T06:16:50.730873+0000","last_undegraded":"2023-11-24T06:16:50.730873+0000","last_fullsized":"2023-11-24T06:16:50.730873+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:20:49.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.898383+0000","last_change":"2023-11-24T06:16:47.869212+0000","last_active":"2023-11-24T06:16:48.898383+0000","last_peered":"2023-11-24T06:16:48.898383+0000","last_clean":"2023-11-24T06:16:48.898383+0000","last_became_active":"2023-11-24T06:16:47.868677+0000","last_became_peered":"2023-11-24T06:16:47.868677+0000","last_unstale":"2023-11-24T06:16:48.898383+0000","last_undegraded":"2023-11-24T06:16:48.898383+0000","last_fullsized":"2023-11-24T06:16:48.898383+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:06.951566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889204+0000","last_change":"2023-11-24T06:16:48.886579+0000","last_active":"2023-11-24T06:16:49.889204+0000","last_peered":"2023-11-24T06:16:49.889204+0000","last_clean":"2023-11-24T06:16:49.889204+0000","last_became_active":"2023-11-24T06:16:48.886267+0000","last_became_peered":"2023-11-24T06:16:48.886267+0000","last_unstale":"2023-11-24T06:16:49.889204+0000","last_undegraded":"2023-11-24T06:16:49.889204+0000","last_fullsized":"2023-11-24T06:16:49.889204+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:27:21.011528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.916366+0000","last_change":"2023-11-24T06:16:47.859062+0000","last_active":"2023-11-24T06:16:48.916366+0000","last_peered":"2023-11-24T06:16:48.916366+0000","last_clean":"2023-11-24T06:16:48.916366+0000","last_became_active":"2023-11-24T06:16:47.858688+0000","last_became_peered":"2023-11-24T06:16:47.858688+0000","last_unstale":"2023-11-24T06:16:48.916366+0000","last_undegraded":"2023-11-24T06:16:48.916366+0000","last_fullsized":"2023-11-24T06:16:48.916366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:52.914802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504436+0000","last_change":"2023-11-24T06:16:48.916325+0000","last_active":"2023-11-24T06:16:50.504436+0000","last_peered":"2023-11-24T06:16:50.504436+0000","last_clean":"2023-11-24T06:16:50.504436+0000","last_became_active":"2023-11-24T06:16:48.916012+0000","last_became_peered":"2023-11-24T06:16:48.916012+0000","last_unstale":"2023-11-24T06:16:50.504436+0000","last_undegraded":"2023-11-24T06:16:50.504436+0000","last_fullsized":"2023-11-24T06:16:50.504436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:16.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.892116+0000","last_change":"2023-11-24T06:16:47.863548+0000","last_active":"2023-11-24T06:16:48.892116+0000","last_peered":"2023-11-24T06:16:48.892116+0000","last_clean":"2023-11-24T06:16:48.892116+0000","last_became_active":"2023-11-24T06:16:47.863229+0000","last_became_peered":"2023-11-24T06:16:47.863229+0000","last_unstale":"2023-11-24T06:16:48.892116+0000","last_undegraded":"2023-11-24T06:16:48.892116+0000","last_fullsized":"2023-11-24T06:16:48.892116+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:00.282582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.504054+0000","last_change":"2023-11-24T06:16:48.919996+0000","last_active":"2023-11-24T06:16:50.504054+0000","last_peered":"2023-11-24T06:16:50.504054+0000","last_clean":"2023-11-24T06:16:50.504054+0000","last_became_active":"2023-11-24T06:16:48.919705+0000","last_became_peered":"2023-11-24T06:16:48.919705+0000","last_unstale":"2023-11-24T06:16:50.504054+0000","last_undegraded":"2023-11-24T06:16:50.504054+0000","last_fullsized":"2023-11-24T06:16:50.504054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:15:42.334420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.878717+0000","last_change":"2023-11-24T06:16:47.864670+0000","last_active":"2023-11-24T06:16:48.878717+0000","last_peered":"2023-11-24T06:16:48.878717+0000","last_clean":"2023-11-24T06:16:48.878717+0000","last_became_active":"2023-11-24T06:16:47.864390+0000","last_became_peered":"2023-11-24T06:16:47.864390+0000","last_unstale":"2023-11-24T06:16:48.878717+0000","last_undegraded":"2023-11-24T06:16:48.878717+0000","last_fullsized":"2023-11-24T06:16:48.878717+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:26:28.591350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889060+0000","last_change":"2023-11-24T06:16:48.900948+0000","last_active":"2023-11-24T06:16:49.889060+0000","last_peered":"2023-11-24T06:16:49.889060+0000","last_clean":"2023-11-24T06:16:49.889060+0000","last_became_active":"2023-11-24T06:16:48.900474+0000","last_became_peered":"2023-11-24T06:16:48.900474+0000","last_unstale":"2023-11-24T06:16:49.889060+0000","last_undegraded":"2023-11-24T06:16:49.889060+0000","last_fullsized":"2023-11-24T06:16:49.889060+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:49:18.137534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.917578+0000","last_change":"2023-11-24T06:16:47.863613+0000","last_active":"2023-11-24T06:16:48.917578+0000","last_peered":"2023-11-24T06:16:48.917578+0000","last_clean":"2023-11-24T06:16:48.917578+0000","last_became_active":"2023-11-24T06:16:47.863279+0000","last_became_peered":"2023-11-24T06:16:47.863279+0000","last_unstale":"2023-11-24T06:16:48.917578+0000","last_undegraded":"2023-11-24T06:16:48.917578+0000","last_fullsized":"2023-11-24T06:16:48.917578+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:04.284985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.889031+0000","last_change":"2023-11-24T06:16:48.896370+0000","last_active":"2023-11-24T06:16:49.889031+0000","last_peered":"2023-11-24T06:16:49.889031+0000","last_clean":"2023-11-24T06:16:49.889031+0000","last_became_active":"2023-11-24T06:16:48.895454+0000","last_became_peered":"2023-11-24T06:16:48.895454+0000","last_unstale":"2023-11-24T06:16:49.889031+0000","last_undegraded":"2023-11-24T06:16:49.889031+0000","last_fullsized":"2023-11-24T06:16:49.889031+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:46.542522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.505170+0000","last_change":"2023-11-24T06:16:47.870072+0000","last_active":"2023-11-24T06:16:50.505170+0000","last_peered":"2023-11-24T06:16:50.505170+0000","last_clean":"2023-11-24T06:16:50.505170+0000","last_became_active":"2023-11-24T06:16:47.869378+0000","last_became_peered":"2023-11-24T06:16:47.869378+0000","last_unstale":"2023-11-24T06:16:50.505170+0000","last_undegraded":"2023-11-24T06:16:50.505170+0000","last_fullsized":"2023-11-24T06:16:50.505170+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:28:53.439168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884526+0000","last_change":"2023-11-24T06:16:48.887076+0000","last_active":"2023-11-24T06:16:49.884526+0000","last_peered":"2023-11-24T06:16:49.884526+0000","last_clean":"2023-11-24T06:16:49.884526+0000","last_became_active":"2023-11-24T06:16:48.886197+0000","last_became_peered":"2023-11-24T06:16:48.886197+0000","last_unstale":"2023-11-24T06:16:49.884526+0000","last_undegraded":"2023-11-24T06:16:49.884526+0000","last_fullsized":"2023-11-24T06:16:49.884526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:14.428755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.879171+0000","last_change":"2023-11-24T06:16:47.861764+0000","last_active":"2023-11-24T06:16:48.879171+0000","last_peered":"2023-11-24T06:16:48.879171+0000","last_clean":"2023-11-24T06:16:48.879171+0000","last_became_active":"2023-11-24T06:16:47.861429+0000","last_became_peered":"2023-11-24T06:16:47.861429+0000","last_unstale":"2023-11-24T06:16:48.879171+0000","last_undegraded":"2023-11-24T06:16:48.879171+0000","last_fullsized":"2023-11-24T06:16:48.879171+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:37:57.635600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.505254+0000","last_change":"2023-11-24T06:16:48.910700+0000","last_active":"2023-11-24T06:16:50.505254+0000","last_peered":"2023-11-24T06:16:50.505254+0000","last_clean":"2023-11-24T06:16:50.505254+0000","last_became_active":"2023-11-24T06:16:48.910427+0000","last_became_peered":"2023-11-24T06:16:48.910427+0000","last_unstale":"2023-11-24T06:16:50.505254+0000","last_undegraded":"2023-11-24T06:16:50.505254+0000","last_fullsized":"2023-11-24T06:16:50.505254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:45:36.669876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.880429+0000","last_change":"2023-11-24T06:16:47.859106+0000","last_active":"2023-11-24T06:16:48.880429+0000","last_peered":"2023-11-24T06:16:48.880429+0000","last_clean":"2023-11-24T06:16:48.880429+0000","last_became_active":"2023-11-24T06:16:47.858851+0000","last_became_peered":"2023-11-24T06:16:47.858851+0000","last_unstale":"2023-11-24T06:16:48.880429+0000","last_undegraded":"2023-11-24T06:16:48.880429+0000","last_fullsized":"2023-11-24T06:16:48.880429+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:11.207235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731409+0000","last_change":"2023-11-24T06:16:48.902068+0000","last_active":"2023-11-24T06:16:50.731409+0000","last_peered":"2023-11-24T06:16:50.731409+0000","last_clean":"2023-11-24T06:16:50.731409+0000","last_became_active":"2023-11-24T06:16:48.901578+0000","last_became_peered":"2023-11-24T06:16:48.901578+0000","last_unstale":"2023-11-24T06:16:50.731409+0000","last_undegraded":"2023-11-24T06:16:50.731409+0000","last_fullsized":"2023-11-24T06:16:50.731409+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:52:42.537057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.892132+0000","last_change":"2023-11-24T06:16:47.867455+0000","last_active":"2023-11-24T06:16:48.892132+0000","last_peered":"2023-11-24T06:16:48.892132+0000","last_clean":"2023-11-24T06:16:48.892132+0000","last_became_active":"2023-11-24T06:16:47.867160+0000","last_became_peered":"2023-11-24T06:16:47.867160+0000","last_unstale":"2023-11-24T06:16:48.892132+0000","last_undegraded":"2023-11-24T06:16:48.892132+0000","last_fullsized":"2023-11-24T06:16:48.892132+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:48.066853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730790+0000","last_change":"2023-11-24T06:16:48.912483+0000","last_active":"2023-11-24T06:16:50.730790+0000","last_peered":"2023-11-24T06:16:50.730790+0000","last_clean":"2023-11-24T06:16:50.730790+0000","last_became_active":"2023-11-24T06:16:48.912236+0000","last_became_peered":"2023-11-24T06:16:48.912236+0000","last_unstale":"2023-11-24T06:16:50.730790+0000","last_undegraded":"2023-11-24T06:16:50.730790+0000","last_fullsized":"2023-11-24T06:16:50.730790+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:58.420759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.876209+0000","last_change":"2023-11-24T06:16:47.869254+0000","last_active":"2023-11-24T06:16:48.876209+0000","last_peered":"2023-11-24T06:16:48.876209+0000","last_clean":"2023-11-24T06:16:48.876209+0000","last_became_active":"2023-11-24T06:16:47.868976+0000","last_became_peered":"2023-11-24T06:16:47.868976+0000","last_unstale":"2023-11-24T06:16:48.876209+0000","last_undegraded":"2023-11-24T06:16:48.876209+0000","last_fullsized":"2023-11-24T06:16:48.876209+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:08.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:49.884015+0000","last_change":"2023-11-24T06:16:48.889009+0000","last_active":"2023-11-24T06:16:49.884015+0000","last_peered":"2023-11-24T06:16:49.884015+0000","last_clean":"2023-11-24T06:16:49.884015+0000","last_became_active":"2023-11-24T06:16:48.888731+0000","last_became_peered":"2023-11-24T06:16:48.888731+0000","last_unstale":"2023-11-24T06:16:49.884015+0000","last_undegraded":"2023-11-24T06:16:49.884015+0000","last_fullsized":"2023-11-24T06:16:49.884015+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.892100+0000","last_change":"2023-11-24T06:16:47.869741+0000","last_active":"2023-11-24T06:16:48.892100+0000","last_peered":"2023-11-24T06:16:48.892100+0000","last_clean":"2023-11-24T06:16:48.892100+0000","last_became_active":"2023-11-24T06:16:47.869465+0000","last_became_peered":"2023-11-24T06:16:47.869465+0000","last_unstale":"2023-11-24T06:16:48.892100+0000","last_undegraded":"2023-11-24T06:16:48.892100+0000","last_fullsized":"2023-11-24T06:16:48.892100+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:06.921054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.731197+0000","last_change":"2023-11-24T06:16:48.894928+0000","last_active":"2023-11-24T06:16:50.731197+0000","last_peered":"2023-11-24T06:16:50.731197+0000","last_clean":"2023-11-24T06:16:50.731197+0000","last_became_active":"2023-11-24T06:16:48.894302+0000","last_became_peered":"2023-11-24T06:16:48.894302+0000","last_unstale":"2023-11-24T06:16:50.731197+0000","last_undegraded":"2023-11-24T06:16:50.731197+0000","last_fullsized":"2023-11-24T06:16:50.731197+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:09:34.986336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.890142+0000","last_change":"2023-11-24T06:16:47.871713+0000","last_active":"2023-11-24T06:16:48.890142+0000","last_peered":"2023-11-24T06:16:48.890142+0000","last_clean":"2023-11-24T06:16:48.890142+0000","last_became_active":"2023-11-24T06:16:47.870883+0000","last_became_peered":"2023-11-24T06:16:47.870883+0000","last_unstale":"2023-11-24T06:16:48.890142+0000","last_undegraded":"2023-11-24T06:16:48.890142+0000","last_fullsized":"2023-11-24T06:16:48.890142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:19:32.348025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-24T06:16:50.730704+0000","last_change":"2023-11-24T06:16:48.907440+0000","last_active":"2023-11-24T06:16:50.730704+0000","last_peered":"2023-11-24T06:16:50.730704+0000","last_clean":"2023-11-24T06:16:50.730704+0000","last_became_active":"2023-11-24T06:16:48.907171+0000","last_became_peered":"2023-11-24T06:16:48.907171+0000","last_unstale":"2023-11-24T06:16:50.730704+0000","last_undegraded":"2023-11-24T06:16:50.730704+0000","last_fullsized":"2023-11-24T06:16:50.730704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:47.825983+0000","last_clean_scrub_stamp":"2023-11-24T06:16:47.825983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:42.085950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.877214+0000","last_change":"2023-11-24T06:16:47.868677+0000","last_active":"2023-11-24T06:16:48.877214+0000","last_peered":"2023-11-24T06:16:48.877214+0000","last_clean":"2023-11-24T06:16:48.877214+0000","last_became_active":"2023-11-24T06:16:47.868343+0000","last_became_peered":"2023-11-24T06:16:47.868343+0000","last_unstale":"2023-11-24T06:16:48.877214+0000","last_undegraded":"2023-11-24T06:16:48.877214+0000","last_fullsized":"2023-11-24T06:16:48.877214+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:16:46.820838+0000","last_clean_scrub_stamp":"2023-11-24T06:16:46.820838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:58.772945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T06:16:48.890528+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:16:48.890528+0000","last_peered":"2023-11-24T06:16:48.890528+0000","last_clean":"2023-11-24T06:16:48.890528+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:16:48.890528+0000","last_undegraded":"2023-11-24T06:16:48.890528+0000","last_fullsized":"2023-11-24T06:16:48.890528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1236992,"data_stored":862148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.012,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.536,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.079},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2430000000000001},"min":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.6220000000000001,"5min":2.004,"15min":2.004},"last":1.242}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.198},"min":{"1min":0.79700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1579999999999999,"15min":1.153},"min":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.637,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.90000000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.234,"15min":1.23},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8069999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.337,"15min":1.339},"min":{"1min":0.95999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.71,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.135}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.351,"15min":1.347},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.4590000000000001,"15min":1.46},"min":{"1min":1.139,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.873,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.5129999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4430000000000001,"15min":1.4390000000000001},"min":{"1min":0.89800000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.704,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.4790000000000001,"15min":1.4850000000000001},"min":{"1min":1.0980000000000001,"5min":1.022,"15min":1.022},"max":{"1min":1.8300000000000001,"5min":1.944,"15min":1.944},"last":1.206}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5429999999999999,"15min":1.55},"min":{"1min":1.042,"5min":0.623,"15min":0.623},"max":{"1min":1.7589999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.476,"15min":1.48},"min":{"1min":0.95699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6859999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.7509999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":271620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.72699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.52,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0269999999999999,"15min":1.016},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.96199999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5660000000000001,"5min":1.615,"15min":1.615},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.181,"15min":1.1870000000000001},"min":{"1min":0.76100000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6419999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.206}]},{"osd":2,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.323,"15min":1.325},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9339999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.254},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.351,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.645,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.278}]},{"osd":3,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.359,"15min":1.3779999999999999},"min":{"1min":0.90300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0350000000000001,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.099},{"interface":"front","average":{"1min":1.296,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9119999999999999,"5min":2.056,"15min":2.056},"last":1.373}]},{"osd":4,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4470000000000001,"15min":1.456},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8029999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.5389999999999999,"15min":1.5449999999999999},"min":{"1min":0.80500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0219999999999998,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.474}]},{"osd":5,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.4650000000000001},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.825,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.635,"15min":1.641},"min":{"1min":0.71399999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0649999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.585}]},{"osd":7,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.5509999999999999,"15min":1.5389999999999999},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9079999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.498,"15min":1.484},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.024,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.528}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":643072,"data_stored":272272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0449999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.464,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5429999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.389}]},{"osd":1,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1579999999999999,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.619,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.292,"15min":1.3069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.542,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.2430000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2629999999999999,"15min":1.2709999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.002},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.444},"min":{"1min":0.98199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0720000000000001,"5min":2.198,"15min":2.198},"last":1.5960000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6359999999999999,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.4450000000000001,"15min":1.4510000000000001},"min":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.9470000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.96699999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6659999999999999,"5min":2.427,"15min":2.427},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.4670000000000001,"15min":1.4830000000000001},"min":{"1min":0.83299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8680000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.625}]},{"osd":6,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.5780000000000001,"15min":1.5940000000000001},"min":{"1min":1.1000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8029999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.587,"15min":1.6200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8069999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.5009999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.651,"15min":1.663},"min":{"1min":1.042,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0230000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.706,"15min":1.712},"min":{"1min":1.234,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1789999999999998,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.6739999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":273232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0129999999999999,"15min":0.997},"min":{"1min":0.69699999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1},{"interface":"front","average":{"1min":1.101,"5min":1.073,"15min":1.069},"min":{"1min":0.77800000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.052}]},{"osd":1,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.083,"15min":1.0780000000000001},"min":{"1min":0.73399999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.88900000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.71,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.53}]},{"osd":2,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.216,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.766,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.232,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5820000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.91200000000000003}]},{"osd":3,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.339},"min":{"1min":0.95099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.643,"5min":2.089,"15min":2.089},"last":1.097},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3360000000000001,"15min":1.337},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.873,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.254},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3899999999999999,"15min":1.4019999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2070000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.6100000000000001,"15min":1.6240000000000001},"min":{"1min":1.1819999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2730000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.405},{"interface":"front","average":{"1min":1.52,"5min":1.5840000000000001,"15min":1.595},"min":{"1min":1.0920000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.1789999999999998,"5min":2.222,"15min":2.222},"last":1.304}]},{"osd":7,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.5069999999999999,"15min":1.524},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.629},{"interface":"front","average":{"1min":1.595,"5min":1.7030000000000001,"15min":1.7210000000000001},"min":{"1min":1.2729999999999999,"5min":1.157,"15min":1.157},"max":{"1min":2.0190000000000001,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.6679999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":271676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.363,"5min":1.71,"15min":1.71},"last":0.751},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.054}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":0.98099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.242,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.874},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.97399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8859999999999999,"5min":1.998,"15min":1.998},"last":1.4059999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.673,"5min":1.802,"15min":1.802},"last":1.127},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1000000000000001,"15min":1.095},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.667,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.238}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":9.7599999999999998,"15min":11.188000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.833,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.464},{"interface":"front","average":{"1min":1.208,"5min":1.4139999999999999,"15min":1.448},"min":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.714,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.4450000000000001,"15min":1.4770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9370000000000001,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.399,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9159999999999999,"5min":4.274,"15min":4.274},"last":1.52}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.7669999999999999,"15min":1.825},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.1190000000000002,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.641},{"interface":"front","average":{"1min":1.26,"5min":1.399,"15min":1.4219999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0369999999999999,"5min":3.157,"15min":3.157},"last":1.3080000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5389999999999999,"15min":1.5680000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1709999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1829999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.5940000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":271676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2190000000000001,"5min":1.304,"15min":1.304},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.329}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0589999999999999,"15min":1.0680000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6879999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.357,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.131,"15min":1.137},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6950000000000001,"5min":2.355,"15min":2.355},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.159,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.03}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3,"15min":1.294},"min":{"1min":0.85499999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.875,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.4490000000000001,"15min":1.446},"min":{"1min":0.95499999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0979999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.296}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4990000000000001,"15min":1.502},"min":{"1min":0.95899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3979999999999999,"15min":1.3999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7869999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.647}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5349999999999999,"15min":1.5389999999999999},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.4119999999999999,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.591,"15min":1.589},"min":{"1min":0.92100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.512}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.544,"15min":1.5509999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0070000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":2.0019999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.577,"15min":1.5840000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.266,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.387}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":271710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1830000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1,"5min":1.002,"15min":1.002},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.879,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.95199999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.999,"15min":1.0089999999999999},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.6000000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.2450000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.712,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.361}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.907,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.712,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.365,"15min":1.393},"min":{"1min":0.84599999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.609,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.117},{"interface":"front","average":{"1min":1.337,"5min":1.5209999999999999,"15min":1.552},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7769999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.4259999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.621,"15min":1.661},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8360000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.6799999999999999,"15min":1.736},"min":{"1min":0.91200000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5860000000000001,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.2110000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5760000000000001,"15min":1.5960000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.246,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.492,"5min":1.8320000000000001,"15min":1.8879999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1619999999999999,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5960000000000001,"15min":1.6080000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.004,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.611,"15min":1.639},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.8240000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.3220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":864182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.97399999999999998,"15min":0.96999999999999997},"min":{"1min":0.53800000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6919999999999999,"5min":2.452,"15min":2.452},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.056,"15min":1.0740000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3360000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2529999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6950000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.113,"15min":1.131},"min":{"1min":0.498,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":3.411,"15min":3.411},"last":1.1339999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.645,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.258,"15min":1.264},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.579,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.446,"15min":1.452},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7949999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.448},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.575,"15min":1.605},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9379999999999999,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.532,"15min":1.5469999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0150000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5469999999999999,"15min":1.5680000000000001},"min":{"1min":0.876,"5min":0.875,"15min":0.875},"max":{"1min":2.0019999999999998,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.55}]},{"osd":6,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.9039999999999999,"15min":1.9870000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0510000000000002,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.077},{"interface":"front","average":{"1min":1.514,"5min":1.7989999999999999,"15min":1.847},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9470000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":0.91800000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.95599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0379999999999998,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.615},{"interface":"front","average":{"1min":1.536,"5min":1.841,"15min":1.8919999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0609999999999999,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.88100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:16:58.977 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:16:58.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:16:59.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.251+0000 7ff4bf95a640 1 Processor -- start 2023-11-24T06:16:59.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.251+0000 7ff4bf95a640 1 -- start start 2023-11-24T06:16:59.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bf95a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b815b440 0x7ff4b80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bf95a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4b80c59b0 0x7ff4b806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bf95a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80cc3a0 con 0x7ff4b80cbf20 2023-11-24T06:16:59.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bf95a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b815b820 con 0x7ff4b80c59b0 2023-11-24T06:16:59.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bf95a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815eea0 con 0x7ff4b815b440 2023-11-24T06:16:59.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bcef5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4b80cbf20 0x7ff4b80c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43230/0 (socket says 172.21.15.37:43230) 2023-11-24T06:16:59.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bcef5640 1 -- 172.21.15.37:0/2391912188 learned_addr learned my addr 172.21.15.37:0/2391912188 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:59.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bdef7640 1 --2- 172.21.15.37:0/2391912188 >> v2:172.21.15.37:3300/0 conn(0x7ff4b80c59b0 0x7ff4b806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.253+0000 7ff4bd6f6640 1 --2- 172.21.15.37:0/2391912188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b815b440 0x7ff4b80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.254+0000 7ff4affff640 1 -- 172.21.15.37:0/2391912188 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827605275 0 0) 0x7ff4a8001110 con 0x7ff4b80cbf20 2023-11-24T06:16:59.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.254+0000 7ff4affff640 1 -- 172.21.15.37:0/2391912188 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a4003520 con 0x7ff4b80cbf20 2023-11-24T06:16:59.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.254+0000 7ff4bdef7640 1 -- 172.21.15.37:0/2391912188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b815b440 msgr2=0x7ff4b80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.254+0000 7ff4bdef7640 1 --2- 172.21.15.37:0/2391912188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b815b440 0x7ff4b80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.254+0000 7ff4bdef7640 1 -- 172.21.15.37:0/2391912188 >> v1:172.21.15.37:6789/0 conn(0x7ff4b80cbf20 legacy=0x7ff4b80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.254+0000 7ff4bdef7640 1 -- 172.21.15.37:0/2391912188 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80abf30 con 0x7ff4b80c59b0 2023-11-24T06:16:59.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.256+0000 7ff4bdef7640 1 --2- 172.21.15.37:0/2391912188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b80c59b0 0x7ff4b806c5f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009d90 tx=0x7ff4b002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbece6348c70ef9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.256+0000 7ff4affff640 1 -- 172.21.15.37:0/2391912188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b002cbc0 con 0x7ff4b80c59b0 2023-11-24T06:16:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.256+0000 7ff4affff640 1 -- 172.21.15.37:0/2391912188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b002cd20 con 0x7ff4b80c59b0 2023-11-24T06:16:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.256+0000 7ff4affff640 1 -- 172.21.15.37:0/2391912188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0034660 con 0x7ff4b80c59b0 2023-11-24T06:16:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2391912188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b80c59b0 msgr2=0x7ff4b806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2391912188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b80c59b0 0x7ff4b806c5f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009d90 tx=0x7ff4b002be10 comp rx=0 tx=0).stop 2023-11-24T06:16:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2391912188 shutdown_connections 2023-11-24T06:16:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2391912188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b80c59b0 0x7ff4b806c5f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2391912188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b815b440 0x7ff4b80cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2391912188 >> 172.21.15.37:0/2391912188 conn(0x7ff4b80b0c50 msgr2=0x7ff4b80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2391912188 shutdown_connections 2023-11-24T06:16:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.257+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2391912188 wait complete. 2023-11-24T06:16:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.259+0000 7ff4bf95a640 1 Processor -- start 2023-11-24T06:16:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.259+0000 7ff4bf95a640 1 -- start start 2023-11-24T06:16:59.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.260+0000 7ff4bf95a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b80c59b0 0x7ff4b80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.260+0000 7ff4bf95a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4b80cbf20 0x7ff4b8159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.260+0000 7ff4bf95a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b815b440 0x7ff4b80cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.260+0000 7ff4bf95a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815a150 con 0x7ff4b815b440 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.260+0000 7ff4bf95a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8159980 con 0x7ff4b80cbf20 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.260+0000 7ff4bf95a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8159b90 con 0x7ff4b80c59b0 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b815b440 0x7ff4b80cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b815b440 0x7ff4b80cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43724/0 (socket says 172.21.15.37:43724) 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 -- 172.21.15.37:0/2870441994 learned_addr learned my addr 172.21.15.37:0/2870441994 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bd6f6640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b80c59b0 0x7ff4b80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bcef5640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4b80cbf20 0x7ff4b8159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 -- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b80c59b0 msgr2=0x7ff4b80c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b80c59b0 0x7ff4b80c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 -- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4b80cbf20 msgr2=0x7ff4b8159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4b80cbf20 0x7ff4b8159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bdef7640 1 -- 172.21.15.37:0/2870441994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0009a70 con 0x7ff4b815b440 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.261+0000 7ff4bd6f6640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b80c59b0 0x7ff4b80c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.262+0000 7ff4bdef7640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b815b440 0x7ff4b80cde90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009eb0 tx=0x7ff4b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.262+0000 7ff4adffb640 1 -- 172.21.15.37:0/2870441994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b003e610 con 0x7ff4b815b440 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.262+0000 7ff4adffb640 1 -- 172.21.15.37:0/2870441994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b002ce90 con 0x7ff4b815b440 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.262+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b8159e70 con 0x7ff4b815b440 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.262+0000 7ff4adffb640 1 -- 172.21.15.37:0/2870441994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b003e9b0 con 0x7ff4b815b440 2023-11-24T06:16:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.262+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b8155930 con 0x7ff4b815b440 2023-11-24T06:16:59.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.263+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b81554b0 con 0x7ff4b815b440 2023-11-24T06:16:59.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.264+0000 7ff4adffb640 1 -- 172.21.15.37:0/2870441994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4b003b050 con 0x7ff4b815b440 2023-11-24T06:16:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.265+0000 7ff4adffb640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff49c06ae40 0x7ff49c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.266+0000 7ff4adffb640 1 -- 172.21.15.37:0/2870441994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4b00abc50 con 0x7ff4b815b440 2023-11-24T06:16:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.266+0000 7ff4bd6f6640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff49c06ae40 0x7ff49c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.266+0000 7ff4bd6f6640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff49c06ae40 0x7ff49c06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009af0 tx=0x7ff4b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.269+0000 7ff4adffb640 1 -- 172.21.15.37:0/2870441994 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4b81554b0 con 0x7ff4b815b440 2023-11-24T06:16:59.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.536+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff4b81554b0 con 0x7ff4b815b440 2023-11-24T06:16:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.541+0000 7ff4adffb640 1 -- 172.21.15.37:0/2870441994 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff4b81554b0 con 0x7ff4b815b440 2023-11-24T06:16:59.549 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-11-24T06:16:59.549 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA== 2023-11-24T06:16:59.549 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-11-24T06:16:59.549 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-11-24T06:16:59.549 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:16:59.550 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-11-24T06:16:59.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.543+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff49c06ae40 msgr2=0x7ff49c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.543+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff49c06ae40 0x7ff49c06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009af0 tx=0x7ff4b4008040 comp rx=0 tx=0).stop 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.543+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b815b440 msgr2=0x7ff4b80cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.543+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b815b440 0x7ff4b80cde90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009eb0 tx=0x7ff4b0004a40 comp rx=0 tx=0).stop 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 shutdown_connections 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff49c06ae40 0x7ff49c06d300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4b80cbf20 0x7ff4b8159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b815b440 0x7ff4b80cde90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 --2- 172.21.15.37:0/2870441994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4b80c59b0 0x7ff4b80c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 >> 172.21.15.37:0/2870441994 conn(0x7ff4b80b0c50 msgr2=0x7ff4b8070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 shutdown_connections 2023-11-24T06:16:59.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.544+0000 7ff4bf95a640 1 -- 172.21.15.37:0/2870441994 wait complete. 2023-11-24T06:16:59.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:16:59.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.791+0000 7fd60af5c640 1 Processor -- start 2023-11-24T06:16:59.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.791+0000 7fd60af5c640 1 -- start start 2023-11-24T06:16:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.793+0000 7fd60af5c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd604144b30 0x7fd60415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.793+0000 7fd60af5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60415bf80 con 0x7fd60415c410 2023-11-24T06:16:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.793+0000 7fd60af5c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040b1560 con 0x7fd6040b1de0 2023-11-24T06:16:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.793+0000 7fd60af5c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6040b1280 con 0x7fd604144b30 2023-11-24T06:16:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.793+0000 7fd609759640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd60415c410 0x7fd6040b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43246/0 (socket says 172.21.15.37:43246) 2023-11-24T06:16:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd609759640 1 -- 172.21.15.37:0/443546393 learned_addr learned my addr 172.21.15.37:0/443546393 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:16:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd609f5a640 1 --2- 172.21.15.37:0/443546393 >> v2:172.21.15.188:3300/0 conn(0x7fd604144b30 0x7fd60415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568061796 0 0) 0x7fd60415bf80 con 0x7fd60415c410 2023-11-24T06:16:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f0003520 con 0x7fd60415c410 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121926437 0 0) 0x7fd5f0003520 con 0x7fd60415c410 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 >> v2:172.21.15.188:3300/0 conn(0x7fd604144b30 msgr2=0x7fd60415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd608f58640 1 --2- 172.21.15.37:0/443546393 >> v2:172.21.15.188:3300/0 conn(0x7fd604144b30 0x7fd60415f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.794+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 >> v1:172.21.15.188:6789/0 conn(0x7fd6040b1de0 legacy=0x7fd6040b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60415b930 con 0x7fd60415c410 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd5f4001670 con 0x7fd60415c410 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 >> v1:172.21.15.37:6789/0 conn(0x7fd60415c410 legacy=0x7fd6040b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f0003970 0x7fd5f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f00047c0 0x7fd5f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f0005180 0x7fd5f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040b1280 con 0x7fd5f0003970 2023-11-24T06:16:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f000c020 con 0x7fd5f0005180 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f000c1e0 con 0x7fd5f00047c0 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd609f5a640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f0003970 0x7fd5f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd609f5a640 1 -- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f00047c0 msgr2=0x7fd5f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd609f5a640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f00047c0 0x7fd5f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd609f5a640 1 -- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f0005180 msgr2=0x7fd5f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd60a75b640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f0005180 0x7fd5f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd609f5a640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f0005180 0x7fd5f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd609f5a640 1 -- 172.21.15.37:0/443546393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0003520 con 0x7fd5f0003970 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd60a75b640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f0005180 0x7fd5f000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.795+0000 7fd60a75b640 1 -- 172.21.15.37:0/443546393 reap_dead start 2023-11-24T06:16:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.797+0000 7fd609f5a640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f0003970 0x7fd5f0003d90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd600009ac0 tx=0x7fd5f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696207af204679ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.797+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002c6b0 con 0x7fd5f0003970 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.797+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60002c810 con 0x7fd5f0003970 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.797+0000 7fd608f58640 1 -- 172.21.15.37:0/443546393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002cba0 con 0x7fd5f0003970 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.797+0000 7fd60af5c640 1 -- 172.21.15.37:0/443546393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f0003970 msgr2=0x7fd5f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.797+0000 7fd60af5c640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f0003970 0x7fd5f0003d90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd600009ac0 tx=0x7fd5f00057f0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.798+0000 7fd60af5c640 1 -- 172.21.15.37:0/443546393 shutdown_connections 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.798+0000 7fd60af5c640 1 --2- 172.21.15.37:0/443546393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5f0003970 0x7fd5f0003d90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.798+0000 7fd60af5c640 1 -- 172.21.15.37:0/443546393 >> 172.21.15.37:0/443546393 conn(0x7fd6040cb830 msgr2=0x7fd6040cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.798+0000 7fd60af5c640 1 -- 172.21.15.37:0/443546393 shutdown_connections 2023-11-24T06:16:59.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.798+0000 7fd60af5c640 1 -- 172.21.15.37:0/443546393 wait complete. 2023-11-24T06:16:59.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.799+0000 7fd60af5c640 1 Processor -- start 2023-11-24T06:16:59.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.800+0000 7fd60af5c640 1 -- start start 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60af5c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f0003970 0x7fd6040c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60af5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60415a470 0x7fd6041f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60af5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6041f38d0 0x7fd6040cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60af5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040c9b00 con 0x7fd6041f38d0 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60af5c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040c86e0 con 0x7fd60415a470 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60af5c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040c8ef0 con 0x7fd5f0003970 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60a75b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6041f38d0 0x7fd6040cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60a75b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6041f38d0 0x7fd6040cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43740/0 (socket says 172.21.15.37:43740) 2023-11-24T06:16:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60a75b640 1 -- 172.21.15.37:0/2986638518 learned_addr learned my addr 172.21.15.37:0/2986638518 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd609f5a640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f0003970 0x7fd6040c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd609759640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60415a470 0x7fd6041f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60a75b640 1 -- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f0003970 msgr2=0x7fd6040c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.801+0000 7fd60a75b640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f0003970 0x7fd6040c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd60a75b640 1 -- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60415a470 msgr2=0x7fd6041f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd60a75b640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60415a470 0x7fd6041f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd60a75b640 1 -- 172.21.15.37:0/2986638518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040c91d0 con 0x7fd6041f38d0 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd609759640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60415a470 0x7fd6041f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd60a75b640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6041f38d0 0x7fd6040cab90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd6040b50a0 tx=0x7fd5fc00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd5fa7fc640 1 -- 172.21.15.37:0/2986638518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc003d80 con 0x7fd6041f38d0 2023-11-24T06:16:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd5fa7fc640 1 -- 172.21.15.37:0/2986638518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc005070 con 0x7fd6041f38d0 2023-11-24T06:16:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd5fa7fc640 1 -- 172.21.15.37:0/2986638518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc005420 con 0x7fd6041f38d0 2023-11-24T06:16:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6040c94b0 con 0x7fd6041f38d0 2023-11-24T06:16:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.802+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60413ea50 con 0x7fd6041f38d0 2023-11-24T06:16:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.804+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6040c9c70 con 0x7fd6041f38d0 2023-11-24T06:16:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.804+0000 7fd5fa7fc640 1 -- 172.21.15.37:0/2986638518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5fc005580 con 0x7fd6041f38d0 2023-11-24T06:16:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.805+0000 7fd5fa7fc640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd5e806aec0 0x7fd5e806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:16:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.805+0000 7fd5fa7fc640 1 -- 172.21.15.37:0/2986638518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5fc088d40 con 0x7fd6041f38d0 2023-11-24T06:16:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.806+0000 7fd609f5a640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd5e806aec0 0x7fd5e806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:16:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.806+0000 7fd609f5a640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd5e806aec0 0x7fd5e806d380 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd600036000 tx=0x7fd600030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:16:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:16:59.809+0000 7fd5fa7fc640 1 -- 172.21.15.37:0/2986638518 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5fc053f60 con 0x7fd6041f38d0 2023-11-24T06:17:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.044+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd60404e840 con 0x7fd6041f38d0 2023-11-24T06:17:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.046+0000 7fd5fa7fc640 1 -- 172.21.15.37:0/2986638518 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fd5fc018070 con 0x7fd6041f38d0 2023-11-24T06:17:00.048 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:00.049 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1029063982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1029063982},{"type":"v1","addr":"172.21.15.37:6835","nonce":1029063982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/3663508959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3663508959},{"type":"v1","addr":"172.21.15.188:6834","nonce":3663508959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/1387291964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1387291964},{"type":"v1","addr":"172.21.15.188:6835","nonce":1387291964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:48.319764+0000","modified":"2023-11-24T06:16:51.408924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5568":{"gid":5568,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6837/1413576215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1413576215},{"type":"v1","addr":"172.21.15.37:6837","nonce":1413576215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-11-24T06:17:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.048+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd5e806aec0 msgr2=0x7fd5e806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.048+0000 7fd60af5c640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd5e806aec0 0x7fd5e806d380 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd600036000 tx=0x7fd600030000 comp rx=0 tx=0).stop 2023-11-24T06:17:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.048+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6041f38d0 msgr2=0x7fd6040cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.048+0000 7fd60af5c640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6041f38d0 0x7fd6040cab90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd6040b50a0 tx=0x7fd5fc00d9d0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 shutdown_connections 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd5e806aec0 0x7fd5e806d380 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60415a470 0x7fd6041f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6041f38d0 0x7fd6040cab90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 --2- 172.21.15.37:0/2986638518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd5f0003970 0x7fd6040c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 >> 172.21.15.37:0/2986638518 conn(0x7fd6040cb830 msgr2=0x7fd60415e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 shutdown_connections 2023-11-24T06:17:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.049+0000 7fd60af5c640 1 -- 172.21.15.37:0/2986638518 wait complete. 2023-11-24T06:17:00.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:16:48.319764+0000', 'modified': '2023-11-24T06:16:51.408924+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5568}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5568': {'gid': 5568, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6837/1413576215', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6836', 'nonce': 1413576215}, {'type': 'v1', 'addr': '172.21.15.37:6837', 'nonce': 1413576215}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:17:00.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:17:00.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-24T06:17:00.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.713+0000 7fb0dba0e640 1 Processor -- start 2023-11-24T06:17:00.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.713+0000 7fb0dba0e640 1 -- start start 2023-11-24T06:17:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.714+0000 7fb0dba0e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d41660b0 0x7fb0d4162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.714+0000 7fb0dba0e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0d4162540 0x7fb0d40c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.714+0000 7fb0dba0e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d4166510 con 0x7fb0d40ccbd0 2023-11-24T06:17:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.714+0000 7fb0dba0e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d41655f0 con 0x7fb0d4162540 2023-11-24T06:17:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.714+0000 7fb0dba0e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40cc380 con 0x7fb0d41660b0 2023-11-24T06:17:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d9fab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0d4162540 0x7fb0d40c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d97aa640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb0d40ccbd0 0x7fb0d40ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54266/0 (socket says 172.21.15.37:54266) 2023-11-24T06:17:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d97aa640 1 -- 172.21.15.37:0/293785866 learned_addr learned my addr 172.21.15.37:0/293785866 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:00.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/293785866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d41660b0 0x7fb0d4162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d9fab640 1 -- 172.21.15.37:0/293785866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d41660b0 msgr2=0x7fb0d4162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/293785866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d41660b0 0x7fb0d4162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d9fab640 1 -- 172.21.15.37:0/293785866 >> v1:172.21.15.37:6789/0 conn(0x7fb0d40ccbd0 legacy=0x7fb0d40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d9fab640 1 -- 172.21.15.37:0/293785866 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4162b30 con 0x7fb0d4162540 2023-11-24T06:17:00.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d3fff640 1 -- 172.21.15.37:0/293785866 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779693680 0 0) 0x7fb0c8001490 con 0x7fb0d40ccbd0 2023-11-24T06:17:00.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.715+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/293785866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d41660b0 0x7fb0d4162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.717+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/293785866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d4162540 0x7fb0d40c9650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0097d0 tx=0x7fb0cc02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c8c151e8f695b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.717+0000 7fb0d3fff640 1 -- 172.21.15.37:0/293785866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc031800 con 0x7fb0d4162540 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.717+0000 7fb0d3fff640 1 -- 172.21.15.37:0/293785866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc031960 con 0x7fb0d4162540 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.717+0000 7fb0d3fff640 1 -- 172.21.15.37:0/293785866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc031cf0 con 0x7fb0d4162540 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 -- 172.21.15.37:0/293785866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d4162540 msgr2=0x7fb0d40c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/293785866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d4162540 0x7fb0d40c9650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0097d0 tx=0x7fb0cc02b8a0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 -- 172.21.15.37:0/293785866 shutdown_connections 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/293785866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d4162540 0x7fb0d40c9650 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/293785866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d41660b0 0x7fb0d4162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 -- 172.21.15.37:0/293785866 >> 172.21.15.37:0/293785866 conn(0x7fb0d40b0c50 msgr2=0x7fb0d40b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 -- 172.21.15.37:0/293785866 shutdown_connections 2023-11-24T06:17:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.718+0000 7fb0dba0e640 1 -- 172.21.15.37:0/293785866 wait complete. 2023-11-24T06:17:00.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.720+0000 7fb0dba0e640 1 Processor -- start 2023-11-24T06:17:00.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.720+0000 7fb0dba0e640 1 -- start start 2023-11-24T06:17:00.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0dba0e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0d40ccbd0 0x7fb0d4158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0dba0e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d4162540 0x7fb0d415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0dba0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d41660b0 0x7fb0d4160e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0dba0e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d415f000 con 0x7fb0d41660b0 2023-11-24T06:17:00.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0dba0e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4158cb0 con 0x7fb0d40ccbd0 2023-11-24T06:17:00.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0dba0e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d415f420 con 0x7fb0d4162540 2023-11-24T06:17:00.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d41660b0 0x7fb0d4160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d41660b0 0x7fb0d4160e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35124/0 (socket says 172.21.15.37:35124) 2023-11-24T06:17:00.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2485175983 learned_addr learned my addr 172.21.15.37:0/2485175983 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:00.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0d40ccbd0 0x7fb0d4158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d4162540 msgr2=0x7fb0d415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d4162540 0x7fb0d415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.721+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0d40ccbd0 msgr2=0x7fb0d4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0d40ccbd0 0x7fb0d4158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2485175983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009400 con 0x7fb0d41660b0 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0d40ccbd0 0x7fb0d4158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d41660b0 0x7fb0d4160e50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098f0 tx=0x7fb0cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0d1ffb640 1 -- 172.21.15.37:0/2485175983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc03cc00 con 0x7fb0d41660b0 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0d1ffb640 1 -- 172.21.15.37:0/2485175983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc03cd60 con 0x7fb0d41660b0 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0d1ffb640 1 -- 172.21.15.37:0/2485175983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc004230 con 0x7fb0d41660b0 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d415e660 con 0x7fb0d41660b0 2023-11-24T06:17:00.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.722+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d415ec20 con 0x7fb0d41660b0 2023-11-24T06:17:00.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.725+0000 7fb0d1ffb640 1 -- 172.21.15.37:0/2485175983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0cc004390 con 0x7fb0d41660b0 2023-11-24T06:17:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.727+0000 7fb0d1ffb640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0b806ae70 0x7fb0b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.727+0000 7fb0d1ffb640 1 -- 172.21.15.37:0/2485175983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc02e070 con 0x7fb0d41660b0 2023-11-24T06:17:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.727+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0b806ae70 0x7fb0b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.727+0000 7fb0de5a5740 1 Processor -- start 2023-11-24T06:17:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.727+0000 7fb0de5a5740 1 -- start start 2023-11-24T06:17:00.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.728+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0b806ae70 0x7fb0b806d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80016f0 tx=0x7fb0c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.728+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d28280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.728+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d270a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.728+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d6b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.728+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2c86880 con 0x55cca2d275e0 2023-11-24T06:17:00.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.728+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2c95ae0 con 0x55cca2d22ba0 2023-11-24T06:17:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.728+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca2c931d0 con 0x55cca2d27ea0 2023-11-24T06:17:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d6b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d6b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35138/0 (socket says 172.21.15.37:35138) 2023-11-24T06:17:00.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 -- 172.21.15.37:0/279471885 learned_addr learned my addr 172.21.15.37:0/279471885 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:00.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d28280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 -- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 msgr2=0x55cca2d28280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d28280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 -- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 msgr2=0x55cca2d270a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d270a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.729+0000 7fb0d9fab640 1 -- 172.21.15.37:0/279471885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cca2c56860 con 0x55cca2d275e0 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.730+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d6b560 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc082a70 tx=0x7fb0cc07b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b75e1cb82a02e35 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.730+0000 7fb0b6ffd640 1 -- 172.21.15.37:0/279471885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc082fa0 con 0x55cca2d275e0 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.730+0000 7fb0b6ffd640 1 -- 172.21.15.37:0/279471885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc047e30 con 0x55cca2d275e0 2023-11-24T06:17:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.730+0000 7fb0b6ffd640 1 -- 172.21.15.37:0/279471885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0773b0 con 0x55cca2d275e0 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.730+0000 7fb0de5a5740 1 -- 172.21.15.37:0/279471885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 msgr2=0x55cca2d6b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.730+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d6b560 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc082a70 tx=0x7fb0cc07b3a0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 -- 172.21.15.37:0/279471885 shutdown_connections 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d270a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d6b560 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/279471885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d28280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 -- 172.21.15.37:0/279471885 >> 172.21.15.37:0/279471885 conn(0x55cca2ce9c70 msgr2=0x55cca2d6d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 -- 172.21.15.37:0/279471885 shutdown_connections 2023-11-24T06:17:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 -- 172.21.15.37:0/279471885 wait complete. 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.731+0000 7fb0de5a5740 1 -- start start 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.732+0000 7fb0de5a5740 1 Processor -- start 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 0x55cca2d75c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d52a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d69d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2c8eac0 con 0x55cca2d27ea0 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2c2b2f0 con 0x55cca2d275e0 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca2c48c70 con 0x55cca2d22ba0 2023-11-24T06:17:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0de5a5740 10 client.0 _ll_register_callbacks cb 0x55cca2c4d3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d69d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d69d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35140/0 (socket says 172.21.15.37:35140) 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.733+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2815171368 learned_addr learned my addr 172.21.15.37:0/2815171368 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d52a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 msgr2=0x55cca2d75c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 0x55cca2d75c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 msgr2=0x55cca2d52a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d52a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2815171368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d415ec20 con 0x55cca2d27ea0 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d52a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d69d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0771a0 tx=0x7fb0cc02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43e3adb121e6e17 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0affff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0affff640 1 -- 172.21.15.37:0/2815171368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc07af00 con 0x55cca2d27ea0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0affff640 1 -- 172.21.15.37:0/2815171368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc07b060 con 0x55cca2d27ea0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cca2c87aa0 con 0x55cca2d27ea0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0affff640 1 -- 172.21.15.37:0/2815171368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0cc07a190 con 0x55cca2d27ea0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0de5a5740 10 client.5736 fetch_fsmap learned FSMap version 31 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.734+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55cca2c8d140 con 0x55cca2d27ea0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0affff640 1 -- 172.21.15.37:0/2815171368 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cca2c87aa0 con 0x55cca2d27ea0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0affff640 1 -- 172.21.15.37:0/2815171368 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb0cc04d060 con 0x55cca2d27ea0 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0de5a5740 10 client.5736 fetch_fsmap finished waiting for FSMap version 31 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0de5a5740 10 client.5736 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T06:17:00.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0de5a5740 20 client.5736 populate_metadata read hostname 'smithi037' 2023-11-24T06:17:00.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d4e6a0 0x55cca2d4ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0de5a5740 4 client.5736 mds_command: new command op to 5568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:17:00.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 --> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cca2c877c0 con 0x55cca2d4e6a0 2023-11-24T06:17:00.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.735+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d4e6a0 0x55cca2d4ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.736+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d4e6a0 0x55cca2d4ea80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bd34865a91f7dae server_cookie=893b730b97107c22 in_seq=0 out_seq=0 2023-11-24T06:17:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.736+0000 7fb0affff640 10 client.5736 ms_handle_connect on v2:172.21.15.37:6836/1413576215 2023-11-24T06:17:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0affff640 1 -- 172.21.15.37:0/2815171368 <== mds.0 v2:172.21.15.37:6836/1413576215 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cca2c877c0 con 0x55cca2d4e6a0 2023-11-24T06:17:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0affff640 10 client.5736 handle_command_reply: tid=0 2023-11-24T06:17:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 client.5736 shutdown 2023-11-24T06:17:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 msgr2=0x55cca2d69d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d69d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0771a0 tx=0x7fb0cc02b8a0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 shutdown_connections 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d4e6a0 0x55cca2d4ea80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d52a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d69d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2815171368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 0x55cca2d75c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0affff640 0 client.5736 ms_handle_reset on v2:172.21.15.37:6836/1413576215 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 >> 172.21.15.37:0/2815171368 conn(0x55cca2ce9c70 msgr2=0x55cca2d70ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 shutdown_connections 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.737+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2815171368 wait complete. 2023-11-24T06:17:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.738+0000 7fb0de5a5740 20 client.5736 trim_cache size 0 max 16384 2023-11-24T06:17:00.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.755+0000 7fb0de5a5740 1 Processor -- start 2023-11-24T06:17:00.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.755+0000 7fb0de5a5740 1 -- start start 2023-11-24T06:17:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.755+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d53c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d22f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2d25100 con 0x55cca2d275e0 2023-11-24T06:17:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca29f1f20 con 0x55cca2d22ba0 2023-11-24T06:17:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca2d90600 con 0x55cca2d27ea0 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0d8fa9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d22f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0d8fa9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d22f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35150/0 (socket says 172.21.15.37:35150) 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0d8fa9640 1 -- 172.21.15.37:0/2090356173 learned_addr learned my addr 172.21.15.37:0/2090356173 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d53c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.756+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0d8fa9640 1 -- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 msgr2=0x55cca2d234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0d8fa9640 1 -- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 msgr2=0x55cca2d53c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d53c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0d8fa9640 1 -- 172.21.15.37:0/2090356173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cca2c2ab80 con 0x55cca2d275e0 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0d8fa9640 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d22f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c8b0 tx=0x7fb0c000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933d82a409a411fb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0b77fe640 1 -- 172.21.15.37:0/2090356173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000ec20 con 0x55cca2d275e0 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0b77fe640 1 -- 172.21.15.37:0/2090356173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c000ed80 con 0x55cca2d275e0 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.757+0000 7fb0b77fe640 1 -- 172.21.15.37:0/2090356173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0012650 con 0x55cca2d275e0 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2090356173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 msgr2=0x55cca2d22f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d22f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c8b0 tx=0x7fb0c000cd70 comp rx=0 tx=0).stop 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2090356173 shutdown_connections 2023-11-24T06:17:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d27ea0 0x55cca2d234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d275e0 0x55cca2d22f80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2090356173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d22ba0 0x55cca2d53c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2090356173 >> 172.21.15.37:0/2090356173 conn(0x55cca2ce9c70 msgr2=0x55cca2d69350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2090356173 shutdown_connections 2023-11-24T06:17:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.758+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2090356173 wait complete. 2023-11-24T06:17:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.759+0000 7fb0de5a5740 1 -- start start 2023-11-24T06:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.759+0000 7fb0de5a5740 1 Processor -- start 2023-11-24T06:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 0x55cca2d23380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d71ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0de5a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d6c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2dd7e50 con 0x55cca2d27ea0 2023-11-24T06:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2d80470 con 0x55cca2d275e0 2023-11-24T06:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0de5a5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca2d54430 con 0x55cca2d22ba0 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0de5a5740 10 client.0 _ll_register_callbacks cb 0x7fb0cc07a870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d6c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0d9fab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d6c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35162/0 (socket says 172.21.15.37:35162) 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2246242979 learned_addr learned my addr 172.21.15.37:0/2246242979 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2246242979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 msgr2=0x55cca2d23380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.760+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 0x55cca2d23380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2246242979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 msgr2=0x55cca2d71ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d71ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0d9fab640 1 -- 172.21.15.37:0/2246242979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c000c4b0 con 0x55cca2d27ea0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0d9fab640 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d6c5d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc083160 tx=0x7fb0cc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af8de35a5a74186 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0affff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0affff640 1 -- 172.21.15.37:0/2246242979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc07a3a0 con 0x55cca2d27ea0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0affff640 1 -- 172.21.15.37:0/2246242979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc07fb30 con 0x55cca2d27ea0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb0cc047e30 con 0x55cca2d27ea0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0affff640 1 -- 172.21.15.37:0/2246242979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0cc07aa70 con 0x55cca2d27ea0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0de5a5740 10 client.5742 fetch_fsmap learned FSMap version 31 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.761+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55cca2c50170 con 0x55cca2d27ea0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0affff640 1 -- 172.21.15.37:0/2246242979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc047e30 con 0x55cca2d27ea0 2023-11-24T06:17:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0affff640 1 -- 172.21.15.37:0/2246242979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb0cc04d040 con 0x55cca2d27ea0 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0de5a5740 10 client.5742 fetch_fsmap finished waiting for FSMap version 31 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0de5a5740 10 client.5742 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0de5a5740 20 client.5742 populate_metadata read hostname 'smithi037' 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d72410 0x55cca2d6cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0de5a5740 4 client.5742 mds_command: new command op to 5568 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 --> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cca298f6c0 con 0x55cca2d72410 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.762+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d72410 0x55cca2d6cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0d97aa640 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d72410 0x55cca2d6cb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=110920d398700ac3 server_cookie=8c1d1e4d66eec62b in_seq=0 out_seq=0 2023-11-24T06:17:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0affff640 10 client.5742 ms_handle_connect on v2:172.21.15.37:6836/1413576215 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0affff640 1 -- 172.21.15.37:0/2246242979 <== mds.0 v2:172.21.15.37:6836/1413576215 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55cca298f6c0 con 0x55cca2d72410 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0affff640 10 client.5742 handle_command_reply: tid=0 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 client.5742 shutdown 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 msgr2=0x55cca2d6c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d6c5d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc083160 tx=0x7fb0cc009190 comp rx=0 tx=0).stop 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 shutdown_connections 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:6836/1413576215,v1:172.21.15.37:6837/1413576215] conn(0x55cca2d72410 0x55cca2d6cb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55cca2d275e0 0x55cca2d71ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cca2d27ea0 0x55cca2d6c5d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 --2- 172.21.15.37:0/2246242979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55cca2d22ba0 0x55cca2d23380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0affff640 0 client.5742 ms_handle_reset on v2:172.21.15.37:6836/1413576215 2023-11-24T06:17:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 >> 172.21.15.37:0/2246242979 conn(0x55cca2ce9c70 msgr2=0x55cca2d6e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 shutdown_connections 2023-11-24T06:17:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.763+0000 7fb0de5a5740 1 -- 172.21.15.37:0/2246242979 wait complete. 2023-11-24T06:17:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0de5a5740 20 client.5742 trim_cache size 0 max 16384 2023-11-24T06:17:00.772 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3", 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5568, 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 11.879420781, 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 31, 2023-11-24T06:17:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 53, 2023-11-24T06:17:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 53, 2023-11-24T06:17:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 20.269281849999999 2023-11-24T06:17:00.774 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0b806ae70 msgr2=0x7fb0b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0b806ae70 0x7fb0b806d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80016f0 tx=0x7fb0c8009040 comp rx=0 tx=0).stop 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d41660b0 msgr2=0x7fb0d4160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d41660b0 0x7fb0d4160e50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098f0 tx=0x7fb0cc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 shutdown_connections 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb0b806ae70 0x7fb0b806d330 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d41660b0 0x7fb0d4160e50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0d4162540 0x7fb0d415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 --2- 172.21.15.37:0/2485175983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0d40ccbd0 0x7fb0d4158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 >> 172.21.15.37:0/2485175983 conn(0x7fb0d40b0c50 msgr2=0x7fb0d40ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.764+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 shutdown_connections 2023-11-24T06:17:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.765+0000 7fb0dba0e640 1 -- 172.21.15.37:0/2485175983 wait complete. 2023-11-24T06:17:00.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:17:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.991+0000 7f54006c6640 1 Processor -- start 2023-11-24T06:17:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.991+0000 7f54006c6640 1 -- start start 2023-11-24T06:17:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.992+0000 7f54006c6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f53f815c7f0 0x7f53f806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.992+0000 7f54006c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 0x7f53f80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.992+0000 7f54006c6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f80cece0 con 0x7f53f80cf450 2023-11-24T06:17:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.992+0000 7f54006c6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f80cfe40 con 0x7f53f815c7f0 2023-11-24T06:17:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.992+0000 7f54006c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8156010 con 0x7f53f80ce6c0 2023-11-24T06:17:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.993+0000 7f53fdc61640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f53f80cf450 0x7f53f80cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54276/0 (socket says 172.21.15.37:54276) 2023-11-24T06:17:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.993+0000 7f53fdc61640 1 -- 172.21.15.37:0/2495607594 learned_addr learned my addr 172.21.15.37:0/2495607594 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:00.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.993+0000 7f53fec63640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 0x7f53f80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.993+0000 7f53fe462640 1 --2- 172.21.15.37:0/2495607594 >> v2:172.21.15.188:3300/0 conn(0x7f53f815c7f0 0x7f53f806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.993+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957313303 0 0) 0x7f53f80cece0 con 0x7f53f80cf450 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.993+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e4003520 con 0x7f53f80cf450 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2968848776 0 0) 0x7f53e4003520 con 0x7f53f80cf450 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 msgr2=0x7f53f80cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 0x7f53f80cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 >> v2:172.21.15.188:3300/0 conn(0x7f53f815c7f0 msgr2=0x7f53f806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 --2- 172.21.15.37:0/2495607594 >> v2:172.21.15.188:3300/0 conn(0x7f53f815c7f0 0x7f53f806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f806d040 con 0x7f53f80cf450 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f53e8001670 con 0x7f53f80cf450 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 >> v1:172.21.15.37:6789/0 conn(0x7f53f80cf450 legacy=0x7f53f80cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4003970 0x7f53e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 0x7f53e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80cfe40 con 0x7f53e4004d00 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8156010 con 0x7f53e4003970 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e400b980 con 0x7f53f80ce6c0 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fec63640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.994+0000 7f53fdc61640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 0x7f53e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.995+0000 7f53fec63640 1 -- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 msgr2=0x7f53e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.995+0000 7f53fe462640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4003970 0x7f53e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.995+0000 7f53fec63640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 0x7f53e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.995+0000 7f53fec63640 1 -- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4003970 msgr2=0x7f53e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.995+0000 7f53fec63640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53e4003970 0x7f53e4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.995+0000 7f53fec63640 1 -- 172.21.15.37:0/2495607594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4003520 con 0x7f53e4004d00 2023-11-24T06:17:01.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.995+0000 7f53fdc61640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f80ce6c0 0x7f53e40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.996+0000 7f53fec63640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53e4005180 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009fc0 tx=0x7f53e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75c8d69dd21ee82 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.996+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f002cc20 con 0x7f53e4004d00 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.996+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f000f040 con 0x7f53e4004d00 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.996+0000 7f53fd460640 1 -- 172.21.15.37:0/2495607594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0034440 con 0x7f53e4004d00 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.997+0000 7f54006c6640 1 -- 172.21.15.37:0/2495607594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 msgr2=0x7f53e4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.997+0000 7f54006c6640 1 --2- 172.21.15.37:0/2495607594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53e4005180 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009fc0 tx=0x7f53e40057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.997+0000 7f53fec63640 1 -- 172.21.15.37:0/2495607594 reap_dead start 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.997+0000 7f54006c6640 1 -- 172.21.15.37:0/2495607594 shutdown_connections 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.997+0000 7f54006c6640 1 -- 172.21.15.37:0/2495607594 >> 172.21.15.37:0/2495607594 conn(0x7f53f806a920 msgr2=0x7f53f806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.997+0000 7f54006c6640 1 -- 172.21.15.37:0/2495607594 shutdown_connections 2023-11-24T06:17:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.997+0000 7f54006c6640 1 -- 172.21.15.37:0/2495607594 wait complete. 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.999+0000 7f54006c6640 1 Processor -- start 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:00.999+0000 7f54006c6640 1 -- start start 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f54006c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53f814c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f54006c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f815fc80 0x7f53f8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f54006c6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80b3260 0x7f53f80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f54006c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f814c9e0 con 0x7f53e4004d00 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f54006c6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80b3c30 con 0x7f53f80b3260 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f54006c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81574b0 con 0x7f53f815fc80 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f53fe462640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53f814c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f53fe462640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53f814c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35190/0 (socket says 172.21.15.37:35190) 2023-11-24T06:17:01.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.000+0000 7f53fe462640 1 -- 172.21.15.37:0/4015634887 learned_addr learned my addr 172.21.15.37:0/4015634887 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fec63640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80b3260 0x7f53f80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fdc61640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f815fc80 0x7f53f8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fe462640 1 -- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f815fc80 msgr2=0x7f53f8156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fe462640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f815fc80 0x7f53f8156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fe462640 1 -- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80b3260 msgr2=0x7f53f80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fe462640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80b3260 0x7f53f80b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fe462640 1 -- 172.21.15.37:0/4015634887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8157790 con 0x7f53e4004d00 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53fe462640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53f814c4a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f53f40108e0 tx=0x7f53f4010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53eeffd640 1 -- 172.21.15.37:0/4015634887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400eb60 con 0x7f53e4004d00 2023-11-24T06:17:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53eeffd640 1 -- 172.21.15.37:0/4015634887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f400ecc0 con 0x7f53e4004d00 2023-11-24T06:17:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f53eeffd640 1 -- 172.21.15.37:0/4015634887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f401c400 con 0x7f53e4004d00 2023-11-24T06:17:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.001+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f8157a70 con 0x7f53e4004d00 2023-11-24T06:17:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.002+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f8158030 con 0x7f53e4004d00 2023-11-24T06:17:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.003+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f8067470 con 0x7f53e4004d00 2023-11-24T06:17:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.004+0000 7f53eeffd640 1 -- 172.21.15.37:0/4015634887 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53f401c560 con 0x7f53e4004d00 2023-11-24T06:17:01.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.005+0000 7f53eeffd640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f53dc06ae40 0x7f53dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:01.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.005+0000 7f53eeffd640 1 -- 172.21.15.37:0/4015634887 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53f4089d40 con 0x7f53e4004d00 2023-11-24T06:17:01.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.005+0000 7f53fdc61640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f53dc06ae40 0x7f53dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:01.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.006+0000 7f53fdc61640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f53dc06ae40 0x7f53dc06d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53f81600a0 tx=0x7f53e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.009+0000 7f53eeffd640 1 -- 172.21.15.37:0/4015634887 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53f4054ea0 con 0x7f53e4004d00 2023-11-24T06:17:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.245+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53f80cd730 con 0x7f53e4004d00 2023-11-24T06:17:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.245+0000 7f53eeffd640 1 -- 172.21.15.37:0/4015634887 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53f40584c0 con 0x7f53e4004d00 2023-11-24T06:17:01.248 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:17:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f53dc06ae40 msgr2=0x7f53dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f53dc06ae40 0x7f53dc06d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f53f81600a0 tx=0x7f53e8009040 comp rx=0 tx=0).stop 2023-11-24T06:17:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 msgr2=0x7f53f814c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53f814c4a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f53f40108e0 tx=0x7f53f4010da0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 shutdown_connections 2023-11-24T06:17:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f53dc06ae40 0x7f53dc06d300 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53f80b3260 0x7f53f80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53f815fc80 0x7f53f8156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 --2- 172.21.15.37:0/4015634887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53e4004d00 0x7f53f814c4a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 >> 172.21.15.37:0/4015634887 conn(0x7f53f806a920 msgr2=0x7f53f80734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 shutdown_connections 2023-11-24T06:17:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:01.248+0000 7f54006c6640 1 -- 172.21.15.37:0/4015634887 wait complete. 2023-11-24T06:17:01.269 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:17:01.269 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:17:01.270 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-11-24T06:17:01.270 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:17:01.270 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:01.270 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:17:01.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:17:01.270 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:17:01.270 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:17:01.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.270 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-11-24T06:17:01.321 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42238sec preferred_lft 42238sec 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:01.322 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::40b6:eeff:fe98:3c34/64 scope link 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:01.323 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:01.324 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:17:01.324 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a462:2eff:fec6:6249/64 scope link 2023-11-24T06:17:01.324 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:01.324 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:01.324 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether d2:91:7f:1d:c0:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:17:01.324 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d091:7fff:fe1d:c078/64 scope link 2023-11-24T06:17:01.325 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:01.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.326 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:17:01.420 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-11-24T06:17:01.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.425 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-11-24T06:17:01.481 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-11-24T06:17:01.481 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:17:01.481 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:17:01.481 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:17:01.481 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:17:01.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.482 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:17:01.482 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:17:01.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:17:01.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:17:01.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:17:01.482 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:17:01.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.683 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:17:01.737 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:17:01.738 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:17:01.739 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:17:01.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-11-24T06:17:01.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:01.829 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:01.885 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:17:01.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:01.886 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:01.940 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:17:01.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:01.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:02.091 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:02.128 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:02.129 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:02.129 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:17:02.129 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:17:02.129 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:17:02.134 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-24T06:17:02.135 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:17:02.135 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:17:02.136 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:17:02.136 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:17:02.139 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:17:02.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:02.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:02.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:02.237 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:17:02.310 INFO:teuthology.orchestra.run.smithi037.stdout:client5131 2023-11-24T06:17:02.310 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:02.310 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:02.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:17:02.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.591+0000 7f6a7a393640 1 Processor -- start 2023-11-24T06:17:02.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.592+0000 7f6a7a393640 1 -- start start 2023-11-24T06:17:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.593+0000 7f6a7a393640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a74144b30 0x7f6a7415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.593+0000 7f6a7a393640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7415bf80 con 0x7f6a740b1de0 2023-11-24T06:17:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.593+0000 7f6a7a393640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740b1560 con 0x7f6a7415c410 2023-11-24T06:17:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.593+0000 7f6a7a393640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a740b1280 con 0x7f6a74144b30 2023-11-24T06:17:02.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.594+0000 7f6a79391640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a74144b30 0x7f6a7415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.594+0000 7f6a79391640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a74144b30 0x7f6a7415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35206/0 (socket says 172.21.15.37:35206) 2023-11-24T06:17:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.594+0000 7f6a79391640 1 -- 172.21.15.37:0/885399857 learned_addr learned my addr 172.21.15.37:0/885399857 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.594+0000 7f6a79391640 1 -- 172.21.15.37:0/885399857 >> v1:172.21.15.188:6789/0 conn(0x7f6a7415c410 legacy=0x7f6a740b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.594+0000 7f6a79391640 1 -- 172.21.15.37:0/885399857 >> v1:172.21.15.37:6789/0 conn(0x7f6a740b1de0 legacy=0x7f6a740b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.594+0000 7f6a79391640 1 -- 172.21.15.37:0/885399857 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7415b930 con 0x7f6a74144b30 2023-11-24T06:17:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.595+0000 7f6a79391640 1 --2- 172.21.15.37:0/885399857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74144b30 0x7f6a7415f920 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009e50 tx=0x7f6a6402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2079b77faddd1c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.596+0000 7f6a73fff640 1 -- 172.21.15.37:0/885399857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6402cb10 con 0x7f6a74144b30 2023-11-24T06:17:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.596+0000 7f6a73fff640 1 -- 172.21.15.37:0/885399857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6402cc70 con 0x7f6a74144b30 2023-11-24T06:17:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.596+0000 7f6a73fff640 1 -- 172.21.15.37:0/885399857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640343f0 con 0x7f6a74144b30 2023-11-24T06:17:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.596+0000 7f6a7a393640 1 -- 172.21.15.37:0/885399857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74144b30 msgr2=0x7f6a7415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.596+0000 7f6a7a393640 1 --2- 172.21.15.37:0/885399857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74144b30 0x7f6a7415f920 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009e50 tx=0x7f6a6402bf70 comp rx=0 tx=0).stop 2023-11-24T06:17:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.597+0000 7f6a7a393640 1 -- 172.21.15.37:0/885399857 shutdown_connections 2023-11-24T06:17:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.597+0000 7f6a7a393640 1 --2- 172.21.15.37:0/885399857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74144b30 0x7f6a7415f920 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.597+0000 7f6a7a393640 1 -- 172.21.15.37:0/885399857 >> 172.21.15.37:0/885399857 conn(0x7f6a740cb830 msgr2=0x7f6a740cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.597+0000 7f6a7a393640 1 -- 172.21.15.37:0/885399857 shutdown_connections 2023-11-24T06:17:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.597+0000 7f6a7a393640 1 -- 172.21.15.37:0/885399857 wait complete. 2023-11-24T06:17:02.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.599+0000 7f6a7a393640 1 Processor -- start 2023-11-24T06:17:02.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.599+0000 7f6a7a393640 1 -- start start 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a7a393640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740b1de0 0x7f6a74143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a7a393640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a74144b30 0x7f6a741f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a7a393640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a7415c410 0x7f6a741f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a7a393640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741f4800 con 0x7f6a740b1de0 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a7a393640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741442d0 con 0x7f6a74144b30 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a7a393640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740cae30 con 0x7f6a7415c410 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740b1de0 0x7f6a74143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740b1de0 0x7f6a74143060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35218/0 (socket says 172.21.15.37:35218) 2023-11-24T06:17:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 -- 172.21.15.37:0/852663025 learned_addr learned my addr 172.21.15.37:0/852663025 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:02.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 -- 172.21.15.37:0/852663025 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a7415c410 msgr2=0x7f6a741f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a7415c410 0x7f6a741f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 -- 172.21.15.37:0/852663025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a74144b30 msgr2=0x7f6a741f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a74144b30 0x7f6a741f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.600+0000 7f6a79391640 1 -- 172.21.15.37:0/852663025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64009b30 con 0x7f6a740b1de0 2023-11-24T06:17:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.601+0000 7f6a79391640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740b1de0 0x7f6a74143060 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009e50 tx=0x7f6a64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.601+0000 7f6a71ffb640 1 -- 172.21.15.37:0/852663025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6403e450 con 0x7f6a740b1de0 2023-11-24T06:17:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.601+0000 7f6a71ffb640 1 -- 172.21.15.37:0/852663025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6403e5f0 con 0x7f6a740b1de0 2023-11-24T06:17:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.601+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a740cb110 con 0x7f6a740b1de0 2023-11-24T06:17:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.601+0000 7f6a71ffb640 1 -- 172.21.15.37:0/852663025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6403e9a0 con 0x7f6a740b1de0 2023-11-24T06:17:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.601+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a741f4a10 con 0x7f6a740b1de0 2023-11-24T06:17:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.602+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7404e840 con 0x7f6a740b1de0 2023-11-24T06:17:02.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.603+0000 7f6a71ffb640 1 -- 172.21.15.37:0/852663025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a6403eb00 con 0x7f6a740b1de0 2023-11-24T06:17:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.604+0000 7f6a71ffb640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6a6006ae40 0x7f6a6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.605+0000 7f6a71ffb640 1 -- 172.21.15.37:0/852663025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a640ac730 con 0x7f6a740b1de0 2023-11-24T06:17:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.605+0000 7f6a78b90640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6a6006ae40 0x7f6a6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:02.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.606+0000 7f6a78b90640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6a6006ae40 0x7f6a6006d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a74072a20 tx=0x7f6a68006ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.609+0000 7f6a71ffb640 1 -- 172.21.15.37:0/852663025 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a64077860 con 0x7f6a740b1de0 2023-11-24T06:17:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.840+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a7406d860 con 0x7f6a740b1de0 2023-11-24T06:17:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.841+0000 7f6a71ffb640 1 -- 172.21.15.37:0/852663025 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a6403edb0 con 0x7f6a740b1de0 2023-11-24T06:17:02.844 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:17:02.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6a6006ae40 msgr2=0x7f6a6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6a6006ae40 0x7f6a6006d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a74072a20 tx=0x7f6a68006ba0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740b1de0 msgr2=0x7f6a74143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740b1de0 0x7f6a74143060 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009e50 tx=0x7f6a64004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 shutdown_connections 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6a6006ae40 0x7f6a6006d300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a74144b30 0x7f6a741f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a7415c410 0x7f6a741f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 --2- 172.21.15.37:0/852663025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740b1de0 0x7f6a74143060 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 >> 172.21.15.37:0/852663025 conn(0x7f6a740cb830 msgr2=0x7f6a740b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:02.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 shutdown_connections 2023-11-24T06:17:02.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:02.844+0000 7f6a7a393640 1 -- 172.21.15.37:0/852663025 wait complete. 2023-11-24T06:17:02.866 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:17:02.867 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:17:02.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:02.867 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-11-24T06:17:02.928 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:17:02.928 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:17:02.928 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:17:02.928 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:02.928 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-11-24T06:17:02.928 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:02.928 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42244sec preferred_lft 42244sec 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2023-11-24T06:17:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9460:4eff:fe42:69c0/64 scope link 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::88b7:c8ff:fef4:7a4d/64 scope link 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:02.930 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 92:37:27:cd:69:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:17:02.931 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9037:27ff:fecd:694e/64 scope link 2023-11-24T06:17:02.931 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:02.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:02.932 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:17:03.023 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-11-24T06:17:03.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:03.027 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-11-24T06:17:03.078 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-11-24T06:17:03.078 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:17:03.079 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:17:03.079 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:17:03.079 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:17:03.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:03.079 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:17:03.079 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:17:03.079 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:17:03.079 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:17:03.079 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:17:03.080 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:17:03.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:03.255 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:17:03.306 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:17:03.306 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:17:03.307 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:17:03.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:03.308 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2023-11-24T06:17:03.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:03.402 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:03.456 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:17:03.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:03.457 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:03.507 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:17:03.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:03.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:03.640 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:03.640 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with new device syntax: 1@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:17:03.678 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:17:03.682 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-24T06:17:03.682 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:17:03.682 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:17:03.682 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:17:03.682 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:17:03.685 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:17:03.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:03.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:03.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:03.770 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:17:03.824 INFO:teuthology.orchestra.run.smithi188.stdout:client5760 2023-11-24T06:17:03.824 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:03.824 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:03.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:17:04.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.118+0000 7f4788378640 1 Processor -- start 2023-11-24T06:17:04.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.118+0000 7f4788378640 1 -- start start 2023-11-24T06:17:04.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.120+0000 7f4788378640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47800cfb60 0x7f47800abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.120+0000 7f4788378640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800ce270 con 0x7f47800cc470 2023-11-24T06:17:04.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.120+0000 7f4788378640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478006d0a0 con 0x7f47800ce640 2023-11-24T06:17:04.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.120+0000 7f4788378640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478006c560 con 0x7f47800cfb60 2023-11-24T06:17:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.120+0000 7f4786114640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47800cc470 0x7f47800cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54296/0 (socket says 172.21.15.37:54296) 2023-11-24T06:17:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.120+0000 7f4786114640 1 -- 172.21.15.37:0/3699584604 learned_addr learned my addr 172.21.15.37:0/3699584604 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.120+0000 7f4785913640 1 --2- 172.21.15.37:0/3699584604 >> v2:172.21.15.37:3300/0 conn(0x7f47800cfb60 0x7f47800abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.121+0000 7f4785112640 1 -- 172.21.15.37:0/3699584604 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935969927 0 0) 0x7f47800ce270 con 0x7f47800cc470 2023-11-24T06:17:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.121+0000 7f4785112640 1 -- 172.21.15.37:0/3699584604 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f476c003520 con 0x7f47800cc470 2023-11-24T06:17:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.121+0000 7f4785913640 1 -- 172.21.15.37:0/3699584604 >> v1:172.21.15.188:6789/0 conn(0x7f47800ce640 legacy=0x7f478006d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.121+0000 7f4785913640 1 -- 172.21.15.37:0/3699584604 >> v1:172.21.15.37:6789/0 conn(0x7f47800cc470 legacy=0x7f47800cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.121+0000 7f4785913640 1 -- 172.21.15.37:0/3699584604 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478006c770 con 0x7f47800cfb60 2023-11-24T06:17:04.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.122+0000 7f4785913640 1 --2- 172.21.15.37:0/3699584604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cfb60 0x7f47800abfc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f47700097a0 tx=0x7f477002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76925e27ac7f716f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.122+0000 7f4785112640 1 -- 172.21.15.37:0/3699584604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770030610 con 0x7f47800cfb60 2023-11-24T06:17:04.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.122+0000 7f4785112640 1 -- 172.21.15.37:0/3699584604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4770030770 con 0x7f47800cfb60 2023-11-24T06:17:04.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.122+0000 7f4785112640 1 -- 172.21.15.37:0/3699584604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770030b00 con 0x7f47800cfb60 2023-11-24T06:17:04.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.123+0000 7f4788378640 1 -- 172.21.15.37:0/3699584604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cfb60 msgr2=0x7f47800abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.123+0000 7f4788378640 1 --2- 172.21.15.37:0/3699584604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cfb60 0x7f47800abfc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f47700097a0 tx=0x7f477002b960 comp rx=0 tx=0).stop 2023-11-24T06:17:04.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.123+0000 7f4788378640 1 -- 172.21.15.37:0/3699584604 shutdown_connections 2023-11-24T06:17:04.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.123+0000 7f4788378640 1 --2- 172.21.15.37:0/3699584604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cfb60 0x7f47800abfc0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.123+0000 7f4788378640 1 -- 172.21.15.37:0/3699584604 >> 172.21.15.37:0/3699584604 conn(0x7f478006a920 msgr2=0x7f478006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:04.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.123+0000 7f4788378640 1 -- 172.21.15.37:0/3699584604 shutdown_connections 2023-11-24T06:17:04.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.123+0000 7f4788378640 1 -- 172.21.15.37:0/3699584604 wait complete. 2023-11-24T06:17:04.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.125+0000 7f4788378640 1 Processor -- start 2023-11-24T06:17:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.125+0000 7f4788378640 1 -- start start 2023-11-24T06:17:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.126+0000 7f4788378640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cc470 0x7f47801fab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.126+0000 7f4788378640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47800ce640 0x7f478015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.126+0000 7f4788378640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47800cfb60 0x7f47801576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.126+0000 7f4788378640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780072060 con 0x7f47800cc470 2023-11-24T06:17:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.126+0000 7f4788378640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780072340 con 0x7f47800cfb60 2023-11-24T06:17:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.126+0000 7f4788378640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4780072620 con 0x7f47800ce640 2023-11-24T06:17:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cc470 0x7f47801fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cc470 0x7f47801fab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35250/0 (socket says 172.21.15.37:35250) 2023-11-24T06:17:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 -- 172.21.15.37:0/3242459165 learned_addr learned my addr 172.21.15.37:0/3242459165 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:04.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4785913640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47800ce640 0x7f478015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786915640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47800cfb60 0x7f47801576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 -- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47800ce640 msgr2=0x7f478015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47800ce640 0x7f478015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 -- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47800cfb60 msgr2=0x7f47801576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47800cfb60 0x7f47801576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 -- 172.21.15.37:0/3242459165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770009400 con 0x7f47800cc470 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4785913640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47800ce640 0x7f478015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786915640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47800cfb60 0x7f47801576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.127+0000 7f4786114640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cc470 0x7f47801fab70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f477c00cbc0 tx=0x7f477c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.128+0000 7f4776ffd640 1 -- 172.21.15.37:0/3242459165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00ad40 con 0x7f47800cc470 2023-11-24T06:17:04.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.128+0000 7f4776ffd640 1 -- 172.21.15.37:0/3242459165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c012400 con 0x7f47800cc470 2023-11-24T06:17:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.128+0000 7f4776ffd640 1 -- 172.21.15.37:0/3242459165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00aea0 con 0x7f47800cc470 2023-11-24T06:17:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.128+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4780163250 con 0x7f47800cc470 2023-11-24T06:17:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.128+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47801fb290 con 0x7f47800cc470 2023-11-24T06:17:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.129+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4780163440 con 0x7f47800cc470 2023-11-24T06:17:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.130+0000 7f4776ffd640 1 -- 172.21.15.37:0/3242459165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f477c007070 con 0x7f47800cc470 2023-11-24T06:17:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.131+0000 7f4776ffd640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f476406ae70 0x7f476406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.131+0000 7f4776ffd640 1 -- 172.21.15.37:0/3242459165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f477c089580 con 0x7f47800cc470 2023-11-24T06:17:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.131+0000 7f4785913640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f476406ae70 0x7f476406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.132+0000 7f4785913640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f476406ae70 0x7f476406d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4770036000 tx=0x7f477003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:04.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.136+0000 7f4776ffd640 1 -- 172.21.15.37:0/3242459165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f477c0546d0 con 0x7f47800cc470 2023-11-24T06:17:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.367+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f47800727e0 con 0x7f47800cc470 2023-11-24T06:17:04.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.987+0000 7f4776ffd640 1 -- 172.21.15.37:0/3242459165 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 136+0+0 (secure 0 0 0) 0x7f477c05e070 con 0x7f47800cc470 2023-11-24T06:17:04.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.991+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f476406ae70 msgr2=0x7f476406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.991+0000 7f4788378640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f476406ae70 0x7f476406d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4770036000 tx=0x7f477003b040 comp rx=0 tx=0).stop 2023-11-24T06:17:04.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.991+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cc470 msgr2=0x7f47801fab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.991+0000 7f4788378640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cc470 0x7f47801fab70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f477c00cbc0 tx=0x7f477c00a430 comp rx=0 tx=0).stop 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 shutdown_connections 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f476406ae70 0x7f476406d330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47800cfb60 0x7f47801576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47800ce640 0x7f478015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 --2- 172.21.15.37:0/3242459165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47800cc470 0x7f47801fab70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 >> 172.21.15.37:0/3242459165 conn(0x7f478006a920 msgr2=0x7f47800ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 shutdown_connections 2023-11-24T06:17:04.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:04.992+0000 7f4788378640 1 -- 172.21.15.37:0/3242459165 wait complete. 2023-11-24T06:17:05.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:17:05.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.247+0000 7fdf57fff640 1 Processor -- start 2023-11-24T06:17:05.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.247+0000 7fdf57fff640 1 -- start start 2023-11-24T06:17:05.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.248+0000 7fdf57fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf5806dd50 0x7fdf580b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf57fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5815e580 con 0x7fdf5815a1c0 2023-11-24T06:17:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf57fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5815e860 con 0x7fdf58070ea0 2023-11-24T06:17:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf57fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf580cd920 con 0x7fdf5806dd50 2023-11-24T06:17:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf5806dd50 0x7fdf580b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf56ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdf5815a1c0 0x7fdf5815dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54304/0 (socket says 172.21.15.37:54304) 2023-11-24T06:17:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf56ffd640 1 -- 172.21.15.37:0/148694720 learned_addr learned my addr 172.21.15.37:0/148694720 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf5806dd50 0x7fdf580b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35266/0 (socket says 172.21.15.37:35266) 2023-11-24T06:17:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf577fe640 1 -- 172.21.15.37:0/148694720 >> v1:172.21.15.188:6789/0 conn(0x7fdf58070ea0 legacy=0x7fdf5806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf577fe640 1 -- 172.21.15.37:0/148694720 >> v1:172.21.15.37:6789/0 conn(0x7fdf5815a1c0 legacy=0x7fdf5815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.250+0000 7fdf577fe640 1 -- 172.21.15.37:0/148694720 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5815eb40 con 0x7fdf5806dd50 2023-11-24T06:17:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.249+0000 7fdf55ffb640 1 -- 172.21.15.37:0/148694720 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540736308 0 0) 0x7fdf5815e580 con 0x7fdf5815a1c0 2023-11-24T06:17:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf577fe640 1 --2- 172.21.15.37:0/148694720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf580b15e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009d90 tx=0x7fdf5002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697bf3ba6b8e97db server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf55ffb640 1 -- 172.21.15.37:0/148694720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5002ccf0 con 0x7fdf5806dd50 2023-11-24T06:17:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf55ffb640 1 -- 172.21.15.37:0/148694720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5002ce50 con 0x7fdf5806dd50 2023-11-24T06:17:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf55ffb640 1 -- 172.21.15.37:0/148694720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50034660 con 0x7fdf5806dd50 2023-11-24T06:17:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf57fff640 1 -- 172.21.15.37:0/148694720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 msgr2=0x7fdf580b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf57fff640 1 --2- 172.21.15.37:0/148694720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf580b15e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009d90 tx=0x7fdf5002bf40 comp rx=0 tx=0).stop 2023-11-24T06:17:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf57fff640 1 -- 172.21.15.37:0/148694720 shutdown_connections 2023-11-24T06:17:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf57fff640 1 --2- 172.21.15.37:0/148694720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf580b15e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.251+0000 7fdf57fff640 1 -- 172.21.15.37:0/148694720 >> 172.21.15.37:0/148694720 conn(0x7fdf580cbb40 msgr2=0x7fdf580cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.252+0000 7fdf57fff640 1 -- 172.21.15.37:0/148694720 shutdown_connections 2023-11-24T06:17:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.252+0000 7fdf57fff640 1 -- 172.21.15.37:0/148694720 wait complete. 2023-11-24T06:17:05.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.253+0000 7fdf57fff640 1 Processor -- start 2023-11-24T06:17:05.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.253+0000 7fdf57fff640 1 -- start start 2023-11-24T06:17:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.254+0000 7fdf57fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf58155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.254+0000 7fdf57fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf58070ea0 0x7fdf580ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.254+0000 7fdf57fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf5815a1c0 0x7fdf580caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.254+0000 7fdf57fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580caf80 con 0x7fdf5806dd50 2023-11-24T06:17:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.254+0000 7fdf57fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf581585e0 con 0x7fdf58070ea0 2023-11-24T06:17:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.254+0000 7fdf57fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5815d090 con 0x7fdf5815a1c0 2023-11-24T06:17:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf58155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf58155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35272/0 (socket says 172.21.15.37:35272) 2023-11-24T06:17:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 -- 172.21.15.37:0/4276565656 learned_addr learned my addr 172.21.15.37:0/4276565656 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf577fe640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf5815a1c0 0x7fdf580caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf567fc640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf58070ea0 0x7fdf580ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 -- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf5815a1c0 msgr2=0x7fdf580caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf5815a1c0 0x7fdf580caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 -- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf58070ea0 msgr2=0x7fdf580ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf58070ea0 0x7fdf580ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 -- 172.21.15.37:0/4276565656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50009a70 con 0x7fdf5806dd50 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf577fe640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf5815a1c0 0x7fdf580caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf567fc640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf58070ea0 0x7fdf580ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.255+0000 7fdf56ffd640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf58155560 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c430 tx=0x7fdf4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.256+0000 7fdf3f7fe640 1 -- 172.21.15.37:0/4276565656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf480074e0 con 0x7fdf5806dd50 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.256+0000 7fdf3f7fe640 1 -- 172.21.15.37:0/4276565656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf48007660 con 0x7fdf5806dd50 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.256+0000 7fdf3f7fe640 1 -- 172.21.15.37:0/4276565656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48004a20 con 0x7fdf5806dd50 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.256+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5815c2d0 con 0x7fdf5806dd50 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.256+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5815c890 con 0x7fdf5806dd50 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.257+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5804e840 con 0x7fdf5806dd50 2023-11-24T06:17:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.258+0000 7fdf3f7fe640 1 -- 172.21.15.37:0/4276565656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf48004b80 con 0x7fdf5806dd50 2023-11-24T06:17:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.260+0000 7fdf3f7fe640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf4406ae40 0x7fdf4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.260+0000 7fdf3f7fe640 1 -- 172.21.15.37:0/4276565656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf48089450 con 0x7fdf5806dd50 2023-11-24T06:17:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.260+0000 7fdf567fc640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf4406ae40 0x7fdf4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.261+0000 7fdf567fc640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf4406ae40 0x7fdf4406d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf58155e90 tx=0x7fdf4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.264+0000 7fdf3f7fe640 1 -- 172.21.15.37:0/4276565656 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf480544f0 con 0x7fdf5806dd50 2023-11-24T06:17:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.486+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf58165110 con 0x7fdf4406ae40 2023-11-24T06:17:05.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.489+0000 7fdf3f7fe640 1 -- 172.21.15.37:0/4276565656 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdf4c005030 con 0x7fdf4406ae40 2023-11-24T06:17:05.492 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:17:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-11-24T06:17:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:05.492 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:17:05.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf4406ae40 msgr2=0x7fdf4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf4406ae40 0x7fdf4406d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf58155e90 tx=0x7fdf4c009040 comp rx=0 tx=0).stop 2023-11-24T06:17:05.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 msgr2=0x7fdf58155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf58155560 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c430 tx=0x7fdf4800c8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 shutdown_connections 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf4406ae40 0x7fdf4406d300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf58070ea0 0x7fdf580ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf5815a1c0 0x7fdf580caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 --2- 172.21.15.37:0/4276565656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf5806dd50 0x7fdf58155560 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.491+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 >> 172.21.15.37:0/4276565656 conn(0x7fdf580cbb40 msgr2=0x7fdf5806d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.492+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 shutdown_connections 2023-11-24T06:17:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.492+0000 7fdf57fff640 1 -- 172.21.15.37:0/4276565656 wait complete. 2023-11-24T06:17:05.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:17:05.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.744+0000 7fe822ac2640 1 Processor -- start 2023-11-24T06:17:05.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.744+0000 7fe822ac2640 1 -- start start 2023-11-24T06:17:05.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.746+0000 7fe822ac2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c072160 0x7fe81c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.746+0000 7fe822ac2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe81c0c49f0 0x7fe81c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.746+0000 7fe822ac2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c15ec90 con 0x7fe81c06dc40 2023-11-24T06:17:05.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.746+0000 7fe822ac2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c06e0f0 con 0x7fe81c0c49f0 2023-11-24T06:17:05.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.746+0000 7fe822ac2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0cd530 con 0x7fe81c072160 2023-11-24T06:17:05.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.747+0000 7fe81bfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe81c0c49f0 0x7fe81c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.747+0000 7fe82085e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c072160 0x7fe81c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.747+0000 7fe82085e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c072160 0x7fe81c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:41112/0 (socket says 172.21.15.37:41112) 2023-11-24T06:17:05.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.747+0000 7fe82085e640 1 -- 172.21.15.37:0/4170036937 learned_addr learned my addr 172.21.15.37:0/4170036937 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:05.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.748+0000 7fe81bfff640 1 -- 172.21.15.37:0/4170036937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c072160 msgr2=0x7fe81c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:05.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.748+0000 7fe81bfff640 1 --2- 172.21.15.37:0/4170036937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c072160 0x7fe81c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.748+0000 7fe81bfff640 1 -- 172.21.15.37:0/4170036937 >> v1:172.21.15.188:6789/0 conn(0x7fe81c06dc40 legacy=0x7fe81c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.748+0000 7fe81bfff640 1 -- 172.21.15.37:0/4170036937 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0c4ed0 con 0x7fe81c0c49f0 2023-11-24T06:17:05.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.750+0000 7fe81bfff640 1 --2- 172.21.15.37:0/4170036937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c0c49f0 0x7fe81c06d700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097a0 tx=0x7fe80802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c1f4b06e47105fe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.750+0000 7fe81b7fe640 1 -- 172.21.15.37:0/4170036937 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80802d040 con 0x7fe81c0c49f0 2023-11-24T06:17:05.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.750+0000 7fe81b7fe640 1 -- 172.21.15.37:0/4170036937 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe808031810 con 0x7fe81c0c49f0 2023-11-24T06:17:05.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.750+0000 7fe81b7fe640 1 -- 172.21.15.37:0/4170036937 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808031ba0 con 0x7fe81c0c49f0 2023-11-24T06:17:05.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 -- 172.21.15.37:0/4170036937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c0c49f0 msgr2=0x7fe81c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 --2- 172.21.15.37:0/4170036937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c0c49f0 0x7fe81c06d700 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097a0 tx=0x7fe80802b8b0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 -- 172.21.15.37:0/4170036937 shutdown_connections 2023-11-24T06:17:05.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 --2- 172.21.15.37:0/4170036937 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c0c49f0 0x7fe81c06d700 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 --2- 172.21.15.37:0/4170036937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c072160 0x7fe81c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 -- 172.21.15.37:0/4170036937 >> 172.21.15.37:0/4170036937 conn(0x7fe81c0b0c50 msgr2=0x7fe81c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 -- 172.21.15.37:0/4170036937 shutdown_connections 2023-11-24T06:17:05.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.751+0000 7fe822ac2640 1 -- 172.21.15.37:0/4170036937 wait complete. 2023-11-24T06:17:05.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.753+0000 7fe822ac2640 1 Processor -- start 2023-11-24T06:17:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.753+0000 7fe822ac2640 1 -- start start 2023-11-24T06:17:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe822ac2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c06dc40 0x7fe81c1f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe822ac2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe81c072160 0x7fe81c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe822ac2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c0c49f0 0x7fe81c0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe822ac2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0c6fe0 con 0x7fe81c072160 2023-11-24T06:17:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe822ac2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0b4b90 con 0x7fe81c06dc40 2023-11-24T06:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe822ac2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1f41d0 con 0x7fe81c0c49f0 2023-11-24T06:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe81bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe81c072160 0x7fe81c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe81bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe81c072160 0x7fe81c158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35286/0 (socket says 172.21.15.37:35286) 2023-11-24T06:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.754+0000 7fe81bfff640 1 -- 172.21.15.37:0/2368294964 learned_addr learned my addr 172.21.15.37:0/2368294964 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe82085e640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c06dc40 0x7fe81c1f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe81bfff640 1 -- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c0c49f0 msgr2=0x7fe81c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe82105f640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c0c49f0 0x7fe81c0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe81bfff640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c0c49f0 0x7fe81c0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe81bfff640 1 -- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c06dc40 msgr2=0x7fe81c1f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe81bfff640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c06dc40 0x7fe81c1f3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe81bfff640 1 -- 172.21.15.37:0/2368294964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009400 con 0x7fe81c072160 2023-11-24T06:17:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe82105f640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c0c49f0 0x7fe81c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe82085e640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c06dc40 0x7fe81c1f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe81bfff640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe81c072160 0x7fe81c158f60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe808000c00 tx=0x7fe8080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe8197fa640 1 -- 172.21.15.37:0/2368294964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80803ace0 con 0x7fe81c072160 2023-11-24T06:17:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe8197fa640 1 -- 172.21.15.37:0/2368294964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80803ae40 con 0x7fe81c072160 2023-11-24T06:17:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c0b42f0 con 0x7fe81c072160 2023-11-24T06:17:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.755+0000 7fe8197fa640 1 -- 172.21.15.37:0/2368294964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808044630 con 0x7fe81c072160 2023-11-24T06:17:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.756+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c0b48b0 con 0x7fe81c072160 2023-11-24T06:17:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.757+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c04e8b0 con 0x7fe81c072160 2023-11-24T06:17:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.758+0000 7fe8197fa640 1 -- 172.21.15.37:0/2368294964 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe80804d450 con 0x7fe81c072160 2023-11-24T06:17:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.759+0000 7fe8197fa640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe80006ae40 0x7fe80006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:05.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.759+0000 7fe8197fa640 1 -- 172.21.15.37:0/2368294964 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8080ab880 con 0x7fe81c072160 2023-11-24T06:17:05.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.759+0000 7fe82085e640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe80006ae40 0x7fe80006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:05.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.760+0000 7fe82085e640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe80006ae40 0x7fe80006d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe81c1f0e00 tx=0x7fe810008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:05.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.763+0000 7fe8197fa640 1 -- 172.21.15.37:0/2368294964 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe808076890 con 0x7fe81c072160 2023-11-24T06:17:05.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.960+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe81c15dab0 con 0x7fe81c072160 2023-11-24T06:17:05.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.961+0000 7fe8197fa640 1 -- 172.21.15.37:0/2368294964 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe8080350c0 con 0x7fe81c072160 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe80006ae40 msgr2=0x7fe80006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe80006ae40 0x7fe80006d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe81c1f0e00 tx=0x7fe810008040 comp rx=0 tx=0).stop 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe81c072160 msgr2=0x7fe81c158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe81c072160 0x7fe81c158f60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe808000c00 tx=0x7fe8080046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 shutdown_connections 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe80006ae40 0x7fe80006d300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe81c0c49f0 0x7fe81c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe81c072160 0x7fe81c158f60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 --2- 172.21.15.37:0/2368294964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe81c06dc40 0x7fe81c1f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:05.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 >> 172.21.15.37:0/2368294964 conn(0x7fe81c0b0c50 msgr2=0x7fe81c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:05.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 shutdown_connections 2023-11-24T06:17:05.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:05.964+0000 7fe822ac2640 1 -- 172.21.15.37:0/2368294964 wait complete. 2023-11-24T06:17:05.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp2508 2023-11-24T06:17:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.207+0000 7f1e693e2640 1 Processor -- start 2023-11-24T06:17:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.207+0000 7f1e693e2640 1 -- start start 2023-11-24T06:17:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.208+0000 7f1e693e2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 0x7f1e640d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.208+0000 7f1e693e2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1e6415d7d0 0x7f1e640d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.208+0000 7f1e693e2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e640d15e0 con 0x7f1e640d0e40 2023-11-24T06:17:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.208+0000 7f1e693e2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e640d0280 con 0x7f1e6415d7d0 2023-11-24T06:17:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.208+0000 7f1e693e2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640d1300 con 0x7f1e6415d3f0 2023-11-24T06:17:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.209+0000 7f1e68be1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1e640d0e40 0x7f1e640afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54316/0 (socket says 172.21.15.37:54316) 2023-11-24T06:17:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.209+0000 7f1e68be1640 1 -- 172.21.15.37:0/3313461548 learned_addr learned my addr 172.21.15.37:0/3313461548 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.209+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000146109 0 0) 0x7f1e640d15e0 con 0x7f1e640d0e40 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.209+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e50003520 con 0x7f1e640d0e40 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.209+0000 7f1e63fff640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 0x7f1e640d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.209+0000 7f1e637fe640 1 --2- 172.21.15.37:0/3313461548 >> v2:172.21.15.188:3300/0 conn(0x7f1e6415d7d0 0x7f1e640d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544112044 0 0) 0x7f1e50003520 con 0x7f1e640d0e40 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 msgr2=0x7f1e640d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 0x7f1e640d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 >> v2:172.21.15.188:3300/0 conn(0x7f1e6415d7d0 msgr2=0x7f1e640d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 --2- 172.21.15.37:0/3313461548 >> v2:172.21.15.188:3300/0 conn(0x7f1e6415d7d0 0x7f1e640d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640cfc30 con 0x7f1e640d0e40 2023-11-24T06:17:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f1e5c001670 con 0x7f1e640d0e40 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e63fff640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 0x7f1e640d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 >> v1:172.21.15.37:6789/0 conn(0x7f1e640d0e40 legacy=0x7f1e640afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e50003970 0x7f1e50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 0x7f1e500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e50004d00 0x7f1e50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640d0280 con 0x7f1e50003970 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640d1300 con 0x7f1e50004d00 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5000ba30 con 0x7f1e6415d3f0 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.210+0000 7f1e63fff640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e50003970 0x7f1e50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.211+0000 7f1e637fe640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 0x7f1e500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.211+0000 7f1e63fff640 1 -- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 msgr2=0x7f1e500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.211+0000 7f1e68be1640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e50004d00 0x7f1e50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.211+0000 7f1e63fff640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e6415d3f0 0x7f1e500047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.211+0000 7f1e63fff640 1 -- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e50004d00 msgr2=0x7f1e50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.211+0000 7f1e63fff640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e50004d00 0x7f1e50005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.211+0000 7f1e63fff640 1 -- 172.21.15.37:0/3313461548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50003520 con 0x7f1e50003970 2023-11-24T06:17:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.212+0000 7f1e63fff640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e50003970 0x7f1e50003d90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e540073e0 tx=0x7f1e500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16231d29de134480 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.212+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5402cd30 con 0x7f1e50003970 2023-11-24T06:17:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.212+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5402ce90 con 0x7f1e50003970 2023-11-24T06:17:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.212+0000 7f1e62ffd640 1 -- 172.21.15.37:0/3313461548 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54034640 con 0x7f1e50003970 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.213+0000 7f1e693e2640 1 -- 172.21.15.37:0/3313461548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e50003970 msgr2=0x7f1e50003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.213+0000 7f1e693e2640 1 --2- 172.21.15.37:0/3313461548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e50003970 0x7f1e50003d90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e540073e0 tx=0x7f1e500057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.213+0000 7f1e68be1640 1 -- 172.21.15.37:0/3313461548 reap_dead start 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.213+0000 7f1e693e2640 1 -- 172.21.15.37:0/3313461548 shutdown_connections 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.213+0000 7f1e693e2640 1 -- 172.21.15.37:0/3313461548 >> 172.21.15.37:0/3313461548 conn(0x7f1e6409c5b0 msgr2=0x7f1e640d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.213+0000 7f1e693e2640 1 -- 172.21.15.37:0/3313461548 shutdown_connections 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.213+0000 7f1e693e2640 1 -- 172.21.15.37:0/3313461548 wait complete. 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.215+0000 7f1e693e2640 1 Processor -- start 2023-11-24T06:17:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.215+0000 7f1e693e2640 1 -- start start 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e693e2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e50003970 0x7f1e6414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e693e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e640b5e90 0x7f1e641f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e693e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6414d080 0x7f1e6406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e693e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c9c90 con 0x7f1e640b5e90 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e693e2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640c9740 con 0x7f1e6414d080 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e693e2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640b62f0 con 0x7f1e50003970 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e640b5e90 0x7f1e641f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e640b5e90 0x7f1e641f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35302/0 (socket says 172.21.15.37:35302) 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 -- 172.21.15.37:0/2102212649 learned_addr learned my addr 172.21.15.37:0/2102212649 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 -- 172.21.15.37:0/2102212649 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e50003970 msgr2=0x7f1e6414a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e50003970 0x7f1e6414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 -- 172.21.15.37:0/2102212649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6414d080 msgr2=0x7f1e6406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6414d080 0x7f1e6406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.216+0000 7f1e637fe640 1 -- 172.21.15.37:0/2102212649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640c99b0 con 0x7f1e640b5e90 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.217+0000 7f1e637fe640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e640b5e90 0x7f1e641f6c60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e810 tx=0x7f1e4c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.217+0000 7f1e60ff9640 1 -- 172.21.15.37:0/2102212649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00c6d0 con 0x7f1e640b5e90 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.217+0000 7f1e60ff9640 1 -- 172.21.15.37:0/2102212649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00c830 con 0x7f1e640b5e90 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.217+0000 7f1e60ff9640 1 -- 172.21.15.37:0/2102212649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00cbc0 con 0x7f1e640b5e90 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.217+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e641f6460 con 0x7f1e640b5e90 2023-11-24T06:17:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.217+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e641f71a0 con 0x7f1e640b5e90 2023-11-24T06:17:06.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.219+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6404e840 con 0x7f1e640b5e90 2023-11-24T06:17:06.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.220+0000 7f1e60ff9640 1 -- 172.21.15.37:0/2102212649 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e4c00cd20 con 0x7f1e640b5e90 2023-11-24T06:17:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.221+0000 7f1e60ff9640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e4406ae40 0x7f1e4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.221+0000 7f1e60ff9640 1 -- 172.21.15.37:0/2102212649 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e4c089300 con 0x7f1e640b5e90 2023-11-24T06:17:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.221+0000 7f1e63fff640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e4406ae40 0x7f1e4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.222+0000 7f1e63fff640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e4406ae40 0x7f1e4406d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e54036000 tx=0x7f1e5402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.225+0000 7f1e60ff9640 1 -- 172.21.15.37:0/2102212649 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e4c0543b0 con 0x7f1e640b5e90 2023-11-24T06:17:06.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.449+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp2508", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e641f62e0 con 0x7f1e4406ae40 2023-11-24T06:17:06.461 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:06.458+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:06.461 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:06.458+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:06.461 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:06.458+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:06.461 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:06.458+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:06.461 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:06.458+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:06.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.487+0000 7f1e60ff9640 1 -- 172.21.15.37:0/2102212649 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1e54034440 con 0x7f1e4406ae40 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e4406ae40 msgr2=0x7f1e4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e4406ae40 0x7f1e4406d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e54036000 tx=0x7f1e5402e000 comp rx=0 tx=0).stop 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e640b5e90 msgr2=0x7f1e641f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e640b5e90 0x7f1e641f6c60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e810 tx=0x7f1e4c00ecd0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 shutdown_connections 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1e4406ae40 0x7f1e4406d300 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1e6414d080 0x7f1e6406c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e640b5e90 0x7f1e641f6c60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 --2- 172.21.15.37:0/2102212649 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1e50003970 0x7f1e6414a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 >> 172.21.15.37:0/2102212649 conn(0x7f1e6409c5b0 msgr2=0x7f1e640b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 shutdown_connections 2023-11-24T06:17:06.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.490+0000 7f1e693e2640 1 -- 172.21.15.37:0/2102212649 wait complete. 2023-11-24T06:17:06.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-11-24T06:17:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.716+0000 7fd0d2fba640 1 Processor -- start 2023-11-24T06:17:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.717+0000 7fd0d2fba640 1 -- start start 2023-11-24T06:17:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.718+0000 7fd0d2fba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc141b90 0x7fd0cc0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.718+0000 7fd0d2fba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd0cc071fe0 0x7fd0cc142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.718+0000 7fd0d2fba640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc0b14f0 con 0x7fd0cc0b1090 2023-11-24T06:17:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.718+0000 7fd0d2fba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc1450d0 con 0x7fd0cc071fe0 2023-11-24T06:17:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.718+0000 7fd0d2fba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc1422b0 con 0x7fd0cc141b90 2023-11-24T06:17:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.719+0000 7fd0d27b9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd0cc071fe0 0x7fd0cc142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.719+0000 7fd0d1fb8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc141b90 0x7fd0cc0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.719+0000 7fd0d1fb8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc141b90 0x7fd0cc0b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:41196/0 (socket says 172.21.15.37:41196) 2023-11-24T06:17:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.719+0000 7fd0d1fb8640 1 -- 172.21.15.37:0/3323989546 learned_addr learned my addr 172.21.15.37:0/3323989546 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.720+0000 7fd0d1fb8640 1 -- 172.21.15.37:0/3323989546 >> v2:172.21.15.188:3300/0 conn(0x7fd0cc071fe0 msgr2=0x7fd0cc142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.720+0000 7fd0d1fb8640 1 --2- 172.21.15.37:0/3323989546 >> v2:172.21.15.188:3300/0 conn(0x7fd0cc071fe0 0x7fd0cc142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.720+0000 7fd0d1fb8640 1 -- 172.21.15.37:0/3323989546 >> v1:172.21.15.188:6789/0 conn(0x7fd0cc0b1090 legacy=0x7fd0cc0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.720+0000 7fd0d1fb8640 1 -- 172.21.15.37:0/3323989546 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc0725e0 con 0x7fd0cc141b90 2023-11-24T06:17:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.721+0000 7fd0d1fb8640 1 --2- 172.21.15.37:0/3323989546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc141b90 0x7fd0cc0b0b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80098a0 tx=0x7fd0c802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2be8367287c006 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d0fb6640 1 -- 172.21.15.37:0/3323989546 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8031640 con 0x7fd0cc141b90 2023-11-24T06:17:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d0fb6640 1 -- 172.21.15.37:0/3323989546 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c80317a0 con 0x7fd0cc141b90 2023-11-24T06:17:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d0fb6640 1 -- 172.21.15.37:0/3323989546 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8031b30 con 0x7fd0cc141b90 2023-11-24T06:17:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d2fba640 1 -- 172.21.15.37:0/3323989546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc141b90 msgr2=0x7fd0cc0b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/3323989546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc141b90 0x7fd0cc0b0b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80098a0 tx=0x7fd0c802b8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d2fba640 1 -- 172.21.15.37:0/3323989546 shutdown_connections 2023-11-24T06:17:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/3323989546 >> v2:172.21.15.188:3300/0 conn(0x7fd0cc071fe0 0x7fd0cc142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.722+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/3323989546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc141b90 0x7fd0cc0b0b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.723+0000 7fd0d2fba640 1 -- 172.21.15.37:0/3323989546 >> 172.21.15.37:0/3323989546 conn(0x7fd0cc06a500 msgr2=0x7fd0cc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.723+0000 7fd0d2fba640 1 -- 172.21.15.37:0/3323989546 shutdown_connections 2023-11-24T06:17:06.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.723+0000 7fd0d2fba640 1 -- 172.21.15.37:0/3323989546 wait complete. 2023-11-24T06:17:06.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.725+0000 7fd0d2fba640 1 Processor -- start 2023-11-24T06:17:06.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.725+0000 7fd0d2fba640 1 -- start start 2023-11-24T06:17:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.726+0000 7fd0d2fba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc071fe0 0x7fd0cc13ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.726+0000 7fd0d2fba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc0b1090 0x7fd0cc15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.726+0000 7fd0d2fba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0cc141b90 0x7fd0cc1f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.726+0000 7fd0d2fba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc13fde0 con 0x7fd0cc141b90 2023-11-24T06:17:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.726+0000 7fd0d2fba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc13f260 con 0x7fd0cc071fe0 2023-11-24T06:17:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.726+0000 7fd0d2fba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc13f540 con 0x7fd0cc0b1090 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0cc141b90 0x7fd0cc1f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0cc141b90 0x7fd0cc1f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35340/0 (socket says 172.21.15.37:35340) 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 -- 172.21.15.37:0/1216750656 learned_addr learned my addr 172.21.15.37:0/1216750656 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d17b7640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc0b1090 0x7fd0cc15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d1fb8640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc071fe0 0x7fd0cc13ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 -- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc0b1090 msgr2=0x7fd0cc15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc0b1090 0x7fd0cc15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 -- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc071fe0 msgr2=0x7fd0cc13ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc071fe0 0x7fd0cc13ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.727+0000 7fd0d27b9640 1 -- 172.21.15.37:0/1216750656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80094d0 con 0x7fd0cc141b90 2023-11-24T06:17:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.728+0000 7fd0d27b9640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0cc141b90 0x7fd0cc1f0730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400efc0 tx=0x7fd0c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.728+0000 7fd0c27fc640 1 -- 172.21.15.37:0/1216750656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4014480 con 0x7fd0cc141b90 2023-11-24T06:17:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.728+0000 7fd0c27fc640 1 -- 172.21.15.37:0/1216750656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c400f040 con 0x7fd0cc141b90 2023-11-24T06:17:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.728+0000 7fd0c27fc640 1 -- 172.21.15.37:0/1216750656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4014820 con 0x7fd0cc141b90 2023-11-24T06:17:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.728+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc13f820 con 0x7fd0cc141b90 2023-11-24T06:17:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.728+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc15e880 con 0x7fd0cc141b90 2023-11-24T06:17:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.729+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc04e840 con 0x7fd0cc141b90 2023-11-24T06:17:06.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.730+0000 7fd0c27fc640 1 -- 172.21.15.37:0/1216750656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0c4014980 con 0x7fd0cc141b90 2023-11-24T06:17:06.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.731+0000 7fd0c27fc640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd0b006ae40 0x7fd0b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:06.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.731+0000 7fd0c27fc640 1 -- 172.21.15.37:0/1216750656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0c408a280 con 0x7fd0cc141b90 2023-11-24T06:17:06.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.731+0000 7fd0d1fb8640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd0b006ae40 0x7fd0b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:06.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.732+0000 7fd0d1fb8640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd0b006ae40 0x7fd0b006d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8036000 tx=0x7fd0c803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:06.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.735+0000 7fd0c27fc640 1 -- 172.21.15.37:0/1216750656 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0c4055290 con 0x7fd0cc141b90 2023-11-24T06:17:06.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.958+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0cc0728c0 con 0x7fd0b006ae40 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.963+0000 7fd0c27fc640 1 -- 172.21.15.37:0/1216750656 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+530 (secure 0 0 0) 0x7fd0c8031990 con 0x7fd0b006ae40 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_addrs": [ 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout: "172.21.15.37:6789", 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout: "172.21.15.188:6789", 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout: "172.21.15.188:6790" 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout: "pending_subvolume_deletions": 0, 2023-11-24T06:17:06.966 INFO:teuthology.orchestra.run.smithi037.stdout: "pools": { 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "data": [ 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "avail": 367086993408, 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs_data", 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "used": 0 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": [ 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "avail": 367086993408, 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs_metadata", 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: "used": 65536 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:06.967 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-11-24T06:17:06.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:06.968 INFO:teuthology.orchestra.run.smithi037.stdout: "used_size": 0 2023-11-24T06:17:06.968 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:17:06.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.965+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd0b006ae40 msgr2=0x7fd0b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.965+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd0b006ae40 0x7fd0b006d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8036000 tx=0x7fd0c803c040 comp rx=0 tx=0).stop 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0cc141b90 msgr2=0x7fd0cc1f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0cc141b90 0x7fd0cc1f0730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400efc0 tx=0x7fd0c400c490 comp rx=0 tx=0).stop 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 shutdown_connections 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd0b006ae40 0x7fd0b006d300 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0cc141b90 0x7fd0cc1f0730 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0cc0b1090 0x7fd0cc15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 --2- 172.21.15.37:0/1216750656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0cc071fe0 0x7fd0cc13ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 >> 172.21.15.37:0/1216750656 conn(0x7fd0cc06a500 msgr2=0x7fd0cc070400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 shutdown_connections 2023-11-24T06:17:06.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:06.966+0000 7fd0d2fba640 1 -- 172.21.15.37:0/1216750656 wait complete. 2023-11-24T06:17:06.988 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:17:06.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:17:07.112 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:17:07.230 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:17:07.230 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:07.230 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:07.294 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:07.294 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:07.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.576+0000 7fbeb4aea640 1 Processor -- start 2023-11-24T06:17:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.577+0000 7fbeb4aea640 1 -- start start 2023-11-24T06:17:07.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeb4aea640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbeb0143ba0 0x7fbeb006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeb4aea640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbeb0146dd0 0x7fbeb006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeb4aea640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb00727f0 con 0x7fbeb006ee60 2023-11-24T06:17:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeb4aea640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb0144110 con 0x7fbeb0146dd0 2023-11-24T06:17:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeb4aea640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb006f300 con 0x7fbeb0143ba0 2023-11-24T06:17:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeaeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbeb0146dd0 0x7fbeb006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeaffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbeb006ee60 0x7fbeb0160f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54318/0 (socket says 172.21.15.37:54318) 2023-11-24T06:17:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeaffff640 1 -- 172.21.15.37:0/3048891133 learned_addr learned my addr 172.21.15.37:0/3048891133 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.579+0000 7fbeaf7fe640 1 --2- 172.21.15.37:0/3048891133 >> v2:172.21.15.188:3300/0 conn(0x7fbeb0143ba0 0x7fbeb006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.580+0000 7fbeaeffd640 1 -- 172.21.15.37:0/3048891133 >> v2:172.21.15.188:3300/0 conn(0x7fbeb0143ba0 msgr2=0x7fbeb006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.580+0000 7fbeaeffd640 1 --2- 172.21.15.37:0/3048891133 >> v2:172.21.15.188:3300/0 conn(0x7fbeb0143ba0 0x7fbeb006e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.580+0000 7fbeaeffd640 1 -- 172.21.15.37:0/3048891133 >> v1:172.21.15.37:6789/0 conn(0x7fbeb006ee60 legacy=0x7fbeb0160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.580+0000 7fbeaeffd640 1 -- 172.21.15.37:0/3048891133 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb006f5e0 con 0x7fbeb0146dd0 2023-11-24T06:17:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.580+0000 7fbeae7fc640 1 -- 172.21.15.37:0/3048891133 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600117737 0 0) 0x7fbeb00727f0 con 0x7fbeb006ee60 2023-11-24T06:17:07.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.581+0000 7fbeaeffd640 1 --2- 172.21.15.37:0/3048891133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0146dd0 0x7fbeb006a500 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbeb006d020 tx=0x7fbea402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed8de1ae4596cb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:07.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.581+0000 7fbeae7fc640 1 -- 172.21.15.37:0/3048891133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4031710 con 0x7fbeb0146dd0 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.581+0000 7fbeae7fc640 1 -- 172.21.15.37:0/3048891133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea402f050 con 0x7fbeb0146dd0 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.581+0000 7fbeae7fc640 1 -- 172.21.15.37:0/3048891133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4031a90 con 0x7fbeb0146dd0 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3048891133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0146dd0 msgr2=0x7fbeb006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3048891133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0146dd0 0x7fbeb006a500 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbeb006d020 tx=0x7fbea402b7b0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3048891133 shutdown_connections 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3048891133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0146dd0 0x7fbeb006a500 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3048891133 >> v2:172.21.15.188:3300/0 conn(0x7fbeb0143ba0 0x7fbeb006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3048891133 >> 172.21.15.37:0/3048891133 conn(0x7fbeb00b1c40 msgr2=0x7fbeb00b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3048891133 shutdown_connections 2023-11-24T06:17:07.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.582+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3048891133 wait complete. 2023-11-24T06:17:07.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.584+0000 7fbeb4aea640 1 Processor -- start 2023-11-24T06:17:07.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.584+0000 7fbeb4aea640 1 -- start start 2023-11-24T06:17:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeb4aea640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb006ee60 0x7fbeb00ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeb4aea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0143ba0 0x7fbeb01f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeb4aea640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0146dd0 0x7fbeb015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeb4aea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f2f10 con 0x7fbeb0143ba0 2023-11-24T06:17:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeb4aea640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f6a40 con 0x7fbeb0146dd0 2023-11-24T06:17:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeb4aea640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f6c70 con 0x7fbeb006ee60 2023-11-24T06:17:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeaeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0143ba0 0x7fbeb01f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeaeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0143ba0 0x7fbeb01f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35356/0 (socket says 172.21.15.37:35356) 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.585+0000 7fbeaeffd640 1 -- 172.21.15.37:0/3861948157 learned_addr learned my addr 172.21.15.37:0/3861948157 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaffff640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0146dd0 0x7fbeb015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaf7fe640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb006ee60 0x7fbeb00ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaeffd640 1 -- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb006ee60 msgr2=0x7fbeb00ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaeffd640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb006ee60 0x7fbeb00ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaeffd640 1 -- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0146dd0 msgr2=0x7fbeb015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaeffd640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0146dd0 0x7fbeb015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaeffd640 1 -- 172.21.15.37:0/3861948157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009400 con 0x7fbeb0143ba0 2023-11-24T06:17:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeaeffd640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0143ba0 0x7fbeb01f6500 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbea4000c00 tx=0x7fbea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbe97fff640 1 -- 172.21.15.37:0/3861948157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4004230 con 0x7fbeb0143ba0 2023-11-24T06:17:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbe97fff640 1 -- 172.21.15.37:0/3861948157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea40043b0 con 0x7fbeb0143ba0 2023-11-24T06:17:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbe97fff640 1 -- 172.21.15.37:0/3861948157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4004520 con 0x7fbeb0143ba0 2023-11-24T06:17:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.586+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb01f6f50 con 0x7fbeb0143ba0 2023-11-24T06:17:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.587+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb01f3100 con 0x7fbeb0143ba0 2023-11-24T06:17:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.588+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb01f7470 con 0x7fbeb0143ba0 2023-11-24T06:17:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.589+0000 7fbe97fff640 1 -- 172.21.15.37:0/3861948157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fbea403a050 con 0x7fbeb0143ba0 2023-11-24T06:17:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.590+0000 7fbe97fff640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbe9c06aed0 0x7fbe9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.590+0000 7fbe97fff640 1 -- 172.21.15.37:0/3861948157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbea40aae10 con 0x7fbeb0143ba0 2023-11-24T06:17:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.590+0000 7fbeaf7fe640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbe9c06aed0 0x7fbe9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.591+0000 7fbeaf7fe640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbe9c06aed0 0x7fbe9c06d390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbea0006fd0 tx=0x7fbea0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.594+0000 7fbe97fff640 1 -- 172.21.15.37:0/3861948157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbea4075e50 con 0x7fbeb0143ba0 2023-11-24T06:17:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.790+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeb0140100 con 0x7fbeb0143ba0 2023-11-24T06:17:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.793+0000 7fbe97fff640 1 -- 172.21.15.37:0/3861948157 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fbea4038090 con 0x7fbeb0143ba0 2023-11-24T06:17:07.797 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:07.797 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:49.877706+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:07.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbe9c06aed0 msgr2=0x7fbe9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbe9c06aed0 0x7fbe9c06d390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbea0006fd0 tx=0x7fbea0008040 comp rx=0 tx=0).stop 2023-11-24T06:17:07.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0143ba0 msgr2=0x7fbeb01f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:07.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0143ba0 0x7fbeb01f6500 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbea4000c00 tx=0x7fbea40046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 shutdown_connections 2023-11-24T06:17:07.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbe9c06aed0 0x7fbe9c06d390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0146dd0 0x7fbeb015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb0143ba0 0x7fbeb01f6500 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 --2- 172.21.15.37:0/3861948157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb006ee60 0x7fbeb00ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:07.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 >> 172.21.15.37:0/3861948157 conn(0x7fbeb00b1c40 msgr2=0x7fbeb013f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:07.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 shutdown_connections 2023-11-24T06:17:07.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:07.796+0000 7fbeb4aea640 1 -- 172.21.15.37:0/3861948157 wait complete. 2023-11-24T06:17:07.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:16:46.245164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:47.345037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:07.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.041+0000 7f242a26d640 1 Processor -- start 2023-11-24T06:17:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.041+0000 7f242a26d640 1 -- start start 2023-11-24T06:17:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.043+0000 7f242a26d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f242415b260 0x7f242406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.043+0000 7f242a26d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24240b1250 0x7f242406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.043+0000 7f242a26d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242415ed20 con 0x7f242406e580 2023-11-24T06:17:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.043+0000 7f242a26d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242415b640 con 0x7f242415b260 2023-11-24T06:17:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.043+0000 7f242a26d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242415f8a0 con 0x7f24240b1250 2023-11-24T06:17:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.044+0000 7f2429a6c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24240b1250 0x7f242406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.044+0000 7f242926b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f242415b260 0x7f242406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.044+0000 7f2429a6c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24240b1250 0x7f242406c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:41230/0 (socket says 172.21.15.37:41230) 2023-11-24T06:17:08.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.044+0000 7f2429a6c640 1 -- 172.21.15.37:0/3908229216 learned_addr learned my addr 172.21.15.37:0/3908229216 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:08.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.045+0000 7f242926b640 1 -- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24240b1250 msgr2=0x7f242406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.045+0000 7f242926b640 1 --2- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24240b1250 0x7f242406c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.045+0000 7f242926b640 1 -- 172.21.15.37:0/3908229216 >> v1:172.21.15.188:6789/0 conn(0x7f242406e580 legacy=0x7f24240b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.045+0000 7f242926b640 1 -- 172.21.15.37:0/3908229216 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24240abe50 con 0x7f242415b260 2023-11-24T06:17:08.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.045+0000 7f2429a6c640 1 --2- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24240b1250 0x7f242406c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:08.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.046+0000 7f242926b640 1 --2- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242415b260 0x7f242406e040 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f24200097a0 tx=0x7f242002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bff5cf3c4642617 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.046+0000 7f241bfff640 1 -- 172.21.15.37:0/3908229216 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200316f0 con 0x7f242415b260 2023-11-24T06:17:08.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f241bfff640 1 -- 172.21.15.37:0/3908229216 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420031850 con 0x7f242415b260 2023-11-24T06:17:08.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f241bfff640 1 -- 172.21.15.37:0/3908229216 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420031be0 con 0x7f242415b260 2023-11-24T06:17:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f242a26d640 1 -- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242415b260 msgr2=0x7f242406e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f242a26d640 1 --2- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242415b260 0x7f242406e040 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f24200097a0 tx=0x7f242002b790 comp rx=0 tx=0).stop 2023-11-24T06:17:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f242a26d640 1 -- 172.21.15.37:0/3908229216 shutdown_connections 2023-11-24T06:17:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f242a26d640 1 --2- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24240b1250 0x7f242406c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f242a26d640 1 --2- 172.21.15.37:0/3908229216 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242415b260 0x7f242406e040 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f242a26d640 1 -- 172.21.15.37:0/3908229216 >> 172.21.15.37:0/3908229216 conn(0x7f24240cbb40 msgr2=0x7f24240cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.047+0000 7f242a26d640 1 -- 172.21.15.37:0/3908229216 shutdown_connections 2023-11-24T06:17:08.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.048+0000 7f242a26d640 1 -- 172.21.15.37:0/3908229216 wait complete. 2023-11-24T06:17:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.050+0000 7f242a26d640 1 Processor -- start 2023-11-24T06:17:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.050+0000 7f242a26d640 1 -- start start 2023-11-24T06:17:08.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.051+0000 7f242a26d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242406e580 0x7f24240c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.051+0000 7f242a26d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24240b1250 0x7f2424159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.051+0000 7f242a26d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242415b260 0x7f2424155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.051+0000 7f242a26d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24240c8130 con 0x7f24240b1250 2023-11-24T06:17:08.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.051+0000 7f242a26d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24240c9a80 con 0x7f242406e580 2023-11-24T06:17:08.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.051+0000 7f242a26d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24240c9d60 con 0x7f242415b260 2023-11-24T06:17:08.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24240b1250 0x7f2424159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24240b1250 0x7f2424159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35358/0 (socket says 172.21.15.37:35358) 2023-11-24T06:17:08.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 -- 172.21.15.37:0/1981868704 learned_addr learned my addr 172.21.15.37:0/1981868704 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:08.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f242926b640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242406e580 0x7f24240c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2429a6c640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242415b260 0x7f2424155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 -- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242415b260 msgr2=0x7f2424155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242415b260 0x7f2424155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 -- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242406e580 msgr2=0x7f24240c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242406e580 0x7f24240c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2428a6a640 1 -- 172.21.15.37:0/1981868704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c009b30 con 0x7f24240b1250 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.052+0000 7f2429a6c640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242415b260 0x7f2424155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.053+0000 7f2428a6a640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24240b1250 0x7f2424159640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f241400c400 tx=0x7f241400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.053+0000 7f2419ffb640 1 -- 172.21.15.37:0/1981868704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24140052d0 con 0x7f24240b1250 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.053+0000 7f2419ffb640 1 -- 172.21.15.37:0/1981868704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414005450 con 0x7f24240b1250 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.053+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2420009400 con 0x7f24240b1250 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.053+0000 7f2419ffb640 1 -- 172.21.15.37:0/1981868704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414007260 con 0x7f24240b1250 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.053+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24240ca320 con 0x7f24240b1250 2023-11-24T06:17:08.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.054+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242406d910 con 0x7f24240b1250 2023-11-24T06:17:08.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.055+0000 7f2419ffb640 1 -- 172.21.15.37:0/1981868704 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f24140073c0 con 0x7f24240b1250 2023-11-24T06:17:08.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.056+0000 7f2419ffb640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f240806aed0 0x7f240806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.056+0000 7f2419ffb640 1 -- 172.21.15.37:0/1981868704 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2414088a40 con 0x7f24240b1250 2023-11-24T06:17:08.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.057+0000 7f242926b640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f240806aed0 0x7f240806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.057+0000 7f242926b640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f240806aed0 0x7f240806d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2420036000 tx=0x7f2420008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.060+0000 7f2419ffb640 1 -- 172.21.15.37:0/1981868704 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2414053b00 con 0x7f24240b1250 2023-11-24T06:17:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.254+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f242404e840 con 0x7f24240b1250 2023-11-24T06:17:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.255+0000 7f2419ffb640 1 -- 172.21.15.37:0/1981868704 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2414057120 con 0x7f24240b1250 2023-11-24T06:17:08.257 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f240806aed0 msgr2=0x7f240806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f240806aed0 0x7f240806d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2420036000 tx=0x7f2420008030 comp rx=0 tx=0).stop 2023-11-24T06:17:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24240b1250 msgr2=0x7f2424159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24240b1250 0x7f2424159640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f241400c400 tx=0x7f241400c8c0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 shutdown_connections 2023-11-24T06:17:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f240806aed0 0x7f240806d390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f242415b260 0x7f2424155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24240b1250 0x7f2424159640 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 --2- 172.21.15.37:0/1981868704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f242406e580 0x7f24240c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.257+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 >> 172.21.15.37:0/1981868704 conn(0x7f24240cbb40 msgr2=0x7f24240aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.258+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 shutdown_connections 2023-11-24T06:17:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.258+0000 7f242a26d640 1 -- 172.21.15.37:0/1981868704 wait complete. 2023-11-24T06:17:08.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:17:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.505+0000 7f4643fff640 1 Processor -- start 2023-11-24T06:17:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.506+0000 7f4643fff640 1 -- start start 2023-11-24T06:17:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f4643fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f46440c27a0 0x7f46440b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f4643fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440cb960 con 0x7f46440cb580 2023-11-24T06:17:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f4643fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4644161e40 con 0x7f46440ca940 2023-11-24T06:17:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f4643fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4644162120 con 0x7f46440c27a0 2023-11-24T06:17:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f4642ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f46440cb580 0x7f46440c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54322/0 (socket says 172.21.15.37:54322) 2023-11-24T06:17:08.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f4642ffd640 1 -- 172.21.15.37:0/2652124505 learned_addr learned my addr 172.21.15.37:0/2652124505 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f463bfff640 1 --2- 172.21.15.37:0/2652124505 >> v2:172.21.15.188:3300/0 conn(0x7f46440c27a0 0x7f46440b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122264666 0 0) 0x7f46440cb960 con 0x7f46440cb580 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.508+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4630003520 con 0x7f46440cb580 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674499192 0 0) 0x7f4630003520 con 0x7f46440cb580 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 >> v2:172.21.15.188:3300/0 conn(0x7f46440c27a0 msgr2=0x7f46440b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 --2- 172.21.15.37:0/2652124505 >> v2:172.21.15.188:3300/0 conn(0x7f46440c27a0 0x7f46440b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 >> v1:172.21.15.188:6789/0 conn(0x7f46440ca940 legacy=0x7f46440b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644162400 con 0x7f46440cb580 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f4634001670 con 0x7f46440cb580 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 >> v1:172.21.15.37:6789/0 conn(0x7f46440cb580 legacy=0x7f46440c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630003970 0x7f4630003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46300047c0 0x7f4630004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4630005180 0x7f463000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644162120 con 0x7f4630003970 2023-11-24T06:17:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463000c000 con 0x7f4630005180 2023-11-24T06:17:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463000c1c0 con 0x7f46300047c0 2023-11-24T06:17:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.509+0000 7f4642ffd640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630003970 0x7f4630003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.510+0000 7f463bfff640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46300047c0 0x7f4630004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.510+0000 7f4642ffd640 1 -- 172.21.15.37:0/2652124505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46300047c0 msgr2=0x7f4630004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.510+0000 7f4642ffd640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46300047c0 0x7f4630004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.510+0000 7f4642ffd640 1 -- 172.21.15.37:0/2652124505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4630005180 msgr2=0x7f463000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.510+0000 7f4642ffd640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4630005180 0x7f463000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.510+0000 7f4642ffd640 1 -- 172.21.15.37:0/2652124505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630003520 con 0x7f4630003970 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.510+0000 7f46437fe640 1 -- 172.21.15.37:0/2652124505 reap_dead start 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.511+0000 7f4642ffd640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630003970 0x7f4630003d70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f463400c210 tx=0x7f46300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2ce9f41eb536d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.511+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463402cae0 con 0x7f4630003970 2023-11-24T06:17:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.511+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463402cc40 con 0x7f4630003970 2023-11-24T06:17:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.511+0000 7f46427fc640 1 -- 172.21.15.37:0/2652124505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340058d0 con 0x7f4630003970 2023-11-24T06:17:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.512+0000 7f4643fff640 1 -- 172.21.15.37:0/2652124505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630003970 msgr2=0x7f4630003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.512+0000 7f4643fff640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630003970 0x7f4630003d70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f463400c210 tx=0x7f46300057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.512+0000 7f4643fff640 1 -- 172.21.15.37:0/2652124505 shutdown_connections 2023-11-24T06:17:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.512+0000 7f4643fff640 1 --2- 172.21.15.37:0/2652124505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630003970 0x7f4630003d70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.512+0000 7f4643fff640 1 -- 172.21.15.37:0/2652124505 >> 172.21.15.37:0/2652124505 conn(0x7f46440cbb40 msgr2=0x7f46440cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.512+0000 7f4643fff640 1 -- 172.21.15.37:0/2652124505 shutdown_connections 2023-11-24T06:17:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.512+0000 7f4643fff640 1 -- 172.21.15.37:0/2652124505 wait complete. 2023-11-24T06:17:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.514+0000 7f4643fff640 1 Processor -- start 2023-11-24T06:17:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.514+0000 7f4643fff640 1 -- start start 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f4643fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4630003970 0x7f4644160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f4643fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f464409c210 0x7f46441f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f4643fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46441f78d0 0x7f46441f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f4643fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644160c90 con 0x7f464409c210 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f4643fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46441f82c0 con 0x7f46441f78d0 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f4643fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464409a3b0 con 0x7f4630003970 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f463bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f464409c210 0x7f46441f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.515+0000 7f463bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f464409c210 0x7f46441f7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35386/0 (socket says 172.21.15.37:35386) 2023-11-24T06:17:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f463bfff640 1 -- 172.21.15.37:0/2221795496 learned_addr learned my addr 172.21.15.37:0/2221795496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:08.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f4642ffd640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4630003970 0x7f4644160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f46437fe640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46441f78d0 0x7f46441f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f463bfff640 1 -- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4630003970 msgr2=0x7f4644160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f463bfff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4630003970 0x7f4644160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f463bfff640 1 -- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46441f78d0 msgr2=0x7f46441f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f463bfff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46441f78d0 0x7f46441f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f463bfff640 1 -- 172.21.15.37:0/2221795496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464409c780 con 0x7f464409c210 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f46437fe640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46441f78d0 0x7f46441f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.516+0000 7f463bfff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f464409c210 0x7f46441f7390 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f462c011510 tx=0x7f462c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.517+0000 7f4640ff9640 1 -- 172.21.15.37:0/2221795496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c015870 con 0x7f464409c210 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.517+0000 7f4640ff9640 1 -- 172.21.15.37:0/2221795496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c0159d0 con 0x7f464409c210 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.517+0000 7f4640ff9640 1 -- 172.21.15.37:0/2221795496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c015d40 con 0x7f464409c210 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.517+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464409a630 con 0x7f464409c210 2023-11-24T06:17:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.517+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464409abf0 con 0x7f464409c210 2023-11-24T06:17:08.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.518+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464404e840 con 0x7f464409c210 2023-11-24T06:17:08.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.519+0000 7f4640ff9640 1 -- 172.21.15.37:0/2221795496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f462c013400 con 0x7f464409c210 2023-11-24T06:17:08.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.520+0000 7f4640ff9640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f462406aed0 0x7f462406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.520+0000 7f4640ff9640 1 -- 172.21.15.37:0/2221795496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f462c089a30 con 0x7f464409c210 2023-11-24T06:17:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.520+0000 7f4642ffd640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f462406aed0 0x7f462406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.521+0000 7f4642ffd640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f462406aed0 0x7f462406d390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4634034000 tx=0x7f4634009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.525+0000 7f4640ff9640 1 -- 172.21.15.37:0/2221795496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f462c054a80 con 0x7f464409c210 2023-11-24T06:17:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.725+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46440ca720 con 0x7f464409c210 2023-11-24T06:17:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.726+0000 7f4640ff9640 1 -- 172.21.15.37:0/2221795496 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f462c0580a0 con 0x7f464409c210 2023-11-24T06:17:08.728 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f462406aed0 msgr2=0x7f462406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f462406aed0 0x7f462406d390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4634034000 tx=0x7f4634009030 comp rx=0 tx=0).stop 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f464409c210 msgr2=0x7f46441f7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f464409c210 0x7f46441f7390 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f462c011510 tx=0x7f462c0119d0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 shutdown_connections 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f462406aed0 0x7f462406d390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46441f78d0 0x7f46441f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f464409c210 0x7f46441f7390 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 --2- 172.21.15.37:0/2221795496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4630003970 0x7f4644160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 >> 172.21.15.37:0/2221795496 conn(0x7f46440cbb40 msgr2=0x7f464406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 shutdown_connections 2023-11-24T06:17:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.729+0000 7f4643fff640 1 -- 172.21.15.37:0/2221795496 wait complete. 2023-11-24T06:17:08.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:08.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.983+0000 7fc9f547c640 1 Processor -- start 2023-11-24T06:17:08.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.983+0000 7fc9f547c640 1 -- start start 2023-11-24T06:17:08.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.985+0000 7fc9f547c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f0146eb0 0x7fc9f0161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.985+0000 7fc9f547c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f0161a10 con 0x7fc9f00cd2e0 2023-11-24T06:17:08.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.985+0000 7fc9f547c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f0161cf0 con 0x7fc9f006e160 2023-11-24T06:17:08.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.985+0000 7fc9f547c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0161fd0 con 0x7fc9f0146eb0 2023-11-24T06:17:08.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.985+0000 7fc9ef7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc9f00cd2e0 0x7fc9f0070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54328/0 (socket says 172.21.15.37:54328) 2023-11-24T06:17:08.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.985+0000 7fc9ef7fe640 1 -- 172.21.15.37:0/1216657168 learned_addr learned my addr 172.21.15.37:0/1216657168 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:08.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.986+0000 7fc9eeffd640 1 --2- 172.21.15.37:0/1216657168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f0146eb0 0x7fc9f0161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.986+0000 7fc9edffb640 1 -- 172.21.15.37:0/1216657168 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391371607 0 0) 0x7fc9f0161a10 con 0x7fc9f00cd2e0 2023-11-24T06:17:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.986+0000 7fc9edffb640 1 -- 172.21.15.37:0/1216657168 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d8003520 con 0x7fc9f00cd2e0 2023-11-24T06:17:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.986+0000 7fc9edffb640 1 -- 172.21.15.37:0/1216657168 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105148032 0 0) 0x7fc9f0161cf0 con 0x7fc9f006e160 2023-11-24T06:17:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.986+0000 7fc9eeffd640 1 -- 172.21.15.37:0/1216657168 >> v1:172.21.15.188:6789/0 conn(0x7fc9f006e160 legacy=0x7fc9f00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.986+0000 7fc9eeffd640 1 -- 172.21.15.37:0/1216657168 >> v1:172.21.15.37:6789/0 conn(0x7fc9f00cd2e0 legacy=0x7fc9f0070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.986+0000 7fc9eeffd640 1 -- 172.21.15.37:0/1216657168 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0070660 con 0x7fc9f0146eb0 2023-11-24T06:17:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.988+0000 7fc9eeffd640 1 --2- 172.21.15.37:0/1216657168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f0146eb0 0x7fc9f0161150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00097d0 tx=0x7fc9e002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa521dd1411340c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.988+0000 7fc9edffb640 1 -- 172.21.15.37:0/1216657168 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0031890 con 0x7fc9f0146eb0 2023-11-24T06:17:08.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.988+0000 7fc9edffb640 1 -- 172.21.15.37:0/1216657168 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e00319f0 con 0x7fc9f0146eb0 2023-11-24T06:17:08.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.988+0000 7fc9edffb640 1 -- 172.21.15.37:0/1216657168 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0031d80 con 0x7fc9f0146eb0 2023-11-24T06:17:08.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.989+0000 7fc9f547c640 1 -- 172.21.15.37:0/1216657168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f0146eb0 msgr2=0x7fc9f0161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.989+0000 7fc9f547c640 1 --2- 172.21.15.37:0/1216657168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f0146eb0 0x7fc9f0161150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00097d0 tx=0x7fc9e002b930 comp rx=0 tx=0).stop 2023-11-24T06:17:08.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.989+0000 7fc9f547c640 1 -- 172.21.15.37:0/1216657168 shutdown_connections 2023-11-24T06:17:08.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.989+0000 7fc9f547c640 1 --2- 172.21.15.37:0/1216657168 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f0146eb0 0x7fc9f0161150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.989+0000 7fc9f547c640 1 -- 172.21.15.37:0/1216657168 >> 172.21.15.37:0/1216657168 conn(0x7fc9f00b0c50 msgr2=0x7fc9f00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:08.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.989+0000 7fc9f547c640 1 -- 172.21.15.37:0/1216657168 shutdown_connections 2023-11-24T06:17:08.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.989+0000 7fc9f547c640 1 -- 172.21.15.37:0/1216657168 wait complete. 2023-11-24T06:17:08.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.991+0000 7fc9f547c640 1 Processor -- start 2023-11-24T06:17:08.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.991+0000 7fc9f547c640 1 -- start start 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.992+0000 7fc9f547c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9f006e160 0x7fc9f00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.992+0000 7fc9f547c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f00cd2e0 0x7fc9f015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.992+0000 7fc9f547c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9f0146eb0 0x7fc9f015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.992+0000 7fc9f547c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f015d4a0 con 0x7fc9f006e160 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.992+0000 7fc9f547c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00b3db0 con 0x7fc9f0146eb0 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.992+0000 7fc9f547c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00b4090 con 0x7fc9f00cd2e0 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9f006e160 0x7fc9f00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9f006e160 0x7fc9f00b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35394/0 (socket says 172.21.15.37:35394) 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 -- 172.21.15.37:0/3970830756 learned_addr learned my addr 172.21.15.37:0/3970830756 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9ee7fc640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f00cd2e0 0x7fc9f015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 -- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f00cd2e0 msgr2=0x7fc9f015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f00cd2e0 0x7fc9f015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9ef7fe640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9f0146eb0 0x7fc9f015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 -- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9f0146eb0 msgr2=0x7fc9f015cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9f0146eb0 0x7fc9f015cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9eeffd640 1 -- 172.21.15.37:0/3970830756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0009400 con 0x7fc9f006e160 2023-11-24T06:17:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.993+0000 7fc9ef7fe640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9f0146eb0 0x7fc9f015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.994+0000 7fc9eeffd640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9f006e160 0x7fc9f00b03f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00097d0 tx=0x7fc9e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.994+0000 7fc9d77fe640 1 -- 172.21.15.37:0/3970830756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e003ad70 con 0x7fc9f006e160 2023-11-24T06:17:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.994+0000 7fc9d77fe640 1 -- 172.21.15.37:0/3970830756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e00443f0 con 0x7fc9f006e160 2023-11-24T06:17:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.994+0000 7fc9d77fe640 1 -- 172.21.15.37:0/3970830756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00447a0 con 0x7fc9f006e160 2023-11-24T06:17:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.994+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f015dca0 con 0x7fc9f006e160 2023-11-24T06:17:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.994+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00b0930 con 0x7fc9f006e160 2023-11-24T06:17:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.995+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f015db00 con 0x7fc9f006e160 2023-11-24T06:17:08.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.996+0000 7fc9d77fe640 1 -- 172.21.15.37:0/3970830756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fc9e004d450 con 0x7fc9f006e160 2023-11-24T06:17:08.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.997+0000 7fc9d77fe640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc9dc06af00 0x7fc9dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.997+0000 7fc9d77fe640 1 -- 172.21.15.37:0/3970830756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9e00abde0 con 0x7fc9f006e160 2023-11-24T06:17:09.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.998+0000 7fc9ee7fc640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc9dc06af00 0x7fc9dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:08.998+0000 7fc9ee7fc640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc9dc06af00 0x7fc9dc06d3c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00cb5b0 tx=0x7fc9e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:09.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.002+0000 7fc9d77fe640 1 -- 172.21.15.37:0/3970830756 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9f015db00 con 0x7fc9f006e160 2023-11-24T06:17:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.195+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9f015e1c0 con 0x7fc9f006e160 2023-11-24T06:17:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.196+0000 7fc9d77fe640 1 -- 172.21.15.37:0/3970830756 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9f015e1c0 con 0x7fc9f006e160 2023-11-24T06:17:09.199 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc9dc06af00 msgr2=0x7fc9dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc9dc06af00 0x7fc9dc06d3c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00cb5b0 tx=0x7fc9e4009040 comp rx=0 tx=0).stop 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9f006e160 msgr2=0x7fc9f00b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9f006e160 0x7fc9f00b03f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00097d0 tx=0x7fc9e00046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 shutdown_connections 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc9dc06af00 0x7fc9dc06d3c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9f0146eb0 0x7fc9f015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9f00cd2e0 0x7fc9f015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 --2- 172.21.15.37:0/3970830756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9f006e160 0x7fc9f00b03f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 >> 172.21.15.37:0/3970830756 conn(0x7fc9f00b0c50 msgr2=0x7fc9f00ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 shutdown_connections 2023-11-24T06:17:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.199+0000 7fc9f547c640 1 -- 172.21.15.37:0/3970830756 wait complete. 2023-11-24T06:17:09.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:17:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.446+0000 7f4831027640 1 Processor -- start 2023-11-24T06:17:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.446+0000 7f4831027640 1 -- start start 2023-11-24T06:17:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.448+0000 7f4831027640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 0x7f482c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.448+0000 7f4831027640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f482c070550 0x7f482c0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.448+0000 7f4831027640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0ca0e0 con 0x7f482c0b1080 2023-11-24T06:17:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.448+0000 7f4831027640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c15fde0 con 0x7f482c070550 2023-11-24T06:17:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.448+0000 7f4831027640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b1510 con 0x7f482c15b1d0 2023-11-24T06:17:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.448+0000 7f4830826640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f482c0b1080 0x7f482c06c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54336/0 (socket says 172.21.15.37:54336) 2023-11-24T06:17:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.448+0000 7f4830826640 1 -- 172.21.15.37:0/542932382 learned_addr learned my addr 172.21.15.37:0/542932382 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482bfff640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 0x7f482c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f48237fe640 1 --2- 172.21.15.37:0/542932382 >> v2:172.21.15.188:3300/0 conn(0x7f482c070550 0x7f482c0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207213847 0 0) 0x7f482c0ca0e0 con 0x7f482c0b1080 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4818003520 con 0x7f482c0b1080 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3724455447 0 0) 0x7f4818003520 con 0x7f482c0b1080 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 msgr2=0x7f482c071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 0x7f482c071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 >> v2:172.21.15.188:3300/0 conn(0x7f482c070550 msgr2=0x7f482c0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:09.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 --2- 172.21.15.37:0/542932382 >> v2:172.21.15.188:3300/0 conn(0x7f482c070550 0x7f482c0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c072800 con 0x7f482c0b1080 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f4824001670 con 0x7f482c0b1080 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 >> v1:172.21.15.37:6789/0 conn(0x7f482c0b1080 legacy=0x7f482c06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 0x7f4818003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.449+0000 7f482b7fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4818003f40 0x7f48180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f482b7fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4818004d00 0x7f4818005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c15fde0 con 0x7f4818003f40 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b1510 con 0x7f4818004d00 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481800b980 con 0x7f482c15b1d0 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f48237fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4818003f40 0x7f48180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f482bfff640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 0x7f4818003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f48237fe640 1 -- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 msgr2=0x7f4818003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f48237fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 0x7f4818003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f48237fe640 1 -- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4818004d00 msgr2=0x7f4818005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f48237fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4818004d00 0x7f4818005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f48237fe640 1 -- 172.21.15.37:0/542932382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818003520 con 0x7f4818003f40 2023-11-24T06:17:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.450+0000 7f482bfff640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f482c15b1d0 0x7f4818003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.451+0000 7f48237fe640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4818003f40 0x7f48180047c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f481400e170 tx=0x7f48180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f363c7fa6c83bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481402cc20 con 0x7f4818003f40 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481400f040 con 0x7f4818003f40 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f482b7fe640 1 -- 172.21.15.37:0/542932382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814034440 con 0x7f4818003f40 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f4831027640 1 -- 172.21.15.37:0/542932382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4818003f40 msgr2=0x7f48180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f4831027640 1 --2- 172.21.15.37:0/542932382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4818003f40 0x7f48180047c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f481400e170 tx=0x7f48180057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f4830826640 1 -- 172.21.15.37:0/542932382 reap_dead start 2023-11-24T06:17:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f4831027640 1 -- 172.21.15.37:0/542932382 shutdown_connections 2023-11-24T06:17:09.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f4831027640 1 -- 172.21.15.37:0/542932382 >> 172.21.15.37:0/542932382 conn(0x7f482c0cbb40 msgr2=0x7f482c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:09.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f4831027640 1 -- 172.21.15.37:0/542932382 shutdown_connections 2023-11-24T06:17:09.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.452+0000 7f4831027640 1 -- 172.21.15.37:0/542932382 wait complete. 2023-11-24T06:17:09.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.454+0000 7f4831027640 1 Processor -- start 2023-11-24T06:17:09.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.454+0000 7f4831027640 1 -- start start 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.455+0000 7f4831027640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4818003f40 0x7f482c15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.455+0000 7f4831027640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f482c0999d0 0x7f482c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.455+0000 7f4831027640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f482c09b0c0 0x7f482c0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.455+0000 7f4831027640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0cec80 con 0x7f482c09b0c0 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.455+0000 7f4831027640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c09a020 con 0x7f482c0999d0 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.455+0000 7f4831027640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c09a300 con 0x7f4818003f40 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f482c09b0c0 0x7f482c0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f482c09b0c0 0x7f482c0cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35422/0 (socket says 172.21.15.37:35422) 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 -- 172.21.15.37:0/1879421087 learned_addr learned my addr 172.21.15.37:0/1879421087 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f482bfff640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4818003f40 0x7f482c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f48237fe640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f482c0999d0 0x7f482c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 -- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4818003f40 msgr2=0x7f482c15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4818003f40 0x7f482c15dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 -- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f482c0999d0 msgr2=0x7f482c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f482c0999d0 0x7f482c0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.456+0000 7f4830826640 1 -- 172.21.15.37:0/1879421087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c09a5e0 con 0x7f482c09b0c0 2023-11-24T06:17:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.457+0000 7f4830826640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f482c09b0c0 0x7f482c0cd970 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f482c0b5170 tx=0x7f482400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.457+0000 7f48297fa640 1 -- 172.21.15.37:0/1879421087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824007440 con 0x7f482c09b0c0 2023-11-24T06:17:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.457+0000 7f48297fa640 1 -- 172.21.15.37:0/1879421087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48240075a0 con 0x7f482c09b0c0 2023-11-24T06:17:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.457+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c09a8c0 con 0x7f482c09b0c0 2023-11-24T06:17:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.457+0000 7f48297fa640 1 -- 172.21.15.37:0/1879421087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824004a20 con 0x7f482c09b0c0 2023-11-24T06:17:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.457+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c09b540 con 0x7f482c09b0c0 2023-11-24T06:17:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.458+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c099db0 con 0x7f482c09b0c0 2023-11-24T06:17:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.460+0000 7f48297fa640 1 -- 172.21.15.37:0/1879421087 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f4824004b80 con 0x7f482c09b0c0 2023-11-24T06:17:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.461+0000 7f48297fa640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f480c06aed0 0x7f480c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.461+0000 7f48297fa640 1 -- 172.21.15.37:0/1879421087 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4824089070 con 0x7f482c09b0c0 2023-11-24T06:17:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.461+0000 7f482bfff640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f480c06aed0 0x7f480c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.462+0000 7f482bfff640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f480c06aed0 0x7f480c06d390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f481c0099c0 tx=0x7f481c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.465+0000 7f48297fa640 1 -- 172.21.15.37:0/1879421087 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4824054030 con 0x7f482c09b0c0 2023-11-24T06:17:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.669+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f482c09b7c0 con 0x7f482c09b0c0 2023-11-24T06:17:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.670+0000 7f48297fa640 1 -- 172.21.15.37:0/1879421087 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4824057650 con 0x7f482c09b0c0 2023-11-24T06:17:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:17:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f480c06aed0 msgr2=0x7f480c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f480c06aed0 0x7f480c06d390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f481c0099c0 tx=0x7f481c008040 comp rx=0 tx=0).stop 2023-11-24T06:17:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f482c09b0c0 msgr2=0x7f482c0cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f482c09b0c0 0x7f482c0cd970 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f482c0b5170 tx=0x7f482400c960 comp rx=0 tx=0).stop 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 shutdown_connections 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f480c06aed0 0x7f480c06d390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f482c0999d0 0x7f482c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f482c09b0c0 0x7f482c0cd970 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 --2- 172.21.15.37:0/1879421087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4818003f40 0x7f482c15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 >> 172.21.15.37:0/1879421087 conn(0x7f482c0cbb40 msgr2=0x7f482c0ad2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 shutdown_connections 2023-11-24T06:17:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:09.673+0000 7f4831027640 1 -- 172.21.15.37:0/1879421087 wait complete. 2023-11-24T06:17:09.693 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:17:09.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:09.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:09.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:09.785 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:09.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:17:09.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:09.799 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:17:09.885 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:09.886 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:09.942 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:09.942 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:10.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.269+0000 7fcb59373640 1 Processor -- start 2023-11-24T06:17:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.270+0000 7fcb59373640 1 -- start start 2023-11-24T06:17:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.271+0000 7fcb59373640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb54161080 0x7fcb540b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.271+0000 7fcb59373640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcb540b0fb0 0x7fcb540cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.271+0000 7fcb59373640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb54161510 con 0x7fcb54143870 2023-11-24T06:17:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb59373640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb54070460 con 0x7fcb54161080 2023-11-24T06:17:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb59373640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb540b1420 con 0x7fcb540b0fb0 2023-11-24T06:17:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb537fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb54161080 0x7fcb540b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb537fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb54161080 0x7fcb540b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35424/0 (socket says 172.21.15.37:35424) 2023-11-24T06:17:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb537fe640 1 -- 172.21.15.37:0/2162219195 learned_addr learned my addr 172.21.15.37:0/2162219195 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb58b72640 1 --2- 172.21.15.37:0/2162219195 >> v2:172.21.15.188:3300/0 conn(0x7fcb540b0fb0 0x7fcb540cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb537fe640 1 -- 172.21.15.37:0/2162219195 >> v2:172.21.15.188:3300/0 conn(0x7fcb540b0fb0 msgr2=0x7fcb540cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb537fe640 1 --2- 172.21.15.37:0/2162219195 >> v2:172.21.15.188:3300/0 conn(0x7fcb540b0fb0 0x7fcb540cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb537fe640 1 -- 172.21.15.37:0/2162219195 >> v1:172.21.15.188:6789/0 conn(0x7fcb54143870 legacy=0x7fcb54146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb537fe640 1 -- 172.21.15.37:0/2162219195 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb541617f0 con 0x7fcb54161080 2023-11-24T06:17:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.272+0000 7fcb58b72640 1 --2- 172.21.15.37:0/2162219195 >> v2:172.21.15.188:3300/0 conn(0x7fcb540b0fb0 0x7fcb540cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.273+0000 7fcb537fe640 1 --2- 172.21.15.37:0/2162219195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb54161080 0x7fcb540b0a70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcb540705a0 tx=0x7fcb4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd3a1035694c77d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.274+0000 7fcb52ffd640 1 -- 172.21.15.37:0/2162219195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48031870 con 0x7fcb54161080 2023-11-24T06:17:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.274+0000 7fcb52ffd640 1 -- 172.21.15.37:0/2162219195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb480319d0 con 0x7fcb54161080 2023-11-24T06:17:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.274+0000 7fcb52ffd640 1 -- 172.21.15.37:0/2162219195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48031d60 con 0x7fcb54161080 2023-11-24T06:17:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.274+0000 7fcb59373640 1 -- 172.21.15.37:0/2162219195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb54161080 msgr2=0x7fcb540b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.274+0000 7fcb59373640 1 --2- 172.21.15.37:0/2162219195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb54161080 0x7fcb540b0a70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcb540705a0 tx=0x7fcb4802b910 comp rx=0 tx=0).stop 2023-11-24T06:17:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.275+0000 7fcb59373640 1 -- 172.21.15.37:0/2162219195 shutdown_connections 2023-11-24T06:17:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.275+0000 7fcb59373640 1 --2- 172.21.15.37:0/2162219195 >> v2:172.21.15.188:3300/0 conn(0x7fcb540b0fb0 0x7fcb540cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.275+0000 7fcb59373640 1 --2- 172.21.15.37:0/2162219195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb54161080 0x7fcb540b0a70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.275+0000 7fcb59373640 1 -- 172.21.15.37:0/2162219195 >> 172.21.15.37:0/2162219195 conn(0x7fcb540cb830 msgr2=0x7fcb540cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.275+0000 7fcb59373640 1 -- 172.21.15.37:0/2162219195 shutdown_connections 2023-11-24T06:17:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.275+0000 7fcb59373640 1 -- 172.21.15.37:0/2162219195 wait complete. 2023-11-24T06:17:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.277+0000 7fcb59373640 1 Processor -- start 2023-11-24T06:17:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.277+0000 7fcb59373640 1 -- start start 2023-11-24T06:17:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb59373640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb540b0fb0 0x7fcb5415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb59373640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54143870 0x7fcb541e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb59373640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb541e6ec0 0x7fcb54132f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb59373640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5415ff60 con 0x7fcb540b0fb0 2023-11-24T06:17:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb59373640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5415d530 con 0x7fcb54143870 2023-11-24T06:17:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb59373640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5415f2e0 con 0x7fcb541e6ec0 2023-11-24T06:17:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb540b0fb0 0x7fcb5415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb540b0fb0 0x7fcb5415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35436/0 (socket says 172.21.15.37:35436) 2023-11-24T06:17:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 -- 172.21.15.37:0/2539618105 learned_addr learned my addr 172.21.15.37:0/2539618105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 -- 172.21.15.37:0/2539618105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb541e6ec0 msgr2=0x7fcb54132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb541e6ec0 0x7fcb54132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 -- 172.21.15.37:0/2539618105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54143870 msgr2=0x7fcb541e77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54143870 0x7fcb541e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.278+0000 7fcb53fff640 1 -- 172.21.15.37:0/2539618105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480094d0 con 0x7fcb540b0fb0 2023-11-24T06:17:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.279+0000 7fcb53fff640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb540b0fb0 0x7fcb5415cff0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c7d0 tx=0x7fcb4400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.279+0000 7fcb50ff9640 1 -- 172.21.15.37:0/2539618105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44003d80 con 0x7fcb540b0fb0 2023-11-24T06:17:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.279+0000 7fcb50ff9640 1 -- 172.21.15.37:0/2539618105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44005070 con 0x7fcb540b0fb0 2023-11-24T06:17:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.279+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5415f5c0 con 0x7fcb540b0fb0 2023-11-24T06:17:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.279+0000 7fcb50ff9640 1 -- 172.21.15.37:0/2539618105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44005420 con 0x7fcb540b0fb0 2023-11-24T06:17:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.279+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5415fb80 con 0x7fcb540b0fb0 2023-11-24T06:17:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.280+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb540cc140 con 0x7fcb540b0fb0 2023-11-24T06:17:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.281+0000 7fcb50ff9640 1 -- 172.21.15.37:0/2539618105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fcb44005580 con 0x7fcb540b0fb0 2023-11-24T06:17:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.282+0000 7fcb50ff9640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcb4006aed0 0x7fcb4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.282+0000 7fcb50ff9640 1 -- 172.21.15.37:0/2539618105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb44088ff0 con 0x7fcb540b0fb0 2023-11-24T06:17:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.282+0000 7fcb537fe640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcb4006aed0 0x7fcb4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.283+0000 7fcb537fe640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcb4006aed0 0x7fcb4006d390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb48036000 tx=0x7fcb48030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.286+0000 7fcb50ff9640 1 -- 172.21.15.37:0/2539618105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb440bbe90 con 0x7fcb540b0fb0 2023-11-24T06:17:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.479+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb5404e840 con 0x7fcb540b0fb0 2023-11-24T06:17:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.481+0000 7fcb50ff9640 1 -- 172.21.15.37:0/2539618105 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fcb44017020 con 0x7fcb540b0fb0 2023-11-24T06:17:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:10.484 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:49.877706+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.483+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcb4006aed0 msgr2=0x7fcb4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.483+0000 7fcb59373640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcb4006aed0 0x7fcb4006d390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb48036000 tx=0x7fcb48030000 comp rx=0 tx=0).stop 2023-11-24T06:17:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb540b0fb0 msgr2=0x7fcb5415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb540b0fb0 0x7fcb5415cff0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c7d0 tx=0x7fcb4400cc90 comp rx=0 tx=0).stop 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 shutdown_connections 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcb4006aed0 0x7fcb4006d390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb54143870 0x7fcb541e77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb541e6ec0 0x7fcb54132f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 --2- 172.21.15.37:0/2539618105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb540b0fb0 0x7fcb5415cff0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 >> 172.21.15.37:0/2539618105 conn(0x7fcb540cb830 msgr2=0x7fcb5406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 shutdown_connections 2023-11-24T06:17:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.484+0000 7fcb59373640 1 -- 172.21.15.37:0/2539618105 wait complete. 2023-11-24T06:17:10.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:16:46.245164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:47.345037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:10.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.741+0000 7f3a4359e640 1 Processor -- start 2023-11-24T06:17:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.741+0000 7f3a4359e640 1 -- start start 2023-11-24T06:17:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.743+0000 7f3a4359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a4415b260 0x7f3a4406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.743+0000 7f3a4359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a4406e580 0x7f3a440b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.743+0000 7f3a4359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4406d5c0 con 0x7f3a440b1080 2023-11-24T06:17:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.743+0000 7f3a4359e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a440b1530 con 0x7f3a4406e580 2023-11-24T06:17:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.743+0000 7f3a4359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4415b640 con 0x7f3a4415b260 2023-11-24T06:17:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.743+0000 7f3a42d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3a440b1080 0x7f3a440ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37104/0 (socket says 172.21.15.37:37104) 2023-11-24T06:17:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a42d9d640 1 -- 172.21.15.37:0/3102340776 learned_addr learned my addr 172.21.15.37:0/3102340776 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a39d9b640 1 --2- 172.21.15.37:0/3102340776 >> v2:172.21.15.37:3300/0 conn(0x7f3a4406e580 0x7f3a440b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a4259c640 1 --2- 172.21.15.37:0/3102340776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a4415b260 0x7f3a4406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a41d9b640 1 -- 172.21.15.37:0/3102340776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654524029 0 0) 0x7f3a4406d5c0 con 0x7f3a440b1080 2023-11-24T06:17:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a41d9b640 1 -- 172.21.15.37:0/3102340776 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a30003520 con 0x7f3a440b1080 2023-11-24T06:17:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a39d9b640 1 -- 172.21.15.37:0/3102340776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a4415b260 msgr2=0x7f3a4406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a39d9b640 1 --2- 172.21.15.37:0/3102340776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a4415b260 0x7f3a4406e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a39d9b640 1 -- 172.21.15.37:0/3102340776 >> v1:172.21.15.37:6789/0 conn(0x7f3a440b1080 legacy=0x7f3a440ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.744+0000 7f3a39d9b640 1 -- 172.21.15.37:0/3102340776 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4415ed20 con 0x7f3a4406e580 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.745+0000 7f3a39d9b640 1 --2- 172.21.15.37:0/3102340776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a440b0b40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009d90 tx=0x7f3a2c02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66b64440f5c7f8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a41d9b640 1 -- 172.21.15.37:0/3102340776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c02cb40 con 0x7f3a4406e580 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a41d9b640 1 -- 172.21.15.37:0/3102340776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c02cca0 con 0x7f3a4406e580 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a41d9b640 1 -- 172.21.15.37:0/3102340776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c034660 con 0x7f3a4406e580 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a4359e640 1 -- 172.21.15.37:0/3102340776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 msgr2=0x7f3a440b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3102340776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a440b0b40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009d90 tx=0x7f3a2c02bd90 comp rx=0 tx=0).stop 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a4359e640 1 -- 172.21.15.37:0/3102340776 shutdown_connections 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3102340776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a440b0b40 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3102340776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a4415b260 0x7f3a4406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a4359e640 1 -- 172.21.15.37:0/3102340776 >> 172.21.15.37:0/3102340776 conn(0x7f3a440cbb40 msgr2=0x7f3a440cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.746+0000 7f3a4359e640 1 -- 172.21.15.37:0/3102340776 shutdown_connections 2023-11-24T06:17:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.747+0000 7f3a4359e640 1 -- 172.21.15.37:0/3102340776 wait complete. 2023-11-24T06:17:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.748+0000 7f3a4359e640 1 Processor -- start 2023-11-24T06:17:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.748+0000 7f3a4359e640 1 -- start start 2023-11-24T06:17:10.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.749+0000 7f3a4359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a44159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.749+0000 7f3a4359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a440b1080 0x7f3a440b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.749+0000 7f3a4359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a4415b260 0x7f3a440b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.749+0000 7f3a4359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440c9710 con 0x7f3a4406e580 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.749+0000 7f3a4359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4406d4f0 con 0x7f3a4415b260 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.749+0000 7f3a4359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440c9960 con 0x7f3a440b1080 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a44159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a44159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43666/0 (socket says 172.21.15.37:43666) 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 -- 172.21.15.37:0/3357433557 learned_addr learned my addr 172.21.15.37:0/3357433557 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a39d9b640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a440b1080 0x7f3a440b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 -- 172.21.15.37:0/3357433557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a440b1080 msgr2=0x7f3a440b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a440b1080 0x7f3a440b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 -- 172.21.15.37:0/3357433557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a4415b260 msgr2=0x7f3a440b41c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:17:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a4415b260 0x7f3a440b41c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 -- 172.21.15.37:0/3357433557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c009a70 con 0x7f3a4406e580 2023-11-24T06:17:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.750+0000 7f3a4259c640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a44159190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e9b0 tx=0x7f3a3400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.751+0000 7f3a3b7fe640 1 -- 172.21.15.37:0/3357433557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34009670 con 0x7f3a4406e580 2023-11-24T06:17:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.751+0000 7f3a3b7fe640 1 -- 172.21.15.37:0/3357433557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400c9a0 con 0x7f3a4406e580 2023-11-24T06:17:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.751+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a440c9c40 con 0x7f3a4406e580 2023-11-24T06:17:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.751+0000 7f3a3b7fe640 1 -- 172.21.15.37:0/3357433557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400cd50 con 0x7f3a4406e580 2023-11-24T06:17:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.751+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4415da70 con 0x7f3a4406e580 2023-11-24T06:17:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.752+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4404e840 con 0x7f3a4406e580 2023-11-24T06:17:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.753+0000 7f3a3b7fe640 1 -- 172.21.15.37:0/3357433557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f3a34013470 con 0x7f3a4406e580 2023-11-24T06:17:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.754+0000 7f3a3b7fe640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3a2406aed0 0x7f3a2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.754+0000 7f3a3b7fe640 1 -- 172.21.15.37:0/3357433557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a34089960 con 0x7f3a4406e580 2023-11-24T06:17:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.754+0000 7f3a39d9b640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3a2406aed0 0x7f3a2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.755+0000 7f3a39d9b640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3a2406aed0 0x7f3a2406d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c036000 tx=0x7f3a2c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:10.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.759+0000 7f3a3b7fe640 1 -- 172.21.15.37:0/3357433557 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a340549b0 con 0x7f3a4406e580 2023-11-24T06:17:10.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.953+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a440ce640 con 0x7f3a4406e580 2023-11-24T06:17:10.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.954+0000 7f3a3b7fe640 1 -- 172.21.15.37:0/3357433557 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a34057fd0 con 0x7f3a4406e580 2023-11-24T06:17:10.956 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3a2406aed0 msgr2=0x7f3a2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3a2406aed0 0x7f3a2406d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c036000 tx=0x7f3a2c030000 comp rx=0 tx=0).stop 2023-11-24T06:17:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 msgr2=0x7f3a44159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a44159190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400e9b0 tx=0x7f3a3400ee70 comp rx=0 tx=0).stop 2023-11-24T06:17:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 shutdown_connections 2023-11-24T06:17:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f3a2406aed0 0x7f3a2406d390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3a4415b260 0x7f3a440b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3a440b1080 0x7f3a440b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.957+0000 7f3a4359e640 1 --2- 172.21.15.37:0/3357433557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4406e580 0x7f3a44159190 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.958+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 >> 172.21.15.37:0/3357433557 conn(0x7f3a440cbb40 msgr2=0x7f3a440add20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.958+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 shutdown_connections 2023-11-24T06:17:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:10.958+0000 7f3a4359e640 1 -- 172.21.15.37:0/3357433557 wait complete. 2023-11-24T06:17:10.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:17:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.192+0000 7fee5b3e2640 1 Processor -- start 2023-11-24T06:17:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.192+0000 7fee5b3e2640 1 -- start start 2023-11-24T06:17:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.194+0000 7fee5b3e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee540c27a0 0x7fee540b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.194+0000 7fee5b3e2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540cb960 con 0x7fee540ca940 2023-11-24T06:17:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.194+0000 7fee5b3e2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee54161e40 con 0x7fee540cb580 2023-11-24T06:17:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.194+0000 7fee5b3e2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee54162120 con 0x7fee540c27a0 2023-11-24T06:17:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.194+0000 7fee5abe1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee540ca940 0x7fee540b13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37116/0 (socket says 172.21.15.37:37116) 2023-11-24T06:17:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.194+0000 7fee5abe1640 1 -- 172.21.15.37:0/535571709 learned_addr learned my addr 172.21.15.37:0/535571709 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.194+0000 7fee59bdf640 1 --2- 172.21.15.37:0/535571709 >> v2:172.21.15.37:3300/0 conn(0x7fee540c27a0 0x7fee540b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.195+0000 7fee59bdf640 1 -- 172.21.15.37:0/535571709 >> v1:172.21.15.188:6789/0 conn(0x7fee540cb580 legacy=0x7fee540c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.195+0000 7fee59bdf640 1 -- 172.21.15.37:0/535571709 >> v1:172.21.15.37:6789/0 conn(0x7fee540ca940 legacy=0x7fee540b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.195+0000 7fee593de640 1 -- 172.21.15.37:0/535571709 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729391292 0 0) 0x7fee540cb960 con 0x7fee540ca940 2023-11-24T06:17:11.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.195+0000 7fee59bdf640 1 -- 172.21.15.37:0/535571709 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54162400 con 0x7fee540c27a0 2023-11-24T06:17:11.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.196+0000 7fee59bdf640 1 --2- 172.21.15.37:0/535571709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540b0e90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fee400097a0 tx=0x7fee4002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce5fe0c0b7cf95b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:11.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.196+0000 7fee593de640 1 -- 172.21.15.37:0/535571709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40030610 con 0x7fee540c27a0 2023-11-24T06:17:11.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.196+0000 7fee593de640 1 -- 172.21.15.37:0/535571709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee40030770 con 0x7fee540c27a0 2023-11-24T06:17:11.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee593de640 1 -- 172.21.15.37:0/535571709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40030b00 con 0x7fee540c27a0 2023-11-24T06:17:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee5b3e2640 1 -- 172.21.15.37:0/535571709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 msgr2=0x7fee540b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/535571709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540b0e90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fee400097a0 tx=0x7fee4002b960 comp rx=0 tx=0).stop 2023-11-24T06:17:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee5b3e2640 1 -- 172.21.15.37:0/535571709 shutdown_connections 2023-11-24T06:17:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/535571709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540b0e90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee5b3e2640 1 -- 172.21.15.37:0/535571709 >> 172.21.15.37:0/535571709 conn(0x7fee540cbb40 msgr2=0x7fee540cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee5b3e2640 1 -- 172.21.15.37:0/535571709 shutdown_connections 2023-11-24T06:17:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.197+0000 7fee5b3e2640 1 -- 172.21.15.37:0/535571709 wait complete. 2023-11-24T06:17:11.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.199+0000 7fee5b3e2640 1 Processor -- start 2023-11-24T06:17:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.199+0000 7fee5b3e2640 1 -- start start 2023-11-24T06:17:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.200+0000 7fee5b3e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.200+0000 7fee5b3e2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee540ca940 0x7fee541f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.200+0000 7fee5b3e2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee540cb580 0x7fee541f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.200+0000 7fee5b3e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5414adc0 con 0x7fee540c27a0 2023-11-24T06:17:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.200+0000 7fee5b3e2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee541fa630 con 0x7fee540cb580 2023-11-24T06:17:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.200+0000 7fee5b3e2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee541fa910 con 0x7fee540ca940 2023-11-24T06:17:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43682/0 (socket says 172.21.15.37:43682) 2023-11-24T06:17:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 -- 172.21.15.37:0/2633413968 learned_addr learned my addr 172.21.15.37:0/2633413968 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 -- 172.21.15.37:0/2633413968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee540ca940 msgr2=0x7fee541f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee540ca940 0x7fee541f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 -- 172.21.15.37:0/2633413968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee540cb580 msgr2=0x7fee541f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee540cb580 0x7fee541f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 -- 172.21.15.37:0/2633413968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee40009400 con 0x7fee540c27a0 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.201+0000 7fee5a3e0640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540c4070 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fee4800c730 tx=0x7fee4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.202+0000 7fee52ffd640 1 -- 172.21.15.37:0/2633413968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48003b70 con 0x7fee540c27a0 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.202+0000 7fee52ffd640 1 -- 172.21.15.37:0/2633413968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48003cf0 con 0x7fee540c27a0 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.202+0000 7fee52ffd640 1 -- 172.21.15.37:0/2633413968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48003ea0 con 0x7fee540c27a0 2023-11-24T06:17:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.202+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee541fabf0 con 0x7fee540c27a0 2023-11-24T06:17:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.202+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee541fb1b0 con 0x7fee540c27a0 2023-11-24T06:17:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.203+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee541fb3a0 con 0x7fee540c27a0 2023-11-24T06:17:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.204+0000 7fee52ffd640 1 -- 172.21.15.37:0/2633413968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fee4800aa90 con 0x7fee540c27a0 2023-11-24T06:17:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.205+0000 7fee52ffd640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806aed0 0x7fee3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.205+0000 7fee52ffd640 1 -- 172.21.15.37:0/2633413968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee48089500 con 0x7fee540c27a0 2023-11-24T06:17:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.205+0000 7fee59bdf640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806aed0 0x7fee3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.206+0000 7fee59bdf640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806aed0 0x7fee3806d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee40036000 tx=0x7fee40030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.209+0000 7fee52ffd640 1 -- 172.21.15.37:0/2633413968 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee48054550 con 0x7fee540c27a0 2023-11-24T06:17:11.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.400+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee5404e840 con 0x7fee540c27a0 2023-11-24T06:17:11.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.401+0000 7fee52ffd640 1 -- 172.21.15.37:0/2633413968 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee48057b70 con 0x7fee540c27a0 2023-11-24T06:17:11.404 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:17:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.404+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806aed0 msgr2=0x7fee3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.404+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806aed0 0x7fee3806d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee40036000 tx=0x7fee40030000 comp rx=0 tx=0).stop 2023-11-24T06:17:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.404+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 msgr2=0x7fee540c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.404+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540c4070 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fee4800c730 tx=0x7fee4800cbf0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 shutdown_connections 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fee3806aed0 0x7fee3806d390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fee540cb580 0x7fee541f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fee540ca940 0x7fee541f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 --2- 172.21.15.37:0/2633413968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540c27a0 0x7fee540c4070 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 >> 172.21.15.37:0/2633413968 conn(0x7fee540cbb40 msgr2=0x7fee540cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 shutdown_connections 2023-11-24T06:17:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.405+0000 7fee5b3e2640 1 -- 172.21.15.37:0/2633413968 wait complete. 2023-11-24T06:17:11.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.647+0000 7f07913ec640 1 Processor -- start 2023-11-24T06:17:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.648+0000 7f07913ec640 1 -- start start 2023-11-24T06:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.650+0000 7f07913ec640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0b2400 0x7f078c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.650+0000 7f07913ec640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f078c0709e0 0x7f078c070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.650+0000 7f07913ec640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c071370 con 0x7f078c146470 2023-11-24T06:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.650+0000 7f07913ec640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c0b2860 con 0x7f078c0709e0 2023-11-24T06:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.650+0000 7f07913ec640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c146850 con 0x7f078c0b2400 2023-11-24T06:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.650+0000 7f078a7fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0b2400 0x7f078c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.650+0000 7f078b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f078c0709e0 0x7f078c070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.651+0000 7f078a7fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0b2400 0x7f078c0b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:36728/0 (socket says 172.21.15.37:36728) 2023-11-24T06:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.651+0000 7f078a7fc640 1 -- 172.21.15.37:0/1068858015 learned_addr learned my addr 172.21.15.37:0/1068858015 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.651+0000 7f078a7fc640 1 -- 172.21.15.37:0/1068858015 >> v2:172.21.15.188:3300/0 conn(0x7f078c0709e0 msgr2=0x7f078c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.651+0000 7f078a7fc640 1 --2- 172.21.15.37:0/1068858015 >> v2:172.21.15.188:3300/0 conn(0x7f078c0709e0 0x7f078c070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.651+0000 7f078a7fc640 1 -- 172.21.15.37:0/1068858015 >> v1:172.21.15.188:6789/0 conn(0x7f078c146470 legacy=0x7f078c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.651+0000 7f078a7fc640 1 -- 172.21.15.37:0/1068858015 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c06cf90 con 0x7f078c0b2400 2023-11-24T06:17:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.653+0000 7f078a7fc640 1 --2- 172.21.15.37:0/1068858015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0b2400 0x7f078c0b3030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f077c009870 tx=0x7f077c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6836f53f3f63d45a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:11.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.653+0000 7f0789ffb640 1 -- 172.21.15.37:0/1068858015 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0317c0 con 0x7f078c0b2400 2023-11-24T06:17:11.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.653+0000 7f0789ffb640 1 -- 172.21.15.37:0/1068858015 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c031920 con 0x7f078c0b2400 2023-11-24T06:17:11.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.653+0000 7f0789ffb640 1 -- 172.21.15.37:0/1068858015 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c031cb0 con 0x7f078c0b2400 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 -- 172.21.15.37:0/1068858015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0b2400 msgr2=0x7f078c0b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 --2- 172.21.15.37:0/1068858015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0b2400 0x7f078c0b3030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f077c009870 tx=0x7f077c02b860 comp rx=0 tx=0).stop 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 -- 172.21.15.37:0/1068858015 shutdown_connections 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 --2- 172.21.15.37:0/1068858015 >> v2:172.21.15.188:3300/0 conn(0x7f078c0709e0 0x7f078c070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 --2- 172.21.15.37:0/1068858015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0b2400 0x7f078c0b3030 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 -- 172.21.15.37:0/1068858015 >> 172.21.15.37:0/1068858015 conn(0x7f078c061340 msgr2=0x7f078c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 -- 172.21.15.37:0/1068858015 shutdown_connections 2023-11-24T06:17:11.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.654+0000 7f07913ec640 1 -- 172.21.15.37:0/1068858015 wait complete. 2023-11-24T06:17:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.656+0000 7f07913ec640 1 Processor -- start 2023-11-24T06:17:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.656+0000 7f07913ec640 1 -- start start 2023-11-24T06:17:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.657+0000 7f07913ec640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0709e0 0x7f078c15e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.657+0000 7f07913ec640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f078c0b2400 0x7f078c145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.657+0000 7f07913ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078c146470 0x7f078c145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.657+0000 7f07913ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c13b950 con 0x7f078c146470 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.657+0000 7f07913ec640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1f6870 con 0x7f078c0b2400 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.657+0000 7f07913ec640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1f7110 con 0x7f078c0709e0 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078c146470 0x7f078c145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078c146470 0x7f078c145590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43688/0 (socket says 172.21.15.37:43688) 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 -- 172.21.15.37:0/2156869781 learned_addr learned my addr 172.21.15.37:0/2156869781 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078a7fc640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f078c0b2400 0x7f078c145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078affd640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0709e0 0x7f078c15e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 -- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0709e0 msgr2=0x7f078c15e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0709e0 0x7f078c15e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 -- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f078c0b2400 msgr2=0x7f078c145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f078c0b2400 0x7f078c145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 -- 172.21.15.37:0/2156869781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0094d0 con 0x7f078c146470 2023-11-24T06:17:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.658+0000 7f078b7fe640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078c146470 0x7f078c145590 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0784009dd0 tx=0x7f078400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.659+0000 7f07837fe640 1 -- 172.21.15.37:0/2156869781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784014480 con 0x7f078c146470 2023-11-24T06:17:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.659+0000 7f07837fe640 1 -- 172.21.15.37:0/2156869781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400f040 con 0x7f078c146470 2023-11-24T06:17:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.659+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c15e720 con 0x7f078c146470 2023-11-24T06:17:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.659+0000 7f07837fe640 1 -- 172.21.15.37:0/2156869781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784014840 con 0x7f078c146470 2023-11-24T06:17:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.659+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c1f6ac0 con 0x7f078c146470 2023-11-24T06:17:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.660+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c04e8b0 con 0x7f078c146470 2023-11-24T06:17:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.661+0000 7f07837fe640 1 -- 172.21.15.37:0/2156869781 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f07840149a0 con 0x7f078c146470 2023-11-24T06:17:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.662+0000 7f07837fe640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f076c06aed0 0x7f076c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.662+0000 7f07837fe640 1 -- 172.21.15.37:0/2156869781 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f078408a380 con 0x7f078c146470 2023-11-24T06:17:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.662+0000 7f078affd640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f076c06aed0 0x7f076c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.663+0000 7f078affd640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f076c06aed0 0x7f076c06d390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0774007fd0 tx=0x7f0774009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:11.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.667+0000 7f07837fe640 1 -- 172.21.15.37:0/2156869781 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07840552c0 con 0x7f078c146470 2023-11-24T06:17:11.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.862+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f078c1f7250 con 0x7f078c146470 2023-11-24T06:17:11.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.863+0000 7f07837fe640 1 -- 172.21.15.37:0/2156869781 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07840588e0 con 0x7f078c146470 2023-11-24T06:17:11.865 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:17:11.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.865+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f076c06aed0 msgr2=0x7f076c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.865+0000 7f07913ec640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f076c06aed0 0x7f076c06d390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0774007fd0 tx=0x7f0774009040 comp rx=0 tx=0).stop 2023-11-24T06:17:11.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.865+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078c146470 msgr2=0x7f078c145590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.865+0000 7f07913ec640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078c146470 0x7f078c145590 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0784009dd0 tx=0x7f078400c490 comp rx=0 tx=0).stop 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 shutdown_connections 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f076c06aed0 0x7f076c06d390 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f078c0b2400 0x7f078c145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078c146470 0x7f078c145590 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 --2- 172.21.15.37:0/2156869781 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f078c0709e0 0x7f078c15e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 >> 172.21.15.37:0/2156869781 conn(0x7f078c061340 msgr2=0x7f078c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 shutdown_connections 2023-11-24T06:17:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:11.866+0000 7f07913ec640 1 -- 172.21.15.37:0/2156869781 wait complete. 2023-11-24T06:17:11.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:17:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.097+0000 7f9039783640 1 Processor -- start 2023-11-24T06:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.097+0000 7f9039783640 1 -- start start 2023-11-24T06:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.098+0000 7f9039783640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f9034071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.098+0000 7f9039783640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9034070550 0x7f90340b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.098+0000 7f9039783640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90340ca0e0 con 0x7f90340b1080 2023-11-24T06:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.098+0000 7f9039783640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903415fde0 con 0x7f9034070550 2023-11-24T06:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.098+0000 7f9039783640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90340b1510 con 0x7f903415b1d0 2023-11-24T06:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.098+0000 7f9038f82640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90340b1080 0x7f903406c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37120/0 (socket says 172.21.15.37:37120) 2023-11-24T06:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.098+0000 7f9038f82640 1 -- 172.21.15.37:0/3699181544 learned_addr learned my addr 172.21.15.37:0/3699181544 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f902bfff640 1 --2- 172.21.15.37:0/3699181544 >> v2:172.21.15.37:3300/0 conn(0x7f9034070550 0x7f90340b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f9033fff640 1 --2- 172.21.15.37:0/3699181544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f9034071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f90337fe640 1 -- 172.21.15.37:0/3699181544 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419906473 0 0) 0x7f90340ca0e0 con 0x7f90340b1080 2023-11-24T06:17:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f90337fe640 1 -- 172.21.15.37:0/3699181544 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020003520 con 0x7f90340b1080 2023-11-24T06:17:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f902bfff640 1 -- 172.21.15.37:0/3699181544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 msgr2=0x7f9034071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f902bfff640 1 --2- 172.21.15.37:0/3699181544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f9034071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f902bfff640 1 -- 172.21.15.37:0/3699181544 >> v1:172.21.15.37:6789/0 conn(0x7f90340b1080 legacy=0x7f903406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.099+0000 7f902bfff640 1 -- 172.21.15.37:0/3699181544 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034072800 con 0x7f9034070550 2023-11-24T06:17:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.100+0000 7f902bfff640 1 --2- 172.21.15.37:0/3699181544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90340b0b40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f901c0097a0 tx=0x7f901c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c472d50c0c3a1377 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f90337fe640 1 -- 172.21.15.37:0/3699181544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c031830 con 0x7f9034070550 2023-11-24T06:17:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f90337fe640 1 -- 172.21.15.37:0/3699181544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c031990 con 0x7f9034070550 2023-11-24T06:17:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f90337fe640 1 -- 172.21.15.37:0/3699181544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c031d20 con 0x7f9034070550 2023-11-24T06:17:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 -- 172.21.15.37:0/3699181544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 msgr2=0x7f90340b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 --2- 172.21.15.37:0/3699181544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90340b0b40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f901c0097a0 tx=0x7f901c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 -- 172.21.15.37:0/3699181544 shutdown_connections 2023-11-24T06:17:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 --2- 172.21.15.37:0/3699181544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90340b0b40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 --2- 172.21.15.37:0/3699181544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f9034071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 -- 172.21.15.37:0/3699181544 >> 172.21.15.37:0/3699181544 conn(0x7f90340cbb40 msgr2=0x7f90340cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 -- 172.21.15.37:0/3699181544 shutdown_connections 2023-11-24T06:17:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.101+0000 7f9039783640 1 -- 172.21.15.37:0/3699181544 wait complete. 2023-11-24T06:17:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.103+0000 7f9039783640 1 Processor -- start 2023-11-24T06:17:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.103+0000 7f9039783640 1 -- start start 2023-11-24T06:17:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.104+0000 7f9039783640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90341f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.104+0000 7f9039783640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90340b1080 0x7f90340c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.104+0000 7f9039783640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f90340c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.104+0000 7f9039783640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340c6a10 con 0x7f9034070550 2023-11-24T06:17:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.104+0000 7f9039783640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340c9280 con 0x7f90340b1080 2023-11-24T06:17:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.104+0000 7f9039783640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90340c6c60 con 0x7f903415b1d0 2023-11-24T06:17:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90341f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90341f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43704/0 (socket says 172.21.15.37:43704) 2023-11-24T06:17:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 -- 172.21.15.37:0/1934517348 learned_addr learned my addr 172.21.15.37:0/1934517348 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f902bfff640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90340b1080 0x7f90340c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 -- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 msgr2=0x7f90340c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9038f82640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f90340c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f90340c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 -- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90340b1080 msgr2=0x7f90340c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90340b1080 0x7f90340c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9033fff640 1 -- 172.21.15.37:0/1934517348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c009400 con 0x7f9034070550 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f902bfff640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90340b1080 0x7f90340c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.105+0000 7f9038f82640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f90340c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.106+0000 7f9033fff640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90341f61e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f902400d5f0 tx=0x7f902400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.106+0000 7f90317fa640 1 -- 172.21.15.37:0/1934517348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90240125f0 con 0x7f9034070550 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.106+0000 7f90317fa640 1 -- 172.21.15.37:0/1934517348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9024012750 con 0x7f9034070550 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.106+0000 7f90317fa640 1 -- 172.21.15.37:0/1934517348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024012b00 con 0x7f9034070550 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.106+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90340c6f40 con 0x7f9034070550 2023-11-24T06:17:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.106+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90340c8e70 con 0x7f9034070550 2023-11-24T06:17:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.107+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903404e840 con 0x7f9034070550 2023-11-24T06:17:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.108+0000 7f90317fa640 1 -- 172.21.15.37:0/1934517348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f9024012c60 con 0x7f9034070550 2023-11-24T06:17:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.109+0000 7f90317fa640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f901406aed0 0x7f901406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.109+0000 7f90317fa640 1 -- 172.21.15.37:0/1934517348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9024089b80 con 0x7f9034070550 2023-11-24T06:17:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.109+0000 7f902bfff640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f901406aed0 0x7f901406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.110+0000 7f902bfff640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f901406aed0 0x7f901406d390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f901c036000 tx=0x7f901c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.114+0000 7f90317fa640 1 -- 172.21.15.37:0/1934517348 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9024054bd0 con 0x7f9034070550 2023-11-24T06:17:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.318+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90340c2800 con 0x7f9034070550 2023-11-24T06:17:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.319+0000 7f90317fa640 1 -- 172.21.15.37:0/1934517348 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9024089e60 con 0x7f9034070550 2023-11-24T06:17:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f901406aed0 msgr2=0x7f901406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f901406aed0 0x7f901406d390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f901c036000 tx=0x7f901c008030 comp rx=0 tx=0).stop 2023-11-24T06:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 msgr2=0x7f90341f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90341f61e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f902400d5f0 tx=0x7f902400dab0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 shutdown_connections 2023-11-24T06:17:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f901406aed0 0x7f901406d390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90340b1080 0x7f90340c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f903415b1d0 0x7f90340c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 --2- 172.21.15.37:0/1934517348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9034070550 0x7f90341f61e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 >> 172.21.15.37:0/1934517348 conn(0x7f90340cbb40 msgr2=0x7f90340cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 shutdown_connections 2023-11-24T06:17:12.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.322+0000 7f9039783640 1 -- 172.21.15.37:0/1934517348 wait complete. 2023-11-24T06:17:12.341 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:17:12.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:12.342 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:12.458 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:17:12.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:12.459 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:17:12.510 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:12.510 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:12.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:17:12.574 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:12.574 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:12.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:17:12.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.862+0000 7f97893fb640 1 Processor -- start 2023-11-24T06:17:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.862+0000 7f97893fb640 1 -- start start 2023-11-24T06:17:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f97893fb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9784144b30 0x7f978415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f97893fb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f978415c410 0x7f97840b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f97893fb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978415bf80 con 0x7f97840b1de0 2023-11-24T06:17:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f97893fb640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97840b1560 con 0x7f978415c410 2023-11-24T06:17:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f97893fb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97840b0fb0 con 0x7f9784144b30 2023-11-24T06:17:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f9788bfa640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f97840b1de0 0x7f978406c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37128/0 (socket says 172.21.15.37:37128) 2023-11-24T06:17:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f9788bfa640 1 -- 172.21.15.37:0/2355332314 learned_addr learned my addr 172.21.15.37:0/2355332314 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.864+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711969273 0 0) 0x7f978415bf80 con 0x7f97840b1de0 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f97837fe640 1 --2- 172.21.15.37:0/2355332314 >> v2:172.21.15.188:3300/0 conn(0x7f978415c410 0x7f97840b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9770003520 con 0x7f97840b1de0 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9783fff640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9784144b30 0x7f978415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572206914 0 0) 0x7f9770003520 con 0x7f97840b1de0 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9784144b30 msgr2=0x7f978415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9784144b30 0x7f978415f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 >> v2:172.21.15.188:3300/0 conn(0x7f978415c410 msgr2=0x7f97840b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 --2- 172.21.15.37:0/2355332314 >> v2:172.21.15.188:3300/0 conn(0x7f978415c410 0x7f97840b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840b1280 con 0x7f97840b1de0 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f977c001670 con 0x7f97840b1de0 2023-11-24T06:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 >> v1:172.21.15.37:6789/0 conn(0x7f97840b1de0 legacy=0x7f978406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9784144b30 0x7f9770003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9770003f40 0x7f97700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770004d00 0x7f9770005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840b1560 con 0x7f9770003f40 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840b0fb0 con 0x7f9770004d00 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977000ba30 con 0x7f9784144b30 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.865+0000 7f97837fe640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9770003f40 0x7f97700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.866+0000 7f9788bfa640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770004d00 0x7f9770005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.866+0000 7f97837fe640 1 -- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9784144b30 msgr2=0x7f9770003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.866+0000 7f97837fe640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9784144b30 0x7f9770003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.866+0000 7f97837fe640 1 -- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770004d00 msgr2=0x7f9770005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.866+0000 7f97837fe640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770004d00 0x7f9770005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.866+0000 7f97837fe640 1 -- 172.21.15.37:0/2355332314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770003520 con 0x7f9770003f40 2023-11-24T06:17:12.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.866+0000 7f9788bfa640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770004d00 0x7f9770005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.867+0000 7f97837fe640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9770003f40 0x7f97700047c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f976c009ac0 tx=0x7f97700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433bd7290e67786a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.867+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c02c710 con 0x7f9770003f40 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.867+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c02c870 con 0x7f9770003f40 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.867+0000 7f9782ffd640 1 -- 172.21.15.37:0/2355332314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c02cc00 con 0x7f9770003f40 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.868+0000 7f97893fb640 1 -- 172.21.15.37:0/2355332314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9770003f40 msgr2=0x7f97700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.868+0000 7f97893fb640 1 --2- 172.21.15.37:0/2355332314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9770003f40 0x7f97700047c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f976c009ac0 tx=0x7f97700057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.868+0000 7f9788bfa640 1 -- 172.21.15.37:0/2355332314 reap_dead start 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.868+0000 7f97893fb640 1 -- 172.21.15.37:0/2355332314 shutdown_connections 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.868+0000 7f97893fb640 1 -- 172.21.15.37:0/2355332314 >> 172.21.15.37:0/2355332314 conn(0x7f97840cb830 msgr2=0x7f97840cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.868+0000 7f97893fb640 1 -- 172.21.15.37:0/2355332314 shutdown_connections 2023-11-24T06:17:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.868+0000 7f97893fb640 1 -- 172.21.15.37:0/2355332314 wait complete. 2023-11-24T06:17:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.870+0000 7f97893fb640 1 Processor -- start 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.870+0000 7f97893fb640 1 -- start start 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97893fb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770003f40 0x7f9784152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97893fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784072060 0x7f97840c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97893fb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978415ad80 0x7f97840ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97893fb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978415ab60 con 0x7f9784072060 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97893fb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840c8570 con 0x7f9770003f40 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97893fb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97840ca870 con 0x7f978415ad80 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784072060 0x7f97840c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784072060 0x7f97840c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43726/0 (socket says 172.21.15.37:43726) 2023-11-24T06:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.871+0000 7f97837fe640 1 -- 172.21.15.37:0/111362991 learned_addr learned my addr 172.21.15.37:0/111362991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97837fe640 1 -- 172.21.15.37:0/111362991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978415ad80 msgr2=0x7f97840ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97837fe640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978415ad80 0x7f97840ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97837fe640 1 -- 172.21.15.37:0/111362991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770003f40 msgr2=0x7f9784152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97837fe640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770003f40 0x7f9784152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97837fe640 1 -- 172.21.15.37:0/111362991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840cab50 con 0x7f9784072060 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97837fe640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784072060 0x7f97840c9b10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f976c037040 tx=0x7f976c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f9780ff9640 1 -- 172.21.15.37:0/111362991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c003810 con 0x7f9784072060 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f9780ff9640 1 -- 172.21.15.37:0/111362991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c003970 con 0x7f9784072060 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f9780ff9640 1 -- 172.21.15.37:0/111362991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c003d20 con 0x7f9784072060 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97840c8200 con 0x7f9784072060 2023-11-24T06:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.872+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978415a830 con 0x7f9784072060 2023-11-24T06:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.874+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97840c8390 con 0x7f9784072060 2023-11-24T06:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.874+0000 7f9780ff9640 1 -- 172.21.15.37:0/111362991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f976c040450 con 0x7f9784072060 2023-11-24T06:17:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.875+0000 7f9780ff9640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f976406af00 0x7f976406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.875+0000 7f9780ff9640 1 -- 172.21.15.37:0/111362991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976c0ab6d0 con 0x7f9784072060 2023-11-24T06:17:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.876+0000 7f9783fff640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f976406af00 0x7f976406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:12.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.876+0000 7f9783fff640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f976406af00 0x7f976406d3c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9774009dd0 tx=0x7f97740094a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:12.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:12.880+0000 7f9780ff9640 1 -- 172.21.15.37:0/111362991 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f976c076600 con 0x7f9784072060 2023-11-24T06:17:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.120+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9784071e20 con 0x7f9784072060 2023-11-24T06:17:13.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.121+0000 7f9780ff9640 1 -- 172.21.15.37:0/111362991 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f976c079c20 con 0x7f9784072060 2023-11-24T06:17:13.124 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:13.124 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1029063982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1029063982},{"type":"v1","addr":"172.21.15.37:6835","nonce":1029063982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/3663508959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3663508959},{"type":"v1","addr":"172.21.15.188:6834","nonce":3663508959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/1387291964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1387291964},{"type":"v1","addr":"172.21.15.188:6835","nonce":1387291964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:48.319764+0000","modified":"2023-11-24T06:16:51.408924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5568":{"gid":5568,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6837/1413576215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1413576215},{"type":"v1","addr":"172.21.15.37:6837","nonce":1413576215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:13.124 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-11-24T06:17:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f976406af00 msgr2=0x7f976406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f976406af00 0x7f976406d3c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9774009dd0 tx=0x7f97740094a0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784072060 msgr2=0x7f97840c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784072060 0x7f97840c9b10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f976c037040 tx=0x7f976c004730 comp rx=0 tx=0).stop 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 shutdown_connections 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f976406af00 0x7f976406d3c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978415ad80 0x7f97840ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9784072060 0x7f97840c9b10 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 --2- 172.21.15.37:0/111362991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9770003f40 0x7f9784152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 >> 172.21.15.37:0/111362991 conn(0x7f97840cb830 msgr2=0x7f978406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 shutdown_connections 2023-11-24T06:17:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.124+0000 7f97893fb640 1 -- 172.21.15.37:0/111362991 wait complete. 2023-11-24T06:17:13.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.375+0000 7fcdf87dc640 1 Processor -- start 2023-11-24T06:17:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.375+0000 7fcdf87dc640 1 -- start start 2023-11-24T06:17:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf87dc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcdf00cf450 0x7fcdf00cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf87dc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf00cece0 con 0x7fcdf015c7f0 2023-11-24T06:17:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf87dc640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf006d040 con 0x7fcdf00cdfb0 2023-11-24T06:17:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf87dc640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf00cfe40 con 0x7fcdf00cf450 2023-11-24T06:17:13.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf6578640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcdf015c7f0 0x7fcdf006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37132/0 (socket says 172.21.15.37:37132) 2023-11-24T06:17:13.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf6578640 1 -- 172.21.15.37:0/2026871824 learned_addr learned my addr 172.21.15.37:0/2026871824 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf5d77640 1 --2- 172.21.15.37:0/2026871824 >> v2:172.21.15.188:3300/0 conn(0x7fcdf00cf450 0x7fcdf00cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.377+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600250199 0 0) 0x7fcdf00cece0 con 0x7fcdf015c7f0 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcddc003520 con 0x7fcdf015c7f0 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2225093825 0 0) 0x7fcddc003520 con 0x7fcdf015c7f0 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 >> v2:172.21.15.188:3300/0 conn(0x7fcdf00cf450 msgr2=0x7fcdf00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 --2- 172.21.15.37:0/2026871824 >> v2:172.21.15.188:3300/0 conn(0x7fcdf00cf450 0x7fcdf00cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 >> v1:172.21.15.188:6789/0 conn(0x7fcdf00cdfb0 legacy=0x7fcdf00ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf006d320 con 0x7fcdf015c7f0 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fcdec001670 con 0x7fcdf015c7f0 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 >> v1:172.21.15.37:6789/0 conn(0x7fcdf015c7f0 legacy=0x7fcdf006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0039c0 0x7fcddc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0047c0 0x7fcddc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcddc005180 0x7fcddc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00cfe40 con 0x7fcddc0039c0 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc00c080 con 0x7fcddc0047c0 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc00c240 con 0x7fcddc005180 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.378+0000 7fcdf6578640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0039c0 0x7fcddc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.379+0000 7fcdf5d77640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0047c0 0x7fcddc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.379+0000 7fcdf6578640 1 -- 172.21.15.37:0/2026871824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcddc005180 msgr2=0x7fcddc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.379+0000 7fcdf6578640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcddc005180 0x7fcddc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.379+0000 7fcdf6578640 1 -- 172.21.15.37:0/2026871824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0047c0 msgr2=0x7fcddc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.379+0000 7fcdf6578640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0047c0 0x7fcddc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.379+0000 7fcdf6578640 1 -- 172.21.15.37:0/2026871824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc003520 con 0x7fcddc0039c0 2023-11-24T06:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.379+0000 7fcdf6d79640 1 -- 172.21.15.37:0/2026871824 reap_dead start 2023-11-24T06:17:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.380+0000 7fcdf6578640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0039c0 0x7fcddc003de0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c0e0 tx=0x7fcddc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bdfad3e246bb39 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.380+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec005ad0 con 0x7fcddc0039c0 2023-11-24T06:17:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.380+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec005c30 con 0x7fcddc0039c0 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.380+0000 7fcdf5576640 1 -- 172.21.15.37:0/2026871824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec02ca50 con 0x7fcddc0039c0 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.381+0000 7fcdf87dc640 1 -- 172.21.15.37:0/2026871824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0039c0 msgr2=0x7fcddc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.381+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0039c0 0x7fcddc003de0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c0e0 tx=0x7fcddc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.381+0000 7fcdf87dc640 1 -- 172.21.15.37:0/2026871824 shutdown_connections 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.381+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/2026871824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0039c0 0x7fcddc003de0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.381+0000 7fcdf87dc640 1 -- 172.21.15.37:0/2026871824 >> 172.21.15.37:0/2026871824 conn(0x7fcdf006a920 msgr2=0x7fcdf006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.381+0000 7fcdf87dc640 1 -- 172.21.15.37:0/2026871824 shutdown_connections 2023-11-24T06:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.381+0000 7fcdf87dc640 1 -- 172.21.15.37:0/2026871824 wait complete. 2023-11-24T06:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.383+0000 7fcdf87dc640 1 Processor -- start 2023-11-24T06:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.383+0000 7fcdf87dc640 1 -- start start 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf87dc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0039c0 0x7fcdf00b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf87dc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdf0157c30 0x7fcdf01580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf87dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdf014d1b0 0x7fcdf014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf87dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0156c90 con 0x7fcdf014d1b0 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf87dc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf01585f0 con 0x7fcddc0039c0 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf87dc640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0155de0 con 0x7fcdf0157c30 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf6d79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdf014d1b0 0x7fcdf014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf6d79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdf014d1b0 0x7fcdf014d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43738/0 (socket says 172.21.15.37:43738) 2023-11-24T06:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.384+0000 7fcdf6d79640 1 -- 172.21.15.37:0/761795589 learned_addr learned my addr 172.21.15.37:0/761795589 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6578640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0039c0 0x7fcdf00b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6d79640 1 -- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdf0157c30 msgr2=0x7fcdf01580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6d79640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdf0157c30 0x7fcdf01580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6d79640 1 -- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0039c0 msgr2=0x7fcdf00b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6d79640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0039c0 0x7fcdf00b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6d79640 1 -- 172.21.15.37:0/761795589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf014db70 con 0x7fcdf014d1b0 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6578640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0039c0 0x7fcdf00b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf6d79640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdf014d1b0 0x7fcdf014d630 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00ccd80 tx=0x7fcde800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcde6ffd640 1 -- 172.21.15.37:0/761795589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8003970 con 0x7fcdf014d1b0 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcde6ffd640 1 -- 172.21.15.37:0/761795589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde8003af0 con 0x7fcdf014d1b0 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcde6ffd640 1 -- 172.21.15.37:0/761795589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8003ea0 con 0x7fcdf014d1b0 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.385+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf0156080 con 0x7fcdf014d1b0 2023-11-24T06:17:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.386+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf0156640 con 0x7fcdf014d1b0 2023-11-24T06:17:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.387+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf0156e40 con 0x7fcdf014d1b0 2023-11-24T06:17:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.388+0000 7fcde6ffd640 1 -- 172.21.15.37:0/761795589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fcde8004000 con 0x7fcdf014d1b0 2023-11-24T06:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.388+0000 7fcde6ffd640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcdd406aed0 0x7fcdd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.389+0000 7fcde6ffd640 1 -- 172.21.15.37:0/761795589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcde8088b50 con 0x7fcdf014d1b0 2023-11-24T06:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.389+0000 7fcdf6578640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcdd406aed0 0x7fcdd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.390+0000 7fcdf6578640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcdd406aed0 0x7fcdd406d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcdec034000 tx=0x7fcdec009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.393+0000 7fcde6ffd640 1 -- 172.21.15.37:0/761795589 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcdf0156e40 con 0x7fcdf014d1b0 2023-11-24T06:17:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.587+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdf0156e40 con 0x7fcdf014d1b0 2023-11-24T06:17:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.589+0000 7fcde6ffd640 1 -- 172.21.15.37:0/761795589 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fcdf0156e40 con 0x7fcdf014d1b0 2023-11-24T06:17:13.592 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:13.592 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:49.877706+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.591+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcdd406aed0 msgr2=0x7fcdd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.591+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcdd406aed0 0x7fcdd406d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcdec034000 tx=0x7fcdec009030 comp rx=0 tx=0).stop 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.591+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdf014d1b0 msgr2=0x7fcdf014d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.591+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdf014d1b0 0x7fcdf014d630 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00ccd80 tx=0x7fcde800c960 comp rx=0 tx=0).stop 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 shutdown_connections 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcdd406aed0 0x7fcdd406d390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdf014d1b0 0x7fcdf014d630 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdf0157c30 0x7fcdf01580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 --2- 172.21.15.37:0/761795589 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcddc0039c0 0x7fcdf00b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 >> 172.21.15.37:0/761795589 conn(0x7fcdf006a920 msgr2=0x7fcdf00cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 shutdown_connections 2023-11-24T06:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.592+0000 7fcdf87dc640 1 -- 172.21.15.37:0/761795589 wait complete. 2023-11-24T06:17:13.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:16:46.245164+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:16:47.345037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:13.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:13.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.841+0000 7f34acd1d640 1 Processor -- start 2023-11-24T06:17:13.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.841+0000 7f34acd1d640 1 -- start start 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34acd1d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34a80cc0f0 0x7f34a80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34acd1d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34a80c57e0 0x7f34a806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34acd1d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a815eea0 con 0x7f34a815b440 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34acd1d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a815b820 con 0x7f34a80c57e0 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34acd1d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a80abf30 con 0x7f34a80cc0f0 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34a6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34a80c57e0 0x7f34a806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34a6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34a80c57e0 0x7f34a806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43744/0 (socket says 172.21.15.37:43744) 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.843+0000 7f34a6d9d640 1 -- 172.21.15.37:0/1021116338 learned_addr learned my addr 172.21.15.37:0/1021116338 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.844+0000 7f34a5d9b640 1 --2- 172.21.15.37:0/1021116338 >> v2:172.21.15.188:3300/0 conn(0x7f34a80cc0f0 0x7f34a80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.844+0000 7f34a6d9d640 1 -- 172.21.15.37:0/1021116338 >> v2:172.21.15.188:3300/0 conn(0x7f34a80cc0f0 msgr2=0x7f34a80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.844+0000 7f34a6d9d640 1 --2- 172.21.15.37:0/1021116338 >> v2:172.21.15.188:3300/0 conn(0x7f34a80cc0f0 0x7f34a80c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.844+0000 7f34a6d9d640 1 -- 172.21.15.37:0/1021116338 >> v1:172.21.15.188:6789/0 conn(0x7f34a815b440 legacy=0x7f34a80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.844+0000 7f34a6d9d640 1 -- 172.21.15.37:0/1021116338 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a815f0f0 con 0x7f34a80c57e0 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.845+0000 7f34a6d9d640 1 --2- 172.21.15.37:0/1021116338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a806c5f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f34a806e720 tx=0x7f34a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82027d465ad55922 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.845+0000 7f34a559a640 1 -- 172.21.15.37:0/1021116338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0031870 con 0x7f34a80c57e0 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.845+0000 7f34a559a640 1 -- 172.21.15.37:0/1021116338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a00319d0 con 0x7f34a80c57e0 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.845+0000 7f34a559a640 1 -- 172.21.15.37:0/1021116338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0031d60 con 0x7f34a80c57e0 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 -- 172.21.15.37:0/1021116338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 msgr2=0x7f34a806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 --2- 172.21.15.37:0/1021116338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a806c5f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f34a806e720 tx=0x7f34a002b910 comp rx=0 tx=0).stop 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 -- 172.21.15.37:0/1021116338 shutdown_connections 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 --2- 172.21.15.37:0/1021116338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a806c5f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 --2- 172.21.15.37:0/1021116338 >> v2:172.21.15.188:3300/0 conn(0x7f34a80cc0f0 0x7f34a80c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 -- 172.21.15.37:0/1021116338 >> 172.21.15.37:0/1021116338 conn(0x7f34a80b0c50 msgr2=0x7f34a80b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 -- 172.21.15.37:0/1021116338 shutdown_connections 2023-11-24T06:17:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.846+0000 7f34acd1d640 1 -- 172.21.15.37:0/1021116338 wait complete. 2023-11-24T06:17:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.848+0000 7f34acd1d640 1 Processor -- start 2023-11-24T06:17:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.848+0000 7f34acd1d640 1 -- start start 2023-11-24T06:17:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34acd1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a80b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34acd1d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34a80cc0f0 0x7f34a8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34acd1d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34a815b440 0x7f34a8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34acd1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8159090 con 0x7f34a80c57e0 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34acd1d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8152870 con 0x7f34a815b440 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34acd1d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a815a8e0 con 0x7f34a80cc0f0 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a80b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a80b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43758/0 (socket says 172.21.15.37:43758) 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.849+0000 7f34a659c640 1 -- 172.21.15.37:0/4283430887 learned_addr learned my addr 172.21.15.37:0/4283430887 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a6d9d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34a815b440 0x7f34a8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a659c640 1 -- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34a80cc0f0 msgr2=0x7f34a8152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a659c640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34a80cc0f0 0x7f34a8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a659c640 1 -- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34a815b440 msgr2=0x7f34a8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a659c640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34a815b440 0x7f34a8157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a659c640 1 -- 172.21.15.37:0/4283430887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00094d0 con 0x7f34a80c57e0 2023-11-24T06:17:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a6d9d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34a815b440 0x7f34a8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f34a659c640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a80b1d10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f349800c730 tx=0x7f349800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.850+0000 7f349effd640 1 -- 172.21.15.37:0/4283430887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498003b70 con 0x7f34a80c57e0 2023-11-24T06:17:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.851+0000 7f349effd640 1 -- 172.21.15.37:0/4283430887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498003cf0 con 0x7f34a80c57e0 2023-11-24T06:17:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.851+0000 7f349effd640 1 -- 172.21.15.37:0/4283430887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498003ea0 con 0x7f34a80c57e0 2023-11-24T06:17:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.851+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a815abc0 con 0x7f34a80c57e0 2023-11-24T06:17:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.851+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a8158db0 con 0x7f34a80c57e0 2023-11-24T06:17:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.852+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a804e8b0 con 0x7f34a80c57e0 2023-11-24T06:17:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.853+0000 7f349effd640 1 -- 172.21.15.37:0/4283430887 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f349800aa90 con 0x7f34a80c57e0 2023-11-24T06:17:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.854+0000 7f349effd640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f348806aed0 0x7f348806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.854+0000 7f349effd640 1 -- 172.21.15.37:0/4283430887 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34980893e0 con 0x7f34a80c57e0 2023-11-24T06:17:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.854+0000 7f34a5d9b640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f348806aed0 0x7f348806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.855+0000 7f34a5d9b640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f348806aed0 0x7f348806d390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3490006fd0 tx=0x7f3490008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:13.858+0000 7f349effd640 1 -- 172.21.15.37:0/4283430887 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3498054530 con 0x7f34a80c57e0 2023-11-24T06:17:14.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.054+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34a806dc80 con 0x7f34a80c57e0 2023-11-24T06:17:14.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.055+0000 7f349effd640 1 -- 172.21.15.37:0/4283430887 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3498057b50 con 0x7f34a80c57e0 2023-11-24T06:17:14.057 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f348806aed0 msgr2=0x7f348806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f348806aed0 0x7f348806d390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3490006fd0 tx=0x7f3490008040 comp rx=0 tx=0).stop 2023-11-24T06:17:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 msgr2=0x7f34a80b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a80b1d10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f349800c730 tx=0x7f349800cbf0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 shutdown_connections 2023-11-24T06:17:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f348806aed0 0x7f348806d390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34a815b440 0x7f34a8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34a80cc0f0 0x7f34a8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 --2- 172.21.15.37:0/4283430887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34a80c57e0 0x7f34a80b1d10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.057+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 >> 172.21.15.37:0/4283430887 conn(0x7f34a80b0c50 msgr2=0x7f34a80c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.058+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 shutdown_connections 2023-11-24T06:17:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.058+0000 7f34acd1d640 1 -- 172.21.15.37:0/4283430887 wait complete. 2023-11-24T06:17:14.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:17:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.310+0000 7f4f659bc640 1 Processor -- start 2023-11-24T06:17:14.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.311+0000 7f4f659bc640 1 -- start start 2023-11-24T06:17:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.312+0000 7f4f659bc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f6015b260 0x7f4f6006e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.312+0000 7f4f659bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f6006e580 0x7f4f600b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.312+0000 7f4f659bc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f600b1080 0x7f4f600ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.312+0000 7f4f659bc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f600b1530 con 0x7f4f6006e580 2023-11-24T06:17:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f659bc640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6015b640 con 0x7f4f600b1080 2023-11-24T06:17:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f659bc640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6015ed20 con 0x7f4f6015b260 2023-11-24T06:17:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f6006e580 0x7f4f600b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f6006e580 0x7f4f600b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43762/0 (socket says 172.21.15.37:43762) 2023-11-24T06:17:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 -- 172.21.15.37:0/1216750653 learned_addr learned my addr 172.21.15.37:0/1216750653 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 -- 172.21.15.37:0/1216750653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f6015b260 msgr2=0x7f4f6006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 --2- 172.21.15.37:0/1216750653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f6015b260 0x7f4f6006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 -- 172.21.15.37:0/1216750653 >> v2:172.21.15.188:3300/0 conn(0x7f4f600b1080 msgr2=0x7f4f600ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 --2- 172.21.15.37:0/1216750653 >> v2:172.21.15.188:3300/0 conn(0x7f4f600b1080 0x7f4f600ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.313+0000 7f4f5ffff640 1 -- 172.21.15.37:0/1216750653 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6015f8a0 con 0x7f4f6006e580 2023-11-24T06:17:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.315+0000 7f4f5ffff640 1 --2- 172.21.15.37:0/1216750653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f600b0b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4f6006dfd0 tx=0x7f4f5402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3262120e3f975aac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.315+0000 7f4f5f7fe640 1 -- 172.21.15.37:0/1216750653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54031740 con 0x7f4f6006e580 2023-11-24T06:17:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.315+0000 7f4f5f7fe640 1 -- 172.21.15.37:0/1216750653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f540318a0 con 0x7f4f6006e580 2023-11-24T06:17:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.315+0000 7f4f5f7fe640 1 -- 172.21.15.37:0/1216750653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54031c30 con 0x7f4f6006e580 2023-11-24T06:17:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 -- 172.21.15.37:0/1216750653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 msgr2=0x7f4f600b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 --2- 172.21.15.37:0/1216750653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f600b0b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4f6006dfd0 tx=0x7f4f5402b7e0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 -- 172.21.15.37:0/1216750653 shutdown_connections 2023-11-24T06:17:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 --2- 172.21.15.37:0/1216750653 >> v2:172.21.15.188:3300/0 conn(0x7f4f600b1080 0x7f4f600ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 --2- 172.21.15.37:0/1216750653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f600b0b40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 --2- 172.21.15.37:0/1216750653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f6015b260 0x7f4f6006e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 -- 172.21.15.37:0/1216750653 >> 172.21.15.37:0/1216750653 conn(0x7f4f600cbb40 msgr2=0x7f4f600cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 -- 172.21.15.37:0/1216750653 shutdown_connections 2023-11-24T06:17:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.316+0000 7f4f659bc640 1 -- 172.21.15.37:0/1216750653 wait complete. 2023-11-24T06:17:14.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.318+0000 7f4f659bc640 1 Processor -- start 2023-11-24T06:17:14.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.318+0000 7f4f659bc640 1 -- start start 2023-11-24T06:17:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f659bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f6015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f659bc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f600b1080 0x7f4f600b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f659bc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f6015b260 0x7f4f600b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f659bc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600b4200 con 0x7f4f6006e580 2023-11-24T06:17:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f659bc640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600b44e0 con 0x7f4f6015b260 2023-11-24T06:17:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f659bc640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600b47c0 con 0x7f4f600b1080 2023-11-24T06:17:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f649ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f6015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f649ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f6015ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43776/0 (socket says 172.21.15.37:43776) 2023-11-24T06:17:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.319+0000 7f4f649ba640 1 -- 172.21.15.37:0/887029850 learned_addr learned my addr 172.21.15.37:0/887029850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f649ba640 1 -- 172.21.15.37:0/887029850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f600b1080 msgr2=0x7f4f600b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f649ba640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f600b1080 0x7f4f600b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f649ba640 1 -- 172.21.15.37:0/887029850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f6015b260 msgr2=0x7f4f600b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f649ba640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f6015b260 0x7f4f600b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f649ba640 1 -- 172.21.15.37:0/887029850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540094d0 con 0x7f4f6006e580 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f649ba640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f6015ddc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b4a0 tx=0x7f4f5000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f5d7fa640 1 -- 172.21.15.37:0/887029850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50010610 con 0x7f4f6006e580 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f5d7fa640 1 -- 172.21.15.37:0/887029850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50010770 con 0x7f4f6006e580 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f5d7fa640 1 -- 172.21.15.37:0/887029850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50010b20 con 0x7f4f6006e580 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f600b4aa0 con 0x7f4f6006e580 2023-11-24T06:17:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.320+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f60156ba0 con 0x7f4f6006e580 2023-11-24T06:17:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.322+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f600b4340 con 0x7f4f6006e580 2023-11-24T06:17:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.323+0000 7f4f5d7fa640 1 -- 172.21.15.37:0/887029850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f4f50010c80 con 0x7f4f6006e580 2023-11-24T06:17:14.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.324+0000 7f4f5d7fa640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f4c06aed0 0x7f4f4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.324+0000 7f4f5d7fa640 1 -- 172.21.15.37:0/887029850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f50089360 con 0x7f4f6006e580 2023-11-24T06:17:14.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.324+0000 7f4f5ffff640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f4c06aed0 0x7f4f4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.325+0000 7f4f5ffff640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f4c06aed0 0x7f4f4c06d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4f54035000 tx=0x7f4f54030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.339+0000 7f4f5d7fa640 1 -- 172.21.15.37:0/887029850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f600b4340 con 0x7f4f6006e580 2023-11-24T06:17:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.537+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f600b4340 con 0x7f4f6006e580 2023-11-24T06:17:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.538+0000 7f4f5d7fa640 1 -- 172.21.15.37:0/887029850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f600b4340 con 0x7f4f6006e580 2023-11-24T06:17:14.540 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.540+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f4c06aed0 msgr2=0x7f4f4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.540+0000 7f4f659bc640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f4c06aed0 0x7f4f4c06d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4f54035000 tx=0x7f4f54030000 comp rx=0 tx=0).stop 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 msgr2=0x7f4f6015ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f6015ddc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b4a0 tx=0x7f4f5000b960 comp rx=0 tx=0).stop 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 shutdown_connections 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f4f4c06aed0 0x7f4f4c06d390 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f6015b260 0x7f4f600b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f600b1080 0x7f4f600b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 --2- 172.21.15.37:0/887029850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f6006e580 0x7f4f6015ddc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 >> 172.21.15.37:0/887029850 conn(0x7f4f600cbb40 msgr2=0x7f4f600ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 shutdown_connections 2023-11-24T06:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.541+0000 7f4f659bc640 1 -- 172.21.15.37:0/887029850 wait complete. 2023-11-24T06:17:14.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.786+0000 7fdb32002640 1 Processor -- start 2023-11-24T06:17:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.786+0000 7fdb32002640 1 -- start start 2023-11-24T06:17:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb32002640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c15b440 0x7fdb2c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb32002640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb2c0cbf20 0x7fdb2c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb32002640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c0cc3a0 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb32002640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb2c15b820 con 0x7fdb2c0cbf20 2023-11-24T06:17:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb32002640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c15eea0 con 0x7fdb2c15b440 2023-11-24T06:17:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb2affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb2c0cbf20 0x7fdb2c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb2affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb2c0cbf20 0x7fdb2c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43788/0 (socket says 172.21.15.37:43788) 2023-11-24T06:17:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.788+0000 7fdb2affd640 1 -- 172.21.15.37:0/894169471 learned_addr learned my addr 172.21.15.37:0/894169471 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.789+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/894169471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c15b440 0x7fdb2c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.789+0000 7fdb2affd640 1 -- 172.21.15.37:0/894169471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c15b440 msgr2=0x7fdb2c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.789+0000 7fdb2affd640 1 --2- 172.21.15.37:0/894169471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c15b440 0x7fdb2c0cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.789+0000 7fdb2affd640 1 -- 172.21.15.37:0/894169471 >> v1:172.21.15.188:6789/0 conn(0x7fdb2c0c57e0 legacy=0x7fdb2c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.789+0000 7fdb2affd640 1 -- 172.21.15.37:0/894169471 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c06d600 con 0x7fdb2c0cbf20 2023-11-24T06:17:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.790+0000 7fdb2affd640 1 --2- 172.21.15.37:0/894169471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0cbf20 0x7fdb2c0c52a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009870 tx=0x7fdb2002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543718b20991966f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.790+0000 7fdb2a7fc640 1 -- 172.21.15.37:0/894169471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb200317c0 con 0x7fdb2c0cbf20 2023-11-24T06:17:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.790+0000 7fdb2a7fc640 1 -- 172.21.15.37:0/894169471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20031920 con 0x7fdb2c0cbf20 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.790+0000 7fdb2a7fc640 1 -- 172.21.15.37:0/894169471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20031cb0 con 0x7fdb2c0cbf20 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 -- 172.21.15.37:0/894169471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0cbf20 msgr2=0x7fdb2c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 --2- 172.21.15.37:0/894169471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0cbf20 0x7fdb2c0c52a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009870 tx=0x7fdb2002b860 comp rx=0 tx=0).stop 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 -- 172.21.15.37:0/894169471 shutdown_connections 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 --2- 172.21.15.37:0/894169471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0cbf20 0x7fdb2c0c52a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 --2- 172.21.15.37:0/894169471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c15b440 0x7fdb2c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 -- 172.21.15.37:0/894169471 >> 172.21.15.37:0/894169471 conn(0x7fdb2c0b0c50 msgr2=0x7fdb2c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 -- 172.21.15.37:0/894169471 shutdown_connections 2023-11-24T06:17:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.791+0000 7fdb32002640 1 -- 172.21.15.37:0/894169471 wait complete. 2023-11-24T06:17:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.793+0000 7fdb32002640 1 Processor -- start 2023-11-24T06:17:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.793+0000 7fdb32002640 1 -- start start 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb32002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0c57e0 0x7fdb2c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb32002640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c0cbf20 0x7fdb2c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb32002640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb2c15b440 0x7fdb2c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb32002640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0b3730 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb32002640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0b4220 con 0x7fdb2c15b440 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb32002640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0b3980 con 0x7fdb2c0cbf20 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0c57e0 0x7fdb2c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0c57e0 0x7fdb2c153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43800/0 (socket says 172.21.15.37:43800) 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 -- 172.21.15.37:0/4123724543 learned_addr learned my addr 172.21.15.37:0/4123724543 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 -- 172.21.15.37:0/4123724543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c0cbf20 msgr2=0x7fdb2c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c0cbf20 0x7fdb2c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 -- 172.21.15.37:0/4123724543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb2c15b440 msgr2=0x7fdb2c156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb2c15b440 0x7fdb2c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.794+0000 7fdb2b7fe640 1 -- 172.21.15.37:0/4123724543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb200094d0 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.795+0000 7fdb2b7fe640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0c57e0 0x7fdb2c153d70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00c7f0 tx=0x7fdb1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.795+0000 7fdb13fff640 1 -- 172.21.15.37:0/4123724543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c004220 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.795+0000 7fdb13fff640 1 -- 172.21.15.37:0/4123724543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c004380 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.795+0000 7fdb13fff640 1 -- 172.21.15.37:0/4123724543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c007840 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.795+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c0b3c60 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.795+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c158b60 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.796+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c158d50 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.797+0000 7fdb13fff640 1 -- 172.21.15.37:0/4123724543 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fdb1c007bb0 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.798+0000 7fdb13fff640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdb1806aed0 0x7fdb1806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:14.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.798+0000 7fdb13fff640 1 -- 172.21.15.37:0/4123724543 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb1c089720 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.798+0000 7fdb2affd640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdb1806aed0 0x7fdb1806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.799+0000 7fdb2affd640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdb1806aed0 0x7fdb1806d390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb20036000 tx=0x7fdb20030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.802+0000 7fdb13fff640 1 -- 172.21.15.37:0/4123724543 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb1c054660 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.992+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb2c04e8b0 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.994+0000 7fdb13fff640 1 -- 172.21.15.37:0/4123724543 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb1c007e60 con 0x7fdb2c0c57e0 2023-11-24T06:17:14.996 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:17:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.997+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdb1806aed0 msgr2=0x7fdb1806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.997+0000 7fdb32002640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdb1806aed0 0x7fdb1806d390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb20036000 tx=0x7fdb20030000 comp rx=0 tx=0).stop 2023-11-24T06:17:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.997+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0c57e0 msgr2=0x7fdb2c153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.997+0000 7fdb32002640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0c57e0 0x7fdb2c153d70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00c7f0 tx=0x7fdb1c00ccb0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.997+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 shutdown_connections 2023-11-24T06:17:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.997+0000 7fdb32002640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdb1806aed0 0x7fdb1806d390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.997+0000 7fdb32002640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdb2c15b440 0x7fdb2c156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.998+0000 7fdb32002640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdb2c0cbf20 0x7fdb2c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.998+0000 7fdb32002640 1 --2- 172.21.15.37:0/4123724543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0c57e0 0x7fdb2c153d70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.998+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 >> 172.21.15.37:0/4123724543 conn(0x7fdb2c0b0c50 msgr2=0x7fdb2c1548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.998+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 shutdown_connections 2023-11-24T06:17:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:14.998+0000 7fdb32002640 1 -- 172.21.15.37:0/4123724543 wait complete. 2023-11-24T06:17:15.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:15.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.245+0000 7f35c124b640 1 Processor -- start 2023-11-24T06:17:15.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.245+0000 7f35c124b640 1 -- start start 2023-11-24T06:17:15.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.246+0000 7f35c124b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f35bc15d4e0 0x7f35bc0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.246+0000 7f35c124b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc0d0240 0x7f35bc0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.246+0000 7f35c124b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc0ce990 con 0x7f35bc0d38e0 2023-11-24T06:17:15.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.247+0000 7f35c124b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc0d4110 con 0x7f35bc15d4e0 2023-11-24T06:17:15.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.247+0000 7f35c124b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0cec70 con 0x7f35bc0d0240 2023-11-24T06:17:15.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.247+0000 7f35bbfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f35bc15d4e0 0x7f35bc0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.247+0000 7f35bbfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f35bc15d4e0 0x7f35bc0d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38162/0 (socket says 172.21.15.37:38162) 2023-11-24T06:17:15.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.247+0000 7f35bbfff640 1 -- 172.21.15.37:0/3683212634 learned_addr learned my addr 172.21.15.37:0/3683212634 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:15.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.247+0000 7f35c0a4a640 1 --2- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc0d0240 0x7f35bc0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.248+0000 7f35bbfff640 1 -- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc0d0240 msgr2=0x7f35bc0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:15.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.248+0000 7f35bbfff640 1 --2- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc0d0240 0x7f35bc0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.248+0000 7f35bbfff640 1 -- 172.21.15.37:0/3683212634 >> v1:172.21.15.188:6789/0 conn(0x7f35bc0d38e0 legacy=0x7f35bc0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.248+0000 7f35bbfff640 1 -- 172.21.15.37:0/3683212634 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0cef50 con 0x7f35bc15d4e0 2023-11-24T06:17:15.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.250+0000 7f35bbfff640 1 --2- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc15d4e0 0x7f35bc0d1e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6a162b0802a34c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.250+0000 7f35baffd640 1 -- 172.21.15.37:0/3683212634 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac030840 con 0x7f35bc15d4e0 2023-11-24T06:17:15.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.250+0000 7f35baffd640 1 -- 172.21.15.37:0/3683212634 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac0309a0 con 0x7f35bc15d4e0 2023-11-24T06:17:15.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.250+0000 7f35baffd640 1 -- 172.21.15.37:0/3683212634 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac030d30 con 0x7f35bc15d4e0 2023-11-24T06:17:15.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 -- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc15d4e0 msgr2=0x7f35bc0d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 --2- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc15d4e0 0x7f35bc0d1e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac02b980 comp rx=0 tx=0).stop 2023-11-24T06:17:15.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 -- 172.21.15.37:0/3683212634 shutdown_connections 2023-11-24T06:17:15.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 --2- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc0d0240 0x7f35bc0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 --2- 172.21.15.37:0/3683212634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc15d4e0 0x7f35bc0d1e20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 -- 172.21.15.37:0/3683212634 >> 172.21.15.37:0/3683212634 conn(0x7f35bc09c510 msgr2=0x7f35bc0d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 -- 172.21.15.37:0/3683212634 shutdown_connections 2023-11-24T06:17:15.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.251+0000 7f35c124b640 1 -- 172.21.15.37:0/3683212634 wait complete. 2023-11-24T06:17:15.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.253+0000 7f35c124b640 1 Processor -- start 2023-11-24T06:17:15.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.253+0000 7f35c124b640 1 -- start start 2023-11-24T06:17:15.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35c124b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35bc0d0240 0x7f35bc152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35c124b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc0d38e0 0x7f35bc0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35c124b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc15d4e0 0x7f35bc0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35c124b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0b6d40 con 0x7f35bc0d0240 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35c124b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0b7860 con 0x7f35bc0d38e0 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35c124b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc15e930 con 0x7f35bc15d4e0 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35bc0d0240 0x7f35bc152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35bc0d0240 0x7f35bc152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43816/0 (socket says 172.21.15.37:43816) 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.254+0000 7f35bbfff640 1 -- 172.21.15.37:0/4207184886 learned_addr learned my addr 172.21.15.37:0/4207184886 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35bb7fe640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc0d38e0 0x7f35bc0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35c0a4a640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc15d4e0 0x7f35bc0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35bbfff640 1 -- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc15d4e0 msgr2=0x7f35bc0b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35bbfff640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc15d4e0 0x7f35bc0b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35bbfff640 1 -- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc0d38e0 msgr2=0x7f35bc0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35bbfff640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc0d38e0 0x7f35bc0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35bbfff640 1 -- 172.21.15.37:0/4207184886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0094d0 con 0x7f35bc0d0240 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.255+0000 7f35bbfff640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35bc0d0240 0x7f35bc152910 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000c00 tx=0x7f35ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.256+0000 7f35b8ff9640 1 -- 172.21.15.37:0/4207184886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac039a90 con 0x7f35bc0d0240 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.256+0000 7f35b8ff9640 1 -- 172.21.15.37:0/4207184886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac039c10 con 0x7f35bc0d0240 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.256+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc0b6fc0 con 0x7f35bc0d0240 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.256+0000 7f35b8ff9640 1 -- 172.21.15.37:0/4207184886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac043410 con 0x7f35bc0d0240 2023-11-24T06:17:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.256+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc0b7580 con 0x7f35bc0d0240 2023-11-24T06:17:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.257+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc04e840 con 0x7f35bc0d0240 2023-11-24T06:17:15.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.258+0000 7f35b8ff9640 1 -- 172.21.15.37:0/4207184886 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f35ac04c3b0 con 0x7f35bc0d0240 2023-11-24T06:17:15.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.259+0000 7f35b8ff9640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f35a806aed0 0x7f35a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.259+0000 7f35b8ff9640 1 -- 172.21.15.37:0/4207184886 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35ac0abbd0 con 0x7f35bc0d0240 2023-11-24T06:17:15.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.259+0000 7f35bb7fe640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f35a806aed0 0x7f35a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.260+0000 7f35bb7fe640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f35a806aed0 0x7f35a806d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0a1150 tx=0x7f35b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.263+0000 7f35b8ff9640 1 -- 172.21.15.37:0/4207184886 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35ac076b00 con 0x7f35bc0d0240 2023-11-24T06:17:15.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.493+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35bc06c520 con 0x7f35bc0d0240 2023-11-24T06:17:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.494+0000 7f35b8ff9640 1 -- 172.21.15.37:0/4207184886 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f35ac048090 con 0x7f35bc0d0240 2023-11-24T06:17:15.497 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:15.497 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1029063982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1029063982},{"type":"v1","addr":"172.21.15.37:6835","nonce":1029063982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/3663508959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3663508959},{"type":"v1","addr":"172.21.15.188:6834","nonce":3663508959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/1387291964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1387291964},{"type":"v1","addr":"172.21.15.188:6835","nonce":1387291964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:48.319764+0000","modified":"2023-11-24T06:16:51.408924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5568":{"gid":5568,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6837/1413576215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1413576215},{"type":"v1","addr":"172.21.15.37:6837","nonce":1413576215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-11-24T06:17:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f35a806aed0 msgr2=0x7f35a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f35a806aed0 0x7f35a806d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0a1150 tx=0x7f35b0009040 comp rx=0 tx=0).stop 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35bc0d0240 msgr2=0x7f35bc152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35bc0d0240 0x7f35bc152910 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000c00 tx=0x7f35ac004730 comp rx=0 tx=0).stop 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 shutdown_connections 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f35a806aed0 0x7f35a806d390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35bc0d38e0 0x7f35bc0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35bc15d4e0 0x7f35bc0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 --2- 172.21.15.37:0/4207184886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35bc0d0240 0x7f35bc152910 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 >> 172.21.15.37:0/4207184886 conn(0x7f35bc09c510 msgr2=0x7f35bc0b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 shutdown_connections 2023-11-24T06:17:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.497+0000 7f35c124b640 1 -- 172.21.15.37:0/4207184886 wait complete. 2023-11-24T06:17:15.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.743+0000 7f5a8c94c640 1 Processor -- start 2023-11-24T06:17:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.744+0000 7f5a8c94c640 1 -- start start 2023-11-24T06:17:15.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.745+0000 7f5a8c94c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a880cf450 0x7f5a880cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.745+0000 7f5a8c94c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5a880cdfb0 0x7f5a880ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.745+0000 7f5a8c94c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a880cece0 con 0x7f5a8815c7f0 2023-11-24T06:17:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.745+0000 7f5a8c94c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a880cfe40 con 0x7f5a880cf450 2023-11-24T06:17:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.745+0000 7f5a8c94c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a88156010 con 0x7f5a880cdfb0 2023-11-24T06:17:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.745+0000 7f5a85d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a880cf450 0x7f5a880cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a85d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a880cf450 0x7f5a880cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43822/0 (socket says 172.21.15.37:43822) 2023-11-24T06:17:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a85d9b640 1 -- 172.21.15.37:0/3348974492 learned_addr learned my addr 172.21.15.37:0/3348974492 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a86d9d640 1 --2- 172.21.15.37:0/3348974492 >> v2:172.21.15.188:3300/0 conn(0x7f5a880cdfb0 0x7f5a880ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a85d9b640 1 -- 172.21.15.37:0/3348974492 >> v2:172.21.15.188:3300/0 conn(0x7f5a880cdfb0 msgr2=0x7f5a880ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a85d9b640 1 --2- 172.21.15.37:0/3348974492 >> v2:172.21.15.188:3300/0 conn(0x7f5a880cdfb0 0x7f5a880ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a85d9b640 1 -- 172.21.15.37:0/3348974492 >> v1:172.21.15.188:6789/0 conn(0x7f5a8815c7f0 legacy=0x7f5a8806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a85d9b640 1 -- 172.21.15.37:0/3348974492 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8806d040 con 0x7f5a880cf450 2023-11-24T06:17:15.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.746+0000 7f5a86d9d640 1 --2- 172.21.15.37:0/3348974492 >> v2:172.21.15.188:3300/0 conn(0x7f5a880cdfb0 0x7f5a880ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:15.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.747+0000 7f5a85d9b640 1 --2- 172.21.15.37:0/3348974492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cf450 0x7f5a880cf900 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5a880d00e0 tx=0x7f5a7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc223c1ba6ab2663 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.747+0000 7f5a8559a640 1 -- 172.21.15.37:0/3348974492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70031870 con 0x7f5a880cf450 2023-11-24T06:17:15.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8559a640 1 -- 172.21.15.37:0/3348974492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a700319d0 con 0x7f5a880cf450 2023-11-24T06:17:15.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8559a640 1 -- 172.21.15.37:0/3348974492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70031d60 con 0x7f5a880cf450 2023-11-24T06:17:15.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3348974492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cf450 msgr2=0x7f5a880cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3348974492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cf450 0x7f5a880cf900 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5a880d00e0 tx=0x7f5a7002b910 comp rx=0 tx=0).stop 2023-11-24T06:17:15.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3348974492 shutdown_connections 2023-11-24T06:17:15.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3348974492 >> v2:172.21.15.188:3300/0 conn(0x7f5a880cdfb0 0x7f5a880ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3348974492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cf450 0x7f5a880cf900 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3348974492 >> 172.21.15.37:0/3348974492 conn(0x7f5a8806a920 msgr2=0x7f5a8806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3348974492 shutdown_connections 2023-11-24T06:17:15.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.748+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3348974492 wait complete. 2023-11-24T06:17:15.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.750+0000 7f5a8c94c640 1 Processor -- start 2023-11-24T06:17:15.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.750+0000 7f5a8c94c640 1 -- start start 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.751+0000 7f5a8c94c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cdfb0 0x7f5a88150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.751+0000 7f5a8c94c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a880cf450 0x7f5a8815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.751+0000 7f5a8c94c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a8815c7f0 0x7f5a880b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.751+0000 7f5a8c94c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b1e50 con 0x7f5a880cdfb0 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.751+0000 7f5a8c94c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b20f0 con 0x7f5a8815c7f0 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.751+0000 7f5a8c94c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b23d0 con 0x7f5a880cf450 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.751+0000 7f5a8659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cdfb0 0x7f5a88150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cdfb0 0x7f5a88150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43838/0 (socket says 172.21.15.37:43838) 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 -- 172.21.15.37:0/3830663647 learned_addr learned my addr 172.21.15.37:0/3830663647 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 -- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a880cf450 msgr2=0x7f5a8815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a880cf450 0x7f5a8815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 -- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a8815c7f0 msgr2=0x7f5a880b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a86d9d640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a8815c7f0 0x7f5a880b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a8815c7f0 0x7f5a880b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 -- 172.21.15.37:0/3830663647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700094d0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a86d9d640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a8815c7f0 0x7f5a880b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.752+0000 7f5a8659c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cdfb0 0x7f5a88150770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800ba50 tx=0x7f5a7800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.753+0000 7f5a7effd640 1 -- 172.21.15.37:0/3830663647 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800cbe0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.753+0000 7f5a7effd640 1 -- 172.21.15.37:0/3830663647 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7800cd80 con 0x7f5a880cdfb0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.753+0000 7f5a7effd640 1 -- 172.21.15.37:0/3830663647 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78014680 con 0x7f5a880cdfb0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.753+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a880b26b0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.753+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a88150cb0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.754+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a88150ea0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.755+0000 7f5a7effd640 1 -- 172.21.15.37:0/3830663647 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f5a780147e0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.756+0000 7f5a7effd640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5a6806af00 0x7f5a6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.756+0000 7f5a7effd640 1 -- 172.21.15.37:0/3830663647 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a780893c0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.757+0000 7f5a85d9b640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5a6806af00 0x7f5a6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.757+0000 7f5a85d9b640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5a6806af00 0x7f5a6806d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a70036000 tx=0x7f5a70030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.761+0000 7f5a7effd640 1 -- 172.21.15.37:0/3830663647 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a780545c0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.957+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a88067470 con 0x7f5a880cdfb0 2023-11-24T06:17:15.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.960+0000 7f5a7effd640 1 -- 172.21.15.37:0/3830663647 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f5a78057be0 con 0x7f5a880cdfb0 2023-11-24T06:17:15.963 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:15.963 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:49.877706+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.962+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5a6806af00 msgr2=0x7f5a6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.962+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5a6806af00 0x7f5a6806d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a70036000 tx=0x7f5a70030000 comp rx=0 tx=0).stop 2023-11-24T06:17:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.962+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cdfb0 msgr2=0x7f5a88150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cdfb0 0x7f5a88150770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800ba50 tx=0x7f5a7800bf10 comp rx=0 tx=0).stop 2023-11-24T06:17:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 shutdown_connections 2023-11-24T06:17:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5a6806af00 0x7f5a6806d3c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a8815c7f0 0x7f5a880b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a880cf450 0x7f5a8815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 --2- 172.21.15.37:0/3830663647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a880cdfb0 0x7f5a88150770 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:15.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 >> 172.21.15.37:0/3830663647 conn(0x7f5a8806a920 msgr2=0x7f5a8815eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:15.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 shutdown_connections 2023-11-24T06:17:15.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:15.963+0000 7f5a8c94c640 1 -- 172.21.15.37:0/3830663647 wait complete. 2023-11-24T06:17:15.983 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:17:15.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.204+0000 7f27a9d5c640 1 Processor -- start 2023-11-24T06:17:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.204+0000 7f27a9d5c640 1 -- start start 2023-11-24T06:17:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.205+0000 7f27a9d5c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a4159e80 0x7f27a4071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.206+0000 7f27a9d5c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f27a40cd6a0 0x7f27a415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.206+0000 7f27a9d5c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a40ce870 con 0x7f27a415a7a0 2023-11-24T06:17:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.206+0000 7f27a9d5c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a40cdc60 con 0x7f27a40cd6a0 2023-11-24T06:17:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.206+0000 7f27a9d5c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40cdf40 con 0x7f27a4159e80 2023-11-24T06:17:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.206+0000 7f279bfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f27a40cd6a0 0x7f27a415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.206+0000 7f27a8d5a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a4159e80 0x7f27a4071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.207+0000 7f27a955b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f27a415a7a0 0x7f27a406c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:46134/0 (socket says 172.21.15.37:46134) 2023-11-24T06:17:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.207+0000 7f27a955b640 1 -- 172.21.15.37:0/1390663586 learned_addr learned my addr 172.21.15.37:0/1390663586 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.207+0000 7f279bfff640 1 -- 172.21.15.37:0/1390663586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a4159e80 msgr2=0x7f27a4071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.207+0000 7f279bfff640 1 --2- 172.21.15.37:0/1390663586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a4159e80 0x7f27a4071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.207+0000 7f279bfff640 1 -- 172.21.15.37:0/1390663586 >> v1:172.21.15.188:6789/0 conn(0x7f27a415a7a0 legacy=0x7f27a406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.207+0000 7f279bfff640 1 -- 172.21.15.37:0/1390663586 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a40ce220 con 0x7f27a40cd6a0 2023-11-24T06:17:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.209+0000 7f279bfff640 1 --2- 172.21.15.37:0/1390663586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a40cd6a0 0x7f27a415a260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f27940097a0 tx=0x7f279402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=124a5d11d71f719e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.210+0000 7f279b7fe640 1 -- 172.21.15.37:0/1390663586 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794031780 con 0x7f27a40cd6a0 2023-11-24T06:17:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.210+0000 7f279b7fe640 1 -- 172.21.15.37:0/1390663586 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27940318e0 con 0x7f27a40cd6a0 2023-11-24T06:17:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.210+0000 7f279b7fe640 1 -- 172.21.15.37:0/1390663586 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794031c70 con 0x7f27a40cd6a0 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 -- 172.21.15.37:0/1390663586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a40cd6a0 msgr2=0x7f27a415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/1390663586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a40cd6a0 0x7f27a415a260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f27940097a0 tx=0x7f279402b820 comp rx=0 tx=0).stop 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 -- 172.21.15.37:0/1390663586 shutdown_connections 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/1390663586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a40cd6a0 0x7f27a415a260 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/1390663586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a4159e80 0x7f27a4071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 -- 172.21.15.37:0/1390663586 >> 172.21.15.37:0/1390663586 conn(0x7f27a40cb830 msgr2=0x7f27a40cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 -- 172.21.15.37:0/1390663586 shutdown_connections 2023-11-24T06:17:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.211+0000 7f27a9d5c640 1 -- 172.21.15.37:0/1390663586 wait complete. 2023-11-24T06:17:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.213+0000 7f27a9d5c640 1 Processor -- start 2023-11-24T06:17:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.213+0000 7f27a9d5c640 1 -- start start 2023-11-24T06:17:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a9d5c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a40cd6a0 0x7f27a41434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a9d5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a4159e80 0x7f27a41f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a9d5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27a415a7a0 0x7f27a4166560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a9d5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a4167690 con 0x7f27a415a7a0 2023-11-24T06:17:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a9d5c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a4143e00 con 0x7f27a4159e80 2023-11-24T06:17:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a9d5c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a4167e80 con 0x7f27a40cd6a0 2023-11-24T06:17:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a955b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27a415a7a0 0x7f27a4166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a955b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27a415a7a0 0x7f27a4166560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43854/0 (socket says 172.21.15.37:43854) 2023-11-24T06:17:16.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.214+0000 7f27a955b640 1 -- 172.21.15.37:0/2976317402 learned_addr learned my addr 172.21.15.37:0/2976317402 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:16.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f279bfff640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a4159e80 0x7f27a41f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f27a8d5a640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a40cd6a0 0x7f27a41434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f27a955b640 1 -- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a40cd6a0 msgr2=0x7f27a41434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f27a955b640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a40cd6a0 0x7f27a41434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f27a955b640 1 -- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a4159e80 msgr2=0x7f27a41f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f27a955b640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a4159e80 0x7f27a41f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f27a955b640 1 -- 172.21.15.37:0/2976317402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2794009400 con 0x7f27a415a7a0 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f279bfff640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a4159e80 0x7f27a41f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.215+0000 7f27a955b640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27a415a7a0 0x7f27a4166560 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f279c00c420 tx=0x7f279c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.216+0000 7f27997fa640 1 -- 172.21.15.37:0/2976317402 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c005ce0 con 0x7f27a415a7a0 2023-11-24T06:17:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.216+0000 7f27997fa640 1 -- 172.21.15.37:0/2976317402 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c005e40 con 0x7f27a415a7a0 2023-11-24T06:17:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.216+0000 7f27997fa640 1 -- 172.21.15.37:0/2976317402 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c0072d0 con 0x7f27a415a7a0 2023-11-24T06:17:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.216+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a41670d0 con 0x7f27a415a7a0 2023-11-24T06:17:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.216+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a41440a0 con 0x7f27a415a7a0 2023-11-24T06:17:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.217+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a4144290 con 0x7f27a415a7a0 2023-11-24T06:17:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.218+0000 7f27997fa640 1 -- 172.21.15.37:0/2976317402 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f279c0074f0 con 0x7f27a415a7a0 2023-11-24T06:17:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.219+0000 7f27997fa640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f279006aed0 0x7f279006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.220+0000 7f27997fa640 1 -- 172.21.15.37:0/2976317402 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f279c088bd0 con 0x7f27a415a7a0 2023-11-24T06:17:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.220+0000 7f27a8d5a640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f279006aed0 0x7f279006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.221+0000 7f27a8d5a640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f279006aed0 0x7f279006d390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27a4167b60 tx=0x7f27a000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.224+0000 7f27997fa640 1 -- 172.21.15.37:0/2976317402 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f279c053c40 con 0x7f27a415a7a0 2023-11-24T06:17:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.455+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27a404e840 con 0x7f27a415a7a0 2023-11-24T06:17:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.455+0000 7f27997fa640 1 -- 172.21.15.37:0/2976317402 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f279c017020 con 0x7f27a415a7a0 2023-11-24T06:17:16.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1029063982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1029063982},{"type":"v1","addr":"172.21.15.37:6835","nonce":1029063982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/3663508959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3663508959},{"type":"v1","addr":"172.21.15.188:6834","nonce":3663508959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/1387291964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1387291964},{"type":"v1","addr":"172.21.15.188:6835","nonce":1387291964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:48.319764+0000","modified":"2023-11-24T06:16:51.408924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5568":{"gid":5568,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6837/1413576215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1413576215},{"type":"v1","addr":"172.21.15.37:6837","nonce":1413576215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-11-24T06:17:16.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.458+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f279006aed0 msgr2=0x7f279006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.458+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f279006aed0 0x7f279006d390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27a4167b60 tx=0x7f27a000b040 comp rx=0 tx=0).stop 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27a415a7a0 msgr2=0x7f27a4166560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27a415a7a0 0x7f27a4166560 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f279c00c420 tx=0x7f279c00c8e0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 shutdown_connections 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f279006aed0 0x7f279006d390 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27a4159e80 0x7f27a41f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27a415a7a0 0x7f27a4166560 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 --2- 172.21.15.37:0/2976317402 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27a40cd6a0 0x7f27a41434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 >> 172.21.15.37:0/2976317402 conn(0x7f27a40cb830 msgr2=0x7f27a406d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 shutdown_connections 2023-11-24T06:17:16.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.459+0000 7f27a9d5c640 1 -- 172.21.15.37:0/2976317402 wait complete. 2023-11-24T06:17:16.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.703+0000 7f98cd3fb640 1 Processor -- start 2023-11-24T06:17:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.703+0000 7f98cd3fb640 1 -- start start 2023-11-24T06:17:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.704+0000 7f98cd3fb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98c8160f50 0x7f98c80ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.704+0000 7f98cd3fb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c8071220 con 0x7f98c80cf0d0 2023-11-24T06:17:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.705+0000 7f98cd3fb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80706a0 con 0x7f98c80cf4b0 2023-11-24T06:17:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.705+0000 7f98cd3fb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c8070980 con 0x7f98c8160f50 2023-11-24T06:17:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.705+0000 7f98c6ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98c80cf0d0 0x7f98c8160840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37142/0 (socket says 172.21.15.37:37142) 2023-11-24T06:17:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.705+0000 7f98c6ffd640 1 -- 172.21.15.37:0/4109177387 learned_addr learned my addr 172.21.15.37:0/4109177387 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.705+0000 7f98c67fc640 1 --2- 172.21.15.37:0/4109177387 >> v2:172.21.15.37:3300/0 conn(0x7f98c8160f50 0x7f98c80ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.705+0000 7f98c5ffb640 1 -- 172.21.15.37:0/4109177387 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533797542 0 0) 0x7f98c8071220 con 0x7f98c80cf0d0 2023-11-24T06:17:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.705+0000 7f98c5ffb640 1 -- 172.21.15.37:0/4109177387 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98b4003520 con 0x7f98c80cf0d0 2023-11-24T06:17:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.706+0000 7f98c67fc640 1 -- 172.21.15.37:0/4109177387 >> v1:172.21.15.188:6789/0 conn(0x7f98c80cf4b0 legacy=0x7f98c806b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.706+0000 7f98c67fc640 1 -- 172.21.15.37:0/4109177387 >> v1:172.21.15.37:6789/0 conn(0x7f98c80cf0d0 legacy=0x7f98c8160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.706+0000 7f98c67fc640 1 -- 172.21.15.37:0/4109177387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8070c60 con 0x7f98c8160f50 2023-11-24T06:17:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.707+0000 7f98c67fc640 1 --2- 172.21.15.37:0/4109177387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c8160f50 0x7f98c80ce3e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009800 tx=0x7f98b002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b00d39d1aa40b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.707+0000 7f98c5ffb640 1 -- 172.21.15.37:0/4109177387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b002d040 con 0x7f98c8160f50 2023-11-24T06:17:16.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.707+0000 7f98c5ffb640 1 -- 172.21.15.37:0/4109177387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b0031810 con 0x7f98c8160f50 2023-11-24T06:17:16.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.707+0000 7f98c5ffb640 1 -- 172.21.15.37:0/4109177387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0031ba0 con 0x7f98c8160f50 2023-11-24T06:17:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.708+0000 7f98cd3fb640 1 -- 172.21.15.37:0/4109177387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c8160f50 msgr2=0x7f98c80ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.708+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/4109177387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c8160f50 0x7f98c80ce3e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009800 tx=0x7f98b002b8b0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.708+0000 7f98cd3fb640 1 -- 172.21.15.37:0/4109177387 shutdown_connections 2023-11-24T06:17:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.708+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/4109177387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c8160f50 0x7f98c80ce3e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.708+0000 7f98cd3fb640 1 -- 172.21.15.37:0/4109177387 >> 172.21.15.37:0/4109177387 conn(0x7f98c80b2e40 msgr2=0x7f98c80b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.708+0000 7f98cd3fb640 1 -- 172.21.15.37:0/4109177387 shutdown_connections 2023-11-24T06:17:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.708+0000 7f98cd3fb640 1 -- 172.21.15.37:0/4109177387 wait complete. 2023-11-24T06:17:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.710+0000 7f98cd3fb640 1 Processor -- start 2023-11-24T06:17:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.710+0000 7f98cd3fb640 1 -- start start 2023-11-24T06:17:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98cd3fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80cf0d0 0x7f98c814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98cd3fb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98c80cf4b0 0x7f98c80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98cd3fb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98c8160f50 0x7f98c80c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98cd3fb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c81581b0 con 0x7f98c80cf0d0 2023-11-24T06:17:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98cd3fb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c814dba0 con 0x7f98c8160f50 2023-11-24T06:17:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98cd3fb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c8157530 con 0x7f98c80cf4b0 2023-11-24T06:17:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80cf0d0 0x7f98c814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80cf0d0 0x7f98c814d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43874/0 (socket says 172.21.15.37:43874) 2023-11-24T06:17:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.711+0000 7f98c6ffd640 1 -- 172.21.15.37:0/416319291 learned_addr learned my addr 172.21.15.37:0/416319291 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98c6ffd640 1 -- 172.21.15.37:0/416319291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98c80cf4b0 msgr2=0x7f98c80b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98c6ffd640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98c80cf4b0 0x7f98c80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98c6ffd640 1 -- 172.21.15.37:0/416319291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98c8160f50 msgr2=0x7f98c80c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98c6ffd640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98c8160f50 0x7f98c80c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98c6ffd640 1 -- 172.21.15.37:0/416319291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0009400 con 0x7f98c80cf0d0 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98c6ffd640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80cf0d0 0x7f98c814d660 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f98b800cbc0 tx=0x7f98b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98bf7fe640 1 -- 172.21.15.37:0/416319291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800ad40 con 0x7f98c80cf0d0 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98bf7fe640 1 -- 172.21.15.37:0/416319291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8012400 con 0x7f98c80cf0d0 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98bf7fe640 1 -- 172.21.15.37:0/416319291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800aea0 con 0x7f98c80cf0d0 2023-11-24T06:17:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c8157810 con 0x7f98c80cf0d0 2023-11-24T06:17:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.712+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c8157dd0 con 0x7f98c80cf0d0 2023-11-24T06:17:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.714+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c80d0540 con 0x7f98c80cf0d0 2023-11-24T06:17:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.714+0000 7f98bf7fe640 1 -- 172.21.15.37:0/416319291 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f98b8007070 con 0x7f98c80cf0d0 2023-11-24T06:17:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.715+0000 7f98bf7fe640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f98a806aed0 0x7f98a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.715+0000 7f98bf7fe640 1 -- 172.21.15.37:0/416319291 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98b8089780 con 0x7f98c80cf0d0 2023-11-24T06:17:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.716+0000 7f98c67fc640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f98a806aed0 0x7f98a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.716+0000 7f98c67fc640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f98a806aed0 0x7f98a806d390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f98b0036000 tx=0x7f98b0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:16.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.720+0000 7f98bf7fe640 1 -- 172.21.15.37:0/416319291 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98b80581f0 con 0x7f98c80cf0d0 2023-11-24T06:17:16.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.949+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98c8067b80 con 0x7f98c80cf0d0 2023-11-24T06:17:16.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.949+0000 7f98bf7fe640 1 -- 172.21.15.37:0/416319291 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f98b8017090 con 0x7f98c80cf0d0 2023-11-24T06:17:16.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:16.952 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1029063982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1029063982},{"type":"v1","addr":"172.21.15.37:6835","nonce":1029063982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/3663508959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3663508959},{"type":"v1","addr":"172.21.15.188:6834","nonce":3663508959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/1387291964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1387291964},{"type":"v1","addr":"172.21.15.188:6835","nonce":1387291964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:16:48.319764+0000","modified":"2023-11-24T06:16:51.408924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5568":{"gid":5568,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6837/1413576215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1413576215},{"type":"v1","addr":"172.21.15.37:6837","nonce":1413576215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T06:17:16.953 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f98a806aed0 msgr2=0x7f98a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f98a806aed0 0x7f98a806d390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f98b0036000 tx=0x7f98b0030000 comp rx=0 tx=0).stop 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80cf0d0 msgr2=0x7f98c814d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80cf0d0 0x7f98c814d660 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f98b800cbc0 tx=0x7f98b800a430 comp rx=0 tx=0).stop 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 shutdown_connections 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f98a806aed0 0x7f98a806d390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98c8160f50 0x7f98c80c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98c80cf4b0 0x7f98c80b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 --2- 172.21.15.37:0/416319291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80cf0d0 0x7f98c814d660 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:16.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 >> 172.21.15.37:0/416319291 conn(0x7f98c80b2e40 msgr2=0x7f98c80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:16.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 shutdown_connections 2023-11-24T06:17:16.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:16.952+0000 7f98cd3fb640 1 -- 172.21.15.37:0/416319291 wait complete. 2023-11-24T06:17:16.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.194+0000 7f34a082e640 1 Processor -- start 2023-11-24T06:17:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.195+0000 7f34a082e640 1 -- start start 2023-11-24T06:17:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.196+0000 7f34a082e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f349c14b100 0x7f349c162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f34a082e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f34a082e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c162eb0 con 0x7f349c0703f0 2023-11-24T06:17:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f34a082e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c1654a0 con 0x7f349c14b100 2023-11-24T06:17:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f34a082e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0ccf00 con 0x7f349c0cd160 2023-11-24T06:17:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f349b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f349c14b100 0x7f349c162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f349b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f349c14b100 0x7f349c162970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38234/0 (socket says 172.21.15.37:38234) 2023-11-24T06:17:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f349b7fe640 1 -- 172.21.15.37:0/2665717092 learned_addr learned my addr 172.21.15.37:0/2665717092 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.197+0000 7f349bfff640 1 --2- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.198+0000 7f349b7fe640 1 -- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 msgr2=0x7f349c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.198+0000 7f349b7fe640 1 --2- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.198+0000 7f349b7fe640 1 -- 172.21.15.37:0/2665717092 >> v1:172.21.15.188:6789/0 conn(0x7f349c0703f0 legacy=0x7f349c165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.198+0000 7f349affd640 1 -- 172.21.15.37:0/2665717092 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796134196 0 0) 0x7f3484001110 con 0x7f349c0703f0 2023-11-24T06:17:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.198+0000 7f349b7fe640 1 -- 172.21.15.37:0/2665717092 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c166320 con 0x7f349c14b100 2023-11-24T06:17:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.198+0000 7f349bfff640 1 --2- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:17.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.200+0000 7f349b7fe640 1 --2- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c162970 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f348c009870 tx=0x7f348c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78b8570eb9d79b69 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.200+0000 7f349affd640 1 -- 172.21.15.37:0/2665717092 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c031640 con 0x7f349c14b100 2023-11-24T06:17:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.200+0000 7f349affd640 1 -- 172.21.15.37:0/2665717092 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c0317a0 con 0x7f349c14b100 2023-11-24T06:17:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.200+0000 7f349affd640 1 -- 172.21.15.37:0/2665717092 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c031b30 con 0x7f349c14b100 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 -- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 msgr2=0x7f349c162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 --2- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c162970 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f348c009870 tx=0x7f348c02b8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 -- 172.21.15.37:0/2665717092 shutdown_connections 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 --2- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 --2- 172.21.15.37:0/2665717092 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c162970 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 -- 172.21.15.37:0/2665717092 >> 172.21.15.37:0/2665717092 conn(0x7f349c0cb830 msgr2=0x7f349c0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 -- 172.21.15.37:0/2665717092 shutdown_connections 2023-11-24T06:17:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.201+0000 7f34a082e640 1 -- 172.21.15.37:0/2665717092 wait complete. 2023-11-24T06:17:17.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.203+0000 7f34a082e640 1 Processor -- start 2023-11-24T06:17:17.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.203+0000 7f34a082e640 1 -- start start 2023-11-24T06:17:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f34a082e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349c0703f0 0x7f349c144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f34a082e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f34a082e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c1ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f34a082e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c143770 con 0x7f349c0703f0 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f34a082e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1ed2a0 con 0x7f349c14b100 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f34a082e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c143d50 con 0x7f349c0cd160 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f349b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349c0703f0 0x7f349c144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f349b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349c0703f0 0x7f349c144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43884/0 (socket says 172.21.15.37:43884) 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.204+0000 7f349b7fe640 1 -- 172.21.15.37:0/1916048855 learned_addr learned my addr 172.21.15.37:0/1916048855 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349bfff640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c1ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349b7fe640 1 -- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 msgr2=0x7f349c143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349b7fe640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349b7fe640 1 -- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 msgr2=0x7f349c1ecd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349b7fe640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c1ecd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349b7fe640 1 -- 172.21.15.37:0/1916048855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009a70 con 0x7f349c0703f0 2023-11-24T06:17:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349bfff640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c1ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.205+0000 7f349b7fe640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349c0703f0 0x7f349c144df0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f348c0090b0 tx=0x7f348c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.206+0000 7f3498ff9640 1 -- 172.21.15.37:0/1916048855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c03a9f0 con 0x7f349c0703f0 2023-11-24T06:17:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.206+0000 7f3498ff9640 1 -- 172.21.15.37:0/1916048855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c03ab70 con 0x7f349c0703f0 2023-11-24T06:17:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.206+0000 7f3498ff9640 1 -- 172.21.15.37:0/1916048855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c0443f0 con 0x7f349c0703f0 2023-11-24T06:17:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.206+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c0094d0 con 0x7f349c0703f0 2023-11-24T06:17:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.206+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c144310 con 0x7f349c0703f0 2023-11-24T06:17:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.207+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c04e840 con 0x7f349c0703f0 2023-11-24T06:17:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.208+0000 7f3498ff9640 1 -- 172.21.15.37:0/1916048855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f348c02f050 con 0x7f349c0703f0 2023-11-24T06:17:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.209+0000 7f3498ff9640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f347c06aed0 0x7f347c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.209+0000 7f3498ff9640 1 -- 172.21.15.37:0/1916048855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f348c0ab5d0 con 0x7f349c0703f0 2023-11-24T06:17:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.209+0000 7f3493fff640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f347c06aed0 0x7f347c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.210+0000 7f3493fff640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f347c06aed0 0x7f347c06d390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f349c0cd7d0 tx=0x7f34840077c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.214+0000 7f3498ff9640 1 -- 172.21.15.37:0/1916048855 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f348c076510 con 0x7f349c0703f0 2023-11-24T06:17:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.417+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f349c06d390 con 0x7f349c0703f0 2023-11-24T06:17:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.420+0000 7f3498ff9640 1 -- 172.21.15.37:0/1916048855 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f348c079b30 con 0x7f349c0703f0 2023-11-24T06:17:17.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:17.423 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:16:49.877706+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:16:46.245164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T06:16:47.345037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.422+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f347c06aed0 msgr2=0x7f347c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.422+0000 7f34a082e640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f347c06aed0 0x7f347c06d390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f349c0cd7d0 tx=0x7f34840077c0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.422+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349c0703f0 msgr2=0x7f349c144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.422+0000 7f34a082e640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349c0703f0 0x7f349c144df0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f348c0090b0 tx=0x7f348c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 shutdown_connections 2023-11-24T06:17:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f347c06aed0 0x7f347c06d390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f349c14b100 0x7f349c1ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f349c0cd160 0x7f349c143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 --2- 172.21.15.37:0/1916048855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349c0703f0 0x7f349c144df0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 >> 172.21.15.37:0/1916048855 conn(0x7f349c0cb830 msgr2=0x7f349c164920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 shutdown_connections 2023-11-24T06:17:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.423+0000 7f34a082e640 1 -- 172.21.15.37:0/1916048855 wait complete. 2023-11-24T06:17:17.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:17:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.670+0000 7fe55af73640 1 Processor -- start 2023-11-24T06:17:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.670+0000 7fe55af73640 1 -- start start 2023-11-24T06:17:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.672+0000 7fe55af73640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5540cdca0 0x7fe554168370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.672+0000 7fe55af73640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55406c530 con 0x7fe5540cb690 2023-11-24T06:17:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.672+0000 7fe55af73640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55406c7d0 con 0x7fe554160890 2023-11-24T06:17:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.672+0000 7fe55af73640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55406d170 con 0x7fe5540cdca0 2023-11-24T06:17:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.672+0000 7fe559770640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe5540cb690 0x7fe5540b0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37152/0 (socket says 172.21.15.37:37152) 2023-11-24T06:17:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.672+0000 7fe559770640 1 -- 172.21.15.37:0/3828036604 learned_addr learned my addr 172.21.15.37:0/3828036604 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe55a772640 1 --2- 172.21.15.37:0/3828036604 >> v2:172.21.15.188:3300/0 conn(0x7fe5540cdca0 0x7fe554168370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465427053 0 0) 0x7fe55406c530 con 0x7fe5540cb690 2023-11-24T06:17:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe540003520 con 0x7fe5540cb690 2023-11-24T06:17:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4247311215 0 0) 0x7fe540003520 con 0x7fe5540cb690 2023-11-24T06:17:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 >> v2:172.21.15.188:3300/0 conn(0x7fe5540cdca0 msgr2=0x7fe554168370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 --2- 172.21.15.37:0/3828036604 >> v2:172.21.15.188:3300/0 conn(0x7fe5540cdca0 0x7fe554168370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 >> v1:172.21.15.188:6789/0 conn(0x7fe554160890 legacy=0x7fe5540c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55406cab0 con 0x7fe5540cb690 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fe544001690 con 0x7fe5540cb690 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 >> v1:172.21.15.37:6789/0 conn(0x7fe5540cb690 legacy=0x7fe5540b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5400039c0 0x7fe540003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.673+0000 7fe558f6f640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5400047c0 0x7fe540004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe558f6f640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe540005180 0x7fe54000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55406d170 con 0x7fe540005180 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54000c080 con 0x7fe5400039c0 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54000c240 con 0x7fe5400047c0 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe55a772640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe540005180 0x7fe54000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe559f71640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5400039c0 0x7fe540003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe559770640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5400047c0 0x7fe540004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe55a772640 1 -- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5400047c0 msgr2=0x7fe540004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe55a772640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5400047c0 0x7fe540004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe55a772640 1 -- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5400039c0 msgr2=0x7fe540003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe55a772640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5400039c0 0x7fe540003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe55a772640 1 -- 172.21.15.37:0/3828036604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe540003520 con 0x7fe540005180 2023-11-24T06:17:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.674+0000 7fe559770640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5400047c0 0x7fe540004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.675+0000 7fe55a772640 1 -- 172.21.15.37:0/3828036604 reap_dead start 2023-11-24T06:17:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe55a772640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe540005180 0x7fe54000b980 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009f90 tx=0x7fe5400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e188bd81aa83c569 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c02cc20 con 0x7fe540005180 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c00f040 con 0x7fe540005180 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe558f6f640 1 -- 172.21.15.37:0/3828036604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c003990 con 0x7fe540005180 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe55af73640 1 -- 172.21.15.37:0/3828036604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe540005180 msgr2=0x7fe54000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe55af73640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe540005180 0x7fe54000b980 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009f90 tx=0x7fe5400057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe55af73640 1 -- 172.21.15.37:0/3828036604 shutdown_connections 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.676+0000 7fe55af73640 1 --2- 172.21.15.37:0/3828036604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe540005180 0x7fe54000b980 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.677+0000 7fe55af73640 1 -- 172.21.15.37:0/3828036604 >> 172.21.15.37:0/3828036604 conn(0x7fe5540cbb40 msgr2=0x7fe5540cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.677+0000 7fe55af73640 1 -- 172.21.15.37:0/3828036604 shutdown_connections 2023-11-24T06:17:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.677+0000 7fe55af73640 1 -- 172.21.15.37:0/3828036604 wait complete. 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.678+0000 7fe55af73640 1 Processor -- start 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.679+0000 7fe55af73640 1 -- start start 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55af73640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe540005180 0x7fe5540b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55af73640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5540b3e00 0x7fe5541f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55af73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5541f2a90 0x7fe55409c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55af73640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5541f2f10 con 0x7fe5541f2a90 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55af73640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5541f3ec0 con 0x7fe5540b3e00 2023-11-24T06:17:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55af73640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5541f3100 con 0x7fe540005180 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5541f2a90 0x7fe55409c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5541f2a90 0x7fe55409c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43914/0 (socket says 172.21.15.37:43914) 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 -- 172.21.15.37:0/586230515 learned_addr learned my addr 172.21.15.37:0/586230515 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 -- 172.21.15.37:0/586230515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe540005180 msgr2=0x7fe5540b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe559770640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5540b3e00 0x7fe5541f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe540005180 0x7fe5540b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 -- 172.21.15.37:0/586230515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5540b3e00 msgr2=0x7fe5541f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5540b3e00 0x7fe5541f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.680+0000 7fe55a772640 1 -- 172.21.15.37:0/586230515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5541f33e0 con 0x7fe5541f2a90 2023-11-24T06:17:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.681+0000 7fe55a772640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5541f2a90 0x7fe55409c0f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe54c02c690 tx=0x7fe54c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.681+0000 7fe54a7fc640 1 -- 172.21.15.37:0/586230515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c02cea0 con 0x7fe5541f2a90 2023-11-24T06:17:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.681+0000 7fe54a7fc640 1 -- 172.21.15.37:0/586230515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c004230 con 0x7fe5541f2a90 2023-11-24T06:17:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.681+0000 7fe54a7fc640 1 -- 172.21.15.37:0/586230515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0045e0 con 0x7fe5541f2a90 2023-11-24T06:17:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.681+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5541f36c0 con 0x7fe5541f2a90 2023-11-24T06:17:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.681+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5540b26c0 con 0x7fe5541f2a90 2023-11-24T06:17:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.683+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5541f3be0 con 0x7fe5541f2a90 2023-11-24T06:17:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.683+0000 7fe54a7fc640 1 -- 172.21.15.37:0/586230515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fe54c004740 con 0x7fe5541f2a90 2023-11-24T06:17:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.685+0000 7fe54a7fc640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe53806aed0 0x7fe53806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.685+0000 7fe54a7fc640 1 -- 172.21.15.37:0/586230515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe54c0ac0d0 con 0x7fe5541f2a90 2023-11-24T06:17:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.685+0000 7fe559f71640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe53806aed0 0x7fe53806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.686+0000 7fe559f71640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe53806aed0 0x7fe53806d390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5500014f0 tx=0x7fe550009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.689+0000 7fe54a7fc640 1 -- 172.21.15.37:0/586230515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5541f3be0 con 0x7fe5541f2a90 2023-11-24T06:17:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.919+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe5541f3be0 con 0x7fe5541f2a90 2023-11-24T06:17:17.922 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-11-24T06:17:17.920+0000 7fe7fc218640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:17:17.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.922+0000 7fe54a7fc640 1 -- 172.21.15.37:0/586230515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe5541f3be0 con 0x7fe5541f2a90 2023-11-24T06:17:17.925 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:17:17.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.926+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe53806aed0 msgr2=0x7fe53806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.926+0000 7fe55af73640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe53806aed0 0x7fe53806d390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5500014f0 tx=0x7fe550009040 comp rx=0 tx=0).stop 2023-11-24T06:17:17.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.926+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5541f2a90 msgr2=0x7fe55409c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.926+0000 7fe55af73640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5541f2a90 0x7fe55409c0f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe54c02c690 tx=0x7fe54c009750 comp rx=0 tx=0).stop 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 shutdown_connections 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fe53806aed0 0x7fe53806d390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5540b3e00 0x7fe5541f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5541f2a90 0x7fe55409c0f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 --2- 172.21.15.37:0/586230515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe540005180 0x7fe5540b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 >> 172.21.15.37:0/586230515 conn(0x7fe5540cbb40 msgr2=0x7fe554071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 shutdown_connections 2023-11-24T06:17:17.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:17.927+0000 7fe55af73640 1 -- 172.21.15.37:0/586230515 wait complete. 2023-11-24T06:17:17.943 INFO:tasks.ceph.mds.a.smithi037.stderr: -3746> 2023-11-24T06:16:50.798+0000 7f674e5af640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:17:17.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:17:18.001 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.149+0000 7f38effff640 1 Processor -- start 2023-11-24T06:17:18.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.149+0000 7f38effff640 1 -- start start 2023-11-24T06:17:18.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38effff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00cf480 0x7f38f015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38effff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f38f015d7b0 0x7f38f00b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38effff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f00b2400 0x7f38f013f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38effff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f015a700 con 0x7f38f00b2400 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38effff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f00b2850 con 0x7f38f015d7b0 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38effff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f013d140 con 0x7f38f00cf480 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38ef7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f00b2400 0x7f38f013f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38ef7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f00b2400 0x7f38f013f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43940/0 (socket says 172.21.15.37:43940) 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.151+0000 7f38ef7fe640 1 -- 172.21.15.37:0/4240018448 learned_addr learned my addr 172.21.15.37:0/4240018448 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.152+0000 7f38e67fc640 1 --2- 172.21.15.37:0/4240018448 >> v2:172.21.15.188:3300/0 conn(0x7f38f015d7b0 0x7f38f00b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.152+0000 7f38eeffd640 1 --2- 172.21.15.37:0/4240018448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00cf480 0x7f38f015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.152+0000 7f38ef7fe640 1 -- 172.21.15.37:0/4240018448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00cf480 msgr2=0x7f38f015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.152+0000 7f38ef7fe640 1 --2- 172.21.15.37:0/4240018448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00cf480 0x7f38f015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.152+0000 7f38ef7fe640 1 -- 172.21.15.37:0/4240018448 >> v2:172.21.15.188:3300/0 conn(0x7f38f015d7b0 msgr2=0x7f38f00b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.152+0000 7f38ef7fe640 1 --2- 172.21.15.37:0/4240018448 >> v2:172.21.15.188:3300/0 conn(0x7f38f015d7b0 0x7f38f00b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.152+0000 7f38ef7fe640 1 -- 172.21.15.37:0/4240018448 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f015b190 con 0x7f38f00b2400 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.153+0000 7f38ef7fe640 1 --2- 172.21.15.37:0/4240018448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b2400 0x7f38f013f4a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f38f006c3e0 tx=0x7f38e802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe0a1f041d0b585 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.153+0000 7f38ee7fc640 1 -- 172.21.15.37:0/4240018448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e802ca80 con 0x7f38f00b2400 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.153+0000 7f38ee7fc640 1 -- 172.21.15.37:0/4240018448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e802cbe0 con 0x7f38f00b2400 2023-11-24T06:17:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.153+0000 7f38ee7fc640 1 -- 172.21.15.37:0/4240018448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80343f0 con 0x7f38f00b2400 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 -- 172.21.15.37:0/4240018448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b2400 msgr2=0x7f38f013f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 --2- 172.21.15.37:0/4240018448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b2400 0x7f38f013f4a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f38f006c3e0 tx=0x7f38e802bee0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 -- 172.21.15.37:0/4240018448 shutdown_connections 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 --2- 172.21.15.37:0/4240018448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b2400 0x7f38f013f4a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 --2- 172.21.15.37:0/4240018448 >> v2:172.21.15.188:3300/0 conn(0x7f38f015d7b0 0x7f38f00b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 --2- 172.21.15.37:0/4240018448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00cf480 0x7f38f015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 -- 172.21.15.37:0/4240018448 >> 172.21.15.37:0/4240018448 conn(0x7f38f006a500 msgr2=0x7f38f006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 -- 172.21.15.37:0/4240018448 shutdown_connections 2023-11-24T06:17:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.154+0000 7f38effff640 1 -- 172.21.15.37:0/4240018448 wait complete. 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.156+0000 7f38effff640 1 Processor -- start 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.156+0000 7f38effff640 1 -- start start 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.157+0000 7f38effff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00b2400 0x7f38f013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.157+0000 7f38effff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38f00cf480 0x7f38f0070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.157+0000 7f38effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f015d7b0 0x7f38f00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.157+0000 7f38effff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00c8010 con 0x7f38f015d7b0 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.157+0000 7f38effff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0071c30 con 0x7f38f00cf480 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.157+0000 7f38effff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00720c0 con 0x7f38f00b2400 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f015d7b0 0x7f38f00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f015d7b0 0x7f38f00c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43950/0 (socket says 172.21.15.37:43950) 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 -- 172.21.15.37:0/3106680574 learned_addr learned my addr 172.21.15.37:0/3106680574 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38e67fc640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38f00cf480 0x7f38f0070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38eeffd640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00b2400 0x7f38f013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 -- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00b2400 msgr2=0x7f38f013cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00b2400 0x7f38f013cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 -- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38f00cf480 msgr2=0x7f38f0070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38f00cf480 0x7f38f0070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 -- 172.21.15.37:0/3106680574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009b30 con 0x7f38f015d7b0 2023-11-24T06:17:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.158+0000 7f38ef7fe640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f015d7b0 0x7f38f00c7350 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f38e8036040 tx=0x7f38e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.159+0000 7f38ecff9640 1 -- 172.21.15.37:0/3106680574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8009510 con 0x7f38f015d7b0 2023-11-24T06:17:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.159+0000 7f38ecff9640 1 -- 172.21.15.37:0/3106680574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e803e450 con 0x7f38f015d7b0 2023-11-24T06:17:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.159+0000 7f38ecff9640 1 -- 172.21.15.37:0/3106680574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e803e800 con 0x7f38f015d7b0 2023-11-24T06:17:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.159+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f0071020 con 0x7f38f015d7b0 2023-11-24T06:17:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.159+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f00715e0 con 0x7f38f015d7b0 2023-11-24T06:17:18.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.160+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f0071dc0 con 0x7f38f015d7b0 2023-11-24T06:17:18.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.161+0000 7f38ecff9640 1 -- 172.21.15.37:0/3106680574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f38e802cd50 con 0x7f38f015d7b0 2023-11-24T06:17:18.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.162+0000 7f38ecff9640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f38d406af00 0x7f38d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:18.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.162+0000 7f38ecff9640 1 -- 172.21.15.37:0/3106680574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f38e80ac260 con 0x7f38f015d7b0 2023-11-24T06:17:18.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.162+0000 7f38eeffd640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f38d406af00 0x7f38d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:18.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.163+0000 7f38eeffd640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f38d406af00 0x7f38d406d3c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38e0006fd0 tx=0x7f38e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:18.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.167+0000 7f38ecff9640 1 -- 172.21.15.37:0/3106680574 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38e8077370 con 0x7f38f015d7b0 2023-11-24T06:17:18.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.399+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f38f004e840 con 0x7f38f015d7b0 2023-11-24T06:17:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.926+0000 7f38ecff9640 1 -- 172.21.15.37:0/3106680574 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f38e807a990 con 0x7f38f015d7b0 2023-11-24T06:17:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f38d406af00 msgr2=0x7f38d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f38d406af00 0x7f38d406d3c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38e0006fd0 tx=0x7f38e0008040 comp rx=0 tx=0).stop 2023-11-24T06:17:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f015d7b0 msgr2=0x7f38f00c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f015d7b0 0x7f38f00c7350 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f38e8036040 tx=0x7f38e8004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 shutdown_connections 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f38d406af00 0x7f38d406d3c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38f00cf480 0x7f38f0070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.930+0000 7f38effff640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f015d7b0 0x7f38f00c7350 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.931+0000 7f38effff640 1 --2- 172.21.15.37:0/3106680574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38f00b2400 0x7f38f013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.931+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 >> 172.21.15.37:0/3106680574 conn(0x7f38f006a500 msgr2=0x7f38f013e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.931+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 shutdown_connections 2023-11-24T06:17:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:18.931+0000 7f38effff640 1 -- 172.21.15.37:0/3106680574 wait complete. 2023-11-24T06:17:18.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:17:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.157+0000 7f0c573cb640 1 Processor -- start 2023-11-24T06:17:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.157+0000 7f0c573cb640 1 -- start start 2023-11-24T06:17:19.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c573cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c5013e230 0x7f0c5006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c573cb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 0x7f0c5006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c573cb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5015f5b0 con 0x7f0c5015b840 2023-11-24T06:17:19.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c573cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c501417c0 con 0x7f0c5013e230 2023-11-24T06:17:19.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c573cb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5015c380 con 0x7f0c5015fa40 2023-11-24T06:17:19.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c563c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c5013e230 0x7f0c5006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c56bca640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0c5015b840 0x7f0c5015bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37168/0 (socket says 172.21.15.37:37168) 2023-11-24T06:17:19.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.159+0000 7f0c56bca640 1 -- 172.21.15.37:0/3208362921 learned_addr learned my addr 172.21.15.37:0/3208362921 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.160+0000 7f0c55bc8640 1 --2- 172.21.15.37:0/3208362921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 0x7f0c5006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.160+0000 7f0c563c9640 1 -- 172.21.15.37:0/3208362921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 msgr2=0x7f0c5006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.160+0000 7f0c563c9640 1 --2- 172.21.15.37:0/3208362921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 0x7f0c5006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.160+0000 7f0c563c9640 1 -- 172.21.15.37:0/3208362921 >> v1:172.21.15.37:6789/0 conn(0x7f0c5015b840 legacy=0x7f0c5015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.160+0000 7f0c563c9640 1 -- 172.21.15.37:0/3208362921 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5015c570 con 0x7f0c5013e230 2023-11-24T06:17:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.161+0000 7f0c563c9640 1 --2- 172.21.15.37:0/3208362921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5006c4f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0097a0 tx=0x7f0c4c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896d550cac22539f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.161+0000 7f0c553c7640 1 -- 172.21.15.37:0/3208362921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c031780 con 0x7f0c5013e230 2023-11-24T06:17:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.161+0000 7f0c553c7640 1 -- 172.21.15.37:0/3208362921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c0318e0 con 0x7f0c5013e230 2023-11-24T06:17:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.161+0000 7f0c553c7640 1 -- 172.21.15.37:0/3208362921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c031c70 con 0x7f0c5013e230 2023-11-24T06:17:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 -- 172.21.15.37:0/3208362921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 msgr2=0x7f0c5006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 --2- 172.21.15.37:0/3208362921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5006c4f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0097a0 tx=0x7f0c4c02b820 comp rx=0 tx=0).stop 2023-11-24T06:17:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 -- 172.21.15.37:0/3208362921 shutdown_connections 2023-11-24T06:17:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 --2- 172.21.15.37:0/3208362921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 0x7f0c5006ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 --2- 172.21.15.37:0/3208362921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5006c4f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 -- 172.21.15.37:0/3208362921 >> 172.21.15.37:0/3208362921 conn(0x7f0c5006dc30 msgr2=0x7f0c5006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 -- 172.21.15.37:0/3208362921 shutdown_connections 2023-11-24T06:17:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.162+0000 7f0c573cb640 1 -- 172.21.15.37:0/3208362921 wait complete. 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.164+0000 7f0c573cb640 1 Processor -- start 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.165+0000 7f0c573cb640 1 -- start start 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c573cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5013aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c573cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5015b840 0x7f0c500ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c573cb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 0x7f0c500addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c573cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5013e610 con 0x7f0c5013e230 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c573cb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500afd00 con 0x7f0c5015b840 2023-11-24T06:17:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c573cb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500affe0 con 0x7f0c5015fa40 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c563c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5013aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c563c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5013aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43976/0 (socket says 172.21.15.37:43976) 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.166+0000 7f0c563c9640 1 -- 172.21.15.37:0/2806166504 learned_addr learned my addr 172.21.15.37:0/2806166504 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c563c9640 1 -- 172.21.15.37:0/2806166504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 msgr2=0x7f0c500addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c563c9640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 0x7f0c500addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c563c9640 1 -- 172.21.15.37:0/2806166504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5015b840 msgr2=0x7f0c500ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c563c9640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5015b840 0x7f0c500ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c563c9640 1 -- 172.21.15.37:0/2806166504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c009400 con 0x7f0c5013e230 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c563c9640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5013aa00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c034040 tx=0x7f0c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c42ffd640 1 -- 172.21.15.37:0/2806166504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c032820 con 0x7f0c5013e230 2023-11-24T06:17:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c42ffd640 1 -- 172.21.15.37:0/2806166504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c0329a0 con 0x7f0c5013e230 2023-11-24T06:17:19.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c42ffd640 1 -- 172.21.15.37:0/2806166504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c032d50 con 0x7f0c5013e230 2023-11-24T06:17:19.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.167+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c500b02c0 con 0x7f0c5013e230 2023-11-24T06:17:19.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.168+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5013af40 con 0x7f0c5013e230 2023-11-24T06:17:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.169+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5013eaa0 con 0x7f0c5013e230 2023-11-24T06:17:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.169+0000 7f0c42ffd640 1 -- 172.21.15.37:0/2806166504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f0c4c04e440 con 0x7f0c5013e230 2023-11-24T06:17:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.170+0000 7f0c42ffd640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c3406af00 0x7f0c3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.170+0000 7f0c42ffd640 1 -- 172.21.15.37:0/2806166504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0c4c0aba50 con 0x7f0c5013e230 2023-11-24T06:17:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.171+0000 7f0c55bc8640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c3406af00 0x7f0c3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.171+0000 7f0c55bc8640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c3406af00 0x7f0c3406d3c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c44006fd0 tx=0x7f0c44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.174+0000 7f0c42ffd640 1 -- 172.21.15.37:0/2806166504 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c5013eaa0 con 0x7f0c5013e230 2023-11-24T06:17:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:19.368+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c5013eaa0 con 0x7f0c5013e230 2023-11-24T06:17:20.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.093+0000 7f0c42ffd640 1 -- 172.21.15.37:0/2806166504 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0c5013eaa0 con 0x7f0c5013e230 2023-11-24T06:17:20.096 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c3406af00 msgr2=0x7f0c3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c3406af00 0x7f0c3406d3c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c44006fd0 tx=0x7f0c44008040 comp rx=0 tx=0).stop 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 msgr2=0x7f0c5013aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5013aa00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c034040 tx=0x7f0c4c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 shutdown_connections 2023-11-24T06:17:20.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0c3406af00 0x7f0c3406d3c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c5015b840 0x7f0c500ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c5015fa40 0x7f0c500addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 --2- 172.21.15.37:0/2806166504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c5013e230 0x7f0c5013aa00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.098+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 >> 172.21.15.37:0/2806166504 conn(0x7f0c5006dc30 msgr2=0x7f0c5006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.099+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 shutdown_connections 2023-11-24T06:17:20.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.099+0000 7f0c573cb640 1 -- 172.21.15.37:0/2806166504 wait complete. 2023-11-24T06:17:20.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:17:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.343+0000 7f173b071640 1 Processor -- start 2023-11-24T06:17:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.343+0000 7f173b071640 1 -- start start 2023-11-24T06:17:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173b071640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17340cfbe0 0x7f17340d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173b071640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f173415ce20 0x7f173415d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173b071640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173415ea30 con 0x7f1734160b00 2023-11-24T06:17:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173b071640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340d0590 con 0x7f17340cfbe0 2023-11-24T06:17:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173b071640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173415de20 con 0x7f173415ce20 2023-11-24T06:17:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173986e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17340cfbe0 0x7f17340d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173986e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17340cfbe0 0x7f17340d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43990/0 (socket says 172.21.15.37:43990) 2023-11-24T06:17:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.345+0000 7f173986e640 1 -- 172.21.15.37:0/293460935 learned_addr learned my addr 172.21.15.37:0/293460935 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.346+0000 7f173a870640 1 --2- 172.21.15.37:0/293460935 >> v2:172.21.15.188:3300/0 conn(0x7f173415ce20 0x7f173415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.346+0000 7f173986e640 1 -- 172.21.15.37:0/293460935 >> v2:172.21.15.188:3300/0 conn(0x7f173415ce20 msgr2=0x7f173415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.346+0000 7f173986e640 1 --2- 172.21.15.37:0/293460935 >> v2:172.21.15.188:3300/0 conn(0x7f173415ce20 0x7f173415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.346+0000 7f173986e640 1 -- 172.21.15.37:0/293460935 >> v1:172.21.15.188:6789/0 conn(0x7f1734160b00 legacy=0x7f17340d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.346+0000 7f173986e640 1 -- 172.21.15.37:0/293460935 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173415e100 con 0x7f17340cfbe0 2023-11-24T06:17:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.347+0000 7f173986e640 1 --2- 172.21.15.37:0/293460935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340cfbe0 0x7f17340d0050 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f17341620e0 tx=0x7f172402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974bcf5d0708ee9e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.347+0000 7f173906d640 1 -- 172.21.15.37:0/293460935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724031870 con 0x7f17340cfbe0 2023-11-24T06:17:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.347+0000 7f173906d640 1 -- 172.21.15.37:0/293460935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17240319d0 con 0x7f17340cfbe0 2023-11-24T06:17:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.347+0000 7f173906d640 1 -- 172.21.15.37:0/293460935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724031d60 con 0x7f17340cfbe0 2023-11-24T06:17:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 -- 172.21.15.37:0/293460935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340cfbe0 msgr2=0x7f17340d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 --2- 172.21.15.37:0/293460935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340cfbe0 0x7f17340d0050 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f17341620e0 tx=0x7f172402b910 comp rx=0 tx=0).stop 2023-11-24T06:17:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 -- 172.21.15.37:0/293460935 shutdown_connections 2023-11-24T06:17:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 --2- 172.21.15.37:0/293460935 >> v2:172.21.15.188:3300/0 conn(0x7f173415ce20 0x7f173415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 --2- 172.21.15.37:0/293460935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340cfbe0 0x7f17340d0050 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 -- 172.21.15.37:0/293460935 >> 172.21.15.37:0/293460935 conn(0x7f173409c510 msgr2=0x7f17340d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 -- 172.21.15.37:0/293460935 shutdown_connections 2023-11-24T06:17:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.348+0000 7f173b071640 1 -- 172.21.15.37:0/293460935 wait complete. 2023-11-24T06:17:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.351+0000 7f173b071640 1 Processor -- start 2023-11-24T06:17:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.351+0000 7f173b071640 1 -- start start 2023-11-24T06:17:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.352+0000 7f173b071640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17340cfbe0 0x7f17340c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.352+0000 7f173b071640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f173415ce20 0x7f17341615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.352+0000 7f173b071640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1734160b00 0x7f17341f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.352+0000 7f173b071640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734153960 con 0x7f173415ce20 2023-11-24T06:17:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.352+0000 7f173b071640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340c9fd0 con 0x7f17340cfbe0 2023-11-24T06:17:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.352+0000 7f173b071640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340c89f0 con 0x7f1734160b00 2023-11-24T06:17:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.352+0000 7f173986e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f173415ce20 0x7f17341615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f173415ce20 0x7f17341615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44000/0 (socket says 172.21.15.37:44000) 2023-11-24T06:17:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 -- 172.21.15.37:0/1208620310 learned_addr learned my addr 172.21.15.37:0/1208620310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173a06f640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17340cfbe0 0x7f17340c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 -- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1734160b00 msgr2=0x7f17341f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1734160b00 0x7f17341f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 -- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17340cfbe0 msgr2=0x7f17340c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17340cfbe0 0x7f17340c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 -- 172.21.15.37:0/1208620310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240094d0 con 0x7f173415ce20 2023-11-24T06:17:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173a06f640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17340cfbe0 0x7f17340c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.353+0000 7f173986e640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f173415ce20 0x7f17341615a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1724000c00 tx=0x7f17240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.354+0000 7f172affd640 1 -- 172.21.15.37:0/1208620310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172403abe0 con 0x7f173415ce20 2023-11-24T06:17:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.354+0000 7f172affd640 1 -- 172.21.15.37:0/1208620310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172403ad40 con 0x7f173415ce20 2023-11-24T06:17:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.354+0000 7f172affd640 1 -- 172.21.15.37:0/1208620310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724044610 con 0x7f173415ce20 2023-11-24T06:17:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.354+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340c8cd0 con 0x7f173415ce20 2023-11-24T06:17:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.354+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17340c9290 con 0x7f173415ce20 2023-11-24T06:17:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.355+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173404e840 con 0x7f173415ce20 2023-11-24T06:17:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.357+0000 7f172affd640 1 -- 172.21.15.37:0/1208620310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f1724044770 con 0x7f173415ce20 2023-11-24T06:17:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.358+0000 7f172affd640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f171806aed0 0x7f171806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.359+0000 7f172affd640 1 -- 172.21.15.37:0/1208620310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f172402d040 con 0x7f173415ce20 2023-11-24T06:17:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.359+0000 7f173a06f640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f171806aed0 0x7f171806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.360+0000 7f173a06f640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f171806aed0 0x7f171806d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f173415ede0 tx=0x7f1730009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.363+0000 7f172affd640 1 -- 172.21.15.37:0/1208620310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1724076e90 con 0x7f173415ce20 2023-11-24T06:17:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:20.564+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f17340cf6e0 con 0x7f173415ce20 2023-11-24T06:17:21.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.105+0000 7f172affd640 1 -- 172.21.15.37:0/1208620310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1724035020 con 0x7f173415ce20 2023-11-24T06:17:21.108 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-11-24T06:17:21.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f171806aed0 msgr2=0x7f171806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f171806aed0 0x7f171806d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f173415ede0 tx=0x7f1730009040 comp rx=0 tx=0).stop 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f173415ce20 msgr2=0x7f17341615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f173415ce20 0x7f17341615a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1724000c00 tx=0x7f17240046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 shutdown_connections 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f171806aed0 0x7f171806d390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1734160b00 0x7f17341f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f173415ce20 0x7f17341615a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 --2- 172.21.15.37:0/1208620310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17340cfbe0 0x7f17340c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.110+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 >> 172.21.15.37:0/1208620310 conn(0x7f173409c510 msgr2=0x7f173406b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.111+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 shutdown_connections 2023-11-24T06:17:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.111+0000 7f173b071640 1 -- 172.21.15.37:0/1208620310 wait complete. 2023-11-24T06:17:21.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:17:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.343+0000 7fd65bf3c640 1 Processor -- start 2023-11-24T06:17:21.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.343+0000 7fd65bf3c640 1 -- start start 2023-11-24T06:17:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.345+0000 7fd65bf3c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd6540c59b0 0x7fd654166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.345+0000 7fd65bf3c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540c5dc0 con 0x7fd65415b440 2023-11-24T06:17:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.345+0000 7fd65bf3c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65415eea0 con 0x7fd6540cc0f0 2023-11-24T06:17:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.345+0000 7fd65bf3c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65415b820 con 0x7fd6540c59b0 2023-11-24T06:17:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.345+0000 7fd659cd8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd65415b440 0x7fd6540cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33038/0 (socket says 172.21.15.37:33038) 2023-11-24T06:17:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.345+0000 7fd659cd8640 1 -- 172.21.15.37:0/3392210744 learned_addr learned my addr 172.21.15.37:0/3392210744 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd65a4d9640 1 --2- 172.21.15.37:0/3392210744 >> v2:172.21.15.188:3300/0 conn(0x7fd6540c59b0 0x7fd654166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48137040 0 0) 0x7fd6540c5dc0 con 0x7fd65415b440 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd640003520 con 0x7fd65415b440 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3743722494 0 0) 0x7fd640003520 con 0x7fd65415b440 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 >> v2:172.21.15.188:3300/0 conn(0x7fd6540c59b0 msgr2=0x7fd654166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 --2- 172.21.15.37:0/3392210744 >> v2:172.21.15.188:3300/0 conn(0x7fd6540c59b0 0x7fd654166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 >> v1:172.21.15.188:6789/0 conn(0x7fd6540cc0f0 legacy=0x7fd6540c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65406d600 con 0x7fd65415b440 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd650001670 con 0x7fd65415b440 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 >> v1:172.21.15.37:6789/0 conn(0x7fd65415b440 legacy=0x7fd6540cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6400039c0 0x7fd640003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd640004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6400051d0 0x7fd64000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65415b820 con 0x7fd6400047c0 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64000c120 con 0x7fd6400051d0 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.346+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64000c2e0 con 0x7fd6400039c0 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd6594d7640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd640004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd659cd8640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6400039c0 0x7fd640003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd65a4d9640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6400051d0 0x7fd64000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd6594d7640 1 -- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6400039c0 msgr2=0x7fd640003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd6594d7640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6400039c0 0x7fd640003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd6594d7640 1 -- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6400051d0 msgr2=0x7fd64000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd6594d7640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6400051d0 0x7fd64000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd6594d7640 1 -- 172.21.15.37:0/3392210744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640003520 con 0x7fd6400047c0 2023-11-24T06:17:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd659cd8640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6400039c0 0x7fd640003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd65a4d9640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6400051d0 0x7fd64000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.347+0000 7fd65a4d9640 1 -- 172.21.15.37:0/3392210744 reap_dead start 2023-11-24T06:17:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.348+0000 7fd6594d7640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd640004c40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd644001720 tx=0x7fd6400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da053a61b27c844 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.348+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440052d0 con 0x7fd6400047c0 2023-11-24T06:17:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64402e050 con 0x7fd6400047c0 2023-11-24T06:17:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd658cd6640 1 -- 172.21.15.37:0/3392210744 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644003830 con 0x7fd6400047c0 2023-11-24T06:17:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd65bf3c640 1 -- 172.21.15.37:0/3392210744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 msgr2=0x7fd640004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd640004c40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd644001720 tx=0x7fd6400057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd65bf3c640 1 -- 172.21.15.37:0/3392210744 shutdown_connections 2023-11-24T06:17:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/3392210744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd640004c40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd65bf3c640 1 -- 172.21.15.37:0/3392210744 >> 172.21.15.37:0/3392210744 conn(0x7fd6540b0c50 msgr2=0x7fd6540b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd65bf3c640 1 -- 172.21.15.37:0/3392210744 shutdown_connections 2023-11-24T06:17:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.349+0000 7fd65bf3c640 1 -- 172.21.15.37:0/3392210744 wait complete. 2023-11-24T06:17:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.351+0000 7fd65bf3c640 1 Processor -- start 2023-11-24T06:17:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.351+0000 7fd65bf3c640 1 -- start start 2023-11-24T06:17:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.352+0000 7fd65bf3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd6540b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.352+0000 7fd65bf3c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6540cd780 0x7fd654150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.352+0000 7fd65bf3c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd654071240 0x7fd6540716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.352+0000 7fd65bf3c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65415aa10 con 0x7fd6400047c0 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.352+0000 7fd65bf3c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540ceae0 con 0x7fd654071240 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.352+0000 7fd65bf3c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654071c00 con 0x7fd6540cd780 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd6540b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd6540b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44300/0 (socket says 172.21.15.37:44300) 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 -- 172.21.15.37:0/1326114445 learned_addr learned my addr 172.21.15.37:0/1326114445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd6594d7640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6540cd780 0x7fd654150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd65a4d9640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd654071240 0x7fd6540716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 -- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6540cd780 msgr2=0x7fd654150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6540cd780 0x7fd654150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 -- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd654071240 msgr2=0x7fd6540716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd654071240 0x7fd6540716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd659cd8640 1 -- 172.21.15.37:0/1326114445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654150ff0 con 0x7fd6400047c0 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.353+0000 7fd6594d7640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6540cd780 0x7fd654150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.354+0000 7fd659cd8640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd6540b3c30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d720 tx=0x7fd65000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.354+0000 7fd64a7fc640 1 -- 172.21.15.37:0/1326114445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500074e0 con 0x7fd6400047c0 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.354+0000 7fd64a7fc640 1 -- 172.21.15.37:0/1326114445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd650007640 con 0x7fd6400047c0 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.354+0000 7fd64a7fc640 1 -- 172.21.15.37:0/1326114445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500049e0 con 0x7fd6400047c0 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.354+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6540cded0 con 0x7fd6400047c0 2023-11-24T06:17:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.354+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6540ce490 con 0x7fd6400047c0 2023-11-24T06:17:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.355+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65404e8b0 con 0x7fd6400047c0 2023-11-24T06:17:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.356+0000 7fd64a7fc640 1 -- 172.21.15.37:0/1326114445 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fd650004b40 con 0x7fd6400047c0 2023-11-24T06:17:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.358+0000 7fd64a7fc640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd63806aed0 0x7fd63806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.358+0000 7fd64a7fc640 1 -- 172.21.15.37:0/1326114445 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd650088e20 con 0x7fd6400047c0 2023-11-24T06:17:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.358+0000 7fd6594d7640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd63806aed0 0x7fd63806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.359+0000 7fd6594d7640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd63806aed0 0x7fd63806d390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd644033000 tx=0x7fd644009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.362+0000 7fd64a7fc640 1 -- 172.21.15.37:0/1326114445 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd650053f40 con 0x7fd6400047c0 2023-11-24T06:17:21.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.551+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd65415f980 con 0x7fd6400047c0 2023-11-24T06:17:21.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.558+0000 7fd64a7fc640 1 -- 172.21.15.37:0/1326114445 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd6500190a0 con 0x7fd6400047c0 2023-11-24T06:17:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.561+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd63806aed0 msgr2=0x7fd63806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.561+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd63806aed0 0x7fd63806d390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd644033000 tx=0x7fd644009030 comp rx=0 tx=0).stop 2023-11-24T06:17:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.561+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 msgr2=0x7fd6540b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.561+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd6540b3c30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d720 tx=0x7fd65000dbe0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 shutdown_connections 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd63806aed0 0x7fd63806d390 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd654071240 0x7fd6540716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6540cd780 0x7fd654150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 --2- 172.21.15.37:0/1326114445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6400047c0 0x7fd6540b3c30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 >> 172.21.15.37:0/1326114445 conn(0x7fd6540b0c50 msgr2=0x7fd6540c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 shutdown_connections 2023-11-24T06:17:21.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.562+0000 7fd65bf3c640 1 -- 172.21.15.37:0/1326114445 wait complete. 2023-11-24T06:17:21.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-11-24T06:17:21.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.788+0000 7f851d3db640 1 Processor -- start 2023-11-24T06:17:21.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.788+0000 7f851d3db640 1 -- start start 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f851d3db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85180d1740 0x7f85180ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f851d3db640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f85180b3880 0x7f85180b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f851d3db640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85180cecc0 con 0x7f85180d0f40 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f851d3db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85180cef60 con 0x7f85180d1740 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f851d3db640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85180b2ac0 con 0x7f85180b3880 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f8517fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85180d1740 0x7f85180ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f8517fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85180d1740 0x7f85180ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44306/0 (socket says 172.21.15.37:44306) 2023-11-24T06:17:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.790+0000 7f8517fff640 1 -- 172.21.15.37:0/1790060981 learned_addr learned my addr 172.21.15.37:0/1790060981 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.791+0000 7f851cbda640 1 --2- 172.21.15.37:0/1790060981 >> v2:172.21.15.188:3300/0 conn(0x7f85180b3880 0x7f85180b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.791+0000 7f8517fff640 1 -- 172.21.15.37:0/1790060981 >> v2:172.21.15.188:3300/0 conn(0x7f85180b3880 msgr2=0x7f85180b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.791+0000 7f8517fff640 1 --2- 172.21.15.37:0/1790060981 >> v2:172.21.15.188:3300/0 conn(0x7f85180b3880 0x7f85180b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.791+0000 7f8517fff640 1 -- 172.21.15.37:0/1790060981 >> v1:172.21.15.188:6789/0 conn(0x7f85180d0f40 legacy=0x7f85180d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.791+0000 7f8517fff640 1 -- 172.21.15.37:0/1790060981 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180b2da0 con 0x7f85180d1740 2023-11-24T06:17:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.792+0000 7f8517fff640 1 --2- 172.21.15.37:0/1790060981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180d1740 0x7f85180ce780 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f85180cf3d0 tx=0x7f850802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668955d96aa2cecb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f8516ffd640 1 -- 172.21.15.37:0/1790060981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508030860 con 0x7f85180d1740 2023-11-24T06:17:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f8516ffd640 1 -- 172.21.15.37:0/1790060981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85080309c0 con 0x7f85180d1740 2023-11-24T06:17:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f8516ffd640 1 -- 172.21.15.37:0/1790060981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508030d50 con 0x7f85180d1740 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f851d3db640 1 -- 172.21.15.37:0/1790060981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180d1740 msgr2=0x7f85180ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f851d3db640 1 --2- 172.21.15.37:0/1790060981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180d1740 0x7f85180ce780 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f85180cf3d0 tx=0x7f850802b9a0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f851d3db640 1 -- 172.21.15.37:0/1790060981 shutdown_connections 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f851d3db640 1 --2- 172.21.15.37:0/1790060981 >> v2:172.21.15.188:3300/0 conn(0x7f85180b3880 0x7f85180b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f851d3db640 1 --2- 172.21.15.37:0/1790060981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180d1740 0x7f85180ce780 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.793+0000 7f851d3db640 1 -- 172.21.15.37:0/1790060981 >> 172.21.15.37:0/1790060981 conn(0x7f851809c500 msgr2=0x7f85180d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.794+0000 7f851d3db640 1 -- 172.21.15.37:0/1790060981 shutdown_connections 2023-11-24T06:17:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.794+0000 7f851d3db640 1 -- 172.21.15.37:0/1790060981 wait complete. 2023-11-24T06:17:21.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.796+0000 7f851d3db640 1 Processor -- start 2023-11-24T06:17:21.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.796+0000 7f851d3db640 1 -- start start 2023-11-24T06:17:21.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.797+0000 7f851d3db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180b3880 0x7f85180a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f851d3db640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85180d0f40 0x7f851815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f851d3db640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f851815b3e0 0x7f8518159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f851d3db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180ca230 con 0x7f85180b3880 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f851d3db640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518160460 con 0x7f851815b3e0 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f851d3db640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85180a0d60 con 0x7f85180d0f40 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180b3880 0x7f85180a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180b3880 0x7f85180a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44316/0 (socket says 172.21.15.37:44316) 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 -- 172.21.15.37:0/2116567859 learned_addr learned my addr 172.21.15.37:0/2116567859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 -- 172.21.15.37:0/2116567859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85180d0f40 msgr2=0x7f851815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85180d0f40 0x7f851815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 -- 172.21.15.37:0/2116567859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f851815b3e0 msgr2=0x7f8518159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f851815b3e0 0x7f8518159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.798+0000 7f8517fff640 1 -- 172.21.15.37:0/2116567859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080094d0 con 0x7f85180b3880 2023-11-24T06:17:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.799+0000 7f8517fff640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180b3880 0x7f85180a0760 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8508000c00 tx=0x7f8508004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.799+0000 7f8514ff9640 1 -- 172.21.15.37:0/2116567859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508039d60 con 0x7f85180b3880 2023-11-24T06:17:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.799+0000 7f8514ff9640 1 -- 172.21.15.37:0/2116567859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8508043400 con 0x7f85180b3880 2023-11-24T06:17:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.799+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85180ca410 con 0x7f85180b3880 2023-11-24T06:17:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.799+0000 7f8514ff9640 1 -- 172.21.15.37:0/2116567859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508043790 con 0x7f85180b3880 2023-11-24T06:17:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.799+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85180ca9d0 con 0x7f85180b3880 2023-11-24T06:17:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.800+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85180cabc0 con 0x7f85180b3880 2023-11-24T06:17:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.801+0000 7f8514ff9640 1 -- 172.21.15.37:0/2116567859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f85080438f0 con 0x7f85180b3880 2023-11-24T06:17:21.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.802+0000 7f8514ff9640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f850406aed0 0x7f850406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:21.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.802+0000 7f8514ff9640 1 -- 172.21.15.37:0/2116567859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f850803e070 con 0x7f85180b3880 2023-11-24T06:17:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.802+0000 7f85177fe640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f850406aed0 0x7f850406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.803+0000 7f85177fe640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f850406aed0 0x7f850406d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85180cd780 tx=0x7f850c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:21.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:21.806+0000 7f8514ff9640 1 -- 172.21.15.37:0/2116567859 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8508077aa0 con 0x7f85180b3880 2023-11-24T06:17:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.069+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f851804e840 con 0x7f85180b3880 2023-11-24T06:17:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.108+0000 7f8514ff9640 1 -- 172.21.15.37:0/2116567859 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v162) v1 ==== 133+0+0 (secure 0 0 0) 0x7f850807b0c0 con 0x7f85180b3880 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f850406aed0 msgr2=0x7f850406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f850406aed0 0x7f850406d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85180cd780 tx=0x7f850c0079b0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180b3880 msgr2=0x7f85180a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180b3880 0x7f85180a0760 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8508000c00 tx=0x7f8508004730 comp rx=0 tx=0).stop 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 shutdown_connections 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f850406aed0 0x7f850406d390 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f851815b3e0 0x7f8518159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85180d0f40 0x7f851815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 --2- 172.21.15.37:0/2116567859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85180b3880 0x7f85180a0760 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 >> 172.21.15.37:0/2116567859 conn(0x7f851809c500 msgr2=0x7f851806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 shutdown_connections 2023-11-24T06:17:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.112+0000 7f851d3db640 1 -- 172.21.15.37:0/2116567859 wait complete. 2023-11-24T06:17:22.135 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2023-11-24T06:17:22.135 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2023-11-24T06:17:22.135 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-11-24T06:17:22.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.364+0000 7f7a9d485640 1 Processor -- start 2023-11-24T06:17:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.364+0000 7f7a9d485640 1 -- start start 2023-11-24T06:17:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.365+0000 7f7a9d485640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a9815d4e0 0x7f7a980d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.365+0000 7f7a9d485640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a980d38e0 0x7f7a980cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.365+0000 7f7a9d485640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a980ce990 con 0x7f7a980d0070 2023-11-24T06:17:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.365+0000 7f7a9d485640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a980d4110 con 0x7f7a980d38e0 2023-11-24T06:17:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.365+0000 7f7a9d485640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980d04e0 con 0x7f7a9815d4e0 2023-11-24T06:17:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.366+0000 7f7a97fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a9815d4e0 0x7f7a980d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.366+0000 7f7a977fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a980d38e0 0x7f7a980cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.367+0000 7f7a977fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a980d38e0 0x7f7a980cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:48270/0 (socket says 172.21.15.37:48270) 2023-11-24T06:17:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.367+0000 7f7a977fe640 1 -- 172.21.15.37:0/2010372157 learned_addr learned my addr 172.21.15.37:0/2010372157 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.367+0000 7f7a9cc84640 1 --1- 172.21.15.37:0/2010372157 >> v1:172.21.15.188:6789/0 conn(0x7f7a980d0070 0x7f7a980d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:55934/0 (socket says 172.21.15.37:55934) 2023-11-24T06:17:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.367+0000 7f7a97fff640 1 -- 172.21.15.37:0/2010372157 >> v2:172.21.15.188:3300/0 conn(0x7f7a980d38e0 msgr2=0x7f7a980cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.367+0000 7f7a97fff640 1 --2- 172.21.15.37:0/2010372157 >> v2:172.21.15.188:3300/0 conn(0x7f7a980d38e0 0x7f7a980cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.368+0000 7f7a97fff640 1 -- 172.21.15.37:0/2010372157 >> v1:172.21.15.188:6789/0 conn(0x7f7a980d0070 legacy=0x7f7a980d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.368+0000 7f7a97fff640 1 -- 172.21.15.37:0/2010372157 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a980cec70 con 0x7f7a9815d4e0 2023-11-24T06:17:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.368+0000 7f7a977fe640 1 --2- 172.21.15.37:0/2010372157 >> v2:172.21.15.188:3300/0 conn(0x7f7a980d38e0 0x7f7a980cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.369+0000 7f7a97fff640 1 --2- 172.21.15.37:0/2010372157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a9815d4e0 0x7f7a980d1e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009d90 tx=0x7f7a8802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a61aae17ac6fc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.370+0000 7f7a96ffd640 1 -- 172.21.15.37:0/2010372157 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8802cc50 con 0x7f7a9815d4e0 2023-11-24T06:17:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.370+0000 7f7a96ffd640 1 -- 172.21.15.37:0/2010372157 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8802cdb0 con 0x7f7a9815d4e0 2023-11-24T06:17:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.370+0000 7f7a96ffd640 1 -- 172.21.15.37:0/2010372157 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88034660 con 0x7f7a9815d4e0 2023-11-24T06:17:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.370+0000 7f7a9d485640 1 -- 172.21.15.37:0/2010372157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a9815d4e0 msgr2=0x7f7a980d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.370+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2010372157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a9815d4e0 0x7f7a980d1e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009d90 tx=0x7f7a8802bea0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.371+0000 7f7a9d485640 1 -- 172.21.15.37:0/2010372157 shutdown_connections 2023-11-24T06:17:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.371+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2010372157 >> v2:172.21.15.188:3300/0 conn(0x7f7a980d38e0 0x7f7a980cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.371+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2010372157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a9815d4e0 0x7f7a980d1e20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.371+0000 7f7a9d485640 1 -- 172.21.15.37:0/2010372157 >> 172.21.15.37:0/2010372157 conn(0x7f7a9809c510 msgr2=0x7f7a980d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.371+0000 7f7a9d485640 1 -- 172.21.15.37:0/2010372157 shutdown_connections 2023-11-24T06:17:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.371+0000 7f7a9d485640 1 -- 172.21.15.37:0/2010372157 wait complete. 2023-11-24T06:17:22.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.373+0000 7f7a9d485640 1 Processor -- start 2023-11-24T06:17:22.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.373+0000 7f7a9d485640 1 -- start start 2023-11-24T06:17:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a9d485640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a980d0070 0x7f7a980b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a9d485640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a980d38e0 0x7f7a9815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a9d485640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a9815d4e0 0x7f7a981f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a9d485640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980b6a30 con 0x7f7a980d0070 2023-11-24T06:17:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a9d485640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980b6d10 con 0x7f7a9815d4e0 2023-11-24T06:17:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a9d485640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980b6ff0 con 0x7f7a980d38e0 2023-11-24T06:17:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a97fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a980d0070 0x7f7a980b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a97fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a980d0070 0x7f7a980b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44320/0 (socket says 172.21.15.37:44320) 2023-11-24T06:17:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a97fff640 1 -- 172.21.15.37:0/2336095190 learned_addr learned my addr 172.21.15.37:0/2336095190 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a977fe640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a980d38e0 0x7f7a9815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a9cc84640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a9815d4e0 0x7f7a981f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a97fff640 1 -- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a980d38e0 msgr2=0x7f7a9815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a97fff640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a980d38e0 0x7f7a9815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a97fff640 1 -- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a9815d4e0 msgr2=0x7f7a981f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.375+0000 7f7a97fff640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a9815d4e0 0x7f7a981f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a97fff640 1 -- 172.21.15.37:0/2336095190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800094d0 con 0x7f7a980d0070 2023-11-24T06:17:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a977fe640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a980d38e0 0x7f7a9815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a97fff640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a980d0070 0x7f7a980b6450 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009eb0 tx=0x7f7a88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a94ff9640 1 -- 172.21.15.37:0/2336095190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8803e610 con 0x7f7a980d0070 2023-11-24T06:17:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a94ff9640 1 -- 172.21.15.37:0/2336095190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8803e790 con 0x7f7a980d0070 2023-11-24T06:17:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a94ff9640 1 -- 172.21.15.37:0/2336095190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8803eb40 con 0x7f7a980d0070 2023-11-24T06:17:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a88009a70 con 0x7f7a980d0070 2023-11-24T06:17:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.376+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a980b75b0 con 0x7f7a980d0070 2023-11-24T06:17:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.378+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9804e840 con 0x7f7a980d0070 2023-11-24T06:17:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.379+0000 7f7a94ff9640 1 -- 172.21.15.37:0/2336095190 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f7a8803b050 con 0x7f7a980d0070 2023-11-24T06:17:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.379+0000 7f7a94ff9640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a7806af20 0x7f7a7806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.380+0000 7f7a94ff9640 1 -- 172.21.15.37:0/2336095190 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a880abdb0 con 0x7f7a980d0070 2023-11-24T06:17:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.380+0000 7f7a977fe640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a7806af20 0x7f7a7806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.381+0000 7f7a977fe640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a7806af20 0x7f7a7806d3e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a98160730 tx=0x7f7a80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:22.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.384+0000 7f7a94ff9640 1 -- 172.21.15.37:0/2336095190 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a880b0070 con 0x7f7a980d0070 2023-11-24T06:17:22.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.579+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a98160a70 con 0x7f7a980d0070 2023-11-24T06:17:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.581+0000 7f7a94ff9640 1 -- 172.21.15.37:0/2336095190 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12950 (secure 0 0 0) 0x7f7a88039090 con 0x7f7a980d0070 2023-11-24T06:17:22.584 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:21.094980+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6837/1413576215":"2023-11-25T06:17:17.920633+0000","172.21.15.37:6836/1413576215":"2023-11-25T06:17:17.920633+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.583+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a7806af20 msgr2=0x7f7a7806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.583+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a7806af20 0x7f7a7806d3e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a98160730 tx=0x7f7a80008040 comp rx=0 tx=0).stop 2023-11-24T06:17:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.583+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a980d0070 msgr2=0x7f7a980b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.583+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a980d0070 0x7f7a980b6450 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009eb0 tx=0x7f7a88004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 shutdown_connections 2023-11-24T06:17:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a7806af20 0x7f7a7806d3e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a9815d4e0 0x7f7a981f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a980d38e0 0x7f7a9815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 --2- 172.21.15.37:0/2336095190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a980d0070 0x7f7a980b6450 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 >> 172.21.15.37:0/2336095190 conn(0x7f7a9809c510 msgr2=0x7f7a980b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 shutdown_connections 2023-11-24T06:17:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.584+0000 7f7a9d485640 1 -- 172.21.15.37:0/2336095190 wait complete. 2023-11-24T06:17:22.607 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:22.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:22.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.832+0000 7f693a683640 1 Processor -- start 2023-11-24T06:17:22.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.833+0000 7f693a683640 1 -- start start 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f693a683640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6934146470 0x7f69340b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f693a683640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f69340709e0 0x7f6934070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f693a683640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6934071330 con 0x7f69340ac840 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f693a683640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6934146850 con 0x7f6934146470 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f693a683640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693406cf90 con 0x7f69340709e0 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f69337fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f69340ac840 0x7f69340b3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33048/0 (socket says 172.21.15.37:33048) 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f69337fe640 1 -- 172.21.15.37:0/2076055990 learned_addr learned my addr 172.21.15.37:0/2076055990 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.834+0000 7f6933fff640 1 --2- 172.21.15.37:0/2076055990 >> v2:172.21.15.37:3300/0 conn(0x7f6934146470 0x7f69340b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.835+0000 7f6938c20640 1 --2- 172.21.15.37:0/2076055990 >> v2:172.21.15.188:3300/0 conn(0x7f69340709e0 0x7f6934070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.835+0000 7f6933fff640 1 -- 172.21.15.37:0/2076055990 >> v2:172.21.15.188:3300/0 conn(0x7f69340709e0 msgr2=0x7f6934070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.835+0000 7f6933fff640 1 --2- 172.21.15.37:0/2076055990 >> v2:172.21.15.188:3300/0 conn(0x7f69340709e0 0x7f6934070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.835+0000 7f6933fff640 1 -- 172.21.15.37:0/2076055990 >> v1:172.21.15.37:6789/0 conn(0x7f69340ac840 legacy=0x7f69340b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.835+0000 7f6932ffd640 1 -- 172.21.15.37:0/2076055990 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668982722 0 0) 0x7f6934071330 con 0x7f69340ac840 2023-11-24T06:17:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.835+0000 7f6933fff640 1 -- 172.21.15.37:0/2076055990 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693406d230 con 0x7f6934146470 2023-11-24T06:17:22.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.835+0000 7f6938c20640 1 --2- 172.21.15.37:0/2076055990 >> v2:172.21.15.188:3300/0 conn(0x7f69340709e0 0x7f6934070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.836+0000 7f6933fff640 1 --2- 172.21.15.37:0/2076055990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6934146470 0x7f69340b2400 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6934073ee0 tx=0x7f692402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeda88c2df2a11ea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.836+0000 7f6932ffd640 1 -- 172.21.15.37:0/2076055990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031520 con 0x7f6934146470 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.836+0000 7f6932ffd640 1 -- 172.21.15.37:0/2076055990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924031680 con 0x7f6934146470 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.836+0000 7f6932ffd640 1 -- 172.21.15.37:0/2076055990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031a10 con 0x7f6934146470 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 -- 172.21.15.37:0/2076055990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6934146470 msgr2=0x7f69340b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 --2- 172.21.15.37:0/2076055990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6934146470 0x7f69340b2400 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6934073ee0 tx=0x7f692402b7c0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 -- 172.21.15.37:0/2076055990 shutdown_connections 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 --2- 172.21.15.37:0/2076055990 >> v2:172.21.15.188:3300/0 conn(0x7f69340709e0 0x7f6934070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 --2- 172.21.15.37:0/2076055990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6934146470 0x7f69340b2400 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 -- 172.21.15.37:0/2076055990 >> 172.21.15.37:0/2076055990 conn(0x7f6934061340 msgr2=0x7f693406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 -- 172.21.15.37:0/2076055990 shutdown_connections 2023-11-24T06:17:22.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.837+0000 7f693a683640 1 -- 172.21.15.37:0/2076055990 wait complete. 2023-11-24T06:17:22.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.839+0000 7f693a683640 1 Processor -- start 2023-11-24T06:17:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.839+0000 7f693a683640 1 -- start start 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.840+0000 7f693a683640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69340709e0 0x7f69341faaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.840+0000 7f693a683640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69340ac840 0x7f693413f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.840+0000 7f693a683640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6934146470 0x7f693413fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.840+0000 7f693a683640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69341402b0 con 0x7f69340709e0 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.840+0000 7f693a683640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69341fa680 con 0x7f6934146470 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.840+0000 7f693a683640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69341404f0 con 0x7f69340ac840 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69340709e0 0x7f69341faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69340709e0 0x7f69341faaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44348/0 (socket says 172.21.15.37:44348) 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 -- 172.21.15.37:0/3813749174 learned_addr learned my addr 172.21.15.37:0/3813749174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f69337fe640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69340ac840 0x7f693413f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 -- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69340ac840 msgr2=0x7f693413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69340ac840 0x7f693413f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6938c20640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6934146470 0x7f693413fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 -- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6934146470 msgr2=0x7f693413fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6934146470 0x7f693413fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6933fff640 1 -- 172.21.15.37:0/3813749174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924009400 con 0x7f69340709e0 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.841+0000 7f6938c20640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6934146470 0x7f693413fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.842+0000 7f6933fff640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69340709e0 0x7f69341faaf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6924000c00 tx=0x7f69240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.842+0000 7f6930ff9640 1 -- 172.21.15.37:0/3813749174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031520 con 0x7f69340709e0 2023-11-24T06:17:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.842+0000 7f6930ff9640 1 -- 172.21.15.37:0/3813749174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924033c70 con 0x7f69340709e0 2023-11-24T06:17:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.842+0000 7f6930ff9640 1 -- 172.21.15.37:0/3813749174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692403c400 con 0x7f69340709e0 2023-11-24T06:17:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.842+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69341407d0 con 0x7f69340709e0 2023-11-24T06:17:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.842+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6934140d90 con 0x7f69340709e0 2023-11-24T06:17:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.843+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693404e8b0 con 0x7f69340709e0 2023-11-24T06:17:22.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.844+0000 7f6930ff9640 1 -- 172.21.15.37:0/3813749174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f692403a040 con 0x7f69340709e0 2023-11-24T06:17:22.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.845+0000 7f6930ff9640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f692006af00 0x7f692006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:22.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.845+0000 7f6930ff9640 1 -- 172.21.15.37:0/3813749174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f69240aaf50 con 0x7f69340709e0 2023-11-24T06:17:22.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.846+0000 7f69337fe640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f692006af00 0x7f692006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:22.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.846+0000 7f69337fe640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f692006af00 0x7f692006d3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6934141520 tx=0x7f6928007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:22.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:22.850+0000 7f6930ff9640 1 -- 172.21.15.37:0/3813749174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69240762b0 con 0x7f69340709e0 2023-11-24T06:17:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.044+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f693406b250 con 0x7f69340709e0 2023-11-24T06:17:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.045+0000 7f6930ff9640 1 -- 172.21.15.37:0/3813749174 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f692404d0a0 con 0x7f69340709e0 2023-11-24T06:17:23.048 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f692006af00 msgr2=0x7f692006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f692006af00 0x7f692006d3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6934141520 tx=0x7f6928007c00 comp rx=0 tx=0).stop 2023-11-24T06:17:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69340709e0 msgr2=0x7f69341faaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69340709e0 0x7f69341faaf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6924000c00 tx=0x7f69240046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 shutdown_connections 2023-11-24T06:17:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f692006af00 0x7f692006d3c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6934146470 0x7f693413fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69340ac840 0x7f693413f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 --2- 172.21.15.37:0/3813749174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69340709e0 0x7f69341faaf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 >> 172.21.15.37:0/3813749174 conn(0x7f6934061340 msgr2=0x7f69340aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 shutdown_connections 2023-11-24T06:17:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.048+0000 7f693a683640 1 -- 172.21.15.37:0/3813749174 wait complete. 2023-11-24T06:17:23.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-11-24T06:17:23.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.280+0000 7f2853fff640 1 Processor -- start 2023-11-24T06:17:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.280+0000 7f2853fff640 1 -- start start 2023-11-24T06:17:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.281+0000 7f2853fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 0x7f28540cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.281+0000 7f2853fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f28540d0070 0x7f28540b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.281+0000 7f2853fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540d04b0 con 0x7f285415d4e0 2023-11-24T06:17:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.281+0000 7f2853fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28540d4110 con 0x7f28540d0070 2023-11-24T06:17:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.281+0000 7f2853fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28540ce990 con 0x7f28540d1e20 2023-11-24T06:17:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f2852ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f285415d4e0 0x7f28540d38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33064/0 (socket says 172.21.15.37:33064) 2023-11-24T06:17:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f2852ffd640 1 -- 172.21.15.37:0/2818944316 learned_addr learned my addr 172.21.15.37:0/2818944316 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137498305 0 0) 0x7f28540d04b0 con 0x7f285415d4e0 2023-11-24T06:17:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2840003520 con 0x7f285415d4e0 2023-11-24T06:17:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f28537fe640 1 --2- 172.21.15.37:0/2818944316 >> v2:172.21.15.188:3300/0 conn(0x7f28540d0070 0x7f28540b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f28527fc640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 0x7f28540cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 768137739 0 0) 0x7f2840003520 con 0x7f285415d4e0 2023-11-24T06:17:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.282+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 msgr2=0x7f28540cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 0x7f28540cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 >> v2:172.21.15.188:3300/0 conn(0x7f28540d0070 msgr2=0x7f28540b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 --2- 172.21.15.37:0/2818944316 >> v2:172.21.15.188:3300/0 conn(0x7f28540d0070 0x7f28540b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540cec70 con 0x7f285415d4e0 2023-11-24T06:17:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f28440019f0 con 0x7f285415d4e0 2023-11-24T06:17:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 >> v1:172.21.15.37:6789/0 conn(0x7f285415d4e0 legacy=0x7f28540d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2840003970 0x7f2840003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28400047c0 0x7f2840004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 0x7f2840005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540d4110 con 0x7f2840003970 2023-11-24T06:17:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540ce990 con 0x7f28400047c0 2023-11-24T06:17:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284000ba30 con 0x7f28540d1e20 2023-11-24T06:17:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2852ffd640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2840003970 0x7f2840003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f28537fe640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 0x7f2840005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f28527fc640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28400047c0 0x7f2840004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2852ffd640 1 -- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 msgr2=0x7f2840005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2852ffd640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 0x7f2840005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2852ffd640 1 -- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28400047c0 msgr2=0x7f2840004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2852ffd640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28400047c0 0x7f2840004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.283+0000 7f2852ffd640 1 -- 172.21.15.37:0/2818944316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840003520 con 0x7f2840003970 2023-11-24T06:17:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.284+0000 7f28537fe640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28540d1e20 0x7f2840005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.284+0000 7f28527fc640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28400047c0 0x7f2840004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2852ffd640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2840003970 0x7f2840003d90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2844002230 tx=0x7f28400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81311395756e5a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844034630 con 0x7f2840003970 2023-11-24T06:17:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284402f070 con 0x7f2840003970 2023-11-24T06:17:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2851ffb640 1 -- 172.21.15.37:0/2818944316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440349d0 con 0x7f2840003970 2023-11-24T06:17:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2853fff640 1 -- 172.21.15.37:0/2818944316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2840003970 msgr2=0x7f2840003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2853fff640 1 --2- 172.21.15.37:0/2818944316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2840003970 0x7f2840003d90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2844002230 tx=0x7f28400057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f28537fe640 1 -- 172.21.15.37:0/2818944316 reap_dead start 2023-11-24T06:17:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2853fff640 1 -- 172.21.15.37:0/2818944316 shutdown_connections 2023-11-24T06:17:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.285+0000 7f2853fff640 1 -- 172.21.15.37:0/2818944316 >> 172.21.15.37:0/2818944316 conn(0x7f285409c510 msgr2=0x7f28540d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.286+0000 7f2853fff640 1 -- 172.21.15.37:0/2818944316 shutdown_connections 2023-11-24T06:17:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.286+0000 7f2853fff640 1 -- 172.21.15.37:0/2818944316 wait complete. 2023-11-24T06:17:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.287+0000 7f2853fff640 1 Processor -- start 2023-11-24T06:17:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.288+0000 7f2853fff640 1 -- start start 2023-11-24T06:17:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.288+0000 7f2853fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2840003970 0x7f28540c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f2853fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28541599d0 0x7f28541590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f2853fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540cabc0 0x7f28540cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f2853fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540cb5b0 con 0x7f28540cabc0 2023-11-24T06:17:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f2853fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540b6ab0 con 0x7f2840003970 2023-11-24T06:17:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f2853fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28540b7070 con 0x7f28541599d0 2023-11-24T06:17:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540cabc0 0x7f28540cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540cabc0 0x7f28540cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44354/0 (socket says 172.21.15.37:44354) 2023-11-24T06:17:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 -- 172.21.15.37:0/110278457 learned_addr learned my addr 172.21.15.37:0/110278457 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f2852ffd640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2840003970 0x7f28540c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28527fc640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28541599d0 0x7f28541590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 -- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28541599d0 msgr2=0x7f28541590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28541599d0 0x7f28541590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 -- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2840003970 msgr2=0x7f28540c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2840003970 0x7f28540c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.289+0000 7f28537fe640 1 -- 172.21.15.37:0/110278457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540cce20 con 0x7f28540cabc0 2023-11-24T06:17:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.290+0000 7f28537fe640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540cabc0 0x7f28540cb070 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f285409cc40 tx=0x7f284c00e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.290+0000 7f284b7fe640 1 -- 172.21.15.37:0/110278457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c00c070 con 0x7f28540cabc0 2023-11-24T06:17:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.290+0000 7f284b7fe640 1 -- 172.21.15.37:0/110278457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c013610 con 0x7f28540cabc0 2023-11-24T06:17:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.290+0000 7f284b7fe640 1 -- 172.21.15.37:0/110278457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0139c0 con 0x7f28540cabc0 2023-11-24T06:17:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.290+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28540cd100 con 0x7f28540cabc0 2023-11-24T06:17:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.290+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2854159630 con 0x7f28540cabc0 2023-11-24T06:17:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.291+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285404e840 con 0x7f28540cabc0 2023-11-24T06:17:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.292+0000 7f284b7fe640 1 -- 172.21.15.37:0/110278457 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f284c013b20 con 0x7f28540cabc0 2023-11-24T06:17:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.294+0000 7f284b7fe640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283406af00 0x7f283406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.294+0000 7f284b7fe640 1 -- 172.21.15.37:0/110278457 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f284c088ed0 con 0x7f28540cabc0 2023-11-24T06:17:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.294+0000 7f2852ffd640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283406af00 0x7f283406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.295+0000 7f2852ffd640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283406af00 0x7f283406d3c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2844034000 tx=0x7f2844009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.298+0000 7f284b7fe640 1 -- 172.21.15.37:0/110278457 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f284c054110 con 0x7f28540cabc0 2023-11-24T06:17:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:23.557+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f28540b71b0 con 0x7f28540cabc0 2023-11-24T06:17:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.120+0000 7f284b7fe640 1 -- 172.21.15.37:0/110278457 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v164) v1 ==== 161+0+0 (secure 0 0 0) 0x7f284c006c30 con 0x7f28540cabc0 2023-11-24T06:17:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283406af00 msgr2=0x7f283406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283406af00 0x7f283406d3c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2844034000 tx=0x7f2844009030 comp rx=0 tx=0).stop 2023-11-24T06:17:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540cabc0 msgr2=0x7f28540cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540cabc0 0x7f28540cb070 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f285409cc40 tx=0x7f284c00e770 comp rx=0 tx=0).stop 2023-11-24T06:17:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 shutdown_connections 2023-11-24T06:17:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f283406af00 0x7f283406d3c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540cabc0 0x7f28540cb070 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28541599d0 0x7f28541590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 --2- 172.21.15.37:0/110278457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2840003970 0x7f28540c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.124+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 >> 172.21.15.37:0/110278457 conn(0x7f285409c510 msgr2=0x7f28540b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.125+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 shutdown_connections 2023-11-24T06:17:24.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.125+0000 7f2853fff640 1 -- 172.21.15.37:0/110278457 wait complete. 2023-11-24T06:17:24.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:17:24.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.368+0000 7f85e1b9e640 1 Processor -- start 2023-11-24T06:17:24.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.369+0000 7f85e1b9e640 1 -- start start 2023-11-24T06:17:24.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.370+0000 7f85e1b9e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 0x7f85dc0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85e1b9e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f85dc0b3550 0x7f85dc15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85e1b9e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc15c650 con 0x7f85dc15be20 2023-11-24T06:17:24.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85e1b9e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc0b39d0 con 0x7f85dc0b3550 2023-11-24T06:17:24.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85e1b9e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc15edb0 con 0x7f85dc13e1b0 2023-11-24T06:17:24.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85e139d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85dc15be20 0x7f85dc0d1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33078/0 (socket says 172.21.15.37:33078) 2023-11-24T06:17:24.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85e139d640 1 -- 172.21.15.37:0/888569293 learned_addr learned my addr 172.21.15.37:0/888569293 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504559709 0 0) 0x7f85dc15c650 con 0x7f85dc15be20 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c4003520 con 0x7f85dc15be20 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.371+0000 7f85d3fff640 1 --2- 172.21.15.37:0/888569293 >> v2:172.21.15.188:3300/0 conn(0x7f85dc0b3550 0x7f85dc15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85e0b9c640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 0x7f85dc0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2168806610 0 0) 0x7f85c4003520 con 0x7f85dc15be20 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 msgr2=0x7f85dc0b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 0x7f85dc0b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 >> v2:172.21.15.188:3300/0 conn(0x7f85dc0b3550 msgr2=0x7f85dc15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 --2- 172.21.15.37:0/888569293 >> v2:172.21.15.188:3300/0 conn(0x7f85dc0b3550 0x7f85dc15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc15f090 con 0x7f85dc15be20 2023-11-24T06:17:24.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f85d40019f0 con 0x7f85dc15be20 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 >> v1:172.21.15.37:6789/0 conn(0x7f85dc15be20 legacy=0x7f85dc0d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c4003970 0x7f85c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 0x7f85c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c4004d00 0x7f85c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0b39d0 con 0x7f85c4003970 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc15edb0 con 0x7f85c4004d00 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c400bab0 con 0x7f85dc13e1b0 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.372+0000 7f85e0b9c640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c4003970 0x7f85c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85d3fff640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 0x7f85c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85e139d640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c4004d00 0x7f85c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85e0b9c640 1 -- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 msgr2=0x7f85c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85e0b9c640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 0x7f85c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85e0b9c640 1 -- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c4004d00 msgr2=0x7f85c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:24.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85e0b9c640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c4004d00 0x7f85c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85e0b9c640 1 -- 172.21.15.37:0/888569293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4003520 con 0x7f85c4003970 2023-11-24T06:17:24.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85d3fff640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85dc13e1b0 0x7f85c40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:24.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.373+0000 7f85e139d640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85c4004d00 0x7f85c4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:24.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.374+0000 7f85e0b9c640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c4003970 0x7f85c4003d90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba30 tx=0x7f85c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d3c1a38d4d5b32 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:24.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.374+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8032640 con 0x7f85c4003970 2023-11-24T06:17:24.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.374+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d80327a0 con 0x7f85c4003970 2023-11-24T06:17:24.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.374+0000 7f85d37fe640 1 -- 172.21.15.37:0/888569293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8032b30 con 0x7f85c4003970 2023-11-24T06:17:24.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.375+0000 7f85e1b9e640 1 -- 172.21.15.37:0/888569293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c4003970 msgr2=0x7f85c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.375+0000 7f85e1b9e640 1 --2- 172.21.15.37:0/888569293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c4003970 0x7f85c4003d90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba30 tx=0x7f85c40057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.375+0000 7f85e139d640 1 -- 172.21.15.37:0/888569293 reap_dead start 2023-11-24T06:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.375+0000 7f85e1b9e640 1 -- 172.21.15.37:0/888569293 shutdown_connections 2023-11-24T06:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.375+0000 7f85e1b9e640 1 -- 172.21.15.37:0/888569293 >> 172.21.15.37:0/888569293 conn(0x7f85dc061100 msgr2=0x7f85dc061510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.375+0000 7f85e1b9e640 1 -- 172.21.15.37:0/888569293 shutdown_connections 2023-11-24T06:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.375+0000 7f85e1b9e640 1 -- 172.21.15.37:0/888569293 wait complete. 2023-11-24T06:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.377+0000 7f85e1b9e640 1 Processor -- start 2023-11-24T06:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.377+0000 7f85e1b9e640 1 -- start start 2023-11-24T06:17:24.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85e1b9e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85c4003970 0x7f85dc0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85e1b9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85dc1e4a90 0x7f85dc13ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85e1b9e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85dc0ac840 0x7f85dc1e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85e1b9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0afdd0 con 0x7f85dc1e4a90 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85e1b9e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0b00b0 con 0x7f85dc0ac840 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85e1b9e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0b60c0 con 0x7f85c4003970 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85dc1e4a90 0x7f85dc13ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85dc1e4a90 0x7f85dc13ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44368/0 (socket says 172.21.15.37:44368) 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 -- 172.21.15.37:0/326098124 learned_addr learned my addr 172.21.15.37:0/326098124 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 -- 172.21.15.37:0/326098124 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85c4003970 msgr2=0x7f85dc0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85c4003970 0x7f85dc0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 -- 172.21.15.37:0/326098124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85dc0ac840 msgr2=0x7f85dc1e5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85dc0ac840 0x7f85dc1e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.378+0000 7f85d3fff640 1 -- 172.21.15.37:0/326098124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0b63a0 con 0x7f85dc1e4a90 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.379+0000 7f85d3fff640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85dc1e4a90 0x7f85dc13ab30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00e7e0 tx=0x7f85cc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.379+0000 7f85d17fa640 1 -- 172.21.15.37:0/326098124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00c8d0 con 0x7f85dc1e4a90 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.379+0000 7f85d17fa640 1 -- 172.21.15.37:0/326098124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00ca30 con 0x7f85dc1e4a90 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.379+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc06c020 con 0x7f85dc1e4a90 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.379+0000 7f85d17fa640 1 -- 172.21.15.37:0/326098124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00cda0 con 0x7f85dc1e4a90 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.379+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc0acea0 con 0x7f85dc1e4a90 2023-11-24T06:17:24.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.380+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc15f890 con 0x7f85dc1e4a90 2023-11-24T06:17:24.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.381+0000 7f85d17fa640 1 -- 172.21.15.37:0/326098124 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f85cc013410 con 0x7f85dc1e4a90 2023-11-24T06:17:24.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.382+0000 7f85d17fa640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f85c806af00 0x7f85c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:24.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.382+0000 7f85d17fa640 1 -- 172.21.15.37:0/326098124 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85cc0892c0 con 0x7f85dc1e4a90 2023-11-24T06:17:24.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.383+0000 7f85e0b9c640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f85c806af00 0x7f85c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:24.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.383+0000 7f85e0b9c640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f85c806af00 0x7f85c806d3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba00 tx=0x7f85d8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:24.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.386+0000 7f85d17fa640 1 -- 172.21.15.37:0/326098124 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85cc054470 con 0x7f85dc1e4a90 2023-11-24T06:17:24.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.580+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f85dc067470 con 0x7f85dc1e4a90 2023-11-24T06:17:24.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.587+0000 7f85d17fa640 1 -- 172.21.15.37:0/326098124 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85cc057a90 con 0x7f85dc1e4a90 2023-11-24T06:17:24.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.589+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f85c806af00 msgr2=0x7f85c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.589+0000 7f85e1b9e640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f85c806af00 0x7f85c806d3c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba00 tx=0x7f85d8032000 comp rx=0 tx=0).stop 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.589+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85dc1e4a90 msgr2=0x7f85dc13ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.589+0000 7f85e1b9e640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85dc1e4a90 0x7f85dc13ab30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00e7e0 tx=0x7f85cc00eca0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 shutdown_connections 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f85c806af00 0x7f85c806d3c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85dc0ac840 0x7f85dc1e5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85dc1e4a90 0x7f85dc13ab30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 --2- 172.21.15.37:0/326098124 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85c4003970 0x7f85dc0b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 >> 172.21.15.37:0/326098124 conn(0x7f85dc061100 msgr2=0x7f85dc15e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 shutdown_connections 2023-11-24T06:17:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:24.590+0000 7f85e1b9e640 1 -- 172.21.15.37:0/326098124 wait complete. 2023-11-24T06:17:24.612 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:17:24.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:17:24.737 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:17:24.866 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:17:24.866 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:24.866 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:24.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:17:24.930 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:24.930 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:24.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:17:24.989 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:24.989 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:25.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:17:25.054 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:25.054 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:25.113 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:17:25.191 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:17:25.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:25.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.424+0000 7f31fe044640 1 Processor -- start 2023-11-24T06:17:25.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.425+0000 7f31fe044640 1 -- start start 2023-11-24T06:17:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.426+0000 7f31fe044640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f815c7f0 0x7f31f806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.426+0000 7f31fe044640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31f80cf450 0x7f31f80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.426+0000 7f31fe044640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f31f80cdfb0 0x7f31f80ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.426+0000 7f31fe044640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f8156010 con 0x7f31f80cf450 2023-11-24T06:17:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.426+0000 7f31fe044640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f806ce30 con 0x7f31f80cdfb0 2023-11-24T06:17:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.426+0000 7f31fe044640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80cfe10 con 0x7f31f815c7f0 2023-11-24T06:17:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31f80cf450 0x7f31f80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31f80cf450 0x7f31f80cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44370/0 (socket says 172.21.15.37:44370) 2023-11-24T06:17:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 -- 172.21.15.37:0/1384627408 learned_addr learned my addr 172.21.15.37:0/1384627408 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f7fff640 1 --2- 172.21.15.37:0/1384627408 >> v2:172.21.15.188:3300/0 conn(0x7f31f80cdfb0 0x7f31f80ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f77fe640 1 --2- 172.21.15.37:0/1384627408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f815c7f0 0x7f31f806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 -- 172.21.15.37:0/1384627408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f815c7f0 msgr2=0x7f31f806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 --2- 172.21.15.37:0/1384627408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f815c7f0 0x7f31f806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 -- 172.21.15.37:0/1384627408 >> v2:172.21.15.188:3300/0 conn(0x7f31f80cdfb0 msgr2=0x7f31f80ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 --2- 172.21.15.37:0/1384627408 >> v2:172.21.15.188:3300/0 conn(0x7f31f80cdfb0 0x7f31f80ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f6ffd640 1 -- 172.21.15.37:0/1384627408 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80cece0 con 0x7f31f80cf450 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.427+0000 7f31f7fff640 1 --2- 172.21.15.37:0/1384627408 >> v2:172.21.15.188:3300/0 conn(0x7f31f80cdfb0 0x7f31f80ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.428+0000 7f31f6ffd640 1 --2- 172.21.15.37:0/1384627408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f80cf450 0x7f31f80cf8d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f31f80aebc0 tx=0x7f31e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b60ba758988b77 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.429+0000 7f31f67fc640 1 -- 172.21.15.37:0/1384627408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e002ca80 con 0x7f31f80cf450 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.429+0000 7f31f67fc640 1 -- 172.21.15.37:0/1384627408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e002cbe0 con 0x7f31f80cf450 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.429+0000 7f31f67fc640 1 -- 172.21.15.37:0/1384627408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00343f0 con 0x7f31f80cf450 2023-11-24T06:17:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.429+0000 7f31fe044640 1 -- 172.21.15.37:0/1384627408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f80cf450 msgr2=0x7f31f80cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.429+0000 7f31fe044640 1 --2- 172.21.15.37:0/1384627408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f80cf450 0x7f31f80cf8d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f31f80aebc0 tx=0x7f31e002bee0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.430+0000 7f31fe044640 1 -- 172.21.15.37:0/1384627408 shutdown_connections 2023-11-24T06:17:25.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.430+0000 7f31fe044640 1 --2- 172.21.15.37:0/1384627408 >> v2:172.21.15.188:3300/0 conn(0x7f31f80cdfb0 0x7f31f80ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.430+0000 7f31fe044640 1 --2- 172.21.15.37:0/1384627408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f80cf450 0x7f31f80cf8d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.430+0000 7f31fe044640 1 --2- 172.21.15.37:0/1384627408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f815c7f0 0x7f31f806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.430+0000 7f31fe044640 1 -- 172.21.15.37:0/1384627408 >> 172.21.15.37:0/1384627408 conn(0x7f31f806a920 msgr2=0x7f31f806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:25.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.430+0000 7f31fe044640 1 -- 172.21.15.37:0/1384627408 shutdown_connections 2023-11-24T06:17:25.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.430+0000 7f31fe044640 1 -- 172.21.15.37:0/1384627408 wait complete. 2023-11-24T06:17:25.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.431+0000 7f31fe044640 1 Processor -- start 2023-11-24T06:17:25.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.432+0000 7f31fe044640 1 -- start start 2023-11-24T06:17:25.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.432+0000 7f31fe044640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f80cdfb0 0x7f31f8158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.432+0000 7f31fe044640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31f80cf450 0x7f31f8156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31fe044640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f815c7f0 0x7f31f81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31fe044640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f809b350 con 0x7f31f815c7f0 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31fe044640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f809b5a0 con 0x7f31f80cf450 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31fe044640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f809b880 con 0x7f31f80cdfb0 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f815c7f0 0x7f31f81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f815c7f0 0x7f31f81566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44378/0 (socket says 172.21.15.37:44378) 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31f7fff640 1 -- 172.21.15.37:0/2118081178 learned_addr learned my addr 172.21.15.37:0/2118081178 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31f77fe640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f80cdfb0 0x7f31f8158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.433+0000 7f31f6ffd640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31f80cf450 0x7f31f8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31f7fff640 1 -- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f80cdfb0 msgr2=0x7f31f8158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31f7fff640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f80cdfb0 0x7f31f8158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31f7fff640 1 -- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31f80cf450 msgr2=0x7f31f8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31f7fff640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31f80cf450 0x7f31f8156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31f7fff640 1 -- 172.21.15.37:0/2118081178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0009b30 con 0x7f31f815c7f0 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31f7fff640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f815c7f0 0x7f31f81566b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d500 tx=0x7f31f000d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31effff640 1 -- 172.21.15.37:0/2118081178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0004030 con 0x7f31f815c7f0 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31effff640 1 -- 172.21.15.37:0/2118081178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0004190 con 0x7f31f815c7f0 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31effff640 1 -- 172.21.15.37:0/2118081178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0014620 con 0x7f31f815c7f0 2023-11-24T06:17:25.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f809bb60 con 0x7f31f815c7f0 2023-11-24T06:17:25.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.434+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f809c120 con 0x7f31f815c7f0 2023-11-24T06:17:25.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.435+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f809c310 con 0x7f31f815c7f0 2023-11-24T06:17:25.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.437+0000 7f31effff640 1 -- 172.21.15.37:0/2118081178 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f31f0014780 con 0x7f31f815c7f0 2023-11-24T06:17:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.438+0000 7f31effff640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f31d806aed0 0x7f31d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.438+0000 7f31effff640 1 -- 172.21.15.37:0/2118081178 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31f00899d0 con 0x7f31f815c7f0 2023-11-24T06:17:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.438+0000 7f31f77fe640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f31d806aed0 0x7f31d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.439+0000 7f31f77fe640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f31d806aed0 0x7f31d806d390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31e8006fd0 tx=0x7f31e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:25.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.442+0000 7f31effff640 1 -- 172.21.15.37:0/2118081178 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31f0054ca0 con 0x7f31f815c7f0 2023-11-24T06:17:25.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.676+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31f8067470 con 0x7f31f815c7f0 2023-11-24T06:17:25.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.677+0000 7f31effff640 1 -- 172.21.15.37:0/2118081178 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f31f00582c0 con 0x7f31f815c7f0 2023-11-24T06:17:25.679 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:25.679 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1029063982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1029063982},{"type":"v1","addr":"172.21.15.37:6835","nonce":1029063982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/3663508959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":3663508959},{"type":"v1","addr":"172.21.15.188:6834","nonce":3663508959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/1387291964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":1387291964},{"type":"v1","addr":"172.21.15.188:6835","nonce":1387291964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1930444960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1930444960},{"type":"v1","addr":"172.21.15.37:6837","nonce":1930444960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[]} 2023-11-24T06:17:25.680 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-11-24T06:17:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.679+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f31d806aed0 msgr2=0x7f31d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.679+0000 7f31fe044640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f31d806aed0 0x7f31d806d390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31e8006fd0 tx=0x7f31e8008040 comp rx=0 tx=0).stop 2023-11-24T06:17:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.679+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f815c7f0 msgr2=0x7f31f81566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.679+0000 7f31fe044640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f815c7f0 0x7f31f81566b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d500 tx=0x7f31f000d9c0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 shutdown_connections 2023-11-24T06:17:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f31d806aed0 0x7f31d806d390 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31f80cf450 0x7f31f8156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f815c7f0 0x7f31f81566b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 --2- 172.21.15.37:0/2118081178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31f80cdfb0 0x7f31f8158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 >> 172.21.15.37:0/2118081178 conn(0x7f31f806a920 msgr2=0x7f31f806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 shutdown_connections 2023-11-24T06:17:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.680+0000 7f31fe044640 1 -- 172.21.15.37:0/2118081178 wait complete. 2023-11-24T06:17:25.705 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:17:25.705 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:17:25.705 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:17:25.705 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:25.705 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:17:25.706 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:17:25.706 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:17:25.706 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:25.706 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:17:25.707 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:17:25.707 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:17:25.707 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:25.707 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:17:25.707 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:17:25.708 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:17:25.708 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:17:25.722 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:17:25.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:17:25.725 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:17:25.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:17:25.727 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:17:25.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:17:25.728 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:17:25.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:17:25.773 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:17:25.774 DEBUG:teuthology.parallel:result is None 2023-11-24T06:17:25.778 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:17:25.778 DEBUG:teuthology.parallel:result is None 2023-11-24T06:17:25.781 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:17:25.781 DEBUG:teuthology.parallel:result is None 2023-11-24T06:17:25.785 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:17:25.785 DEBUG:teuthology.parallel:result is None 2023-11-24T06:17:25.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:17:25.938 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2023-11-24T06:17:25.939 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2023-11-24T06:17:25.942 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-11-24T06:17:25.942 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-11-24T06:17:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.981+0000 7f83f71ac640 1 Processor -- start 2023-11-24T06:17:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.981+0000 7f83f71ac640 1 -- start start 2023-11-24T06:17:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.982+0000 7f83f71ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f015d490 0x7f83f00cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.982+0000 7f83f71ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83f00b63d0 0x7f83f00d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.982+0000 7f83f71ac640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f00cea30 con 0x7f83f00ce270 2023-11-24T06:17:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.982+0000 7f83f71ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f00d0450 con 0x7f83f00b63d0 2023-11-24T06:17:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.982+0000 7f83f71ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00d0bf0 con 0x7f83f015d490 2023-11-24T06:17:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f59a9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83f00b63d0 0x7f83f00d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f61aa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f015d490 0x7f83f00cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f59a9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83f00b63d0 0x7f83f00d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44420/0 (socket says 172.21.15.37:44420) 2023-11-24T06:17:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f59a9640 1 -- 172.21.15.37:0/3762742290 learned_addr learned my addr 172.21.15.37:0/3762742290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f61aa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f015d490 0x7f83f00cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:52118/0 (socket says 172.21.15.37:52118) 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f59a9640 1 -- 172.21.15.37:0/3762742290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f015d490 msgr2=0x7f83f00cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f59a9640 1 --2- 172.21.15.37:0/3762742290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f015d490 0x7f83f00cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f59a9640 1 -- 172.21.15.37:0/3762742290 >> v1:172.21.15.188:6789/0 conn(0x7f83f00ce270 legacy=0x7f83f0160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.983+0000 7f83f59a9640 1 -- 172.21.15.37:0/3762742290 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00d2260 con 0x7f83f00b63d0 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.984+0000 7f83f59a9640 1 --2- 172.21.15.37:0/3762742290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f00b63d0 0x7f83f00d3230 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009870 tx=0x7f83e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76fe0b26655a829 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.984+0000 7f83f51a8640 1 -- 172.21.15.37:0/3762742290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0030840 con 0x7f83f00b63d0 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f51a8640 1 -- 172.21.15.37:0/3762742290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e00309a0 con 0x7f83f00b63d0 2023-11-24T06:17:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f51a8640 1 -- 172.21.15.37:0/3762742290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0030d30 con 0x7f83f00b63d0 2023-11-24T06:17:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 -- 172.21.15.37:0/3762742290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f00b63d0 msgr2=0x7f83f00d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 --2- 172.21.15.37:0/3762742290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f00b63d0 0x7f83f00d3230 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009870 tx=0x7f83e002b980 comp rx=0 tx=0).stop 2023-11-24T06:17:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 -- 172.21.15.37:0/3762742290 shutdown_connections 2023-11-24T06:17:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 --2- 172.21.15.37:0/3762742290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f00b63d0 0x7f83f00d3230 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 --2- 172.21.15.37:0/3762742290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f015d490 0x7f83f00cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 -- 172.21.15.37:0/3762742290 >> 172.21.15.37:0/3762742290 conn(0x7f83f0061340 msgr2=0x7f83f0061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 -- 172.21.15.37:0/3762742290 shutdown_connections 2023-11-24T06:17:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.985+0000 7f83f71ac640 1 -- 172.21.15.37:0/3762742290 wait complete. 2023-11-24T06:17:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.987+0000 7f83f71ac640 1 Processor -- start 2023-11-24T06:17:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.987+0000 7f83f71ac640 1 -- start start 2023-11-24T06:17:25.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f71ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83f00ce270 0x7f83f0154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f71ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f015d490 0x7f83f00b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f71ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f00b8660 0x7f83f00cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f71ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00b8ae0 con 0x7f83f015d490 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f71ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0154d90 con 0x7f83f00ce270 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f71ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00cc1d0 con 0x7f83f00b8660 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f59a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f015d490 0x7f83f00b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f59a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f015d490 0x7f83f00b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44436/0 (socket says 172.21.15.37:44436) 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.988+0000 7f83f59a9640 1 -- 172.21.15.37:0/2325917849 learned_addr learned my addr 172.21.15.37:0/2325917849 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f61aa640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83f00ce270 0x7f83f0154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f69ab640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f00b8660 0x7f83f00cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f59a9640 1 -- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f00b8660 msgr2=0x7f83f00cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f59a9640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f00b8660 0x7f83f00cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f59a9640 1 -- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83f00ce270 msgr2=0x7f83f0154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f59a9640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83f00ce270 0x7f83f0154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f59a9640 1 -- 172.21.15.37:0/2325917849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00094d0 con 0x7f83f015d490 2023-11-24T06:17:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f61aa640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83f00ce270 0x7f83f0154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f69ab640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f00b8660 0x7f83f00cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.989+0000 7f83f59a9640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f015d490 0x7f83f00b8120 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f83e0000c00 tx=0x7f83e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.990+0000 7f83e6ffd640 1 -- 172.21.15.37:0/2325917849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0039c90 con 0x7f83f015d490 2023-11-24T06:17:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.990+0000 7f83e6ffd640 1 -- 172.21.15.37:0/2325917849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0039df0 con 0x7f83f015d490 2023-11-24T06:17:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.990+0000 7f83e6ffd640 1 -- 172.21.15.37:0/2325917849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0043640 con 0x7f83f015d490 2023-11-24T06:17:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.990+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f00cc4b0 con 0x7f83f015d490 2023-11-24T06:17:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.990+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f00cca70 con 0x7f83f015d490 2023-11-24T06:17:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.991+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f004e840 con 0x7f83f015d490 2023-11-24T06:17:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.992+0000 7f83e6ffd640 1 -- 172.21.15.37:0/2325917849 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f83e00437a0 con 0x7f83f015d490 2023-11-24T06:17:25.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.993+0000 7f83e6ffd640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f83d406af00 0x7f83d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:25.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.993+0000 7f83e6ffd640 1 -- 172.21.15.37:0/2325917849 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f83e003e070 con 0x7f83f015d490 2023-11-24T06:17:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.993+0000 7f83f61aa640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f83d406af00 0x7f83d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.994+0000 7f83f61aa640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f83d406af00 0x7f83d406d3c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009af0 tx=0x7f83ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:26.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:25.998+0000 7f83e6ffd640 1 -- 172.21.15.37:0/2325917849 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83e0077720 con 0x7f83f015d490 2023-11-24T06:17:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:26.203+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f83f01608a0 con 0x7f83f015d490 2023-11-24T06:17:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.625+0000 7f83e6ffd640 1 -- 172.21.15.37:0/2325917849 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f83e007ad40 con 0x7f83f015d490 2023-11-24T06:17:27.628 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-11-24T06:17:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.628+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f83d406af00 msgr2=0x7f83d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.628+0000 7f83f71ac640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f83d406af00 0x7f83d406d3c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009af0 tx=0x7f83ec008040 comp rx=0 tx=0).stop 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.628+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f015d490 msgr2=0x7f83f00b8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.628+0000 7f83f71ac640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f015d490 0x7f83f00b8120 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f83e0000c00 tx=0x7f83e0004730 comp rx=0 tx=0).stop 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 shutdown_connections 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f83d406af00 0x7f83d406d3c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83f00b8660 0x7f83f00cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f015d490 0x7f83f00b8120 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 --2- 172.21.15.37:0/2325917849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83f00ce270 0x7f83f0154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 >> 172.21.15.37:0/2325917849 conn(0x7f83f0061340 msgr2=0x7f83f00d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 shutdown_connections 2023-11-24T06:17:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.629+0000 7f83f71ac640 1 -- 172.21.15.37:0/2325917849 wait complete. 2023-11-24T06:17:27.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:17:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.875+0000 7f330e009640 1 Processor -- start 2023-11-24T06:17:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.875+0000 7f330e009640 1 -- start start 2023-11-24T06:17:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330e009640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330813e0e0 0x7f330806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330e009640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f330806cee0 0x7f3308070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330e009640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33080708b0 0x7f33080b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330e009640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330806d360 con 0x7f33080708b0 2023-11-24T06:17:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330e009640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330815b7a0 con 0x7f330806cee0 2023-11-24T06:17:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330e009640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330815ba60 con 0x7f330813e0e0 2023-11-24T06:17:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330d808640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33080708b0 0x7f33080b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330d808640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33080708b0 0x7f33080b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44444/0 (socket says 172.21.15.37:44444) 2023-11-24T06:17:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.877+0000 7f330d808640 1 -- 172.21.15.37:0/4231005565 learned_addr learned my addr 172.21.15.37:0/4231005565 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330c806640 1 --2- 172.21.15.37:0/4231005565 >> v2:172.21.15.188:3300/0 conn(0x7f330806cee0 0x7f3308070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330d007640 1 --2- 172.21.15.37:0/4231005565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330813e0e0 0x7f330806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330d808640 1 -- 172.21.15.37:0/4231005565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330813e0e0 msgr2=0x7f330806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330d808640 1 --2- 172.21.15.37:0/4231005565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330813e0e0 0x7f330806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330d808640 1 -- 172.21.15.37:0/4231005565 >> v2:172.21.15.188:3300/0 conn(0x7f330806cee0 msgr2=0x7f3308070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330d808640 1 --2- 172.21.15.37:0/4231005565 >> v2:172.21.15.188:3300/0 conn(0x7f330806cee0 0x7f3308070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330d808640 1 -- 172.21.15.37:0/4231005565 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330815bd40 con 0x7f33080708b0 2023-11-24T06:17:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330c806640 1 --2- 172.21.15.37:0/4231005565 >> v2:172.21.15.188:3300/0 conn(0x7f330806cee0 0x7f3308070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.878+0000 7f330d007640 1 --2- 172.21.15.37:0/4231005565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330813e0e0 0x7f330806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.879+0000 7f330d808640 1 --2- 172.21.15.37:0/4231005565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f33080b0bc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f330806d4d0 tx=0x7f330002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67baf4bc2748a4fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.879+0000 7f32fffff640 1 -- 172.21.15.37:0/4231005565 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330002ca80 con 0x7f33080708b0 2023-11-24T06:17:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.879+0000 7f32fffff640 1 -- 172.21.15.37:0/4231005565 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330002cbe0 con 0x7f33080708b0 2023-11-24T06:17:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.879+0000 7f32fffff640 1 -- 172.21.15.37:0/4231005565 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33000343f0 con 0x7f33080708b0 2023-11-24T06:17:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 -- 172.21.15.37:0/4231005565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 msgr2=0x7f33080b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 --2- 172.21.15.37:0/4231005565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f33080b0bc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f330806d4d0 tx=0x7f330002bee0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 -- 172.21.15.37:0/4231005565 shutdown_connections 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 --2- 172.21.15.37:0/4231005565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f33080b0bc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 --2- 172.21.15.37:0/4231005565 >> v2:172.21.15.188:3300/0 conn(0x7f330806cee0 0x7f3308070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 --2- 172.21.15.37:0/4231005565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330813e0e0 0x7f330806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 -- 172.21.15.37:0/4231005565 >> 172.21.15.37:0/4231005565 conn(0x7f33080b4630 msgr2=0x7f33080b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 -- 172.21.15.37:0/4231005565 shutdown_connections 2023-11-24T06:17:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.880+0000 7f330e009640 1 -- 172.21.15.37:0/4231005565 wait complete. 2023-11-24T06:17:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.882+0000 7f330e009640 1 Processor -- start 2023-11-24T06:17:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.882+0000 7f330e009640 1 -- start start 2023-11-24T06:17:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330e009640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330806cee0 0x7f33080a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330e009640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f330815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330e009640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330813e0e0 0x7f330815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330e009640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080acec0 con 0x7f33080708b0 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330e009640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33080a8970 con 0x7f330813e0e0 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330e009640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3308131b90 con 0x7f330806cee0 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f330815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f330815a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44454/0 (socket says 172.21.15.37:44454) 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 -- 172.21.15.37:0/1898348996 learned_addr learned my addr 172.21.15.37:0/1898348996 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 -- 172.21.15.37:0/1898348996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330806cee0 msgr2=0x7f33080a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330806cee0 0x7f33080a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 -- 172.21.15.37:0/1898348996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330813e0e0 msgr2=0x7f330815a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330813e0e0 0x7f330815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.883+0000 7f330c806640 1 -- 172.21.15.37:0/1898348996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300009b30 con 0x7f33080708b0 2023-11-24T06:17:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.884+0000 7f330c806640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f330815a270 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7c0 tx=0x7f32f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.884+0000 7f32fdffb640 1 -- 172.21.15.37:0/1898348996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8007a30 con 0x7f33080708b0 2023-11-24T06:17:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.884+0000 7f32fdffb640 1 -- 172.21.15.37:0/1898348996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8007b90 con 0x7f33080708b0 2023-11-24T06:17:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.884+0000 7f32fdffb640 1 -- 172.21.15.37:0/1898348996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f800ce70 con 0x7f33080708b0 2023-11-24T06:17:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.884+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3308131e70 con 0x7f33080708b0 2023-11-24T06:17:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.884+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3308132430 con 0x7f33080708b0 2023-11-24T06:17:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.885+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33080acd20 con 0x7f33080708b0 2023-11-24T06:17:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.886+0000 7f32fdffb640 1 -- 172.21.15.37:0/1898348996 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f32f80113f0 con 0x7f33080708b0 2023-11-24T06:17:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.887+0000 7f32fdffb640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f32ec06aed0 0x7f32ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.887+0000 7f32fdffb640 1 -- 172.21.15.37:0/1898348996 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32f80895f0 con 0x7f33080708b0 2023-11-24T06:17:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.887+0000 7f330d007640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f32ec06aed0 0x7f32ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.888+0000 7f330d007640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f32ec06aed0 0x7f32ec06d390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3304006fd0 tx=0x7f3304008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:27.892+0000 7f32fdffb640 1 -- 172.21.15.37:0/1898348996 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33080acd20 con 0x7f33080708b0 2023-11-24T06:17:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.161+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f33080acd20 con 0x7f33080708b0 2023-11-24T06:17:28.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.162+0000 7f32fdffb640 1 -- 172.21.15.37:0/1898348996 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f33080acd20 con 0x7f33080708b0 2023-11-24T06:17:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:28.165 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:17:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-11-24T06:17:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlgknvDhAAb5FktSscZfBXGBuKWouBXA==", 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-11-24T06:17:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlJjg6MhAANLI6BPtnpgIn9G0CEPxTVQ==", 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2Bl9wrhIBAAp1rkuZvYeDseCqvLIHzS3g==", 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlurVTBxAAgadZStT24OMDy63I86vTUA==", 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.168 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdP2Blh/MmBRAAwJHTQ1wwlmIGG8B26AeHJw==", 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAgP2BlWl7zIBAAat/1A8KGpPpqC1cmaGGN6g==", 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAjP2Bl4Rk7OxAAJ86tWyBRTgnF5nyjFqTOKA==", 2023-11-24T06:17:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAnP2BlpK9fGRAANr9PMAxN1uBbcKllLiUluA==", 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAuP2Bl1izGHxAAXjn5+EnnFQOnKxiuDeg1Ug==", 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAxP2BlSpciKRAAG5p7jzKUX0CDLhPbPGpV2g==", 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1P2BlTZUKBxAAYSXZ0hoJrqzN5I6NkT4RrA==", 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA4P2Bluo2REBAAnUZSYi+3ENutNfPVGxF8oQ==", 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA==", 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlhpPeLBAA+FETlJwFxw/Un58VF8KxtQ==", 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlLSTWIRAAntWBgOa+b6RFdEH4Jb9BjQ==", 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-11-24T06:17:28.177 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYP2BlIx2bNxAASM7PdeBoVMXV+iLedKvdfA==", 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAWP2BlJBINARAAYuCFdJsu598989ZBCaK/Xw==", 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAXP2BlCBlAAhAATR60ipjSv9JZI4d7vH8t9Q==", 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.179 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAWP2Bl+PLrMhAA6Gc/HfKd/LAjoPsOGI1O6w==", 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-11-24T06:17:28.180 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:17:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f32ec06aed0 msgr2=0x7f32ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f32ec06aed0 0x7f32ec06d390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3304006fd0 tx=0x7f3304008040 comp rx=0 tx=0).stop 2023-11-24T06:17:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 msgr2=0x7f330815a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f330815a270 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7c0 tx=0x7f32f800cc80 comp rx=0 tx=0).stop 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 shutdown_connections 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f32ec06aed0 0x7f32ec06d390 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330813e0e0 0x7f330815a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33080708b0 0x7f330815a270 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 --2- 172.21.15.37:0/1898348996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330806cee0 0x7f33080a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 >> 172.21.15.37:0/1898348996 conn(0x7f33080b4630 msgr2=0x7f33080cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 shutdown_connections 2023-11-24T06:17:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.165+0000 7f330e009640 1 -- 172.21.15.37:0/1898348996 wait complete. 2023-11-24T06:17:28.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.405+0000 7f90b1690640 1 Processor -- start 2023-11-24T06:17:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.406+0000 7f90b1690640 1 -- start start 2023-11-24T06:17:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.408+0000 7f90b1690640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90ac15e390 0x7f90ac161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.408+0000 7f90b1690640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac0ce0b0 con 0x7f90ac157c70 2023-11-24T06:17:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.408+0000 7f90b1690640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac161960 con 0x7f90ac0cfb60 2023-11-24T06:17:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.408+0000 7f90b1690640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ac15e8d0 con 0x7f90ac15e390 2023-11-24T06:17:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.408+0000 7f90ab7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90ac15e390 0x7f90ac161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.408+0000 7f90aaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90ac157c70 0x7f90ac0cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33102/0 (socket says 172.21.15.37:33102) 2023-11-24T06:17:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.408+0000 7f90aaffd640 1 -- 172.21.15.37:0/3777955748 learned_addr learned my addr 172.21.15.37:0/3777955748 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.409+0000 7f90ab7fe640 1 -- 172.21.15.37:0/3777955748 >> v1:172.21.15.188:6789/0 conn(0x7f90ac0cfb60 legacy=0x7f90ac15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.409+0000 7f90ab7fe640 1 -- 172.21.15.37:0/3777955748 >> v1:172.21.15.37:6789/0 conn(0x7f90ac157c70 legacy=0x7f90ac0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.409+0000 7f90ab7fe640 1 -- 172.21.15.37:0/3777955748 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac15ebb0 con 0x7f90ac15e390 2023-11-24T06:17:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.409+0000 7f90aa7fc640 1 -- 172.21.15.37:0/3777955748 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691308462 0 0) 0x7f90ac0ce0b0 con 0x7f90ac157c70 2023-11-24T06:17:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.410+0000 7f90ab7fe640 1 --2- 172.21.15.37:0/3777955748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac161df0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009d90 tx=0x7f90a402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feb866dbfe19561 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.410+0000 7f90aa7fc640 1 -- 172.21.15.37:0/3777955748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a402cc60 con 0x7f90ac15e390 2023-11-24T06:17:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.410+0000 7f90aa7fc640 1 -- 172.21.15.37:0/3777955748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a402cdc0 con 0x7f90ac15e390 2023-11-24T06:17:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.410+0000 7f90aa7fc640 1 -- 172.21.15.37:0/3777955748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4034660 con 0x7f90ac15e390 2023-11-24T06:17:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.411+0000 7f90b1690640 1 -- 172.21.15.37:0/3777955748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 msgr2=0x7f90ac161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.411+0000 7f90b1690640 1 --2- 172.21.15.37:0/3777955748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac161df0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009d90 tx=0x7f90a402beb0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.411+0000 7f90b1690640 1 -- 172.21.15.37:0/3777955748 shutdown_connections 2023-11-24T06:17:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.411+0000 7f90b1690640 1 --2- 172.21.15.37:0/3777955748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac161df0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.411+0000 7f90b1690640 1 -- 172.21.15.37:0/3777955748 >> 172.21.15.37:0/3777955748 conn(0x7f90ac06a920 msgr2=0x7f90ac06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.411+0000 7f90b1690640 1 -- 172.21.15.37:0/3777955748 shutdown_connections 2023-11-24T06:17:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.411+0000 7f90b1690640 1 -- 172.21.15.37:0/3777955748 wait complete. 2023-11-24T06:17:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.413+0000 7f90b1690640 1 Processor -- start 2023-11-24T06:17:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.413+0000 7f90b1690640 1 -- start start 2023-11-24T06:17:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90b1690640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90ac0cfb60 0x7f90ac09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90b1690640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90ac157c70 0x7f90ac0ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90b1690640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90b1690640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac09d160 con 0x7f90ac15e390 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90b1690640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac0c9770 con 0x7f90ac157c70 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90b1690640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac0c9a50 con 0x7f90ac0cfb60 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44470/0 (socket says 172.21.15.37:44470) 2023-11-24T06:17:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90ab7fe640 1 -- 172.21.15.37:0/4020170842 learned_addr learned my addr 172.21.15.37:0/4020170842 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.414+0000 7f90aaffd640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90ac0cfb60 0x7f90ac09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90a3fff640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90ac157c70 0x7f90ac0ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90ab7fe640 1 -- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90ac0cfb60 msgr2=0x7f90ac09cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90ab7fe640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90ac0cfb60 0x7f90ac09cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90ab7fe640 1 -- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90ac157c70 msgr2=0x7f90ac0ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90ab7fe640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90ac157c70 0x7f90ac0ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90ab7fe640 1 -- 172.21.15.37:0/4020170842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a4009a70 con 0x7f90ac15e390 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90ab7fe640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac147320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009d90 tx=0x7f90a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90a37fe640 1 -- 172.21.15.37:0/4020170842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4040650 con 0x7f90ac15e390 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90a37fe640 1 -- 172.21.15.37:0/4020170842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a40407b0 con 0x7f90ac15e390 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90a37fe640 1 -- 172.21.15.37:0/4020170842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4040b60 con 0x7f90ac15e390 2023-11-24T06:17:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.415+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac0c9d30 con 0x7f90ac15e390 2023-11-24T06:17:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.416+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac0ca2f0 con 0x7f90ac15e390 2023-11-24T06:17:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.417+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac067470 con 0x7f90ac15e390 2023-11-24T06:17:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.418+0000 7f90a37fe640 1 -- 172.21.15.37:0/4020170842 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f90a4040cc0 con 0x7f90ac15e390 2023-11-24T06:17:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.419+0000 7f90a37fe640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f908c06af00 0x7f908c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.419+0000 7f90a37fe640 1 -- 172.21.15.37:0/4020170842 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90a40ac020 con 0x7f90ac15e390 2023-11-24T06:17:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.419+0000 7f90aaffd640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f908c06af00 0x7f908c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.420+0000 7f90aaffd640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f908c06af00 0x7f908c06d3c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f909c000f60 tx=0x7f909c007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.423+0000 7f90a37fe640 1 -- 172.21.15.37:0/4020170842 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f90a4077460 con 0x7f90ac15e390 2023-11-24T06:17:28.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.619+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90ac0cd910 con 0x7f90ac15e390 2023-11-24T06:17:28.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.620+0000 7f90a37fe640 1 -- 172.21.15.37:0/4020170842 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12821 (secure 0 0 0) 0x7f90a407aa80 con 0x7f90ac15e390 2023-11-24T06:17:28.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:28.623 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:27.622072+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f908c06af00 msgr2=0x7f908c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f908c06af00 0x7f908c06d3c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f909c000f60 tx=0x7f909c007b90 comp rx=0 tx=0).stop 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 msgr2=0x7f90ac147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac147320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009d90 tx=0x7f90a4004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 shutdown_connections 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f908c06af00 0x7f908c06d3c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90ac157c70 0x7f90ac0ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac15e390 0x7f90ac147320 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 --2- 172.21.15.37:0/4020170842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90ac0cfb60 0x7f90ac09cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 >> 172.21.15.37:0/4020170842 conn(0x7f90ac06a920 msgr2=0x7f90ac160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 shutdown_connections 2023-11-24T06:17:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.623+0000 7f90b1690640 1 -- 172.21.15.37:0/4020170842 wait complete. 2023-11-24T06:17:28.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:28.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:28.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.874+0000 7fa8150d8640 1 Processor -- start 2023-11-24T06:17:28.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.874+0000 7fa8150d8640 1 -- start start 2023-11-24T06:17:28.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.875+0000 7fa8150d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa81015d3f0 0x7fa8100d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.875+0000 7fa8150d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8100d15e0 con 0x7fa8100d0e40 2023-11-24T06:17:28.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.876+0000 7fa8150d8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8100d0280 con 0x7fa81015d7d0 2023-11-24T06:17:28.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.876+0000 7fa8150d8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8100d1300 con 0x7fa81015d3f0 2023-11-24T06:17:28.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.876+0000 7fa8148d7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa8100d0e40 0x7fa8100b05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33106/0 (socket says 172.21.15.37:33106) 2023-11-24T06:17:28.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.876+0000 7fa8148d7640 1 -- 172.21.15.37:0/2065298261 learned_addr learned my addr 172.21.15.37:0/2065298261 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.876+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554368848 0 0) 0x7fa8100d15e0 con 0x7fa8100d0e40 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.876+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f8003520 con 0x7fa8100d0e40 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.876+0000 7fa80ffff640 1 --2- 172.21.15.37:0/2065298261 >> v2:172.21.15.188:3300/0 conn(0x7fa81015d3f0 0x7fa8100d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596745326 0 0) 0x7fa7f8003520 con 0x7fa8100d0e40 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 >> v2:172.21.15.188:3300/0 conn(0x7fa81015d3f0 msgr2=0x7fa8100d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 --2- 172.21.15.37:0/2065298261 >> v2:172.21.15.188:3300/0 conn(0x7fa81015d3f0 0x7fa8100d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 >> v1:172.21.15.188:6789/0 conn(0x7fa81015d7d0 legacy=0x7fa8100afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100cfc30 con 0x7fa8100d0e40 2023-11-24T06:17:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fa808001670 con 0x7fa8100d0e40 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 >> v1:172.21.15.37:6789/0 conn(0x7fa8100d0e40 legacy=0x7fa8100b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7f8003970 0x7fa7f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa7f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7f8005180 0x7fa7f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100d1300 con 0x7fa7f80047c0 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f800c0d0 con 0x7fa7f8003970 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f800c290 con 0x7fa7f8005180 2023-11-24T06:17:28.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.877+0000 7fa80f7fe640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa7f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa8148d7640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7f8005180 0x7fa7f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa80ffff640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7f8003970 0x7fa7f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa80f7fe640 1 -- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7f8005180 msgr2=0x7fa7f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa80f7fe640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7f8005180 0x7fa7f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa80f7fe640 1 -- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7f8003970 msgr2=0x7fa7f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa80f7fe640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7f8003970 0x7fa7f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa80f7fe640 1 -- 172.21.15.37:0/2065298261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8003520 con 0x7fa7f80047c0 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa8148d7640 1 -- 172.21.15.37:0/2065298261 reap_dead start 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.878+0000 7fa80ffff640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7f8003970 0x7fa7f8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.879+0000 7fa80f7fe640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa7f8004c40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa804001720 tx=0x7fa7f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5a923bf504b1c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.879+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040052d0 con 0x7fa7f80047c0 2023-11-24T06:17:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.879+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80402e050 con 0x7fa7f80047c0 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.879+0000 7fa80effd640 1 -- 172.21.15.37:0/2065298261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804003830 con 0x7fa7f80047c0 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.880+0000 7fa8150d8640 1 -- 172.21.15.37:0/2065298261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 msgr2=0x7fa7f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.880+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa7f8004c40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa804001720 tx=0x7fa7f80057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.880+0000 7fa8150d8640 1 -- 172.21.15.37:0/2065298261 shutdown_connections 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.880+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2065298261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa7f8004c40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.880+0000 7fa8150d8640 1 -- 172.21.15.37:0/2065298261 >> 172.21.15.37:0/2065298261 conn(0x7fa81009c5b0 msgr2=0x7fa8100d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.880+0000 7fa8150d8640 1 -- 172.21.15.37:0/2065298261 shutdown_connections 2023-11-24T06:17:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.880+0000 7fa8150d8640 1 -- 172.21.15.37:0/2065298261 wait complete. 2023-11-24T06:17:28.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.882+0000 7fa8150d8640 1 Processor -- start 2023-11-24T06:17:28.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.882+0000 7fa8150d8640 1 -- start start 2023-11-24T06:17:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa8150d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa8100c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa8150d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8100ccbf0 0x7fa8101566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa8150d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8100b68e0 0x7fa8100b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa8150d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100b5e90 con 0x7fa7f80047c0 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa8150d8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100b6450 con 0x7fa8100b68e0 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa8150d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c75d0 con 0x7fa8100ccbf0 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa80ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa8100c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.883+0000 7fa80ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa8100c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44494/0 (socket says 172.21.15.37:44494) 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80ffff640 1 -- 172.21.15.37:0/2892285793 learned_addr learned my addr 172.21.15.37:0/2892285793 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80f7fe640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8100ccbf0 0x7fa8101566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa8148d7640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8100b68e0 0x7fa8100b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80ffff640 1 -- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8100ccbf0 msgr2=0x7fa8101566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80ffff640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8100ccbf0 0x7fa8101566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80ffff640 1 -- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8100b68e0 msgr2=0x7fa8100b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80ffff640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8100b68e0 0x7fa8100b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:28.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80ffff640 1 -- 172.21.15.37:0/2892285793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100c78b0 con 0x7fa7f80047c0 2023-11-24T06:17:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.884+0000 7fa80ffff640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa8100c6da0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa800007df0 tx=0x7fa80000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.885+0000 7fa80cff9640 1 -- 172.21.15.37:0/2892285793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000143f0 con 0x7fa7f80047c0 2023-11-24T06:17:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.885+0000 7fa80cff9640 1 -- 172.21.15.37:0/2892285793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa800014550 con 0x7fa7f80047c0 2023-11-24T06:17:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.885+0000 7fa80cff9640 1 -- 172.21.15.37:0/2892285793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800014900 con 0x7fa7f80047c0 2023-11-24T06:17:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.885+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8100b60e0 con 0x7fa7f80047c0 2023-11-24T06:17:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.885+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa810156bf0 con 0x7fa7f80047c0 2023-11-24T06:17:28.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.886+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81004e840 con 0x7fa7f80047c0 2023-11-24T06:17:28.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.887+0000 7fa80cff9640 1 -- 172.21.15.37:0/2892285793 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fa800014a60 con 0x7fa7f80047c0 2023-11-24T06:17:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.888+0000 7fa80cff9640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa7fc06aed0 0x7fa7fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.889+0000 7fa80cff9640 1 -- 172.21.15.37:0/2892285793 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa80008a190 con 0x7fa7f80047c0 2023-11-24T06:17:28.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.889+0000 7fa80f7fe640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa7fc06aed0 0x7fa7fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:28.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.889+0000 7fa80f7fe640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa7fc06aed0 0x7fa7fc06d390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa804033000 tx=0x7fa804009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:28.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:28.893+0000 7fa80cff9640 1 -- 172.21.15.37:0/2892285793 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa800055420 con 0x7fa7f80047c0 2023-11-24T06:17:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.087+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8100b12c0 con 0x7fa7f80047c0 2023-11-24T06:17:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.088+0000 7fa80cff9640 1 -- 172.21.15.37:0/2892285793 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa800058a40 con 0x7fa7f80047c0 2023-11-24T06:17:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:29.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa7fc06aed0 msgr2=0x7fa7fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa7fc06aed0 0x7fa7fc06d390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa804033000 tx=0x7fa804009030 comp rx=0 tx=0).stop 2023-11-24T06:17:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 msgr2=0x7fa8100c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa8100c6da0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa800007df0 tx=0x7fa80000f520 comp rx=0 tx=0).stop 2023-11-24T06:17:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 shutdown_connections 2023-11-24T06:17:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa7fc06aed0 0x7fa7fc06d390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8100b68e0 0x7fa8100b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8100ccbf0 0x7fa8101566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 --2- 172.21.15.37:0/2892285793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7f80047c0 0x7fa8100c6da0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.090+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 >> 172.21.15.37:0/2892285793 conn(0x7fa81009c5b0 msgr2=0x7fa81015c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.091+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 shutdown_connections 2023-11-24T06:17:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.091+0000 7fa8150d8640 1 -- 172.21.15.37:0/2892285793 wait complete. 2023-11-24T06:17:29.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:17:29.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.331+0000 7ff60d7cb640 1 Processor -- start 2023-11-24T06:17:29.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.331+0000 7ff60d7cb640 1 -- start start 2023-11-24T06:17:29.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.333+0000 7ff60d7cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff608161080 0x7ff6080b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.333+0000 7ff60d7cb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff608161510 con 0x7ff608143870 2023-11-24T06:17:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.333+0000 7ff60d7cb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6081617f0 con 0x7ff6080b0fb0 2023-11-24T06:17:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.333+0000 7ff60d7cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff608070460 con 0x7ff608161080 2023-11-24T06:17:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.333+0000 7ff607fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff608143870 0x7ff608146970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33112/0 (socket says 172.21.15.37:33112) 2023-11-24T06:17:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.333+0000 7ff607fff640 1 -- 172.21.15.37:0/1009316789 learned_addr learned my addr 172.21.15.37:0/1009316789 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.333+0000 7ff6077fe640 1 --2- 172.21.15.37:0/1009316789 >> v2:172.21.15.37:3300/0 conn(0x7ff608161080 0x7ff6080b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.334+0000 7ff606ffd640 1 -- 172.21.15.37:0/1009316789 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430309380 0 0) 0x7ff608161510 con 0x7ff608143870 2023-11-24T06:17:29.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.334+0000 7ff606ffd640 1 -- 172.21.15.37:0/1009316789 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f4003520 con 0x7ff608143870 2023-11-24T06:17:29.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.334+0000 7ff6077fe640 1 -- 172.21.15.37:0/1009316789 >> v1:172.21.15.188:6789/0 conn(0x7ff6080b0fb0 legacy=0x7ff6080cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:29.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.334+0000 7ff6077fe640 1 -- 172.21.15.37:0/1009316789 >> v1:172.21.15.37:6789/0 conn(0x7ff608143870 legacy=0x7ff608146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.334+0000 7ff6077fe640 1 -- 172.21.15.37:0/1009316789 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608161ad0 con 0x7ff608161080 2023-11-24T06:17:29.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.335+0000 7ff6077fe640 1 --2- 172.21.15.37:0/1009316789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608161080 0x7ff6080b0a70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00097a0 tx=0x7ff5f002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60ef5ae4810ea1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:29.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff606ffd640 1 -- 172.21.15.37:0/1009316789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0030610 con 0x7ff608161080 2023-11-24T06:17:29.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff606ffd640 1 -- 172.21.15.37:0/1009316789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0030770 con 0x7ff608161080 2023-11-24T06:17:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff606ffd640 1 -- 172.21.15.37:0/1009316789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0030ae0 con 0x7ff608161080 2023-11-24T06:17:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff60d7cb640 1 -- 172.21.15.37:0/1009316789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608161080 msgr2=0x7ff6080b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/1009316789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608161080 0x7ff6080b0a70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00097a0 tx=0x7ff5f002b960 comp rx=0 tx=0).stop 2023-11-24T06:17:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff60d7cb640 1 -- 172.21.15.37:0/1009316789 shutdown_connections 2023-11-24T06:17:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/1009316789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608161080 0x7ff6080b0a70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff60d7cb640 1 -- 172.21.15.37:0/1009316789 >> 172.21.15.37:0/1009316789 conn(0x7ff6080cb830 msgr2=0x7ff6080cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:29.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff60d7cb640 1 -- 172.21.15.37:0/1009316789 shutdown_connections 2023-11-24T06:17:29.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.336+0000 7ff60d7cb640 1 -- 172.21.15.37:0/1009316789 wait complete. 2023-11-24T06:17:29.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.338+0000 7ff60d7cb640 1 Processor -- start 2023-11-24T06:17:29.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.338+0000 7ff60d7cb640 1 -- start start 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.339+0000 7ff60d7cb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6080b0fb0 0x7ff60815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.339+0000 7ff60d7cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608143870 0x7ff60815fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.339+0000 7ff60d7cb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff608160250 0x7ff6080c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.339+0000 7ff60d7cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815ec70 con 0x7ff608143870 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.339+0000 7ff60d7cb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815ef50 con 0x7ff608160250 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.339+0000 7ff60d7cb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815f230 con 0x7ff6080b0fb0 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608143870 0x7ff60815fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608143870 0x7ff60815fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44502/0 (socket says 172.21.15.37:44502) 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 -- 172.21.15.37:0/3803568831 learned_addr learned my addr 172.21.15.37:0/3803568831 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff607fff640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6080b0fb0 0x7ff60815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff60cfca640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff608160250 0x7ff6080c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 -- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6080b0fb0 msgr2=0x7ff60815d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6080b0fb0 0x7ff60815d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 -- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff608160250 msgr2=0x7ff6080c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff608160250 0x7ff6080c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.340+0000 7ff6077fe640 1 -- 172.21.15.37:0/3803568831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f0009400 con 0x7ff608143870 2023-11-24T06:17:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.341+0000 7ff6077fe640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608143870 0x7ff60815fd10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0000c00 tx=0x7ff5f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.341+0000 7ff604ff9640 1 -- 172.21.15.37:0/3803568831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f003f070 con 0x7ff608143870 2023-11-24T06:17:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.341+0000 7ff604ff9640 1 -- 172.21.15.37:0/3803568831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0030e30 con 0x7ff608143870 2023-11-24T06:17:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.341+0000 7ff604ff9640 1 -- 172.21.15.37:0/3803568831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0004230 con 0x7ff608143870 2023-11-24T06:17:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.341+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60815f510 con 0x7ff608143870 2023-11-24T06:17:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.341+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60815d610 con 0x7ff608143870 2023-11-24T06:17:29.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.342+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60815fa30 con 0x7ff608143870 2023-11-24T06:17:29.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.343+0000 7ff604ff9640 1 -- 172.21.15.37:0/3803568831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7ff5f0043070 con 0x7ff608143870 2023-11-24T06:17:29.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.344+0000 7ff604ff9640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff5e806af00 0x7ff5e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.344+0000 7ff604ff9640 1 -- 172.21.15.37:0/3803568831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5f00ab1a0 con 0x7ff608143870 2023-11-24T06:17:29.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.344+0000 7ff607fff640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff5e806af00 0x7ff5e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.345+0000 7ff607fff640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff5e806af00 0x7ff5e806d3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80011e0 tx=0x7ff5f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:29.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.348+0000 7ff604ff9640 1 -- 172.21.15.37:0/3803568831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff60815fa30 con 0x7ff608143870 2023-11-24T06:17:29.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.545+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff60815fa30 con 0x7ff608143870 2023-11-24T06:17:29.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.545+0000 7ff604ff9640 1 -- 172.21.15.37:0/3803568831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff5f0034060 con 0x7ff608143870 2023-11-24T06:17:29.549 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:29.549 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:17:29.549 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:29.549 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-11-24T06:17:29.549 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-11-24T06:17:29.549 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:29.550 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff5e806af00 msgr2=0x7ff5e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff5e806af00 0x7ff5e806d3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80011e0 tx=0x7ff5f8009040 comp rx=0 tx=0).stop 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608143870 msgr2=0x7ff60815fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608143870 0x7ff60815fd10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0000c00 tx=0x7ff5f00046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 shutdown_connections 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7ff5e806af00 0x7ff5e806d3c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff608160250 0x7ff6080c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608143870 0x7ff60815fd10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 --2- 172.21.15.37:0/3803568831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6080b0fb0 0x7ff60815d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 >> 172.21.15.37:0/3803568831 conn(0x7ff6080cb830 msgr2=0x7ff6080cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 shutdown_connections 2023-11-24T06:17:29.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.548+0000 7ff60d7cb640 1 -- 172.21.15.37:0/3803568831 wait complete. 2023-11-24T06:17:29.570 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:17:29.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:17:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.799+0000 7f2e31e09640 1 Processor -- start 2023-11-24T06:17:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.799+0000 7f2e31e09640 1 -- start start 2023-11-24T06:17:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.801+0000 7f2e31e09640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.801+0000 7f2e31e09640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e2c0ce6c0 0x7f2e2c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.801+0000 7f2e31e09640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c0cece0 con 0x7f2e2c0cf450 2023-11-24T06:17:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.801+0000 7f2e31e09640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c156010 con 0x7f2e2c0ce6c0 2023-11-24T06:17:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.801+0000 7f2e31e09640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c06ce30 con 0x7f2e2c15c7f0 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e2c0ce6c0 0x7f2e2c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e2c0ce6c0 0x7f2e2c0cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44518/0 (socket says 172.21.15.37:44518) 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2bfff640 1 -- 172.21.15.37:0/4057902479 learned_addr learned my addr 172.21.15.37:0/4057902479 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2b7fe640 1 --2- 172.21.15.37:0/4057902479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2bfff640 1 -- 172.21.15.37:0/4057902479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 msgr2=0x7f2e2c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2bfff640 1 --2- 172.21.15.37:0/4057902479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2bfff640 1 -- 172.21.15.37:0/4057902479 >> v1:172.21.15.188:6789/0 conn(0x7f2e2c0cf450 legacy=0x7f2e2c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.802+0000 7f2e2bfff640 1 -- 172.21.15.37:0/4057902479 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c06d040 con 0x7f2e2c0ce6c0 2023-11-24T06:17:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.803+0000 7f2e2bfff640 1 --2- 172.21.15.37:0/4057902479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0ce6c0 0x7f2e2c0cf8d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009870 tx=0x7f2e2402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90592ddcdc41b87e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.804+0000 7f2e2a7fc640 1 -- 172.21.15.37:0/4057902479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24030840 con 0x7f2e2c0ce6c0 2023-11-24T06:17:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.804+0000 7f2e2a7fc640 1 -- 172.21.15.37:0/4057902479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e240309a0 con 0x7f2e2c0ce6c0 2023-11-24T06:17:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.804+0000 7f2e2a7fc640 1 -- 172.21.15.37:0/4057902479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24030d30 con 0x7f2e2c0ce6c0 2023-11-24T06:17:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.804+0000 7f2e31e09640 1 -- 172.21.15.37:0/4057902479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0ce6c0 msgr2=0x7f2e2c0cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.804+0000 7f2e31e09640 1 --2- 172.21.15.37:0/4057902479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0ce6c0 0x7f2e2c0cf8d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009870 tx=0x7f2e2402b980 comp rx=0 tx=0).stop 2023-11-24T06:17:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.805+0000 7f2e31e09640 1 -- 172.21.15.37:0/4057902479 shutdown_connections 2023-11-24T06:17:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.805+0000 7f2e31e09640 1 --2- 172.21.15.37:0/4057902479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0ce6c0 0x7f2e2c0cf8d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.805+0000 7f2e31e09640 1 --2- 172.21.15.37:0/4057902479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c06db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.805+0000 7f2e31e09640 1 -- 172.21.15.37:0/4057902479 >> 172.21.15.37:0/4057902479 conn(0x7f2e2c06a920 msgr2=0x7f2e2c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.805+0000 7f2e31e09640 1 -- 172.21.15.37:0/4057902479 shutdown_connections 2023-11-24T06:17:29.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.805+0000 7f2e31e09640 1 -- 172.21.15.37:0/4057902479 wait complete. 2023-11-24T06:17:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.806+0000 7f2e31e09640 1 Processor -- start 2023-11-24T06:17:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.807+0000 7f2e31e09640 1 -- start start 2023-11-24T06:17:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.807+0000 7f2e31e09640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2c0ce6c0 0x7f2e2c146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.807+0000 7f2e31e09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0cf450 0x7f2e2c14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.807+0000 7f2e31e09640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.807+0000 7f2e31e09640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c15a480 con 0x7f2e2c0cf450 2023-11-24T06:17:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.807+0000 7f2e31e09640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0b3990 con 0x7f2e2c0ce6c0 2023-11-24T06:17:29.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.807+0000 7f2e31e09640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c146da0 con 0x7f2e2c15c7f0 2023-11-24T06:17:29.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0cf450 0x7f2e2c14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0cf450 0x7f2e2c14aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44522/0 (socket says 172.21.15.37:44522) 2023-11-24T06:17:29.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 -- 172.21.15.37:0/77258897 learned_addr learned my addr 172.21.15.37:0/77258897 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2b7fe640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2c0ce6c0 0x7f2e2c146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2bfff640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 -- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 msgr2=0x7f2e2c14b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c14b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 -- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2c0ce6c0 msgr2=0x7f2e2c146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2c0ce6c0 0x7f2e2c146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2affd640 1 -- 172.21.15.37:0/77258897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e240094d0 con 0x7f2e2c0cf450 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.808+0000 7f2e2bfff640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c14b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.809+0000 7f2e2affd640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0cf450 0x7f2e2c14aeb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c450 tx=0x7f2e1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.809+0000 7f2e23fff640 1 -- 172.21.15.37:0/77258897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140052d0 con 0x7f2e2c0cf450 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.809+0000 7f2e23fff640 1 -- 172.21.15.37:0/77258897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14005430 con 0x7f2e2c0cf450 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.809+0000 7f2e23fff640 1 -- 172.21.15.37:0/77258897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14012870 con 0x7f2e2c0cf450 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.809+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c159800 con 0x7f2e2c0cf450 2023-11-24T06:17:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.809+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c159dc0 con 0x7f2e2c0cf450 2023-11-24T06:17:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.810+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c067470 con 0x7f2e2c0cf450 2023-11-24T06:17:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.811+0000 7f2e23fff640 1 -- 172.21.15.37:0/77258897 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f2e140129d0 con 0x7f2e2c0cf450 2023-11-24T06:17:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.812+0000 7f2e23fff640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e0c06aed0 0x7f2e0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.812+0000 7f2e23fff640 1 -- 172.21.15.37:0/77258897 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2e14088ea0 con 0x7f2e2c0cf450 2023-11-24T06:17:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.813+0000 7f2e2b7fe640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e0c06aed0 0x7f2e0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.813+0000 7f2e2b7fe640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e0c06aed0 0x7f2e0c06d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0073f0 tx=0x7f2e1c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:29.817+0000 7f2e23fff640 1 -- 172.21.15.37:0/77258897 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e14054240 con 0x7f2e2c0cf450 2023-11-24T06:17:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.012+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2e2c0cd730 con 0x7f2e2c0cf450 2023-11-24T06:17:30.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.652+0000 7f2e23fff640 1 -- 172.21.15.37:0/77258897 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2e14057860 con 0x7f2e2c0cf450 2023-11-24T06:17:30.655 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-11-24T06:17:30.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e0c06aed0 msgr2=0x7f2e0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:30.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e0c06aed0 0x7f2e0c06d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0073f0 tx=0x7f2e1c00b040 comp rx=0 tx=0).stop 2023-11-24T06:17:30.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0cf450 msgr2=0x7f2e2c14aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:30.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0cf450 0x7f2e2c14aeb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c450 tx=0x7f2e1400c910 comp rx=0 tx=0).stop 2023-11-24T06:17:30.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 shutdown_connections 2023-11-24T06:17:30.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e0c06aed0 0x7f2e0c06d390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e2c15c7f0 0x7f2e2c14b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c0cf450 0x7f2e2c14aeb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 --2- 172.21.15.37:0/77258897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2c0ce6c0 0x7f2e2c146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 >> 172.21.15.37:0/77258897 conn(0x7f2e2c06a920 msgr2=0x7f2e2c0cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.655+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 shutdown_connections 2023-11-24T06:17:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.656+0000 7f2e31e09640 1 -- 172.21.15.37:0/77258897 wait complete. 2023-11-24T06:17:30.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:17:30.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.907+0000 7f31654c2640 1 Processor -- start 2023-11-24T06:17:30.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.907+0000 7f31654c2640 1 -- start start 2023-11-24T06:17:30.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f31654c2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31600999d0 0x7f31600b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:30.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f31654c2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31600b5430 0x7f3160167280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:30.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f31654c2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600b37b0 con 0x7f316015d620 2023-11-24T06:17:30.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f31654c2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316006f9b0 con 0x7f31600999d0 2023-11-24T06:17:30.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f31654c2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316006d900 con 0x7f31600b5430 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f315e7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31600999d0 0x7f31600b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f315e7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31600999d0 0x7f31600b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60244/0 (socket says 172.21.15.37:60244) 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.909+0000 7f315e7fc640 1 -- 172.21.15.37:0/1725667758 learned_addr learned my addr 172.21.15.37:0/1725667758 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.910+0000 7f315f7fe640 1 --2- 172.21.15.37:0/1725667758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31600b5430 0x7f3160167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.910+0000 7f315e7fc640 1 -- 172.21.15.37:0/1725667758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31600b5430 msgr2=0x7f3160167280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.910+0000 7f315e7fc640 1 --2- 172.21.15.37:0/1725667758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31600b5430 0x7f3160167280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.910+0000 7f315e7fc640 1 -- 172.21.15.37:0/1725667758 >> v1:172.21.15.188:6789/0 conn(0x7f316015d620 legacy=0x7f31600b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:30.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.910+0000 7f315e7fc640 1 -- 172.21.15.37:0/1725667758 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316006dbe0 con 0x7f31600999d0 2023-11-24T06:17:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.911+0000 7f315e7fc640 1 --2- 172.21.15.37:0/1725667758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600999d0 0x7f31600b3270 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3154009870 tx=0x7f315402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f516965ee77de1ff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.911+0000 7f315dffb640 1 -- 172.21.15.37:0/1725667758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154030840 con 0x7f31600999d0 2023-11-24T06:17:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f315dffb640 1 -- 172.21.15.37:0/1725667758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31540309a0 con 0x7f31600999d0 2023-11-24T06:17:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f315dffb640 1 -- 172.21.15.37:0/1725667758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154030d30 con 0x7f31600999d0 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 -- 172.21.15.37:0/1725667758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600999d0 msgr2=0x7f31600b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 --2- 172.21.15.37:0/1725667758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600999d0 0x7f31600b3270 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3154009870 tx=0x7f315402b980 comp rx=0 tx=0).stop 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 -- 172.21.15.37:0/1725667758 shutdown_connections 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 --2- 172.21.15.37:0/1725667758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600999d0 0x7f31600b3270 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 --2- 172.21.15.37:0/1725667758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31600b5430 0x7f3160167280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 -- 172.21.15.37:0/1725667758 >> 172.21.15.37:0/1725667758 conn(0x7f316006c090 msgr2=0x7f31600b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 -- 172.21.15.37:0/1725667758 shutdown_connections 2023-11-24T06:17:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.912+0000 7f31654c2640 1 -- 172.21.15.37:0/1725667758 wait complete. 2023-11-24T06:17:30.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.914+0000 7f31654c2640 1 Processor -- start 2023-11-24T06:17:30.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.914+0000 7f31654c2640 1 -- start start 2023-11-24T06:17:30.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.915+0000 7f31654c2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31600999d0 0x7f3160150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:30.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.915+0000 7f31654c2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600b5430 0x7f31601f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:30.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.915+0000 7f31654c2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f316015d620 0x7f316014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:30.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.915+0000 7f31654c2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31601f3d90 con 0x7f31600b5430 2023-11-24T06:17:30.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.915+0000 7f31654c2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316014d3f0 con 0x7f31600999d0 2023-11-24T06:17:30.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.915+0000 7f31654c2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316015ede0 con 0x7f316015d620 2023-11-24T06:17:30.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600b5430 0x7f31601f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600b5430 0x7f31601f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60260/0 (socket says 172.21.15.37:60260) 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 -- 172.21.15.37:0/1040934145 learned_addr learned my addr 172.21.15.37:0/1040934145 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315effd640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31600999d0 0x7f3160150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315f7fe640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f316015d620 0x7f316014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 -- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f316015d620 msgr2=0x7f316014ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f316015d620 0x7f316014ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 -- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31600999d0 msgr2=0x7f3160150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31600999d0 0x7f3160150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315e7fc640 1 -- 172.21.15.37:0/1040934145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540094d0 con 0x7f31600b5430 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.916+0000 7f315f7fe640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f316015d620 0x7f316014ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:30.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.917+0000 7f315e7fc640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600b5430 0x7f31601f3850 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3154000c00 tx=0x7f3154004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:30.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.917+0000 7f31477fe640 1 -- 172.21.15.37:0/1040934145 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154039c90 con 0x7f31600b5430 2023-11-24T06:17:30.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.917+0000 7f31477fe640 1 -- 172.21.15.37:0/1040934145 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154039df0 con 0x7f31600b5430 2023-11-24T06:17:30.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.917+0000 7f31477fe640 1 -- 172.21.15.37:0/1040934145 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154043640 con 0x7f31600b5430 2023-11-24T06:17:30.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.917+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316015f0c0 con 0x7f31600b5430 2023-11-24T06:17:30.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.917+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316015f680 con 0x7f31600b5430 2023-11-24T06:17:30.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.919+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316004e8b0 con 0x7f31600b5430 2023-11-24T06:17:30.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.920+0000 7f31477fe640 1 -- 172.21.15.37:0/1040934145 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f31540437a0 con 0x7f31600b5430 2023-11-24T06:17:30.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.921+0000 7f31477fe640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f314c06aed0 0x7f314c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:30.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.921+0000 7f31477fe640 1 -- 172.21.15.37:0/1040934145 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f315403e070 con 0x7f31600b5430 2023-11-24T06:17:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.921+0000 7f315effd640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f314c06aed0 0x7f314c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.922+0000 7f315effd640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f314c06aed0 0x7f314c06d390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3150000f60 tx=0x7f3150009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:30.928+0000 7f31477fe640 1 -- 172.21.15.37:0/1040934145 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3154077730 con 0x7f31600b5430 2023-11-24T06:17:31.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.126+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3160157a10 con 0x7f31600b5430 2023-11-24T06:17:31.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.659+0000 7f31477fe640 1 -- 172.21.15.37:0/1040934145 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7f315407ad50 con 0x7f31600b5430 2023-11-24T06:17:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-11-24T06:17:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f314c06aed0 msgr2=0x7f314c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f314c06aed0 0x7f314c06d390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3150000f60 tx=0x7f3150009040 comp rx=0 tx=0).stop 2023-11-24T06:17:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600b5430 msgr2=0x7f31601f3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600b5430 0x7f31601f3850 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3154000c00 tx=0x7f3154004730 comp rx=0 tx=0).stop 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 shutdown_connections 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f314c06aed0 0x7f314c06d390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f316015d620 0x7f316014ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600b5430 0x7f31601f3850 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 --2- 172.21.15.37:0/1040934145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31600999d0 0x7f3160150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.663+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 >> 172.21.15.37:0/1040934145 conn(0x7f316006c090 msgr2=0x7f3160157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.664+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 shutdown_connections 2023-11-24T06:17:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.664+0000 7f31654c2640 1 -- 172.21.15.37:0/1040934145 wait complete. 2023-11-24T06:17:31.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:17:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.892+0000 7f5c2091c640 1 Processor -- start 2023-11-24T06:17:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.892+0000 7f5c2091c640 1 -- start start 2023-11-24T06:17:31.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.893+0000 7f5c2091c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5c1c15a1c0 0x7f5c1c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c2091c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 0x7f5c1c0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c2091c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c06d430 con 0x7f5c1c15ded0 2023-11-24T06:17:31.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c2091c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c15ea70 con 0x7f5c1c15a1c0 2023-11-24T06:17:31.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c2091c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c15ec50 con 0x7f5c1c0b0b40 2023-11-24T06:17:31.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c1b59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5c1c15ded0 0x7f5c1c15e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55834/0 (socket says 172.21.15.37:55834) 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c1b59e640 1 -- 172.21.15.37:0/1155158037 learned_addr learned my addr 172.21.15.37:0/1155158037 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 0x7f5c1c0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.894+0000 7f5c1ad9d640 1 --2- 172.21.15.37:0/1155158037 >> v2:172.21.15.188:3300/0 conn(0x7f5c1c15a1c0 0x7f5c1c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068765005 0 0) 0x7f5c1c06d430 con 0x7f5c1c15ded0 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c04003520 con 0x7f5c1c15ded0 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3745878971 0 0) 0x7f5c04003520 con 0x7f5c1c15ded0 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 msgr2=0x7f5c1c0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 0x7f5c1c0b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 >> v2:172.21.15.188:3300/0 conn(0x7f5c1c15a1c0 msgr2=0x7f5c1c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 --2- 172.21.15.37:0/1155158037 >> v2:172.21.15.188:3300/0 conn(0x7f5c1c15a1c0 0x7f5c1c06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c0b14e0 con 0x7f5c1c15ded0 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f5c140019f0 con 0x7f5c1c15ded0 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 >> v1:172.21.15.37:6789/0 conn(0x7f5c1c15ded0 legacy=0x7f5c1c15e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c04003970 0x7f5c04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 0x7f5c04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c15ea70 con 0x7f5c040047c0 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c15ec50 con 0x7f5c04003970 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0400b980 con 0x7f5c1c0b0b40 2023-11-24T06:17:31.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.895+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.896+0000 7f5c1ad9d640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c04003970 0x7f5c04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.896+0000 7f5c1b59e640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 0x7f5c04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.896+0000 7f5c1a59c640 1 -- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 msgr2=0x7f5c04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.896+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c0b0b40 0x7f5c04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.896+0000 7f5c1a59c640 1 -- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c04003970 msgr2=0x7f5c04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.896+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c04003970 0x7f5c04003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.896+0000 7f5c1a59c640 1 -- 172.21.15.37:0/1155158037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04003520 con 0x7f5c040047c0 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.897+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c04004c40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009ac0 tx=0x7f5c040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f957cef8024fd5e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.897+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1002c6b0 con 0x7f5c040047c0 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.897+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1002c810 con 0x7f5c040047c0 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.897+0000 7f5c19d9b640 1 -- 172.21.15.37:0/1155158037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1002cba0 con 0x7f5c040047c0 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.898+0000 7f5c2091c640 1 -- 172.21.15.37:0/1155158037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 msgr2=0x7f5c04004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.898+0000 7f5c2091c640 1 --2- 172.21.15.37:0/1155158037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c04004c40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009ac0 tx=0x7f5c040057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.898+0000 7f5c1b59e640 1 -- 172.21.15.37:0/1155158037 reap_dead start 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.898+0000 7f5c2091c640 1 -- 172.21.15.37:0/1155158037 shutdown_connections 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.898+0000 7f5c2091c640 1 -- 172.21.15.37:0/1155158037 >> 172.21.15.37:0/1155158037 conn(0x7f5c1c0cbb40 msgr2=0x7f5c1c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.898+0000 7f5c2091c640 1 -- 172.21.15.37:0/1155158037 shutdown_connections 2023-11-24T06:17:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.898+0000 7f5c2091c640 1 -- 172.21.15.37:0/1155158037 wait complete. 2023-11-24T06:17:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.900+0000 7f5c2091c640 1 Processor -- start 2023-11-24T06:17:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.900+0000 7f5c2091c640 1 -- start start 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c2091c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c1c0abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c2091c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c0ae9f0 0x7f5c1c071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c2091c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c158810 0x7f5c1c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c2091c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c071b40 con 0x7f5c040047c0 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c2091c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0ac4e0 con 0x7f5c1c0ae9f0 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c2091c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0adf10 con 0x7f5c1c158810 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c1ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c1c0abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c1ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c1c0abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60272/0 (socket says 172.21.15.37:60272) 2023-11-24T06:17:31.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.901+0000 7f5c1ad9d640 1 -- 172.21.15.37:0/2100156962 learned_addr learned my addr 172.21.15.37:0/2100156962 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c0ae9f0 0x7f5c1c071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1b59e640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c158810 0x7f5c1c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1ad9d640 1 -- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c158810 msgr2=0x7f5c1c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1ad9d640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c158810 0x7f5c1c0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1ad9d640 1 -- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c0ae9f0 msgr2=0x7f5c1c071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1ad9d640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c0ae9f0 0x7f5c1c071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1ad9d640 1 -- 172.21.15.37:0/2100156962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c0ae1f0 con 0x7f5c040047c0 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c1ad9d640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c1c0abe50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0116d0 tx=0x7f5c0c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.902+0000 7f5c037fe640 1 -- 172.21.15.37:0/2100156962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c00f9c0 con 0x7f5c040047c0 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.903+0000 7f5c037fe640 1 -- 172.21.15.37:0/2100156962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c00fb20 con 0x7f5c040047c0 2023-11-24T06:17:31.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.903+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c0ae4d0 con 0x7f5c040047c0 2023-11-24T06:17:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.903+0000 7f5c037fe640 1 -- 172.21.15.37:0/2100156962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c00fe90 con 0x7f5c040047c0 2023-11-24T06:17:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.903+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c0adb30 con 0x7f5c040047c0 2023-11-24T06:17:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.904+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c04e840 con 0x7f5c040047c0 2023-11-24T06:17:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.905+0000 7f5c037fe640 1 -- 172.21.15.37:0/2100156962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f5c0c015460 con 0x7f5c040047c0 2023-11-24T06:17:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.906+0000 7f5c037fe640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5c0806aed0 0x7f5c0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.906+0000 7f5c037fe640 1 -- 172.21.15.37:0/2100156962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5c0c089fa0 con 0x7f5c040047c0 2023-11-24T06:17:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.906+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5c0806aed0 0x7f5c0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.907+0000 7f5c1a59c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5c0806aed0 0x7f5c0806d390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5c10036000 tx=0x7f5c10030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:31.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:31.910+0000 7f5c037fe640 1 -- 172.21.15.37:0/2100156962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c0c0550d0 con 0x7f5c040047c0 2023-11-24T06:17:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.140+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c1c06c6d0 con 0x7f5c040047c0 2023-11-24T06:17:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.713+0000 7f5c037fe640 1 -- 172.21.15.37:0/2100156962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5c0c0586f0 con 0x7f5c040047c0 2023-11-24T06:17:32.721 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 10 and data pool 11 2023-11-24T06:17:32.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.726+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5c0806aed0 msgr2=0x7f5c0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:32.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.726+0000 7f5c2091c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5c0806aed0 0x7f5c0806d390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5c10036000 tx=0x7f5c10030000 comp rx=0 tx=0).stop 2023-11-24T06:17:32.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.726+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 msgr2=0x7f5c1c0abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:32.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.726+0000 7f5c2091c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c1c0abe50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0116d0 tx=0x7f5c0c011b90 comp rx=0 tx=0).stop 2023-11-24T06:17:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.727+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 shutdown_connections 2023-11-24T06:17:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.728+0000 7f5c2091c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5c0806aed0 0x7f5c0806d390 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.728+0000 7f5c2091c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c1c0ae9f0 0x7f5c1c071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.728+0000 7f5c2091c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c1c158810 0x7f5c1c0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.728+0000 7f5c2091c640 1 --2- 172.21.15.37:0/2100156962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c040047c0 0x7f5c1c0abe50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.728+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 >> 172.21.15.37:0/2100156962 conn(0x7f5c1c0cbb40 msgr2=0x7f5c1c159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.728+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 shutdown_connections 2023-11-24T06:17:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.728+0000 7f5c2091c640 1 -- 172.21.15.37:0/2100156962 wait complete. 2023-11-24T06:17:32.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.939+0000 7fc5c1d4e640 1 Processor -- start 2023-11-24T06:17:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.940+0000 7fc5c1d4e640 1 -- start start 2023-11-24T06:17:32.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.941+0000 7fc5c1d4e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5bc15c410 0x7fc5bc15f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:32.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.941+0000 7fc5c1d4e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc15bf80 con 0x7fc5bc144b30 2023-11-24T06:17:32.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.941+0000 7fc5c1d4e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc0b1560 con 0x7fc5bc0b1de0 2023-11-24T06:17:32.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.941+0000 7fc5c1d4e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc0b1280 con 0x7fc5bc15c410 2023-11-24T06:17:32.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.942+0000 7fc5bbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5bc15c410 0x7fc5bc15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:32.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.942+0000 7fc5c0d4c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc5bc144b30 0x7fc5bc0b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55838/0 (socket says 172.21.15.37:55838) 2023-11-24T06:17:32.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.942+0000 7fc5c0d4c640 1 -- 172.21.15.37:0/2804636452 learned_addr learned my addr 172.21.15.37:0/2804636452 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:32.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.942+0000 7fc5bbfff640 1 -- 172.21.15.37:0/2804636452 >> v1:172.21.15.188:6789/0 conn(0x7fc5bc0b1de0 legacy=0x7fc5bc0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:32.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.942+0000 7fc5bbfff640 1 -- 172.21.15.37:0/2804636452 >> v1:172.21.15.37:6789/0 conn(0x7fc5bc144b30 legacy=0x7fc5bc0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:32.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.942+0000 7fc5bb7fe640 1 -- 172.21.15.37:0/2804636452 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515065934 0 0) 0x7fc5bc15bf80 con 0x7fc5bc144b30 2023-11-24T06:17:32.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.942+0000 7fc5bbfff640 1 -- 172.21.15.37:0/2804636452 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc15b930 con 0x7fc5bc15c410 2023-11-24T06:17:32.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.944+0000 7fc5bbfff640 1 --2- 172.21.15.37:0/2804636452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc15c410 0x7fc5bc15f920 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097a0 tx=0x7fc5a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52587302106c9fa4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.944+0000 7fc5bb7fe640 1 -- 172.21.15.37:0/2804636452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031830 con 0x7fc5bc15c410 2023-11-24T06:17:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.944+0000 7fc5bb7fe640 1 -- 172.21.15.37:0/2804636452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4031990 con 0x7fc5bc15c410 2023-11-24T06:17:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.944+0000 7fc5bb7fe640 1 -- 172.21.15.37:0/2804636452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031d20 con 0x7fc5bc15c410 2023-11-24T06:17:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.945+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/2804636452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc15c410 msgr2=0x7fc5bc15f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.945+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/2804636452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc15c410 0x7fc5bc15f920 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097a0 tx=0x7fc5a402b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.945+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/2804636452 shutdown_connections 2023-11-24T06:17:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.945+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/2804636452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc15c410 0x7fc5bc15f920 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.945+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/2804636452 >> 172.21.15.37:0/2804636452 conn(0x7fc5bc0cb830 msgr2=0x7fc5bc0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.945+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/2804636452 shutdown_connections 2023-11-24T06:17:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.945+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/2804636452 wait complete. 2023-11-24T06:17:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.947+0000 7fc5c1d4e640 1 Processor -- start 2023-11-24T06:17:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.947+0000 7fc5c1d4e640 1 -- start start 2023-11-24T06:17:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5c1d4e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0b1de0 0x7fc5bc1413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5c1d4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc144b30 0x7fc5bc15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5c1d4e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc15c410 0x7fc5bc143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5c1d4e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc15aa40 con 0x7fc5bc144b30 2023-11-24T06:17:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5c1d4e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc1443e0 con 0x7fc5bc15c410 2023-11-24T06:17:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5c1d4e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc142830 con 0x7fc5bc0b1de0 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc144b30 0x7fc5bc15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc144b30 0x7fc5bc15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60286/0 (socket says 172.21.15.37:60286) 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 -- 172.21.15.37:0/3097066991 learned_addr learned my addr 172.21.15.37:0/3097066991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 -- 172.21.15.37:0/3097066991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0b1de0 msgr2=0x7fc5bc1413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0b1de0 0x7fc5bc1413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 -- 172.21.15.37:0/3097066991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc15c410 msgr2=0x7fc5bc143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc15c410 0x7fc5bc143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.948+0000 7fc5bbfff640 1 -- 172.21.15.37:0/3097066991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009400 con 0x7fc5bc144b30 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.949+0000 7fc5bbfff640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc144b30 0x7fc5bc15a500 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40098c0 tx=0x7fc5a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.949+0000 7fc5b97fa640 1 -- 172.21.15.37:0/3097066991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a403bb70 con 0x7fc5bc144b30 2023-11-24T06:17:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.949+0000 7fc5b97fa640 1 -- 172.21.15.37:0/3097066991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a403bcf0 con 0x7fc5bc144b30 2023-11-24T06:17:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.949+0000 7fc5b97fa640 1 -- 172.21.15.37:0/3097066991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4045630 con 0x7fc5bc144b30 2023-11-24T06:17:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.949+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc142b10 con 0x7fc5bc144b30 2023-11-24T06:17:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.949+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc141af0 con 0x7fc5bc144b30 2023-11-24T06:17:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.950+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc067970 con 0x7fc5bc144b30 2023-11-24T06:17:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.951+0000 7fc5b97fa640 1 -- 172.21.15.37:0/3097066991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fc5a404e450 con 0x7fc5bc144b30 2023-11-24T06:17:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.952+0000 7fc5b97fa640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc59c06af00 0x7fc59c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.952+0000 7fc5b97fa640 1 -- 172.21.15.37:0/3097066991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5a40abad0 con 0x7fc5bc144b30 2023-11-24T06:17:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.952+0000 7fc5c0d4c640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc59c06af00 0x7fc59c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.953+0000 7fc5c0d4c640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc59c06af00 0x7fc59c06d3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac007fd0 tx=0x7fc5ac007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:32.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:32.956+0000 7fc5b97fa640 1 -- 172.21.15.37:0/3097066991 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5a4076ba0 con 0x7fc5bc144b30 2023-11-24T06:17:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.146+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5bc04e840 con 0x7fc5bc144b30 2023-11-24T06:17:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.149+0000 7fc5b97fa640 1 -- 172.21.15.37:0/3097066991 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fc5a4035090 con 0x7fc5bc144b30 2023-11-24T06:17:33.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:33.153 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:32.141756+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.152+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc59c06af00 msgr2=0x7fc59c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.152+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc59c06af00 0x7fc59c06d3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac007fd0 tx=0x7fc5ac007ce0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.152+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc144b30 msgr2=0x7fc5bc15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.152+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc144b30 0x7fc5bc15a500 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40098c0 tx=0x7fc5a40046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 shutdown_connections 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc59c06af00 0x7fc59c06d3c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc15c410 0x7fc5bc143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5bc144b30 0x7fc5bc15a500 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 --2- 172.21.15.37:0/3097066991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0b1de0 0x7fc5bc1413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 >> 172.21.15.37:0/3097066991 conn(0x7fc5bc0cb830 msgr2=0x7fc5bc13f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 shutdown_connections 2023-11-24T06:17:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.153+0000 7fc5c1d4e640 1 -- 172.21.15.37:0/3097066991 wait complete. 2023-11-24T06:17:33.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:33.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.385+0000 7f8d19bac640 1 Processor -- start 2023-11-24T06:17:33.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.386+0000 7f8d19bac640 1 -- start start 2023-11-24T06:17:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d19bac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d14144b30 0x7f8d1415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d19bac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d1415c410 0x7f8d140b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d19bac640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1415bf80 con 0x7f8d140b1de0 2023-11-24T06:17:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d19bac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140b1560 con 0x7f8d1415c410 2023-11-24T06:17:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d19bac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140b0fb0 con 0x7f8d14144b30 2023-11-24T06:17:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d13fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d1415c410 0x7f8d140b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d13fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d1415c410 0x7f8d140b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60290/0 (socket says 172.21.15.37:60290) 2023-11-24T06:17:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.387+0000 7f8d13fff640 1 -- 172.21.15.37:0/1937922966 learned_addr learned my addr 172.21.15.37:0/1937922966 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.388+0000 7f8d18baa640 1 --2- 172.21.15.37:0/1937922966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d14144b30 0x7f8d1415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.388+0000 7f8d13fff640 1 -- 172.21.15.37:0/1937922966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d14144b30 msgr2=0x7f8d1415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.388+0000 7f8d13fff640 1 --2- 172.21.15.37:0/1937922966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d14144b30 0x7f8d1415f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.388+0000 7f8d13fff640 1 -- 172.21.15.37:0/1937922966 >> v1:172.21.15.188:6789/0 conn(0x7f8d140b1de0 legacy=0x7f8d1406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.388+0000 7f8d13fff640 1 -- 172.21.15.37:0/1937922966 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d140b1280 con 0x7f8d1415c410 2023-11-24T06:17:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.389+0000 7f8d13fff640 1 --2- 172.21.15.37:0/1937922966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c410 0x7f8d140b0a70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009870 tx=0x7f8d0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2fee1f16b66a34 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.389+0000 7f8d137fe640 1 -- 172.21.15.37:0/1937922966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00031640 con 0x7f8d1415c410 2023-11-24T06:17:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.389+0000 7f8d137fe640 1 -- 172.21.15.37:0/1937922966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d000317a0 con 0x7f8d1415c410 2023-11-24T06:17:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.389+0000 7f8d137fe640 1 -- 172.21.15.37:0/1937922966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00031b30 con 0x7f8d1415c410 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 -- 172.21.15.37:0/1937922966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c410 msgr2=0x7f8d140b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 --2- 172.21.15.37:0/1937922966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c410 0x7f8d140b0a70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009870 tx=0x7f8d0002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 -- 172.21.15.37:0/1937922966 shutdown_connections 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 --2- 172.21.15.37:0/1937922966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1415c410 0x7f8d140b0a70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 --2- 172.21.15.37:0/1937922966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d14144b30 0x7f8d1415f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 -- 172.21.15.37:0/1937922966 >> 172.21.15.37:0/1937922966 conn(0x7f8d140cb830 msgr2=0x7f8d140cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 -- 172.21.15.37:0/1937922966 shutdown_connections 2023-11-24T06:17:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.390+0000 7f8d19bac640 1 -- 172.21.15.37:0/1937922966 wait complete. 2023-11-24T06:17:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.392+0000 7f8d19bac640 1 Processor -- start 2023-11-24T06:17:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.392+0000 7f8d19bac640 1 -- start start 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d19bac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d140b1de0 0x7f8d140c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d19bac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d14144b30 0x7f8d14138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d19bac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d1415c410 0x7f8d1413a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d19bac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c9830 con 0x7f8d14144b30 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d19bac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14138db0 con 0x7f8d1415c410 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d19bac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c9a10 con 0x7f8d140b1de0 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d14144b30 0x7f8d14138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d14144b30 0x7f8d14138870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60306/0 (socket says 172.21.15.37:60306) 2023-11-24T06:17:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.393+0000 7f8d13fff640 1 -- 172.21.15.37:0/976408887 learned_addr learned my addr 172.21.15.37:0/976408887 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d13fff640 1 -- 172.21.15.37:0/976408887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d140b1de0 msgr2=0x7f8d140c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d13fff640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d140b1de0 0x7f8d140c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d13fff640 1 -- 172.21.15.37:0/976408887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d1415c410 msgr2=0x7f8d1413a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d13fff640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d1415c410 0x7f8d1413a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d13fff640 1 -- 172.21.15.37:0/976408887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000094d0 con 0x7f8d14144b30 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d13fff640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d14144b30 0x7f8d14138870 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009870 tx=0x7f8d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d117fa640 1 -- 172.21.15.37:0/976408887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0003ac60 con 0x7f8d14144b30 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d117fa640 1 -- 172.21.15.37:0/976408887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0003adc0 con 0x7f8d14144b30 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d117fa640 1 -- 172.21.15.37:0/976408887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00044630 con 0x7f8d14144b30 2023-11-24T06:17:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.394+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d140c9cf0 con 0x7f8d14144b30 2023-11-24T06:17:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.395+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d140ca2b0 con 0x7f8d14144b30 2023-11-24T06:17:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.396+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1404e840 con 0x7f8d14144b30 2023-11-24T06:17:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.397+0000 7f8d117fa640 1 -- 172.21.15.37:0/976408887 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f8d0002f050 con 0x7f8d14144b30 2023-11-24T06:17:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.398+0000 7f8d117fa640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8cf806aed0 0x7f8cf806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.398+0000 7f8d117fa640 1 -- 172.21.15.37:0/976408887 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d000ab590 con 0x7f8d14144b30 2023-11-24T06:17:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.398+0000 7f8d18baa640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8cf806aed0 0x7f8cf806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.399+0000 7f8d18baa640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8cf806aed0 0x7f8cf806d390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d14140e90 tx=0x7f8d08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.403+0000 7f8d117fa640 1 -- 172.21.15.37:0/976408887 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d000766f0 con 0x7f8d14144b30 2023-11-24T06:17:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.596+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d1406d860 con 0x7f8d14144b30 2023-11-24T06:17:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.599+0000 7f8d117fa640 1 -- 172.21.15.37:0/976408887 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f8d00031e60 con 0x7f8d14144b30 2023-11-24T06:17:33.602 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:33.602 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:32.141756+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8cf806aed0 msgr2=0x7f8cf806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8cf806aed0 0x7f8cf806d390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d14140e90 tx=0x7f8d08008040 comp rx=0 tx=0).stop 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d14144b30 msgr2=0x7f8d14138870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d14144b30 0x7f8d14138870 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009870 tx=0x7f8d000046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 shutdown_connections 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f8cf806aed0 0x7f8cf806d390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d1415c410 0x7f8d1413a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d14144b30 0x7f8d14138870 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 --2- 172.21.15.37:0/976408887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d140b1de0 0x7f8d140c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 >> 172.21.15.37:0/976408887 conn(0x7f8d140cb830 msgr2=0x7f8d140cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 shutdown_connections 2023-11-24T06:17:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.602+0000 7f8d19bac640 1 -- 172.21.15.37:0/976408887 wait complete. 2023-11-24T06:17:33.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:17:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.850+0000 7fa226ecf640 1 Processor -- start 2023-11-24T06:17:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.850+0000 7fa226ecf640 1 -- start start 2023-11-24T06:17:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.852+0000 7fa226ecf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa22015b440 0x7fa2200cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.852+0000 7fa226ecf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa2200c59b0 0x7fa22006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.852+0000 7fa226ecf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2200cc3a0 con 0x7fa2200cbf20 2023-11-24T06:17:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.852+0000 7fa226ecf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22015b820 con 0x7fa2200c59b0 2023-11-24T06:17:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.852+0000 7fa226ecf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22015eea0 con 0x7fa22015b440 2023-11-24T06:17:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.853+0000 7fa22546c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa2200c59b0 0x7fa22006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.853+0000 7fa21ffff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fa2200cbf20 0x7fa2200c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:60440/0 (socket says 172.21.15.37:60440) 2023-11-24T06:17:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.853+0000 7fa21ffff640 1 -- 172.21.15.37:0/2311380253 learned_addr learned my addr 172.21.15.37:0/2311380253 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.853+0000 7fa224c6b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa22015b440 0x7fa2200cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.854+0000 7fa224c6b640 1 -- 172.21.15.37:0/2311380253 >> v2:172.21.15.188:3300/0 conn(0x7fa2200c59b0 msgr2=0x7fa22006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.854+0000 7fa224c6b640 1 --2- 172.21.15.37:0/2311380253 >> v2:172.21.15.188:3300/0 conn(0x7fa2200c59b0 0x7fa22006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.854+0000 7fa224c6b640 1 -- 172.21.15.37:0/2311380253 >> v1:172.21.15.188:6789/0 conn(0x7fa2200cbf20 legacy=0x7fa2200c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.854+0000 7fa224c6b640 1 -- 172.21.15.37:0/2311380253 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200abf30 con 0x7fa22015b440 2023-11-24T06:17:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.854+0000 7fa22546c640 1 --2- 172.21.15.37:0/2311380253 >> v2:172.21.15.188:3300/0 conn(0x7fa2200c59b0 0x7fa22006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.855+0000 7fa224c6b640 1 --2- 172.21.15.37:0/2311380253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa22015b440 0x7fa2200cb9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2140097a0 tx=0x7fa21402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba775c74faf9dc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.856+0000 7fa21f7fe640 1 -- 172.21.15.37:0/2311380253 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214031780 con 0x7fa22015b440 2023-11-24T06:17:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa21f7fe640 1 -- 172.21.15.37:0/2311380253 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140318e0 con 0x7fa22015b440 2023-11-24T06:17:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa21f7fe640 1 -- 172.21.15.37:0/2311380253 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214031c70 con 0x7fa22015b440 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 -- 172.21.15.37:0/2311380253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa22015b440 msgr2=0x7fa2200cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2311380253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa22015b440 0x7fa2200cb9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2140097a0 tx=0x7fa21402b820 comp rx=0 tx=0).stop 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 -- 172.21.15.37:0/2311380253 shutdown_connections 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2311380253 >> v2:172.21.15.188:3300/0 conn(0x7fa2200c59b0 0x7fa22006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2311380253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa22015b440 0x7fa2200cb9e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 -- 172.21.15.37:0/2311380253 >> 172.21.15.37:0/2311380253 conn(0x7fa2200b0c50 msgr2=0x7fa2200b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 -- 172.21.15.37:0/2311380253 shutdown_connections 2023-11-24T06:17:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.857+0000 7fa226ecf640 1 -- 172.21.15.37:0/2311380253 wait complete. 2023-11-24T06:17:33.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.860+0000 7fa226ecf640 1 Processor -- start 2023-11-24T06:17:33.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.860+0000 7fa226ecf640 1 -- start start 2023-11-24T06:17:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa226ecf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2200c59b0 0x7fa22015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa226ecf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2200cbf20 0x7fa2200cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa226ecf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa22015b440 0x7fa220156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa226ecf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22015d6f0 con 0x7fa2200c59b0 2023-11-24T06:17:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa226ecf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200ce280 con 0x7fa22015b440 2023-11-24T06:17:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa226ecf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22015ca70 con 0x7fa2200cbf20 2023-11-24T06:17:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa224c6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2200c59b0 0x7fa22015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa224c6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2200c59b0 0x7fa22015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60318/0 (socket says 172.21.15.37:60318) 2023-11-24T06:17:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.861+0000 7fa224c6b640 1 -- 172.21.15.37:0/2731796284 learned_addr learned my addr 172.21.15.37:0/2731796284 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa21ffff640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2200cbf20 0x7fa2200cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa224c6b640 1 -- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2200cbf20 msgr2=0x7fa2200cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa22546c640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa22015b440 0x7fa220156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa224c6b640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2200cbf20 0x7fa2200cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa224c6b640 1 -- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa22015b440 msgr2=0x7fa220156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa224c6b640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa22015b440 0x7fa220156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa224c6b640 1 -- 172.21.15.37:0/2731796284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009a70 con 0x7fa2200c59b0 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.862+0000 7fa224c6b640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2200c59b0 0x7fa22015c370 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa21402be30 tx=0x7fa2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.863+0000 7fa21d7fa640 1 -- 172.21.15.37:0/2731796284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214032820 con 0x7fa2200c59b0 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.863+0000 7fa21d7fa640 1 -- 172.21.15.37:0/2731796284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa214032980 con 0x7fa2200c59b0 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.863+0000 7fa21d7fa640 1 -- 172.21.15.37:0/2731796284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214032d30 con 0x7fa2200c59b0 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.863+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa214009400 con 0x7fa2200c59b0 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.863+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22015d030 con 0x7fa2200c59b0 2023-11-24T06:17:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.864+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22004e8b0 con 0x7fa2200c59b0 2023-11-24T06:17:33.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.865+0000 7fa21d7fa640 1 -- 172.21.15.37:0/2731796284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fa21404d3f0 con 0x7fa2200c59b0 2023-11-24T06:17:33.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.866+0000 7fa21d7fa640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa20c06af00 0x7fa20c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:33.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.866+0000 7fa21d7fa640 1 -- 172.21.15.37:0/2731796284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2140ab350 con 0x7fa2200c59b0 2023-11-24T06:17:33.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.867+0000 7fa21ffff640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa20c06af00 0x7fa20c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:33.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.867+0000 7fa21ffff640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa20c06af00 0x7fa20c06d3c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa2200c9030 tx=0x7fa210009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:33.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:33.870+0000 7fa21d7fa640 1 -- 172.21.15.37:0/2731796284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa214076300 con 0x7fa2200c59b0 2023-11-24T06:17:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.109+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa220157670 con 0x7fa2200c59b0 2023-11-24T06:17:34.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.730+0000 7fa21d7fa640 1 -- 172.21.15.37:0/2731796284 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa214079920 con 0x7fa2200c59b0 2023-11-24T06:17:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.733+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa20c06af00 msgr2=0x7fa20c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.733+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa20c06af00 0x7fa20c06d3c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa2200c9030 tx=0x7fa210009040 comp rx=0 tx=0).stop 2023-11-24T06:17:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.733+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2200c59b0 msgr2=0x7fa22015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.733+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2200c59b0 0x7fa22015c370 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa21402be30 tx=0x7fa2140046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 shutdown_connections 2023-11-24T06:17:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa20c06af00 0x7fa20c06d3c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa22015b440 0x7fa220156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2200cbf20 0x7fa2200cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 --2- 172.21.15.37:0/2731796284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2200c59b0 0x7fa22015c370 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 >> 172.21.15.37:0/2731796284 conn(0x7fa2200b0c50 msgr2=0x7fa220071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 shutdown_connections 2023-11-24T06:17:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.734+0000 7fa226ecf640 1 -- 172.21.15.37:0/2731796284 wait complete. 2023-11-24T06:17:34.757 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:17:34.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:17:34.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.979+0000 7fd968368640 1 Processor -- start 2023-11-24T06:17:34.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.979+0000 7fd968368640 1 -- start start 2023-11-24T06:17:34.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.981+0000 7fd968368640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9600ccbd0 0x7fd9601660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.981+0000 7fd968368640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9601655f0 con 0x7fd9600ccfb0 2023-11-24T06:17:34.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.981+0000 7fd968368640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9600cc380 con 0x7fd9600c9650 2023-11-24T06:17:34.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.981+0000 7fd968368640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd960162b30 con 0x7fd9600ccbd0 2023-11-24T06:17:34.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.982+0000 7fd965903640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd9600ccfb0 0x7fd960162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55842/0 (socket says 172.21.15.37:55842) 2023-11-24T06:17:34.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.982+0000 7fd965903640 1 -- 172.21.15.37:0/3780980055 learned_addr learned my addr 172.21.15.37:0/3780980055 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.982+0000 7fd966104640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9600ccbd0 0x7fd9601660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.982+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178253922 0 0) 0x7fd9601655f0 con 0x7fd9600ccfb0 2023-11-24T06:17:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.982+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c003520 con 0x7fd9600ccfb0 2023-11-24T06:17:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1977457829 0 0) 0x7fd94c003520 con 0x7fd9600ccfb0 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9600ccbd0 msgr2=0x7fd9601660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9600ccbd0 0x7fd9601660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 >> v1:172.21.15.188:6789/0 conn(0x7fd9600c9650 legacy=0x7fd9600c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960162e10 con 0x7fd9600ccfb0 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd950001670 con 0x7fd9600ccfb0 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 >> v1:172.21.15.37:6789/0 conn(0x7fd9600ccfb0 legacy=0x7fd960162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd94c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9600ccbd0 0x7fd94c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd94c004d00 0x7fd94c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960162b30 con 0x7fd94c0039a0 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c00ba60 con 0x7fd94c004d00 2023-11-24T06:17:34.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c00bc20 con 0x7fd9600ccbd0 2023-11-24T06:17:34.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.983+0000 7fd966104640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd94c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:34.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.984+0000 7fd966104640 1 -- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9600ccbd0 msgr2=0x7fd94c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:34.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.984+0000 7fd966104640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9600ccbd0 0x7fd94c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.984+0000 7fd966104640 1 -- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd94c004d00 msgr2=0x7fd94c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:34.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.984+0000 7fd966104640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd94c004d00 0x7fd94c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.984+0000 7fd966104640 1 -- 172.21.15.37:0/3780980055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c003520 con 0x7fd94c0039a0 2023-11-24T06:17:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.985+0000 7fd966104640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd94c003dc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009a90 tx=0x7fd94c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606e9d6bfa892ebb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.985+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c02c6b0 con 0x7fd94c0039a0 2023-11-24T06:17:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.985+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c02c810 con 0x7fd94c0039a0 2023-11-24T06:17:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.985+0000 7fd965102640 1 -- 172.21.15.37:0/3780980055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c02cba0 con 0x7fd94c0039a0 2023-11-24T06:17:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.986+0000 7fd968368640 1 -- 172.21.15.37:0/3780980055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 msgr2=0x7fd94c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.986+0000 7fd968368640 1 --2- 172.21.15.37:0/3780980055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd94c003dc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009a90 tx=0x7fd94c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.986+0000 7fd966905640 1 -- 172.21.15.37:0/3780980055 reap_dead start 2023-11-24T06:17:34.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.986+0000 7fd968368640 1 -- 172.21.15.37:0/3780980055 shutdown_connections 2023-11-24T06:17:34.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.986+0000 7fd968368640 1 -- 172.21.15.37:0/3780980055 >> 172.21.15.37:0/3780980055 conn(0x7fd9600b0c50 msgr2=0x7fd9600b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:34.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.986+0000 7fd968368640 1 -- 172.21.15.37:0/3780980055 shutdown_connections 2023-11-24T06:17:34.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.986+0000 7fd968368640 1 -- 172.21.15.37:0/3780980055 wait complete. 2023-11-24T06:17:34.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.988+0000 7fd968368640 1 Processor -- start 2023-11-24T06:17:34.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.988+0000 7fd968368640 1 -- start start 2023-11-24T06:17:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd968368640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd9600ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd968368640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd960158340 0x7fd9601587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd968368640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd96009a3e0 0x7fd96009a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd968368640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601647a0 con 0x7fd94c0039a0 2023-11-24T06:17:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd968368640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960158d00 con 0x7fd960158340 2023-11-24T06:17:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd968368640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96009ada0 con 0x7fd96009a3e0 2023-11-24T06:17:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd9600ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd9600ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60340/0 (socket says 172.21.15.37:60340) 2023-11-24T06:17:34.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 -- 172.21.15.37:0/868557257 learned_addr learned my addr 172.21.15.37:0/868557257 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 -- 172.21.15.37:0/868557257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd96009a3e0 msgr2=0x7fd96009a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd96009a3e0 0x7fd96009a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 -- 172.21.15.37:0/868557257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd960158340 msgr2=0x7fd9601587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd960158340 0x7fd9601587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.989+0000 7fd966104640 1 -- 172.21.15.37:0/868557257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96009b030 con 0x7fd94c0039a0 2023-11-24T06:17:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.990+0000 7fd966104640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd9600ad1f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009bb0 tx=0x7fd95c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:34.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.990+0000 7fd956ffd640 1 -- 172.21.15.37:0/868557257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c003810 con 0x7fd94c0039a0 2023-11-24T06:17:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.990+0000 7fd956ffd640 1 -- 172.21.15.37:0/868557257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c003990 con 0x7fd94c0039a0 2023-11-24T06:17:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.990+0000 7fd956ffd640 1 -- 172.21.15.37:0/868557257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c003d40 con 0x7fd94c0039a0 2023-11-24T06:17:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.990+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96009b310 con 0x7fd94c0039a0 2023-11-24T06:17:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.990+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9600c6690 con 0x7fd94c0039a0 2023-11-24T06:17:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.991+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96009b830 con 0x7fd94c0039a0 2023-11-24T06:17:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.992+0000 7fd956ffd640 1 -- 172.21.15.37:0/868557257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fd95c03b070 con 0x7fd94c0039a0 2023-11-24T06:17:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.993+0000 7fd956ffd640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd94406aed0 0x7fd94406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.993+0000 7fd956ffd640 1 -- 172.21.15.37:0/868557257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd95c0ab2e0 con 0x7fd94c0039a0 2023-11-24T06:17:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.994+0000 7fd965903640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd94406aed0 0x7fd94406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.994+0000 7fd965903640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd94406aed0 0x7fd94406d390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9600c91d0 tx=0x7fd950001580 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:35.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:34.998+0000 7fd956ffd640 1 -- 172.21.15.37:0/868557257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd95c076350 con 0x7fd94c0039a0 2023-11-24T06:17:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.235+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd96004e8b0 con 0x7fd94c0039a0 2023-11-24T06:17:35.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.739+0000 7fd956ffd640 1 -- 172.21.15.37:0/868557257 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd95c003ea0 con 0x7fd94c0039a0 2023-11-24T06:17:35.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd94406aed0 msgr2=0x7fd94406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:35.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd94406aed0 0x7fd94406d390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9600c91d0 tx=0x7fd950001580 comp rx=0 tx=0).stop 2023-11-24T06:17:35.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 msgr2=0x7fd9600ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:35.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd9600ad1f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009bb0 tx=0x7fd95c004730 comp rx=0 tx=0).stop 2023-11-24T06:17:35.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 shutdown_connections 2023-11-24T06:17:35.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd94406aed0 0x7fd94406d390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:35.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd960158340 0x7fd9601587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd96009a3e0 0x7fd96009a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 --2- 172.21.15.37:0/868557257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd94c0039a0 0x7fd9600ad1f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 >> 172.21.15.37:0/868557257 conn(0x7fd9600b0c50 msgr2=0x7fd9600cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.743+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 shutdown_connections 2023-11-24T06:17:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.744+0000 7fd968368640 1 -- 172.21.15.37:0/868557257 wait complete. 2023-11-24T06:17:35.768 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:17:35.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.988+0000 7fc2d973c640 1 Processor -- start 2023-11-24T06:17:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.988+0000 7fc2d973c640 1 -- start start 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d973c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2d40cfb60 0x7fc2d40abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d973c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc2d40ce640 0x7fc2d40b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d973c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40ce270 con 0x7fc2d40cc470 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d973c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d406c560 con 0x7fc2d40cfb60 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d973c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d406d0a0 con 0x7fc2d40ce640 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d27fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2d40cfb60 0x7fc2d40abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d27fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2d40cfb60 0x7fc2d40abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60342/0 (socket says 172.21.15.37:60342) 2023-11-24T06:17:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.990+0000 7fc2d27fc640 1 -- 172.21.15.37:0/289156910 learned_addr learned my addr 172.21.15.37:0/289156910 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.991+0000 7fc2d27fc640 1 -- 172.21.15.37:0/289156910 >> v2:172.21.15.188:3300/0 conn(0x7fc2d40ce640 msgr2=0x7fc2d40b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.991+0000 7fc2d27fc640 1 --2- 172.21.15.37:0/289156910 >> v2:172.21.15.188:3300/0 conn(0x7fc2d40ce640 0x7fc2d40b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.991+0000 7fc2d27fc640 1 -- 172.21.15.37:0/289156910 >> v1:172.21.15.188:6789/0 conn(0x7fc2d40cc470 legacy=0x7fc2d40cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.991+0000 7fc2d27fc640 1 -- 172.21.15.37:0/289156910 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40b4200 con 0x7fc2d40cfb60 2023-11-24T06:17:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.992+0000 7fc2d27fc640 1 --2- 172.21.15.37:0/289156910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40cfb60 0x7fc2d40abfc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40cd5e0 tx=0x7fc2c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da05b511f17874a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.992+0000 7fc2d1ffb640 1 -- 172.21.15.37:0/289156910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8031870 con 0x7fc2d40cfb60 2023-11-24T06:17:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.992+0000 7fc2d1ffb640 1 -- 172.21.15.37:0/289156910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80319d0 con 0x7fc2d40cfb60 2023-11-24T06:17:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.992+0000 7fc2d1ffb640 1 -- 172.21.15.37:0/289156910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8031d60 con 0x7fc2d40cfb60 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 -- 172.21.15.37:0/289156910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40cfb60 msgr2=0x7fc2d40abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 --2- 172.21.15.37:0/289156910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40cfb60 0x7fc2d40abfc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40cd5e0 tx=0x7fc2c802b910 comp rx=0 tx=0).stop 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 -- 172.21.15.37:0/289156910 shutdown_connections 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 --2- 172.21.15.37:0/289156910 >> v2:172.21.15.188:3300/0 conn(0x7fc2d40ce640 0x7fc2d40b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 --2- 172.21.15.37:0/289156910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40cfb60 0x7fc2d40abfc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 -- 172.21.15.37:0/289156910 >> 172.21.15.37:0/289156910 conn(0x7fc2d406a920 msgr2=0x7fc2d406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 -- 172.21.15.37:0/289156910 shutdown_connections 2023-11-24T06:17:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.993+0000 7fc2d973c640 1 -- 172.21.15.37:0/289156910 wait complete. 2023-11-24T06:17:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.995+0000 7fc2d973c640 1 Processor -- start 2023-11-24T06:17:35.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.995+0000 7fc2d973c640 1 -- start start 2023-11-24T06:17:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.996+0000 7fc2d973c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2d40cc470 0x7fc2d4161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.996+0000 7fc2d973c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40ce640 0x7fc2d4164b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.996+0000 7fc2d973c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d40cfb60 0x7fc2d4162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.996+0000 7fc2d973c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4071a80 con 0x7fc2d40ce640 2023-11-24T06:17:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.996+0000 7fc2d973c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4162400 con 0x7fc2d40cfb60 2023-11-24T06:17:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.996+0000 7fc2d973c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41650a0 con 0x7fc2d40cc470 2023-11-24T06:17:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40ce640 0x7fc2d4164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40ce640 0x7fc2d4164b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60356/0 (socket says 172.21.15.37:60356) 2023-11-24T06:17:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 -- 172.21.15.37:0/3566106898 learned_addr learned my addr 172.21.15.37:0/3566106898 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d2ffd640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2d40cc470 0x7fc2d4161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d37fe640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d40cfb60 0x7fc2d4162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 -- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2d40cc470 msgr2=0x7fc2d4161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2d40cc470 0x7fc2d4161ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 -- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d40cfb60 msgr2=0x7fc2d4162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d40cfb60 0x7fc2d4162d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 -- 172.21.15.37:0/3566106898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80094d0 con 0x7fc2d40ce640 2023-11-24T06:17:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.997+0000 7fc2d27fc640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40ce640 0x7fc2d4164b60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc2c802b950 tx=0x7fc2c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.998+0000 7fc2bb7fe640 1 -- 172.21.15.37:0/3566106898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8031820 con 0x7fc2d40ce640 2023-11-24T06:17:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.998+0000 7fc2bb7fe640 1 -- 172.21.15.37:0/3566106898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80443f0 con 0x7fc2d40ce640 2023-11-24T06:17:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.998+0000 7fc2bb7fe640 1 -- 172.21.15.37:0/3566106898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80447a0 con 0x7fc2d40ce640 2023-11-24T06:17:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.998+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4070e00 con 0x7fc2d40ce640 2023-11-24T06:17:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.998+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d40713c0 con 0x7fc2d40ce640 2023-11-24T06:17:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:35.999+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d4067470 con 0x7fc2d40ce640 2023-11-24T06:17:36.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.000+0000 7fc2bb7fe640 1 -- 172.21.15.37:0/3566106898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fc2c804d450 con 0x7fc2d40ce640 2023-11-24T06:17:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.001+0000 7fc2bb7fe640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006aed0 0x7fc2c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.001+0000 7fc2bb7fe640 1 -- 172.21.15.37:0/3566106898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2c802d040 con 0x7fc2d40ce640 2023-11-24T06:17:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.001+0000 7fc2d2ffd640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006aed0 0x7fc2c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.002+0000 7fc2d2ffd640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006aed0 0x7fc2c006d390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005520 tx=0x7fc2c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.006+0000 7fc2bb7fe640 1 -- 172.21.15.37:0/3566106898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2c80b1020 con 0x7fc2d40ce640 2023-11-24T06:17:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.240+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2d40cd910 con 0x7fc2d40ce640 2023-11-24T06:17:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.241+0000 7fc2bb7fe640 1 -- 172.21.15.37:0/3566106898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fc2c8076e10 con 0x7fc2d40ce640 2023-11-24T06:17:36.244 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:36.244 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2892400858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2892400858},{"type":"v1","addr":"172.21.15.188:6835","nonce":2892400858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":4961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/4008465884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":4008465884},{"type":"v1","addr":"172.21.15.37:6837","nonce":4008465884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/2245601301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":2245601301},{"type":"v1","addr":"172.21.15.188:6834","nonce":2245601301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:17:32.142253+0000","modified":"2023-11-24T06:17:35.237267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6836/2581426871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2581426871},{"type":"v1","addr":"172.21.15.37:6836","nonce":2581426871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:17:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006aed0 msgr2=0x7fc2c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006aed0 0x7fc2c006d390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005520 tx=0x7fc2c4009040 comp rx=0 tx=0).stop 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40ce640 msgr2=0x7fc2d4164b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40ce640 0x7fc2d4164b60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc2c802b950 tx=0x7fc2c80046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 shutdown_connections 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc2c006aed0 0x7fc2c006d390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc2d40cfb60 0x7fc2d4162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d40ce640 0x7fc2d4164b60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 --2- 172.21.15.37:0/3566106898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2d40cc470 0x7fc2d4161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 >> 172.21.15.37:0/3566106898 conn(0x7fc2d406a920 msgr2=0x7fc2d40cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.244+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 shutdown_connections 2023-11-24T06:17:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.245+0000 7fc2d973c640 1 -- 172.21.15.37:0/3566106898 wait complete. 2023-11-24T06:17:36.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.490+0000 7f526a3e4640 1 Processor -- start 2023-11-24T06:17:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.490+0000 7f526a3e4640 1 -- start start 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f526a3e4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5264144b30 0x7f526415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f526a3e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f526415c410 0x7f52640b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f526a3e4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526415bf80 con 0x7f52640b1de0 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f526a3e4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52640b1560 con 0x7f5264144b30 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f526a3e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52640b0fb0 con 0x7f526415c410 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f52693e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5264144b30 0x7f526415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f52693e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5264144b30 0x7f526415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60364/0 (socket says 172.21.15.37:60364) 2023-11-24T06:17:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.492+0000 7f52693e2640 1 -- 172.21.15.37:0/3034309919 learned_addr learned my addr 172.21.15.37:0/3034309919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.493+0000 7f5268be1640 1 --2- 172.21.15.37:0/3034309919 >> v2:172.21.15.188:3300/0 conn(0x7f526415c410 0x7f52640b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.493+0000 7f52693e2640 1 -- 172.21.15.37:0/3034309919 >> v2:172.21.15.188:3300/0 conn(0x7f526415c410 msgr2=0x7f52640b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.493+0000 7f52693e2640 1 --2- 172.21.15.37:0/3034309919 >> v2:172.21.15.188:3300/0 conn(0x7f526415c410 0x7f52640b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.493+0000 7f52693e2640 1 -- 172.21.15.37:0/3034309919 >> v1:172.21.15.188:6789/0 conn(0x7f52640b1de0 legacy=0x7f526406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.493+0000 7f52693e2640 1 -- 172.21.15.37:0/3034309919 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640b1280 con 0x7f5264144b30 2023-11-24T06:17:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.493+0000 7f5268be1640 1 --2- 172.21.15.37:0/3034309919 >> v2:172.21.15.188:3300/0 conn(0x7f526415c410 0x7f52640b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.494+0000 7f52693e2640 1 --2- 172.21.15.37:0/3034309919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f526415f920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f52640cc7a0 tx=0x7f526002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0547fc235d7245 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.494+0000 7f525bfff640 1 -- 172.21.15.37:0/3034309919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260030860 con 0x7f5264144b30 2023-11-24T06:17:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f525bfff640 1 -- 172.21.15.37:0/3034309919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600309c0 con 0x7f5264144b30 2023-11-24T06:17:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f525bfff640 1 -- 172.21.15.37:0/3034309919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260030d50 con 0x7f5264144b30 2023-11-24T06:17:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 -- 172.21.15.37:0/3034309919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 msgr2=0x7f526415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 --2- 172.21.15.37:0/3034309919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f526415f920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f52640cc7a0 tx=0x7f526002b9a0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 -- 172.21.15.37:0/3034309919 shutdown_connections 2023-11-24T06:17:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 --2- 172.21.15.37:0/3034309919 >> v2:172.21.15.188:3300/0 conn(0x7f526415c410 0x7f52640b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 --2- 172.21.15.37:0/3034309919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f526415f920 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 -- 172.21.15.37:0/3034309919 >> 172.21.15.37:0/3034309919 conn(0x7f52640cb830 msgr2=0x7f52640cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 -- 172.21.15.37:0/3034309919 shutdown_connections 2023-11-24T06:17:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.495+0000 7f526a3e4640 1 -- 172.21.15.37:0/3034309919 wait complete. 2023-11-24T06:17:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.497+0000 7f526a3e4640 1 Processor -- start 2023-11-24T06:17:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.497+0000 7f526a3e4640 1 -- start start 2023-11-24T06:17:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f526a3e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52640b1de0 0x7f526415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f526a3e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f5264141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f526a3e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f526415c410 0x7f5264142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f526a3e4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52641f1ab0 con 0x7f5264144b30 2023-11-24T06:17:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f526a3e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640c9480 con 0x7f52640b1de0 2023-11-24T06:17:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f526a3e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52640c96f0 con 0x7f526415c410 2023-11-24T06:17:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f5268be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f5264141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f5268be1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f5264141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60374/0 (socket says 172.21.15.37:60374) 2023-11-24T06:17:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.498+0000 7f5268be1640 1 -- 172.21.15.37:0/1923919917 learned_addr learned my addr 172.21.15.37:0/1923919917 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f52693e2640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52640b1de0 0x7f526415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f5269be3640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f526415c410 0x7f5264142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f5268be1640 1 -- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f526415c410 msgr2=0x7f5264142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f5268be1640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f526415c410 0x7f5264142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f5268be1640 1 -- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52640b1de0 msgr2=0x7f526415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f5268be1640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52640b1de0 0x7f526415a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f5268be1640 1 -- 172.21.15.37:0/1923919917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600094d0 con 0x7f5264144b30 2023-11-24T06:17:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f52693e2640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52640b1de0 0x7f526415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.499+0000 7f5268be1640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f5264141fd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f525400c820 tx=0x7f525400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.500+0000 7f5259ffb640 1 -- 172.21.15.37:0/1923919917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254007a30 con 0x7f5264144b30 2023-11-24T06:17:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.500+0000 7f5259ffb640 1 -- 172.21.15.37:0/1923919917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254007b90 con 0x7f5264144b30 2023-11-24T06:17:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.500+0000 7f5259ffb640 1 -- 172.21.15.37:0/1923919917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400ce10 con 0x7f5264144b30 2023-11-24T06:17:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.500+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52640c99d0 con 0x7f5264144b30 2023-11-24T06:17:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.500+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526412fef0 con 0x7f5264144b30 2023-11-24T06:17:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.501+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52640b3610 con 0x7f5264144b30 2023-11-24T06:17:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.502+0000 7f5259ffb640 1 -- 172.21.15.37:0/1923919917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f52540113f0 con 0x7f5264144b30 2023-11-24T06:17:36.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.503+0000 7f5259ffb640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524806aed0 0x7f524806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.504+0000 7f5259ffb640 1 -- 172.21.15.37:0/1923919917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5254089920 con 0x7f5264144b30 2023-11-24T06:17:36.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.504+0000 7f52693e2640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524806aed0 0x7f524806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.504+0000 7f52693e2640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524806aed0 0x7f524806d390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5260036000 tx=0x7f5260008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.508+0000 7f5259ffb640 1 -- 172.21.15.37:0/1923919917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52640b3610 con 0x7f5264144b30 2023-11-24T06:17:36.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.702+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52640b3610 con 0x7f5264144b30 2023-11-24T06:17:36.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.705+0000 7f5259ffb640 1 -- 172.21.15.37:0/1923919917 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f52640b3610 con 0x7f5264144b30 2023-11-24T06:17:36.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:36.708 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:33.680484+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524806aed0 msgr2=0x7f524806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524806aed0 0x7f524806d390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5260036000 tx=0x7f5260008030 comp rx=0 tx=0).stop 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 msgr2=0x7f5264141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f5264141fd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f525400c820 tx=0x7f525400cce0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 shutdown_connections 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f524806aed0 0x7f524806d390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f526415c410 0x7f5264142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5264144b30 0x7f5264141fd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 --2- 172.21.15.37:0/1923919917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52640b1de0 0x7f526415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.708+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 >> 172.21.15.37:0/1923919917 conn(0x7f52640cb830 msgr2=0x7f526415e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.709+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 shutdown_connections 2023-11-24T06:17:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.709+0000 7f526a3e4640 1 -- 172.21.15.37:0/1923919917 wait complete. 2023-11-24T06:17:36.717 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-11-24T06:17:36.715+0000 7f28393e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:17:36.731 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:17:36.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:17:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.952+0000 7f65f6878640 1 Processor -- start 2023-11-24T06:17:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.952+0000 7f65f6878640 1 -- start start 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.954+0000 7f65f6878640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65f0144b30 0x7f65f015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.954+0000 7f65f6878640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f65f00b1de0 0x7f65f00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.954+0000 7f65f6878640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f015bf80 con 0x7f65f015c410 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.954+0000 7f65f6878640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00b27b0 con 0x7f65f0144b30 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.954+0000 7f65f6878640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00b1560 con 0x7f65f00b1de0 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.954+0000 7f65f5876640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65f0144b30 0x7f65f015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.955+0000 7f65f5876640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65f0144b30 0x7f65f015f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60384/0 (socket says 172.21.15.37:60384) 2023-11-24T06:17:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.955+0000 7f65f5876640 1 -- 172.21.15.37:0/754121849 learned_addr learned my addr 172.21.15.37:0/754121849 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.955+0000 7f65f6077640 1 --2- 172.21.15.37:0/754121849 >> v2:172.21.15.188:3300/0 conn(0x7f65f00b1de0 0x7f65f00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.955+0000 7f65f5876640 1 -- 172.21.15.37:0/754121849 >> v2:172.21.15.188:3300/0 conn(0x7f65f00b1de0 msgr2=0x7f65f00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.955+0000 7f65f5876640 1 --2- 172.21.15.37:0/754121849 >> v2:172.21.15.188:3300/0 conn(0x7f65f00b1de0 0x7f65f00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.955+0000 7f65f5876640 1 -- 172.21.15.37:0/754121849 >> v1:172.21.15.188:6789/0 conn(0x7f65f015c410 legacy=0x7f65f00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.955+0000 7f65f5876640 1 -- 172.21.15.37:0/754121849 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00b1280 con 0x7f65f0144b30 2023-11-24T06:17:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.957+0000 7f65f5876640 1 --2- 172.21.15.37:0/754121849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f015f920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f65f0072a50 tx=0x7f65ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a846f43ef5b32c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f4874640 1 -- 172.21.15.37:0/754121849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec030860 con 0x7f65f0144b30 2023-11-24T06:17:36.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f4874640 1 -- 172.21.15.37:0/754121849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec0309c0 con 0x7f65f0144b30 2023-11-24T06:17:36.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f4874640 1 -- 172.21.15.37:0/754121849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec030d50 con 0x7f65f0144b30 2023-11-24T06:17:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 -- 172.21.15.37:0/754121849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 msgr2=0x7f65f015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 --2- 172.21.15.37:0/754121849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f015f920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f65f0072a50 tx=0x7f65ec02b9a0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 -- 172.21.15.37:0/754121849 shutdown_connections 2023-11-24T06:17:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 --2- 172.21.15.37:0/754121849 >> v2:172.21.15.188:3300/0 conn(0x7f65f00b1de0 0x7f65f00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 --2- 172.21.15.37:0/754121849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f015f920 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 -- 172.21.15.37:0/754121849 >> 172.21.15.37:0/754121849 conn(0x7f65f00cb830 msgr2=0x7f65f00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 -- 172.21.15.37:0/754121849 shutdown_connections 2023-11-24T06:17:36.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.958+0000 7f65f6878640 1 -- 172.21.15.37:0/754121849 wait complete. 2023-11-24T06:17:36.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.960+0000 7f65f6878640 1 Processor -- start 2023-11-24T06:17:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.960+0000 7f65f6878640 1 -- start start 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.961+0000 7f65f6878640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65f00b1de0 0x7f65f015d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.961+0000 7f65f6878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f01f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.961+0000 7f65f6878640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65f015c410 0x7f65f01403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.961+0000 7f65f6878640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00c7790 con 0x7f65f0144b30 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.961+0000 7f65f6878640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00c79e0 con 0x7f65f015c410 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.961+0000 7f65f6878640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00c7cc0 con 0x7f65f00b1de0 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f01f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f01f1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60388/0 (socket says 172.21.15.37:60388) 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 -- 172.21.15.37:0/2430749575 learned_addr learned my addr 172.21.15.37:0/2430749575 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 -- 172.21.15.37:0/2430749575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65f00b1de0 msgr2=0x7f65f015d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65f00b1de0 0x7f65f015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 -- 172.21.15.37:0/2430749575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65f015c410 msgr2=0x7f65f01403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:36.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f6077640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65f015c410 0x7f65f01403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65f015c410 0x7f65f01403a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:36.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 -- 172.21.15.37:0/2430749575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0094d0 con 0x7f65f0144b30 2023-11-24T06:17:36.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.962+0000 7f65f5075640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f01f1d50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c400 tx=0x7f65e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.963+0000 7f65e67fc640 1 -- 172.21.15.37:0/2430749575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00052d0 con 0x7f65f0144b30 2023-11-24T06:17:36.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.963+0000 7f65e67fc640 1 -- 172.21.15.37:0/2430749575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0005430 con 0x7f65f0144b30 2023-11-24T06:17:36.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.963+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f00c7fa0 con 0x7f65f0144b30 2023-11-24T06:17:36.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.963+0000 7f65e67fc640 1 -- 172.21.15.37:0/2430749575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0003830 con 0x7f65f0144b30 2023-11-24T06:17:36.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.963+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f015d640 con 0x7f65f0144b30 2023-11-24T06:17:36.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.964+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f00c84c0 con 0x7f65f0144b30 2023-11-24T06:17:36.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.965+0000 7f65e67fc640 1 -- 172.21.15.37:0/2430749575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f65e0003990 con 0x7f65f0144b30 2023-11-24T06:17:36.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.967+0000 7f65e67fc640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f65d406aed0 0x7f65d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:36.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.967+0000 7f65e67fc640 1 -- 172.21.15.37:0/2430749575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65e0088c30 con 0x7f65f0144b30 2023-11-24T06:17:36.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.967+0000 7f65f5876640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f65d406aed0 0x7f65d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:36.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.968+0000 7f65f5876640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f65d406aed0 0x7f65d406d390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f65ec036000 tx=0x7f65ec03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:36.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:36.971+0000 7f65e67fc640 1 -- 172.21.15.37:0/2430749575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65f00c84c0 con 0x7f65f0144b30 2023-11-24T06:17:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.161+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65f015bc10 con 0x7f65d406aed0 2023-11-24T06:17:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.187+0000 7f65e67fc640 1 -- 172.21.15.37:0/2430749575 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286984 (secure 0 0 0) 0x7f65ec030bb0 con 0x7f65d406aed0 2023-11-24T06:17:37.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:17:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f65d406aed0 msgr2=0x7f65d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f65d406aed0 0x7f65d406d390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f65ec036000 tx=0x7f65ec03b040 comp rx=0 tx=0).stop 2023-11-24T06:17:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 msgr2=0x7f65f01f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f01f1d50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c400 tx=0x7f65e000c8c0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 shutdown_connections 2023-11-24T06:17:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f65d406aed0 0x7f65d406d390 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65f015c410 0x7f65f01403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65f0144b30 0x7f65f01f1d50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 --2- 172.21.15.37:0/2430749575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65f00b1de0 0x7f65f015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 >> 172.21.15.37:0/2430749575 conn(0x7f65f00cb830 msgr2=0x7f65f015e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 shutdown_connections 2023-11-24T06:17:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.194+0000 7f65f6878640 1 -- 172.21.15.37:0/2430749575 wait complete. 2023-11-24T06:17:37.215 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-11-24T06:17:36.866707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":7479296,"data_stored":3856236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002167"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.731128+0000","last_change":"2023-11-24T06:17:32.730151+0000","last_active":"2023-11-24T06:17:32.731128+0000","last_peered":"2023-11-24T06:17:32.731128+0000","last_clean":"2023-11-24T06:17:32.731128+0000","last_became_active":"2023-11-24T06:17:32.729798+0000","last_became_peered":"2023-11-24T06:17:32.729798+0000","last_unstale":"2023-11-24T06:17:32.731128+0000","last_undegraded":"2023-11-24T06:17:32.731128+0000","last_fullsized":"2023-11-24T06:17:32.731128+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:57:22.946032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721090+0000","last_change":"2023-11-24T06:17:32.710702+0000","last_active":"2023-11-24T06:17:32.721090+0000","last_peered":"2023-11-24T06:17:32.721090+0000","last_clean":"2023-11-24T06:17:32.721090+0000","last_became_active":"2023-11-24T06:17:32.710314+0000","last_became_peered":"2023-11-24T06:17:32.710314+0000","last_unstale":"2023-11-24T06:17:32.721090+0000","last_undegraded":"2023-11-24T06:17:32.721090+0000","last_fullsized":"2023-11-24T06:17:32.721090+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:47.332904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728249+0000","last_change":"2023-11-24T06:17:32.722161+0000","last_active":"2023-11-24T06:17:32.728249+0000","last_peered":"2023-11-24T06:17:32.728249+0000","last_clean":"2023-11-24T06:17:32.728249+0000","last_became_active":"2023-11-24T06:17:32.721786+0000","last_became_peered":"2023-11-24T06:17:32.721786+0000","last_unstale":"2023-11-24T06:17:32.728249+0000","last_undegraded":"2023-11-24T06:17:32.728249+0000","last_fullsized":"2023-11-24T06:17:32.728249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:42.483931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686761+0000","last_change":"2023-11-24T06:17:32.721405+0000","last_active":"2023-11-24T06:17:33.686761+0000","last_peered":"2023-11-24T06:17:33.686761+0000","last_clean":"2023-11-24T06:17:33.686761+0000","last_became_active":"2023-11-24T06:17:32.721119+0000","last_became_peered":"2023-11-24T06:17:32.721119+0000","last_unstale":"2023-11-24T06:17:33.686761+0000","last_undegraded":"2023-11-24T06:17:33.686761+0000","last_fullsized":"2023-11-24T06:17:33.686761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:11.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.730403+0000","last_change":"2023-11-24T06:17:32.718912+0000","last_active":"2023-11-24T06:17:32.730403+0000","last_peered":"2023-11-24T06:17:32.730403+0000","last_clean":"2023-11-24T06:17:32.730403+0000","last_became_active":"2023-11-24T06:17:32.718516+0000","last_became_peered":"2023-11-24T06:17:32.718516+0000","last_unstale":"2023-11-24T06:17:32.730403+0000","last_undegraded":"2023-11-24T06:17:32.730403+0000","last_fullsized":"2023-11-24T06:17:32.730403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:53.403576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.720868+0000","last_change":"2023-11-24T06:17:32.712405+0000","last_active":"2023-11-24T06:17:32.720868+0000","last_peered":"2023-11-24T06:17:32.720868+0000","last_clean":"2023-11-24T06:17:32.720868+0000","last_became_active":"2023-11-24T06:17:32.712119+0000","last_became_peered":"2023-11-24T06:17:32.712119+0000","last_unstale":"2023-11-24T06:17:32.720868+0000","last_undegraded":"2023-11-24T06:17:32.720868+0000","last_fullsized":"2023-11-24T06:17:32.720868+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:16.907468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689376+0000","last_change":"2023-11-24T06:17:32.713050+0000","last_active":"2023-11-24T06:17:33.689376+0000","last_peered":"2023-11-24T06:17:33.689376+0000","last_clean":"2023-11-24T06:17:33.689376+0000","last_became_active":"2023-11-24T06:17:32.712701+0000","last_became_peered":"2023-11-24T06:17:32.712701+0000","last_unstale":"2023-11-24T06:17:33.689376+0000","last_undegraded":"2023-11-24T06:17:33.689376+0000","last_fullsized":"2023-11-24T06:17:33.689376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:34.869885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.723699+0000","last_change":"2023-11-24T06:17:32.719354+0000","last_active":"2023-11-24T06:17:32.723699+0000","last_peered":"2023-11-24T06:17:32.723699+0000","last_clean":"2023-11-24T06:17:32.723699+0000","last_became_active":"2023-11-24T06:17:32.716001+0000","last_became_peered":"2023-11-24T06:17:32.716001+0000","last_unstale":"2023-11-24T06:17:32.723699+0000","last_undegraded":"2023-11-24T06:17:32.723699+0000","last_fullsized":"2023-11-24T06:17:32.723699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:27:13.423205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.731701+0000","last_change":"2023-11-24T06:17:32.724280+0000","last_active":"2023-11-24T06:17:32.731701+0000","last_peered":"2023-11-24T06:17:32.731701+0000","last_clean":"2023-11-24T06:17:32.731701+0000","last_became_active":"2023-11-24T06:17:32.721277+0000","last_became_peered":"2023-11-24T06:17:32.721277+0000","last_unstale":"2023-11-24T06:17:32.731701+0000","last_undegraded":"2023-11-24T06:17:32.731701+0000","last_fullsized":"2023-11-24T06:17:32.731701+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:58.255465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692439+0000","last_change":"2023-11-24T06:17:32.717882+0000","last_active":"2023-11-24T06:17:33.692439+0000","last_peered":"2023-11-24T06:17:33.692439+0000","last_clean":"2023-11-24T06:17:33.692439+0000","last_became_active":"2023-11-24T06:17:32.717599+0000","last_became_peered":"2023-11-24T06:17:32.717599+0000","last_unstale":"2023-11-24T06:17:33.692439+0000","last_undegraded":"2023-11-24T06:17:33.692439+0000","last_fullsized":"2023-11-24T06:17:33.692439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:14.301522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728614+0000","last_change":"2023-11-24T06:17:32.725180+0000","last_active":"2023-11-24T06:17:32.728614+0000","last_peered":"2023-11-24T06:17:32.728614+0000","last_clean":"2023-11-24T06:17:32.728614+0000","last_became_active":"2023-11-24T06:17:32.724854+0000","last_became_peered":"2023-11-24T06:17:32.724854+0000","last_unstale":"2023-11-24T06:17:32.728614+0000","last_undegraded":"2023-11-24T06:17:32.728614+0000","last_fullsized":"2023-11-24T06:17:32.728614+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:49.937740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686924+0000","last_change":"2023-11-24T06:17:32.728048+0000","last_active":"2023-11-24T06:17:33.686924+0000","last_peered":"2023-11-24T06:17:33.686924+0000","last_clean":"2023-11-24T06:17:33.686924+0000","last_became_active":"2023-11-24T06:17:32.727531+0000","last_became_peered":"2023-11-24T06:17:32.727531+0000","last_unstale":"2023-11-24T06:17:33.686924+0000","last_undegraded":"2023-11-24T06:17:33.686924+0000","last_fullsized":"2023-11-24T06:17:33.686924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:36.258177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724938+0000","last_change":"2023-11-24T06:17:32.719214+0000","last_active":"2023-11-24T06:17:32.724938+0000","last_peered":"2023-11-24T06:17:32.724938+0000","last_clean":"2023-11-24T06:17:32.724938+0000","last_became_active":"2023-11-24T06:17:32.718903+0000","last_became_peered":"2023-11-24T06:17:32.718903+0000","last_unstale":"2023-11-24T06:17:32.724938+0000","last_undegraded":"2023-11-24T06:17:32.724938+0000","last_fullsized":"2023-11-24T06:17:32.724938+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:43.199442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732017+0000","last_change":"2023-11-24T06:17:32.728821+0000","last_active":"2023-11-24T06:17:32.732017+0000","last_peered":"2023-11-24T06:17:32.732017+0000","last_clean":"2023-11-24T06:17:32.732017+0000","last_became_active":"2023-11-24T06:17:32.728495+0000","last_became_peered":"2023-11-24T06:17:32.728495+0000","last_unstale":"2023-11-24T06:17:32.732017+0000","last_undegraded":"2023-11-24T06:17:32.732017+0000","last_fullsized":"2023-11-24T06:17:32.732017+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:40.635302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732858+0000","last_change":"2023-11-24T06:17:32.727369+0000","last_active":"2023-11-24T06:17:32.732858+0000","last_peered":"2023-11-24T06:17:32.732858+0000","last_clean":"2023-11-24T06:17:32.732858+0000","last_became_active":"2023-11-24T06:17:32.726821+0000","last_became_peered":"2023-11-24T06:17:32.726821+0000","last_unstale":"2023-11-24T06:17:32.732858+0000","last_undegraded":"2023-11-24T06:17:32.732858+0000","last_fullsized":"2023-11-24T06:17:32.732858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:14.301522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690016+0000","last_change":"2023-11-24T06:17:32.723917+0000","last_active":"2023-11-24T06:17:33.690016+0000","last_peered":"2023-11-24T06:17:33.690016+0000","last_clean":"2023-11-24T06:17:33.690016+0000","last_became_active":"2023-11-24T06:17:32.723137+0000","last_became_peered":"2023-11-24T06:17:32.723137+0000","last_unstale":"2023-11-24T06:17:33.690016+0000","last_undegraded":"2023-11-24T06:17:33.690016+0000","last_fullsized":"2023-11-24T06:17:33.690016+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:15.495203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.730085+0000","last_change":"2023-11-24T06:17:32.714927+0000","last_active":"2023-11-24T06:17:32.730085+0000","last_peered":"2023-11-24T06:17:32.730085+0000","last_clean":"2023-11-24T06:17:32.730085+0000","last_became_active":"2023-11-24T06:17:32.714613+0000","last_became_peered":"2023-11-24T06:17:32.714613+0000","last_unstale":"2023-11-24T06:17:32.730085+0000","last_undegraded":"2023-11-24T06:17:32.730085+0000","last_fullsized":"2023-11-24T06:17:32.730085+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:02.308967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.687412+0000","last_change":"2023-11-24T06:17:32.723374+0000","last_active":"2023-11-24T06:17:33.687412+0000","last_peered":"2023-11-24T06:17:33.687412+0000","last_clean":"2023-11-24T06:17:33.687412+0000","last_became_active":"2023-11-24T06:17:32.722515+0000","last_became_peered":"2023-11-24T06:17:32.722515+0000","last_unstale":"2023-11-24T06:17:33.687412+0000","last_undegraded":"2023-11-24T06:17:33.687412+0000","last_fullsized":"2023-11-24T06:17:33.687412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:37.746657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.723607+0000","last_change":"2023-11-24T06:17:32.717447+0000","last_active":"2023-11-24T06:17:32.723607+0000","last_peered":"2023-11-24T06:17:32.723607+0000","last_clean":"2023-11-24T06:17:32.723607+0000","last_became_active":"2023-11-24T06:17:32.716958+0000","last_became_peered":"2023-11-24T06:17:32.716958+0000","last_unstale":"2023-11-24T06:17:32.723607+0000","last_undegraded":"2023-11-24T06:17:32.723607+0000","last_fullsized":"2023-11-24T06:17:32.723607+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:08:39.332077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.726908+0000","last_change":"2023-11-24T06:17:32.724224+0000","last_active":"2023-11-24T06:17:32.726908+0000","last_peered":"2023-11-24T06:17:32.726908+0000","last_clean":"2023-11-24T06:17:32.726908+0000","last_became_active":"2023-11-24T06:17:32.723795+0000","last_became_peered":"2023-11-24T06:17:32.723795+0000","last_unstale":"2023-11-24T06:17:32.726908+0000","last_undegraded":"2023-11-24T06:17:32.726908+0000","last_fullsized":"2023-11-24T06:17:32.726908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:49.937740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691578+0000","last_change":"2023-11-24T06:17:32.720018+0000","last_active":"2023-11-24T06:17:33.691578+0000","last_peered":"2023-11-24T06:17:33.691578+0000","last_clean":"2023-11-24T06:17:33.691578+0000","last_became_active":"2023-11-24T06:17:32.719753+0000","last_became_peered":"2023-11-24T06:17:32.719753+0000","last_unstale":"2023-11-24T06:17:33.691578+0000","last_undegraded":"2023-11-24T06:17:33.691578+0000","last_fullsized":"2023-11-24T06:17:33.691578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:52:07.683192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691244+0000","last_change":"2023-11-24T06:17:32.718725+0000","last_active":"2023-11-24T06:17:33.691244+0000","last_peered":"2023-11-24T06:17:33.691244+0000","last_clean":"2023-11-24T06:17:33.691244+0000","last_became_active":"2023-11-24T06:17:32.718406+0000","last_became_peered":"2023-11-24T06:17:32.718406+0000","last_unstale":"2023-11-24T06:17:33.691244+0000","last_undegraded":"2023-11-24T06:17:33.691244+0000","last_fullsized":"2023-11-24T06:17:33.691244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:53:10.683577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.723115+0000","last_change":"2023-11-24T06:17:32.716871+0000","last_active":"2023-11-24T06:17:32.723115+0000","last_peered":"2023-11-24T06:17:32.723115+0000","last_clean":"2023-11-24T06:17:32.723115+0000","last_became_active":"2023-11-24T06:17:32.716390+0000","last_became_peered":"2023-11-24T06:17:32.716390+0000","last_unstale":"2023-11-24T06:17:32.723115+0000","last_undegraded":"2023-11-24T06:17:32.723115+0000","last_fullsized":"2023-11-24T06:17:32.723115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:20.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.727785+0000","last_change":"2023-11-24T06:17:32.724494+0000","last_active":"2023-11-24T06:17:32.727785+0000","last_peered":"2023-11-24T06:17:32.727785+0000","last_clean":"2023-11-24T06:17:32.727785+0000","last_became_active":"2023-11-24T06:17:32.724185+0000","last_became_peered":"2023-11-24T06:17:32.724185+0000","last_unstale":"2023-11-24T06:17:32.727785+0000","last_undegraded":"2023-11-24T06:17:32.727785+0000","last_fullsized":"2023-11-24T06:17:32.727785+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:21.980927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692313+0000","last_change":"2023-11-24T06:17:32.718277+0000","last_active":"2023-11-24T06:17:33.692313+0000","last_peered":"2023-11-24T06:17:33.692313+0000","last_clean":"2023-11-24T06:17:33.692313+0000","last_became_active":"2023-11-24T06:17:32.716503+0000","last_became_peered":"2023-11-24T06:17:32.716503+0000","last_unstale":"2023-11-24T06:17:33.692313+0000","last_undegraded":"2023-11-24T06:17:33.692313+0000","last_fullsized":"2023-11-24T06:17:33.692313+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:53:26.363767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691688+0000","last_change":"2023-11-24T06:17:32.720018+0000","last_active":"2023-11-24T06:17:33.691688+0000","last_peered":"2023-11-24T06:17:33.691688+0000","last_clean":"2023-11-24T06:17:33.691688+0000","last_became_active":"2023-11-24T06:17:32.719531+0000","last_became_peered":"2023-11-24T06:17:32.719531+0000","last_unstale":"2023-11-24T06:17:33.691688+0000","last_undegraded":"2023-11-24T06:17:33.691688+0000","last_fullsized":"2023-11-24T06:17:33.691688+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:03:03.492480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721562+0000","last_change":"2023-11-24T06:17:32.716693+0000","last_active":"2023-11-24T06:17:32.721562+0000","last_peered":"2023-11-24T06:17:32.721562+0000","last_clean":"2023-11-24T06:17:32.721562+0000","last_became_active":"2023-11-24T06:17:32.716355+0000","last_became_peered":"2023-11-24T06:17:32.716355+0000","last_unstale":"2023-11-24T06:17:32.721562+0000","last_undegraded":"2023-11-24T06:17:32.721562+0000","last_fullsized":"2023-11-24T06:17:32.721562+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:45.712303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692549+0000","last_change":"2023-11-24T06:17:32.718200+0000","last_active":"2023-11-24T06:17:33.692549+0000","last_peered":"2023-11-24T06:17:33.692549+0000","last_clean":"2023-11-24T06:17:33.692549+0000","last_became_active":"2023-11-24T06:17:32.717845+0000","last_became_peered":"2023-11-24T06:17:32.717845+0000","last_unstale":"2023-11-24T06:17:33.692549+0000","last_undegraded":"2023-11-24T06:17:33.692549+0000","last_fullsized":"2023-11-24T06:17:33.692549+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:43.199442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.708543+0000","last_change":"2023-11-24T06:17:32.701799+0000","last_active":"2023-11-24T06:17:32.708543+0000","last_peered":"2023-11-24T06:17:32.708543+0000","last_clean":"2023-11-24T06:17:32.708543+0000","last_became_active":"2023-11-24T06:17:32.700446+0000","last_became_peered":"2023-11-24T06:17:32.700446+0000","last_unstale":"2023-11-24T06:17:32.708543+0000","last_undegraded":"2023-11-24T06:17:32.708543+0000","last_fullsized":"2023-11-24T06:17:32.708543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:58.641441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690689+0000","last_change":"2023-11-24T06:17:32.713368+0000","last_active":"2023-11-24T06:17:33.690689+0000","last_peered":"2023-11-24T06:17:33.690689+0000","last_clean":"2023-11-24T06:17:33.690689+0000","last_became_active":"2023-11-24T06:17:32.712400+0000","last_became_peered":"2023-11-24T06:17:32.712400+0000","last_unstale":"2023-11-24T06:17:33.690689+0000","last_undegraded":"2023-11-24T06:17:33.690689+0000","last_fullsized":"2023-11-24T06:17:33.690689+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:19.687998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691178+0000","last_change":"2023-11-24T06:17:32.715032+0000","last_active":"2023-11-24T06:17:33.691178+0000","last_peered":"2023-11-24T06:17:33.691178+0000","last_clean":"2023-11-24T06:17:33.691178+0000","last_became_active":"2023-11-24T06:17:32.714740+0000","last_became_peered":"2023-11-24T06:17:32.714740+0000","last_unstale":"2023-11-24T06:17:33.691178+0000","last_undegraded":"2023-11-24T06:17:33.691178+0000","last_fullsized":"2023-11-24T06:17:33.691178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:08.913100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724580+0000","last_change":"2023-11-24T06:17:32.721933+0000","last_active":"2023-11-24T06:17:32.724580+0000","last_peered":"2023-11-24T06:17:32.724580+0000","last_clean":"2023-11-24T06:17:32.724580+0000","last_became_active":"2023-11-24T06:17:32.721655+0000","last_became_peered":"2023-11-24T06:17:32.721655+0000","last_unstale":"2023-11-24T06:17:32.724580+0000","last_undegraded":"2023-11-24T06:17:32.724580+0000","last_fullsized":"2023-11-24T06:17:32.724580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.263858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728358+0000","last_change":"2023-11-24T06:17:32.724675+0000","last_active":"2023-11-24T06:17:32.728358+0000","last_peered":"2023-11-24T06:17:32.728358+0000","last_clean":"2023-11-24T06:17:32.728358+0000","last_became_active":"2023-11-24T06:17:32.724347+0000","last_became_peered":"2023-11-24T06:17:32.724347+0000","last_unstale":"2023-11-24T06:17:32.728358+0000","last_undegraded":"2023-11-24T06:17:32.728358+0000","last_fullsized":"2023-11-24T06:17:32.728358+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:24.001288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.745334+0000","last_change":"2023-11-24T06:17:31.697723+0000","last_active":"2023-11-24T06:17:32.745334+0000","last_peered":"2023-11-24T06:17:32.745334+0000","last_clean":"2023-11-24T06:17:32.745334+0000","last_became_active":"2023-11-24T06:17:31.697190+0000","last_became_peered":"2023-11-24T06:17:31.697190+0000","last_unstale":"2023-11-24T06:17:32.745334+0000","last_undegraded":"2023-11-24T06:17:32.745334+0000","last_fullsized":"2023-11-24T06:17:32.745334+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:28:06.182577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732608+0000","last_change":"2023-11-24T06:17:32.729905+0000","last_active":"2023-11-24T06:17:32.732608+0000","last_peered":"2023-11-24T06:17:32.732608+0000","last_clean":"2023-11-24T06:17:32.732608+0000","last_became_active":"2023-11-24T06:17:32.721306+0000","last_became_peered":"2023-11-24T06:17:32.721306+0000","last_unstale":"2023-11-24T06:17:32.732608+0000","last_undegraded":"2023-11-24T06:17:32.732608+0000","last_fullsized":"2023-11-24T06:17:32.732608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:45:18.936606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.738814+0000","last_change":"2023-11-24T06:17:31.691591+0000","last_active":"2023-11-24T06:17:32.738814+0000","last_peered":"2023-11-24T06:17:32.738814+0000","last_clean":"2023-11-24T06:17:32.738814+0000","last_became_active":"2023-11-24T06:17:31.690821+0000","last_became_peered":"2023-11-24T06:17:31.690821+0000","last_unstale":"2023-11-24T06:17:32.738814+0000","last_undegraded":"2023-11-24T06:17:32.738814+0000","last_fullsized":"2023-11-24T06:17:32.738814+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:27.439322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.725635+0000","last_change":"2023-11-24T06:17:32.722349+0000","last_active":"2023-11-24T06:17:32.725635+0000","last_peered":"2023-11-24T06:17:32.725635+0000","last_clean":"2023-11-24T06:17:32.725635+0000","last_became_active":"2023-11-24T06:17:32.722056+0000","last_became_peered":"2023-11-24T06:17:32.722056+0000","last_unstale":"2023-11-24T06:17:32.725635+0000","last_undegraded":"2023-11-24T06:17:32.725635+0000","last_fullsized":"2023-11-24T06:17:32.725635+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:16:26.161130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"64'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692292+0000","last_change":"2023-11-24T06:17:31.702187+0000","last_active":"2023-11-24T06:17:33.692292+0000","last_peered":"2023-11-24T06:17:33.692292+0000","last_clean":"2023-11-24T06:17:33.692292+0000","last_became_active":"2023-11-24T06:17:31.701872+0000","last_became_peered":"2023-11-24T06:17:31.701872+0000","last_unstale":"2023-11-24T06:17:33.692292+0000","last_undegraded":"2023-11-24T06:17:33.692292+0000","last_fullsized":"2023-11-24T06:17:33.692292+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:13.096340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728636+0000","last_change":"2023-11-24T06:17:32.726082+0000","last_active":"2023-11-24T06:17:32.728636+0000","last_peered":"2023-11-24T06:17:32.728636+0000","last_clean":"2023-11-24T06:17:32.728636+0000","last_became_active":"2023-11-24T06:17:32.725787+0000","last_became_peered":"2023-11-24T06:17:32.725787+0000","last_unstale":"2023-11-24T06:17:32.728636+0000","last_undegraded":"2023-11-24T06:17:32.728636+0000","last_fullsized":"2023-11-24T06:17:32.728636+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:40:20.249310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.743061+0000","last_change":"2023-11-24T06:17:31.687630+0000","last_active":"2023-11-24T06:17:32.743061+0000","last_peered":"2023-11-24T06:17:32.743061+0000","last_clean":"2023-11-24T06:17:32.743061+0000","last_became_active":"2023-11-24T06:17:31.687169+0000","last_became_peered":"2023-11-24T06:17:31.687169+0000","last_unstale":"2023-11-24T06:17:32.743061+0000","last_undegraded":"2023-11-24T06:17:32.743061+0000","last_fullsized":"2023-11-24T06:17:32.743061+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:29.354316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690451+0000","last_change":"2023-11-24T06:17:32.698746+0000","last_active":"2023-11-24T06:17:33.690451+0000","last_peered":"2023-11-24T06:17:33.690451+0000","last_clean":"2023-11-24T06:17:33.690451+0000","last_became_active":"2023-11-24T06:17:32.697979+0000","last_became_peered":"2023-11-24T06:17:32.697979+0000","last_unstale":"2023-11-24T06:17:33.690451+0000","last_undegraded":"2023-11-24T06:17:33.690451+0000","last_fullsized":"2023-11-24T06:17:33.690451+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:28:07.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.739569+0000","last_change":"2023-11-24T06:17:31.698341+0000","last_active":"2023-11-24T06:17:32.739569+0000","last_peered":"2023-11-24T06:17:32.739569+0000","last_clean":"2023-11-24T06:17:32.739569+0000","last_became_active":"2023-11-24T06:17:31.698105+0000","last_became_peered":"2023-11-24T06:17:31.698105+0000","last_unstale":"2023-11-24T06:17:32.739569+0000","last_undegraded":"2023-11-24T06:17:32.739569+0000","last_fullsized":"2023-11-24T06:17:32.739569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:16:23.728251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691912+0000","last_change":"2023-11-24T06:17:32.712443+0000","last_active":"2023-11-24T06:17:33.691912+0000","last_peered":"2023-11-24T06:17:33.691912+0000","last_clean":"2023-11-24T06:17:33.691912+0000","last_became_active":"2023-11-24T06:17:32.712138+0000","last_became_peered":"2023-11-24T06:17:32.712138+0000","last_unstale":"2023-11-24T06:17:33.691912+0000","last_undegraded":"2023-11-24T06:17:33.691912+0000","last_fullsized":"2023-11-24T06:17:33.691912+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:10:18.813045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.742548+0000","last_change":"2023-11-24T06:17:31.693222+0000","last_active":"2023-11-24T06:17:32.742548+0000","last_peered":"2023-11-24T06:17:32.742548+0000","last_clean":"2023-11-24T06:17:32.742548+0000","last_became_active":"2023-11-24T06:17:31.692954+0000","last_became_peered":"2023-11-24T06:17:31.692954+0000","last_unstale":"2023-11-24T06:17:32.742548+0000","last_undegraded":"2023-11-24T06:17:32.742548+0000","last_fullsized":"2023-11-24T06:17:32.742548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:00.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.727357+0000","last_change":"2023-11-24T06:17:32.715191+0000","last_active":"2023-11-24T06:17:32.727357+0000","last_peered":"2023-11-24T06:17:32.727357+0000","last_clean":"2023-11-24T06:17:32.727357+0000","last_became_active":"2023-11-24T06:17:32.714876+0000","last_became_peered":"2023-11-24T06:17:32.714876+0000","last_unstale":"2023-11-24T06:17:32.727357+0000","last_undegraded":"2023-11-24T06:17:32.727357+0000","last_fullsized":"2023-11-24T06:17:32.727357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:50.185055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686511+0000","last_change":"2023-11-24T06:17:31.699669+0000","last_active":"2023-11-24T06:17:33.686511+0000","last_peered":"2023-11-24T06:17:33.686511+0000","last_clean":"2023-11-24T06:17:33.686511+0000","last_became_active":"2023-11-24T06:17:31.698650+0000","last_became_peered":"2023-11-24T06:17:31.698650+0000","last_unstale":"2023-11-24T06:17:33.686511+0000","last_undegraded":"2023-11-24T06:17:33.686511+0000","last_fullsized":"2023-11-24T06:17:33.686511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:28:03.823322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.720372+0000","last_change":"2023-11-24T06:17:32.716662+0000","last_active":"2023-11-24T06:17:32.720372+0000","last_peered":"2023-11-24T06:17:32.720372+0000","last_clean":"2023-11-24T06:17:32.720372+0000","last_became_active":"2023-11-24T06:17:32.715872+0000","last_became_peered":"2023-11-24T06:17:32.715872+0000","last_unstale":"2023-11-24T06:17:32.720372+0000","last_undegraded":"2023-11-24T06:17:32.720372+0000","last_fullsized":"2023-11-24T06:17:32.720372+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:53:26.363767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.698086+0000","last_change":"2023-11-24T06:17:31.686137+0000","last_active":"2023-11-24T06:17:32.698086+0000","last_peered":"2023-11-24T06:17:32.698086+0000","last_clean":"2023-11-24T06:17:32.698086+0000","last_became_active":"2023-11-24T06:17:31.684865+0000","last_became_peered":"2023-11-24T06:17:31.684865+0000","last_unstale":"2023-11-24T06:17:32.698086+0000","last_undegraded":"2023-11-24T06:17:32.698086+0000","last_fullsized":"2023-11-24T06:17:32.698086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:41.703713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691848+0000","last_change":"2023-11-24T06:17:32.707170+0000","last_active":"2023-11-24T06:17:33.691848+0000","last_peered":"2023-11-24T06:17:33.691848+0000","last_clean":"2023-11-24T06:17:33.691848+0000","last_became_active":"2023-11-24T06:17:32.706862+0000","last_became_peered":"2023-11-24T06:17:32.706862+0000","last_unstale":"2023-11-24T06:17:33.691848+0000","last_undegraded":"2023-11-24T06:17:33.691848+0000","last_fullsized":"2023-11-24T06:17:33.691848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:24.293482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692538+0000","last_change":"2023-11-24T06:17:31.698166+0000","last_active":"2023-11-24T06:17:33.692538+0000","last_peered":"2023-11-24T06:17:33.692538+0000","last_clean":"2023-11-24T06:17:33.692538+0000","last_became_active":"2023-11-24T06:17:31.697394+0000","last_became_peered":"2023-11-24T06:17:31.697394+0000","last_unstale":"2023-11-24T06:17:33.692538+0000","last_undegraded":"2023-11-24T06:17:33.692538+0000","last_fullsized":"2023-11-24T06:17:33.692538+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:49.537913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729235+0000","last_change":"2023-11-24T06:17:32.727391+0000","last_active":"2023-11-24T06:17:32.729235+0000","last_peered":"2023-11-24T06:17:32.729235+0000","last_clean":"2023-11-24T06:17:32.729235+0000","last_became_active":"2023-11-24T06:17:32.726921+0000","last_became_peered":"2023-11-24T06:17:32.726921+0000","last_unstale":"2023-11-24T06:17:32.729235+0000","last_undegraded":"2023-11-24T06:17:32.729235+0000","last_fullsized":"2023-11-24T06:17:32.729235+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:34.869885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706244+0000","last_change":"2023-11-24T06:17:31.694482+0000","last_active":"2023-11-24T06:17:32.706244+0000","last_peered":"2023-11-24T06:17:32.706244+0000","last_clean":"2023-11-24T06:17:32.706244+0000","last_became_active":"2023-11-24T06:17:31.694176+0000","last_became_peered":"2023-11-24T06:17:31.694176+0000","last_unstale":"2023-11-24T06:17:32.706244+0000","last_undegraded":"2023-11-24T06:17:32.706244+0000","last_fullsized":"2023-11-24T06:17:32.706244+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:03:38.336905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721751+0000","last_change":"2023-11-24T06:17:32.714251+0000","last_active":"2023-11-24T06:17:32.721751+0000","last_peered":"2023-11-24T06:17:32.721751+0000","last_clean":"2023-11-24T06:17:32.721751+0000","last_became_active":"2023-11-24T06:17:32.713034+0000","last_became_peered":"2023-11-24T06:17:32.713034+0000","last_unstale":"2023-11-24T06:17:32.721751+0000","last_undegraded":"2023-11-24T06:17:32.721751+0000","last_fullsized":"2023-11-24T06:17:32.721751+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:56.039090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.742860+0000","last_change":"2023-11-24T06:17:31.696519+0000","last_active":"2023-11-24T06:17:32.742860+0000","last_peered":"2023-11-24T06:17:32.742860+0000","last_clean":"2023-11-24T06:17:32.742860+0000","last_became_active":"2023-11-24T06:17:31.696265+0000","last_became_peered":"2023-11-24T06:17:31.696265+0000","last_unstale":"2023-11-24T06:17:32.742860+0000","last_undegraded":"2023-11-24T06:17:32.742860+0000","last_fullsized":"2023-11-24T06:17:32.742860+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:23.510776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729297+0000","last_change":"2023-11-24T06:17:32.719575+0000","last_active":"2023-11-24T06:17:32.729297+0000","last_peered":"2023-11-24T06:17:32.729297+0000","last_clean":"2023-11-24T06:17:32.729297+0000","last_became_active":"2023-11-24T06:17:32.719309+0000","last_became_peered":"2023-11-24T06:17:32.719309+0000","last_unstale":"2023-11-24T06:17:32.729297+0000","last_undegraded":"2023-11-24T06:17:32.729297+0000","last_fullsized":"2023-11-24T06:17:32.729297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:49.116839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"64'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.687122+0000","last_change":"2023-11-24T06:17:31.685099+0000","last_active":"2023-11-24T06:17:33.687122+0000","last_peered":"2023-11-24T06:17:33.687122+0000","last_clean":"2023-11-24T06:17:33.687122+0000","last_became_active":"2023-11-24T06:17:31.684747+0000","last_became_peered":"2023-11-24T06:17:31.684747+0000","last_unstale":"2023-11-24T06:17:33.687122+0000","last_undegraded":"2023-11-24T06:17:33.687122+0000","last_fullsized":"2023-11-24T06:17:33.687122+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:41.232553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.725588+0000","last_change":"2023-11-24T06:17:32.721073+0000","last_active":"2023-11-24T06:17:32.725588+0000","last_peered":"2023-11-24T06:17:32.725588+0000","last_clean":"2023-11-24T06:17:32.725588+0000","last_became_active":"2023-11-24T06:17:32.720773+0000","last_became_peered":"2023-11-24T06:17:32.720773+0000","last_unstale":"2023-11-24T06:17:32.725588+0000","last_undegraded":"2023-11-24T06:17:32.725588+0000","last_fullsized":"2023-11-24T06:17:32.725588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:28.454238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"64'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686785+0000","last_change":"2023-11-24T06:17:31.694191+0000","last_active":"2023-11-24T06:17:33.686785+0000","last_peered":"2023-11-24T06:17:33.686785+0000","last_clean":"2023-11-24T06:17:33.686785+0000","last_became_active":"2023-11-24T06:17:31.693737+0000","last_became_peered":"2023-11-24T06:17:31.693737+0000","last_unstale":"2023-11-24T06:17:33.686785+0000","last_undegraded":"2023-11-24T06:17:33.686785+0000","last_fullsized":"2023-11-24T06:17:33.686785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:03:38.336905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689783+0000","last_change":"2023-11-24T06:17:32.703920+0000","last_active":"2023-11-24T06:17:33.689783+0000","last_peered":"2023-11-24T06:17:33.689783+0000","last_clean":"2023-11-24T06:17:33.689783+0000","last_became_active":"2023-11-24T06:17:32.703278+0000","last_became_peered":"2023-11-24T06:17:32.703278+0000","last_unstale":"2023-11-24T06:17:33.689783+0000","last_undegraded":"2023-11-24T06:17:33.689783+0000","last_fullsized":"2023-11-24T06:17:33.689783+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:09.093203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706127+0000","last_change":"2023-11-24T06:17:31.685487+0000","last_active":"2023-11-24T06:17:32.706127+0000","last_peered":"2023-11-24T06:17:32.706127+0000","last_clean":"2023-11-24T06:17:32.706127+0000","last_became_active":"2023-11-24T06:17:31.685112+0000","last_became_peered":"2023-11-24T06:17:31.685112+0000","last_unstale":"2023-11-24T06:17:32.706127+0000","last_undegraded":"2023-11-24T06:17:32.706127+0000","last_fullsized":"2023-11-24T06:17:32.706127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:28:03.823322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724862+0000","last_change":"2023-11-24T06:17:32.718023+0000","last_active":"2023-11-24T06:17:32.724862+0000","last_peered":"2023-11-24T06:17:32.724862+0000","last_clean":"2023-11-24T06:17:32.724862+0000","last_became_active":"2023-11-24T06:17:32.717715+0000","last_became_peered":"2023-11-24T06:17:32.717715+0000","last_unstale":"2023-11-24T06:17:32.724862+0000","last_undegraded":"2023-11-24T06:17:32.724862+0000","last_fullsized":"2023-11-24T06:17:32.724862+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:10:18.813045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689431+0000","last_change":"2023-11-24T06:17:31.696297+0000","last_active":"2023-11-24T06:17:33.689431+0000","last_peered":"2023-11-24T06:17:33.689431+0000","last_clean":"2023-11-24T06:17:33.689431+0000","last_became_active":"2023-11-24T06:17:31.696056+0000","last_became_peered":"2023-11-24T06:17:31.696056+0000","last_unstale":"2023-11-24T06:17:33.689431+0000","last_undegraded":"2023-11-24T06:17:33.689431+0000","last_fullsized":"2023-11-24T06:17:33.689431+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:13.286606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729221+0000","last_change":"2023-11-24T06:17:32.718777+0000","last_active":"2023-11-24T06:17:32.729221+0000","last_peered":"2023-11-24T06:17:32.729221+0000","last_clean":"2023-11-24T06:17:32.729221+0000","last_became_active":"2023-11-24T06:17:32.718449+0000","last_became_peered":"2023-11-24T06:17:32.718449+0000","last_unstale":"2023-11-24T06:17:32.729221+0000","last_undegraded":"2023-11-24T06:17:32.729221+0000","last_fullsized":"2023-11-24T06:17:32.729221+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:36:37.058638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"64'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689940+0000","last_change":"2023-11-24T06:17:31.694543+0000","last_active":"2023-11-24T06:17:33.689940+0000","last_peered":"2023-11-24T06:17:33.689940+0000","last_clean":"2023-11-24T06:17:33.689940+0000","last_became_active":"2023-11-24T06:17:31.694248+0000","last_became_peered":"2023-11-24T06:17:31.694248+0000","last_unstale":"2023-11-24T06:17:33.689940+0000","last_undegraded":"2023-11-24T06:17:33.689940+0000","last_fullsized":"2023-11-24T06:17:33.689940+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:20:16.164964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692610+0000","last_change":"2023-11-24T06:17:32.717211+0000","last_active":"2023-11-24T06:17:33.692610+0000","last_peered":"2023-11-24T06:17:33.692610+0000","last_clean":"2023-11-24T06:17:33.692610+0000","last_became_active":"2023-11-24T06:17:32.714466+0000","last_became_peered":"2023-11-24T06:17:32.714466+0000","last_unstale":"2023-11-24T06:17:33.692610+0000","last_undegraded":"2023-11-24T06:17:33.692610+0000","last_fullsized":"2023-11-24T06:17:33.692610+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:20.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.745540+0000","last_change":"2023-11-24T06:17:31.694034+0000","last_active":"2023-11-24T06:17:32.745540+0000","last_peered":"2023-11-24T06:17:32.745540+0000","last_clean":"2023-11-24T06:17:32.745540+0000","last_became_active":"2023-11-24T06:17:31.693720+0000","last_became_peered":"2023-11-24T06:17:31.693720+0000","last_unstale":"2023-11-24T06:17:32.745540+0000","last_undegraded":"2023-11-24T06:17:32.745540+0000","last_fullsized":"2023-11-24T06:17:32.745540+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:50.768505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729196+0000","last_change":"2023-11-24T06:17:32.727193+0000","last_active":"2023-11-24T06:17:32.729196+0000","last_peered":"2023-11-24T06:17:32.729196+0000","last_clean":"2023-11-24T06:17:32.729196+0000","last_became_active":"2023-11-24T06:17:32.726546+0000","last_became_peered":"2023-11-24T06:17:32.726546+0000","last_unstale":"2023-11-24T06:17:32.729196+0000","last_undegraded":"2023-11-24T06:17:32.729196+0000","last_fullsized":"2023-11-24T06:17:32.729196+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:19.687998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"64'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692578+0000","last_change":"2023-11-24T06:17:31.697299+0000","last_active":"2023-11-24T06:17:33.692578+0000","last_peered":"2023-11-24T06:17:33.692578+0000","last_clean":"2023-11-24T06:17:33.692578+0000","last_became_active":"2023-11-24T06:17:31.696994+0000","last_became_peered":"2023-11-24T06:17:31.696994+0000","last_unstale":"2023-11-24T06:17:33.692578+0000","last_undegraded":"2023-11-24T06:17:33.692578+0000","last_fullsized":"2023-11-24T06:17:33.692578+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:42:24.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.687146+0000","last_change":"2023-11-24T06:17:32.727860+0000","last_active":"2023-11-24T06:17:33.687146+0000","last_peered":"2023-11-24T06:17:33.687146+0000","last_clean":"2023-11-24T06:17:33.687146+0000","last_became_active":"2023-11-24T06:17:32.727188+0000","last_became_peered":"2023-11-24T06:17:32.727188+0000","last_unstale":"2023-11-24T06:17:33.687146+0000","last_undegraded":"2023-11-24T06:17:33.687146+0000","last_fullsized":"2023-11-24T06:17:33.687146+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:04.024574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.741367+0000","last_change":"2023-11-24T06:17:31.699450+0000","last_active":"2023-11-24T06:17:32.741367+0000","last_peered":"2023-11-24T06:17:32.741367+0000","last_clean":"2023-11-24T06:17:32.741367+0000","last_became_active":"2023-11-24T06:17:31.699044+0000","last_became_peered":"2023-11-24T06:17:31.699044+0000","last_unstale":"2023-11-24T06:17:32.741367+0000","last_undegraded":"2023-11-24T06:17:32.741367+0000","last_fullsized":"2023-11-24T06:17:32.741367+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:59.703333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.727874+0000","last_change":"2023-11-24T06:17:32.717749+0000","last_active":"2023-11-24T06:17:32.727874+0000","last_peered":"2023-11-24T06:17:32.727874+0000","last_clean":"2023-11-24T06:17:32.727874+0000","last_became_active":"2023-11-24T06:17:32.714412+0000","last_became_peered":"2023-11-24T06:17:32.714412+0000","last_unstale":"2023-11-24T06:17:32.727874+0000","last_undegraded":"2023-11-24T06:17:32.727874+0000","last_fullsized":"2023-11-24T06:17:32.727874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:13.084969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.707829+0000","last_change":"2023-11-24T06:17:31.700940+0000","last_active":"2023-11-24T06:17:32.707829+0000","last_peered":"2023-11-24T06:17:32.707829+0000","last_clean":"2023-11-24T06:17:32.707829+0000","last_became_active":"2023-11-24T06:17:31.700647+0000","last_became_peered":"2023-11-24T06:17:31.700647+0000","last_unstale":"2023-11-24T06:17:32.707829+0000","last_undegraded":"2023-11-24T06:17:32.707829+0000","last_fullsized":"2023-11-24T06:17:32.707829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:26.155841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721347+0000","last_change":"2023-11-24T06:17:32.715768+0000","last_active":"2023-11-24T06:17:32.721347+0000","last_peered":"2023-11-24T06:17:32.721347+0000","last_clean":"2023-11-24T06:17:32.721347+0000","last_became_active":"2023-11-24T06:17:32.715477+0000","last_became_peered":"2023-11-24T06:17:32.715477+0000","last_unstale":"2023-11-24T06:17:32.721347+0000","last_undegraded":"2023-11-24T06:17:32.721347+0000","last_fullsized":"2023-11-24T06:17:32.721347+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:48.495192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706253+0000","last_change":"2023-11-24T06:17:31.693076+0000","last_active":"2023-11-24T06:17:32.706253+0000","last_peered":"2023-11-24T06:17:32.706253+0000","last_clean":"2023-11-24T06:17:32.706253+0000","last_became_active":"2023-11-24T06:17:31.692762+0000","last_became_peered":"2023-11-24T06:17:31.692762+0000","last_unstale":"2023-11-24T06:17:32.706253+0000","last_undegraded":"2023-11-24T06:17:32.706253+0000","last_fullsized":"2023-11-24T06:17:32.706253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:19.481669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.720980+0000","last_change":"2023-11-24T06:17:32.712498+0000","last_active":"2023-11-24T06:17:32.720980+0000","last_peered":"2023-11-24T06:17:32.720980+0000","last_clean":"2023-11-24T06:17:32.720980+0000","last_became_active":"2023-11-24T06:17:32.712149+0000","last_became_peered":"2023-11-24T06:17:32.712149+0000","last_unstale":"2023-11-24T06:17:32.720980+0000","last_undegraded":"2023-11-24T06:17:32.720980+0000","last_fullsized":"2023-11-24T06:17:32.720980+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:16.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690507+0000","last_change":"2023-11-24T06:17:31.700392+0000","last_active":"2023-11-24T06:17:33.690507+0000","last_peered":"2023-11-24T06:17:33.690507+0000","last_clean":"2023-11-24T06:17:33.690507+0000","last_became_active":"2023-11-24T06:17:31.699609+0000","last_became_peered":"2023-11-24T06:17:31.699609+0000","last_unstale":"2023-11-24T06:17:33.690507+0000","last_undegraded":"2023-11-24T06:17:33.690507+0000","last_fullsized":"2023-11-24T06:17:33.690507+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:48.922824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.714809+0000","last_change":"2023-11-24T06:17:32.707177+0000","last_active":"2023-11-24T06:17:32.714809+0000","last_peered":"2023-11-24T06:17:32.714809+0000","last_clean":"2023-11-24T06:17:32.714809+0000","last_became_active":"2023-11-24T06:17:32.706299+0000","last_became_peered":"2023-11-24T06:17:32.706299+0000","last_unstale":"2023-11-24T06:17:32.714809+0000","last_undegraded":"2023-11-24T06:17:32.714809+0000","last_fullsized":"2023-11-24T06:17:32.714809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:26.812148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.708230+0000","last_change":"2023-11-24T06:17:31.692103+0000","last_active":"2023-11-24T06:17:32.708230+0000","last_peered":"2023-11-24T06:17:32.708230+0000","last_clean":"2023-11-24T06:17:32.708230+0000","last_became_active":"2023-11-24T06:17:31.691195+0000","last_became_peered":"2023-11-24T06:17:31.691195+0000","last_unstale":"2023-11-24T06:17:32.708230+0000","last_undegraded":"2023-11-24T06:17:32.708230+0000","last_fullsized":"2023-11-24T06:17:32.708230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:19.857288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732852+0000","last_change":"2023-11-24T06:17:32.727859+0000","last_active":"2023-11-24T06:17:32.732852+0000","last_peered":"2023-11-24T06:17:32.732852+0000","last_clean":"2023-11-24T06:17:32.732852+0000","last_became_active":"2023-11-24T06:17:32.727572+0000","last_became_peered":"2023-11-24T06:17:32.727572+0000","last_unstale":"2023-11-24T06:17:32.732852+0000","last_undegraded":"2023-11-24T06:17:32.732852+0000","last_fullsized":"2023-11-24T06:17:32.732852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:21.980927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.745472+0000","last_change":"2023-11-24T06:17:31.691234+0000","last_active":"2023-11-24T06:17:32.745472+0000","last_peered":"2023-11-24T06:17:32.745472+0000","last_clean":"2023-11-24T06:17:32.745472+0000","last_became_active":"2023-11-24T06:17:31.690342+0000","last_became_peered":"2023-11-24T06:17:31.690342+0000","last_unstale":"2023-11-24T06:17:32.745472+0000","last_undegraded":"2023-11-24T06:17:32.745472+0000","last_fullsized":"2023-11-24T06:17:32.745472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:58.417357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690452+0000","last_change":"2023-11-24T06:17:32.715792+0000","last_active":"2023-11-24T06:17:33.690452+0000","last_peered":"2023-11-24T06:17:33.690452+0000","last_clean":"2023-11-24T06:17:33.690452+0000","last_became_active":"2023-11-24T06:17:32.715410+0000","last_became_peered":"2023-11-24T06:17:32.715410+0000","last_unstale":"2023-11-24T06:17:33.690452+0000","last_undegraded":"2023-11-24T06:17:33.690452+0000","last_fullsized":"2023-11-24T06:17:33.690452+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:24.001288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692785+0000","last_change":"2023-11-24T06:17:31.694736+0000","last_active":"2023-11-24T06:17:33.692785+0000","last_peered":"2023-11-24T06:17:33.692785+0000","last_clean":"2023-11-24T06:17:33.692785+0000","last_became_active":"2023-11-24T06:17:31.693965+0000","last_became_peered":"2023-11-24T06:17:31.693965+0000","last_unstale":"2023-11-24T06:17:33.692785+0000","last_undegraded":"2023-11-24T06:17:33.692785+0000","last_fullsized":"2023-11-24T06:17:33.692785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:40:19.234394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729310+0000","last_change":"2023-11-24T06:17:32.727914+0000","last_active":"2023-11-24T06:17:32.729310+0000","last_peered":"2023-11-24T06:17:32.729310+0000","last_clean":"2023-11-24T06:17:32.729310+0000","last_became_active":"2023-11-24T06:17:32.725992+0000","last_became_peered":"2023-11-24T06:17:32.725992+0000","last_unstale":"2023-11-24T06:17:32.729310+0000","last_undegraded":"2023-11-24T06:17:32.729310+0000","last_fullsized":"2023-11-24T06:17:32.729310+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:49.760487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.710095+0000","last_change":"2023-11-24T06:17:31.693018+0000","last_active":"2023-11-24T06:17:32.710095+0000","last_peered":"2023-11-24T06:17:32.710095+0000","last_clean":"2023-11-24T06:17:32.710095+0000","last_became_active":"2023-11-24T06:17:31.692785+0000","last_became_peered":"2023-11-24T06:17:31.692785+0000","last_unstale":"2023-11-24T06:17:32.710095+0000","last_undegraded":"2023-11-24T06:17:32.710095+0000","last_fullsized":"2023-11-24T06:17:32.710095+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:43.793062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.725979+0000","last_change":"2023-11-24T06:17:32.722402+0000","last_active":"2023-11-24T06:17:32.725979+0000","last_peered":"2023-11-24T06:17:32.725979+0000","last_clean":"2023-11-24T06:17:32.725979+0000","last_became_active":"2023-11-24T06:17:32.722135+0000","last_became_peered":"2023-11-24T06:17:32.722135+0000","last_unstale":"2023-11-24T06:17:32.725979+0000","last_undegraded":"2023-11-24T06:17:32.725979+0000","last_fullsized":"2023-11-24T06:17:32.725979+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:09.093203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.712194+0000","last_change":"2023-11-24T06:17:31.697514+0000","last_active":"2023-11-24T06:17:32.712194+0000","last_peered":"2023-11-24T06:17:32.712194+0000","last_clean":"2023-11-24T06:17:32.712194+0000","last_became_active":"2023-11-24T06:17:31.697115+0000","last_became_peered":"2023-11-24T06:17:31.697115+0000","last_unstale":"2023-11-24T06:17:32.712194+0000","last_undegraded":"2023-11-24T06:17:32.712194+0000","last_fullsized":"2023-11-24T06:17:32.712194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:48.745571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.731679+0000","last_change":"2023-11-24T06:17:32.720786+0000","last_active":"2023-11-24T06:17:32.731679+0000","last_peered":"2023-11-24T06:17:32.731679+0000","last_clean":"2023-11-24T06:17:32.731679+0000","last_became_active":"2023-11-24T06:17:32.719902+0000","last_became_peered":"2023-11-24T06:17:32.719902+0000","last_unstale":"2023-11-24T06:17:32.731679+0000","last_undegraded":"2023-11-24T06:17:32.731679+0000","last_fullsized":"2023-11-24T06:17:32.731679+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:25.663401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.699305+0000","last_change":"2023-11-24T06:17:31.696510+0000","last_active":"2023-11-24T06:17:32.699305+0000","last_peered":"2023-11-24T06:17:32.699305+0000","last_clean":"2023-11-24T06:17:32.699305+0000","last_became_active":"2023-11-24T06:17:31.696239+0000","last_became_peered":"2023-11-24T06:17:31.696239+0000","last_unstale":"2023-11-24T06:17:32.699305+0000","last_undegraded":"2023-11-24T06:17:32.699305+0000","last_fullsized":"2023-11-24T06:17:32.699305+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:20.997565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724544+0000","last_change":"2023-11-24T06:17:32.722022+0000","last_active":"2023-11-24T06:17:32.724544+0000","last_peered":"2023-11-24T06:17:32.724544+0000","last_clean":"2023-11-24T06:17:32.724544+0000","last_became_active":"2023-11-24T06:17:32.721743+0000","last_became_peered":"2023-11-24T06:17:32.721743+0000","last_unstale":"2023-11-24T06:17:32.724544+0000","last_undegraded":"2023-11-24T06:17:32.724544+0000","last_fullsized":"2023-11-24T06:17:32.724544+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:34.970555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686656+0000","last_change":"2023-11-24T06:17:31.700032+0000","last_active":"2023-11-24T06:17:33.686656+0000","last_peered":"2023-11-24T06:17:33.686656+0000","last_clean":"2023-11-24T06:17:33.686656+0000","last_became_active":"2023-11-24T06:17:31.699676+0000","last_became_peered":"2023-11-24T06:17:31.699676+0000","last_unstale":"2023-11-24T06:17:33.686656+0000","last_undegraded":"2023-11-24T06:17:33.686656+0000","last_fullsized":"2023-11-24T06:17:33.686656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:00.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686692+0000","last_change":"2023-11-24T06:17:32.719855+0000","last_active":"2023-11-24T06:17:33.686692+0000","last_peered":"2023-11-24T06:17:33.686692+0000","last_clean":"2023-11-24T06:17:33.686692+0000","last_became_active":"2023-11-24T06:17:32.714543+0000","last_became_peered":"2023-11-24T06:17:32.714543+0000","last_unstale":"2023-11-24T06:17:33.686692+0000","last_undegraded":"2023-11-24T06:17:33.686692+0000","last_fullsized":"2023-11-24T06:17:33.686692+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:33.368300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690026+0000","last_change":"2023-11-24T06:17:31.698757+0000","last_active":"2023-11-24T06:17:33.690026+0000","last_peered":"2023-11-24T06:17:33.690026+0000","last_clean":"2023-11-24T06:17:33.690026+0000","last_became_active":"2023-11-24T06:17:31.698449+0000","last_became_peered":"2023-11-24T06:17:31.698449+0000","last_unstale":"2023-11-24T06:17:33.690026+0000","last_undegraded":"2023-11-24T06:17:33.690026+0000","last_fullsized":"2023-11-24T06:17:33.690026+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:15.286599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724393+0000","last_change":"2023-11-24T06:17:32.720627+0000","last_active":"2023-11-24T06:17:32.724393+0000","last_peered":"2023-11-24T06:17:32.724393+0000","last_clean":"2023-11-24T06:17:32.724393+0000","last_became_active":"2023-11-24T06:17:32.720365+0000","last_became_peered":"2023-11-24T06:17:32.720365+0000","last_unstale":"2023-11-24T06:17:32.724393+0000","last_undegraded":"2023-11-24T06:17:32.724393+0000","last_fullsized":"2023-11-24T06:17:32.724393+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:33.036641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706387+0000","last_change":"2023-11-24T06:17:31.685766+0000","last_active":"2023-11-24T06:17:32.706387+0000","last_peered":"2023-11-24T06:17:32.706387+0000","last_clean":"2023-11-24T06:17:32.706387+0000","last_became_active":"2023-11-24T06:17:31.685428+0000","last_became_peered":"2023-11-24T06:17:31.685428+0000","last_unstale":"2023-11-24T06:17:32.706387+0000","last_undegraded":"2023-11-24T06:17:32.706387+0000","last_fullsized":"2023-11-24T06:17:32.706387+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:14.889238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721416+0000","last_change":"2023-11-24T06:17:32.715073+0000","last_active":"2023-11-24T06:17:32.721416+0000","last_peered":"2023-11-24T06:17:32.721416+0000","last_clean":"2023-11-24T06:17:32.721416+0000","last_became_active":"2023-11-24T06:17:32.714661+0000","last_became_peered":"2023-11-24T06:17:32.714661+0000","last_unstale":"2023-11-24T06:17:32.721416+0000","last_undegraded":"2023-11-24T06:17:32.721416+0000","last_fullsized":"2023-11-24T06:17:32.721416+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:54.235225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.743171+0000","last_change":"2023-11-24T06:17:31.686740+0000","last_active":"2023-11-24T06:17:32.743171+0000","last_peered":"2023-11-24T06:17:32.743171+0000","last_clean":"2023-11-24T06:17:32.743171+0000","last_became_active":"2023-11-24T06:17:31.686453+0000","last_became_peered":"2023-11-24T06:17:31.686453+0000","last_unstale":"2023-11-24T06:17:32.743171+0000","last_undegraded":"2023-11-24T06:17:32.743171+0000","last_fullsized":"2023-11-24T06:17:32.743171+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:37.256107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-24T06:17:31.684676+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:17:31.684676+0000","last_peered":"2023-11-24T06:17:31.684676+0000","last_clean":"2023-11-24T06:17:31.684676+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:17:31.684676+0000","last_undegraded":"2023-11-24T06:17:31.684676+0000","last_fullsized":"2023-11-24T06:17:31.684676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1380352,"data_stored":924819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.012,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.448}]},{"osd":1,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.536,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.583},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2430000000000001},"min":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.6220000000000001,"5min":2.004,"15min":2.004},"last":1.4159999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.198},"min":{"1min":0.79700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1579999999999999,"15min":1.153},"min":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.637,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.234,"15min":1.23},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8069999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.548},{"interface":"front","average":{"1min":1.325,"5min":1.337,"15min":1.339},"min":{"1min":0.95999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.71,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.371}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.351,"15min":1.347},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.4590000000000001,"15min":1.46},"min":{"1min":1.139,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.873,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.252}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4430000000000001,"15min":1.4390000000000001},"min":{"1min":0.89800000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.704,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.997},{"interface":"front","average":{"1min":1.444,"5min":1.4790000000000001,"15min":1.4850000000000001},"min":{"1min":1.0980000000000001,"5min":1.022,"15min":1.022},"max":{"1min":1.8300000000000001,"5min":1.944,"15min":1.944},"last":1.5169999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5429999999999999,"15min":1.55},"min":{"1min":1.042,"5min":0.623,"15min":0.623},"max":{"1min":1.7589999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.292},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.476,"15min":1.48},"min":{"1min":0.95699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6859999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.1599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":333927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.72699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.52,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.0269999999999999,"15min":1.016},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5660000000000001,"5min":1.615,"15min":1.615},"last":1.077},{"interface":"front","average":{"1min":1.145,"5min":1.181,"15min":1.1870000000000001},"min":{"1min":0.76100000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6419999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.1120000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.323,"15min":1.325},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9339999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.204},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.351,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.645,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.5309999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.359,"15min":1.3779999999999999},"min":{"1min":0.90300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0350000000000001,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9119999999999999,"5min":2.056,"15min":2.056},"last":1.387}]},{"osd":4,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4470000000000001,"15min":1.456},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8029999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3},{"interface":"front","average":{"1min":1.506,"5min":1.5389999999999999,"15min":1.5449999999999999},"min":{"1min":0.80500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0219999999999998,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.6040000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.4650000000000001},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.825,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.635,"15min":1.641},"min":{"1min":0.71399999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0649999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.4750000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.5509999999999999,"15min":1.5389999999999999},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9079999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.431},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.498,"15min":1.484},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.024,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.508}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":333925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0449999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.464,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.246},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5429999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.1040000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1579999999999999,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.619,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.292,"15min":1.3069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.542,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.145}]},{"osd":2,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2629999999999999,"15min":1.2709999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.444},"min":{"1min":0.98199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0720000000000001,"5min":2.198,"15min":2.198},"last":1.4470000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6359999999999999,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.198},{"interface":"front","average":{"1min":1.407,"5min":1.4450000000000001,"15min":1.4510000000000001},"min":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.9470000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.532}]},{"osd":4,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6659999999999999,"5min":2.427,"15min":2.427},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.375,"5min":1.4670000000000001,"15min":1.4830000000000001},"min":{"1min":0.83299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8680000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.3029999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.5780000000000001,"15min":1.5940000000000001},"min":{"1min":1.1000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8029999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.587,"15min":1.6200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8069999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.0429999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.651,"15min":1.663},"min":{"1min":1.042,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0230000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.395},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.706,"15min":1.712},"min":{"1min":1.234,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1789999999999998,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.6870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":333905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0129999999999999,"15min":0.997},"min":{"1min":0.69699999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.407},{"interface":"front","average":{"1min":1.101,"5min":1.073,"15min":1.069},"min":{"1min":0.77800000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.103}]},{"osd":1,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.083,"15min":1.0780000000000001},"min":{"1min":0.73399999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.88900000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.71,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.266}]},{"osd":2,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.216,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.766,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.232,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5820000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.056}]},{"osd":3,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.339},"min":{"1min":0.95099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.643,"5min":2.089,"15min":2.089},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3360000000000001,"15min":1.337},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.873,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.1479999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3899999999999999,"15min":1.4019999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.47}]},{"osd":6,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.6100000000000001,"15min":1.6240000000000001},"min":{"1min":1.1819999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2730000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.454},{"interface":"front","average":{"1min":1.52,"5min":1.5840000000000001,"15min":1.595},"min":{"1min":1.0920000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.1789999999999998,"5min":2.222,"15min":2.222},"last":1.5580000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.5069999999999999,"15min":1.524},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.595,"5min":1.7030000000000001,"15min":1.7210000000000001},"min":{"1min":1.2729999999999999,"5min":1.157,"15min":1.157},"max":{"1min":2.0190000000000001,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.5}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":333947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.363,"5min":1.71,"15min":1.71},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.2769999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":0.98099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.242,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.97399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8859999999999999,"5min":1.998,"15min":1.998},"last":0.95999999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.673,"5min":1.802,"15min":1.802},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1000000000000001,"15min":1.095},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.667,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.2150000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":9.7599999999999998,"15min":11.188000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.833,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.4139999999999999,"15min":1.448},"min":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.714,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.7350000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.4450000000000001,"15min":1.4770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9370000000000001,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.399,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9159999999999999,"5min":4.274,"15min":4.274},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.7669999999999999,"15min":1.825},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.1190000000000002,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.399,"15min":1.4219999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0369999999999999,"5min":3.157,"15min":3.157},"last":1.6319999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5389999999999999,"15min":1.5680000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1709999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1829999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.7090000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":335447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2190000000000001,"5min":1.304,"15min":1.304},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0589999999999999,"15min":1.0680000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6879999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.625},{"interface":"front","average":{"1min":1.036,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.357,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.131,"15min":1.137},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6950000000000001,"5min":2.355,"15min":2.355},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.159,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.278}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3,"15min":1.294},"min":{"1min":0.85499999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.875,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.996},{"interface":"front","average":{"1min":1.468,"5min":1.4490000000000001,"15min":1.446},"min":{"1min":0.95499999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0979999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4159999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4990000000000001,"15min":1.502},"min":{"1min":0.95899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.47},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3979999999999999,"15min":1.3999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7869999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.373}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5349999999999999,"15min":1.5389999999999999},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.4119999999999999,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.591,"15min":1.589},"min":{"1min":0.92100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.595}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.544,"15min":1.5509999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0070000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.577,"15min":1.5840000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.266,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.153}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":336063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1830000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.109},{"interface":"front","average":{"1min":1,"5min":1.002,"15min":1.002},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.879,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.145}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.999,"15min":1.0089999999999999},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.6000000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.2450000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.712,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.907,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.377},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.712,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0840000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.365,"15min":1.393},"min":{"1min":0.84599999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.609,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.5209999999999999,"15min":1.552},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7769999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.2150000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.621,"15min":1.661},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8360000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.202},{"interface":"front","average":{"1min":1.341,"5min":1.6799999999999999,"15min":1.736},"min":{"1min":0.91200000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5860000000000001,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.3420000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5760000000000001,"15min":1.5960000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.246,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.45},{"interface":"front","average":{"1min":1.492,"5min":1.8320000000000001,"15min":1.8879999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1619999999999999,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.405}]},{"osd":7,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5960000000000001,"15min":1.6080000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.004,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.476},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.611,"15min":1.639},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.8240000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.1619999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1372160,"data_stored":924203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.97399999999999998,"15min":0.96999999999999997},"min":{"1min":0.53800000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6919999999999999,"5min":2.452,"15min":2.452},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.056,"15min":1.0740000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3360000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2529999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6950000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.258},{"interface":"front","average":{"1min":1.004,"5min":1.113,"15min":1.131},"min":{"1min":0.498,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":3.411,"15min":3.411},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.645,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.258,"15min":1.264},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.579,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.599}]},{"osd":4,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.446,"15min":1.452},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7949999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.554},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.575,"15min":1.605},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9379999999999999,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.212}]},{"osd":5,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.532,"15min":1.5469999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0150000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5469999999999999,"15min":1.5680000000000001},"min":{"1min":0.876,"5min":0.875,"15min":0.875},"max":{"1min":2.0019999999999998,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.355}]},{"osd":6,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.9039999999999999,"15min":1.9870000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0510000000000002,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.7989999999999999,"15min":1.847},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9470000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.508}]},{"osd":7,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.95599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0379999999999998,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.46},{"interface":"front","average":{"1min":1.536,"5min":1.841,"15min":1.8919999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0609999999999999,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.6459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:17:37.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:17:37.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.474+0000 7fad0359e640 1 Processor -- start 2023-11-24T06:17:37.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.475+0000 7fad0359e640 1 -- start start 2023-11-24T06:17:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.476+0000 7fad0359e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fad0415d390 0x7fad041618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.476+0000 7fad0359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 0x7fad0406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.476+0000 7fad0359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad04161e00 con 0x7fad0406bc60 2023-11-24T06:17:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.476+0000 7fad0359e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0415d770 con 0x7fad0415d390 2023-11-24T06:17:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.476+0000 7fad0359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0406a680 con 0x7fad0406dd00 2023-11-24T06:17:37.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.477+0000 7fad02d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad0406bc60 0x7fad0406d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55848/0 (socket says 172.21.15.37:55848) 2023-11-24T06:17:37.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.477+0000 7fad02d9d640 1 -- 172.21.15.37:0/2086655475 learned_addr learned my addr 172.21.15.37:0/2086655475 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.477+0000 7fad0259c640 1 --2- 172.21.15.37:0/2086655475 >> v2:172.21.15.188:3300/0 conn(0x7fad0415d390 0x7fad041618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.477+0000 7facf9d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 0x7fad0406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.477+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991827538 0 0) 0x7fad04161e00 con 0x7fad0406bc60 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.477+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf0003520 con 0x7fad0406bc60 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2125122436 0 0) 0x7facf0003520 con 0x7fad0406bc60 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 msgr2=0x7fad0406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 0x7fad0406b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 >> v2:172.21.15.188:3300/0 conn(0x7fad0415d390 msgr2=0x7fad041618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 --2- 172.21.15.37:0/2086655475 >> v2:172.21.15.188:3300/0 conn(0x7fad0415d390 0x7fad041618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0406a960 con 0x7fad0406bc60 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7facfc0019f0 con 0x7fad0406bc60 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 >> v1:172.21.15.37:6789/0 conn(0x7fad0406bc60 legacy=0x7fad0406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 0x7facf0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7facf00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf0004d00 0x7facf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415d770 con 0x7facf0003f40 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0406a680 con 0x7facf0004d00 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf000ba30 con 0x7fad0406dd00 2023-11-24T06:17:37.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.478+0000 7facf9d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7facf00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.479+0000 7fad0259c640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 0x7facf0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.479+0000 7fad02d9d640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf0004d00 0x7facf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.479+0000 7facf9d9b640 1 -- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 msgr2=0x7facf0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.479+0000 7facf9d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad0406dd00 0x7facf0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.479+0000 7facf9d9b640 1 -- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf0004d00 msgr2=0x7facf0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.479+0000 7facf9d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facf0004d00 0x7facf0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.479+0000 7facf9d9b640 1 -- 172.21.15.37:0/2086655475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0003520 con 0x7facf0003f40 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.480+0000 7facf9d9b640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7facf00047c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7facec009ac0 tx=0x7facf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af40d08f537878f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.480+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec02c6b0 con 0x7facf0003f40 2023-11-24T06:17:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.480+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec02c810 con 0x7facf0003f40 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.480+0000 7fad01d9b640 1 -- 172.21.15.37:0/2086655475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec02cba0 con 0x7facf0003f40 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.481+0000 7fad0359e640 1 -- 172.21.15.37:0/2086655475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 msgr2=0x7facf00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.481+0000 7fad0359e640 1 --2- 172.21.15.37:0/2086655475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7facf00047c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7facec009ac0 tx=0x7facf00057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.481+0000 7fad02d9d640 1 -- 172.21.15.37:0/2086655475 reap_dead start 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.481+0000 7fad0359e640 1 -- 172.21.15.37:0/2086655475 shutdown_connections 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.481+0000 7fad0359e640 1 -- 172.21.15.37:0/2086655475 >> 172.21.15.37:0/2086655475 conn(0x7fad040cf600 msgr2=0x7fad040cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.481+0000 7fad0359e640 1 -- 172.21.15.37:0/2086655475 shutdown_connections 2023-11-24T06:17:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.481+0000 7fad0359e640 1 -- 172.21.15.37:0/2086655475 wait complete. 2023-11-24T06:17:37.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.483+0000 7fad0359e640 1 Processor -- start 2023-11-24T06:17:37.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.483+0000 7fad0359e640 1 -- start start 2023-11-24T06:17:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7fad041413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad041512a0 0x7fad04151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad04143120 0x7fad041435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0413d910 con 0x7facf0003f40 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415dee0 con 0x7fad04143120 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad04151c40 con 0x7fad041512a0 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7fad041413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7fad041413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60400/0 (socket says 172.21.15.37:60400) 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.484+0000 7fad0259c640 1 -- 172.21.15.37:0/495186410 learned_addr learned my addr 172.21.15.37:0/495186410 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad0259c640 1 -- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad041512a0 msgr2=0x7fad04151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad0259c640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad041512a0 0x7fad04151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad0259c640 1 -- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad04143120 msgr2=0x7fad041435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad02d9d640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad04143120 0x7fad041435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad0259c640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad04143120 0x7fad041435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad0259c640 1 -- 172.21.15.37:0/495186410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad04141920 con 0x7facf0003f40 2023-11-24T06:17:37.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad02d9d640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad04143120 0x7fad041435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:37.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad0259c640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7fad041413e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7facf4011700 tx=0x7facf4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:37.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7facfb7fe640 1 -- 172.21.15.37:0/495186410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400f960 con 0x7facf0003f40 2023-11-24T06:17:37.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7facfb7fe640 1 -- 172.21.15.37:0/495186410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400fac0 con 0x7facf0003f40 2023-11-24T06:17:37.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7facfb7fe640 1 -- 172.21.15.37:0/495186410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400fe30 con 0x7facf0003f40 2023-11-24T06:17:37.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.485+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad04144510 con 0x7facf0003f40 2023-11-24T06:17:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.486+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad04144230 con 0x7facf0003f40 2023-11-24T06:17:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.487+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad04067990 con 0x7facf0003f40 2023-11-24T06:17:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.488+0000 7facfb7fe640 1 -- 172.21.15.37:0/495186410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7facf4015460 con 0x7facf0003f40 2023-11-24T06:17:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.489+0000 7facfb7fe640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7face406aed0 0x7face406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.489+0000 7facfb7fe640 1 -- 172.21.15.37:0/495186410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf4089b40 con 0x7facf0003f40 2023-11-24T06:17:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.489+0000 7facf9d9b640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7face406aed0 0x7face406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.490+0000 7facf9d9b640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7face406aed0 0x7face406d390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7facec036000 tx=0x7facec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.494+0000 7facfb7fe640 1 -- 172.21.15.37:0/495186410 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7facf4054c00 con 0x7facf0003f40 2023-11-24T06:17:37.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.678+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad0406b200 con 0x7face406aed0 2023-11-24T06:17:37.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.691+0000 7facfb7fe640 1 -- 172.21.15.37:0/495186410 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286984 (secure 0 0 0) 0x7facec02c980 con 0x7face406aed0 2023-11-24T06:17:37.696 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:17:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7face406aed0 msgr2=0x7face406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7face406aed0 0x7face406d390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7facec036000 tx=0x7facec02e000 comp rx=0 tx=0).stop 2023-11-24T06:17:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 msgr2=0x7fad041413e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7fad041413e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7facf4011700 tx=0x7facf4011bc0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 shutdown_connections 2023-11-24T06:17:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7face406aed0 0x7face406d390 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad04143120 0x7fad041435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad041512a0 0x7fad04151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 --2- 172.21.15.37:0/495186410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf0003f40 0x7fad041413e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.697+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 >> 172.21.15.37:0/495186410 conn(0x7fad040cf600 msgr2=0x7fad041409d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.698+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 shutdown_connections 2023-11-24T06:17:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.698+0000 7fad0359e640 1 -- 172.21.15.37:0/495186410 wait complete. 2023-11-24T06:17:37.717 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-11-24T06:17:36.866707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":7479296,"data_stored":3856236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002167"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.731128+0000","last_change":"2023-11-24T06:17:32.730151+0000","last_active":"2023-11-24T06:17:32.731128+0000","last_peered":"2023-11-24T06:17:32.731128+0000","last_clean":"2023-11-24T06:17:32.731128+0000","last_became_active":"2023-11-24T06:17:32.729798+0000","last_became_peered":"2023-11-24T06:17:32.729798+0000","last_unstale":"2023-11-24T06:17:32.731128+0000","last_undegraded":"2023-11-24T06:17:32.731128+0000","last_fullsized":"2023-11-24T06:17:32.731128+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:57:22.946032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721090+0000","last_change":"2023-11-24T06:17:32.710702+0000","last_active":"2023-11-24T06:17:32.721090+0000","last_peered":"2023-11-24T06:17:32.721090+0000","last_clean":"2023-11-24T06:17:32.721090+0000","last_became_active":"2023-11-24T06:17:32.710314+0000","last_became_peered":"2023-11-24T06:17:32.710314+0000","last_unstale":"2023-11-24T06:17:32.721090+0000","last_undegraded":"2023-11-24T06:17:32.721090+0000","last_fullsized":"2023-11-24T06:17:32.721090+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:47.332904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728249+0000","last_change":"2023-11-24T06:17:32.722161+0000","last_active":"2023-11-24T06:17:32.728249+0000","last_peered":"2023-11-24T06:17:32.728249+0000","last_clean":"2023-11-24T06:17:32.728249+0000","last_became_active":"2023-11-24T06:17:32.721786+0000","last_became_peered":"2023-11-24T06:17:32.721786+0000","last_unstale":"2023-11-24T06:17:32.728249+0000","last_undegraded":"2023-11-24T06:17:32.728249+0000","last_fullsized":"2023-11-24T06:17:32.728249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:42.483931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686761+0000","last_change":"2023-11-24T06:17:32.721405+0000","last_active":"2023-11-24T06:17:33.686761+0000","last_peered":"2023-11-24T06:17:33.686761+0000","last_clean":"2023-11-24T06:17:33.686761+0000","last_became_active":"2023-11-24T06:17:32.721119+0000","last_became_peered":"2023-11-24T06:17:32.721119+0000","last_unstale":"2023-11-24T06:17:33.686761+0000","last_undegraded":"2023-11-24T06:17:33.686761+0000","last_fullsized":"2023-11-24T06:17:33.686761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:11.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.730403+0000","last_change":"2023-11-24T06:17:32.718912+0000","last_active":"2023-11-24T06:17:32.730403+0000","last_peered":"2023-11-24T06:17:32.730403+0000","last_clean":"2023-11-24T06:17:32.730403+0000","last_became_active":"2023-11-24T06:17:32.718516+0000","last_became_peered":"2023-11-24T06:17:32.718516+0000","last_unstale":"2023-11-24T06:17:32.730403+0000","last_undegraded":"2023-11-24T06:17:32.730403+0000","last_fullsized":"2023-11-24T06:17:32.730403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:53.403576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.720868+0000","last_change":"2023-11-24T06:17:32.712405+0000","last_active":"2023-11-24T06:17:32.720868+0000","last_peered":"2023-11-24T06:17:32.720868+0000","last_clean":"2023-11-24T06:17:32.720868+0000","last_became_active":"2023-11-24T06:17:32.712119+0000","last_became_peered":"2023-11-24T06:17:32.712119+0000","last_unstale":"2023-11-24T06:17:32.720868+0000","last_undegraded":"2023-11-24T06:17:32.720868+0000","last_fullsized":"2023-11-24T06:17:32.720868+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:16.907468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689376+0000","last_change":"2023-11-24T06:17:32.713050+0000","last_active":"2023-11-24T06:17:33.689376+0000","last_peered":"2023-11-24T06:17:33.689376+0000","last_clean":"2023-11-24T06:17:33.689376+0000","last_became_active":"2023-11-24T06:17:32.712701+0000","last_became_peered":"2023-11-24T06:17:32.712701+0000","last_unstale":"2023-11-24T06:17:33.689376+0000","last_undegraded":"2023-11-24T06:17:33.689376+0000","last_fullsized":"2023-11-24T06:17:33.689376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:34.869885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.723699+0000","last_change":"2023-11-24T06:17:32.719354+0000","last_active":"2023-11-24T06:17:32.723699+0000","last_peered":"2023-11-24T06:17:32.723699+0000","last_clean":"2023-11-24T06:17:32.723699+0000","last_became_active":"2023-11-24T06:17:32.716001+0000","last_became_peered":"2023-11-24T06:17:32.716001+0000","last_unstale":"2023-11-24T06:17:32.723699+0000","last_undegraded":"2023-11-24T06:17:32.723699+0000","last_fullsized":"2023-11-24T06:17:32.723699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:27:13.423205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.731701+0000","last_change":"2023-11-24T06:17:32.724280+0000","last_active":"2023-11-24T06:17:32.731701+0000","last_peered":"2023-11-24T06:17:32.731701+0000","last_clean":"2023-11-24T06:17:32.731701+0000","last_became_active":"2023-11-24T06:17:32.721277+0000","last_became_peered":"2023-11-24T06:17:32.721277+0000","last_unstale":"2023-11-24T06:17:32.731701+0000","last_undegraded":"2023-11-24T06:17:32.731701+0000","last_fullsized":"2023-11-24T06:17:32.731701+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:58.255465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692439+0000","last_change":"2023-11-24T06:17:32.717882+0000","last_active":"2023-11-24T06:17:33.692439+0000","last_peered":"2023-11-24T06:17:33.692439+0000","last_clean":"2023-11-24T06:17:33.692439+0000","last_became_active":"2023-11-24T06:17:32.717599+0000","last_became_peered":"2023-11-24T06:17:32.717599+0000","last_unstale":"2023-11-24T06:17:33.692439+0000","last_undegraded":"2023-11-24T06:17:33.692439+0000","last_fullsized":"2023-11-24T06:17:33.692439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:14.301522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728614+0000","last_change":"2023-11-24T06:17:32.725180+0000","last_active":"2023-11-24T06:17:32.728614+0000","last_peered":"2023-11-24T06:17:32.728614+0000","last_clean":"2023-11-24T06:17:32.728614+0000","last_became_active":"2023-11-24T06:17:32.724854+0000","last_became_peered":"2023-11-24T06:17:32.724854+0000","last_unstale":"2023-11-24T06:17:32.728614+0000","last_undegraded":"2023-11-24T06:17:32.728614+0000","last_fullsized":"2023-11-24T06:17:32.728614+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:49.937740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686924+0000","last_change":"2023-11-24T06:17:32.728048+0000","last_active":"2023-11-24T06:17:33.686924+0000","last_peered":"2023-11-24T06:17:33.686924+0000","last_clean":"2023-11-24T06:17:33.686924+0000","last_became_active":"2023-11-24T06:17:32.727531+0000","last_became_peered":"2023-11-24T06:17:32.727531+0000","last_unstale":"2023-11-24T06:17:33.686924+0000","last_undegraded":"2023-11-24T06:17:33.686924+0000","last_fullsized":"2023-11-24T06:17:33.686924+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:36.258177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724938+0000","last_change":"2023-11-24T06:17:32.719214+0000","last_active":"2023-11-24T06:17:32.724938+0000","last_peered":"2023-11-24T06:17:32.724938+0000","last_clean":"2023-11-24T06:17:32.724938+0000","last_became_active":"2023-11-24T06:17:32.718903+0000","last_became_peered":"2023-11-24T06:17:32.718903+0000","last_unstale":"2023-11-24T06:17:32.724938+0000","last_undegraded":"2023-11-24T06:17:32.724938+0000","last_fullsized":"2023-11-24T06:17:32.724938+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:43.199442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732017+0000","last_change":"2023-11-24T06:17:32.728821+0000","last_active":"2023-11-24T06:17:32.732017+0000","last_peered":"2023-11-24T06:17:32.732017+0000","last_clean":"2023-11-24T06:17:32.732017+0000","last_became_active":"2023-11-24T06:17:32.728495+0000","last_became_peered":"2023-11-24T06:17:32.728495+0000","last_unstale":"2023-11-24T06:17:32.732017+0000","last_undegraded":"2023-11-24T06:17:32.732017+0000","last_fullsized":"2023-11-24T06:17:32.732017+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:44:40.635302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732858+0000","last_change":"2023-11-24T06:17:32.727369+0000","last_active":"2023-11-24T06:17:32.732858+0000","last_peered":"2023-11-24T06:17:32.732858+0000","last_clean":"2023-11-24T06:17:32.732858+0000","last_became_active":"2023-11-24T06:17:32.726821+0000","last_became_peered":"2023-11-24T06:17:32.726821+0000","last_unstale":"2023-11-24T06:17:32.732858+0000","last_undegraded":"2023-11-24T06:17:32.732858+0000","last_fullsized":"2023-11-24T06:17:32.732858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:14.301522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690016+0000","last_change":"2023-11-24T06:17:32.723917+0000","last_active":"2023-11-24T06:17:33.690016+0000","last_peered":"2023-11-24T06:17:33.690016+0000","last_clean":"2023-11-24T06:17:33.690016+0000","last_became_active":"2023-11-24T06:17:32.723137+0000","last_became_peered":"2023-11-24T06:17:32.723137+0000","last_unstale":"2023-11-24T06:17:33.690016+0000","last_undegraded":"2023-11-24T06:17:33.690016+0000","last_fullsized":"2023-11-24T06:17:33.690016+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:01:15.495203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.730085+0000","last_change":"2023-11-24T06:17:32.714927+0000","last_active":"2023-11-24T06:17:32.730085+0000","last_peered":"2023-11-24T06:17:32.730085+0000","last_clean":"2023-11-24T06:17:32.730085+0000","last_became_active":"2023-11-24T06:17:32.714613+0000","last_became_peered":"2023-11-24T06:17:32.714613+0000","last_unstale":"2023-11-24T06:17:32.730085+0000","last_undegraded":"2023-11-24T06:17:32.730085+0000","last_fullsized":"2023-11-24T06:17:32.730085+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:02.308967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.687412+0000","last_change":"2023-11-24T06:17:32.723374+0000","last_active":"2023-11-24T06:17:33.687412+0000","last_peered":"2023-11-24T06:17:33.687412+0000","last_clean":"2023-11-24T06:17:33.687412+0000","last_became_active":"2023-11-24T06:17:32.722515+0000","last_became_peered":"2023-11-24T06:17:32.722515+0000","last_unstale":"2023-11-24T06:17:33.687412+0000","last_undegraded":"2023-11-24T06:17:33.687412+0000","last_fullsized":"2023-11-24T06:17:33.687412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:37.746657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.723607+0000","last_change":"2023-11-24T06:17:32.717447+0000","last_active":"2023-11-24T06:17:32.723607+0000","last_peered":"2023-11-24T06:17:32.723607+0000","last_clean":"2023-11-24T06:17:32.723607+0000","last_became_active":"2023-11-24T06:17:32.716958+0000","last_became_peered":"2023-11-24T06:17:32.716958+0000","last_unstale":"2023-11-24T06:17:32.723607+0000","last_undegraded":"2023-11-24T06:17:32.723607+0000","last_fullsized":"2023-11-24T06:17:32.723607+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:08:39.332077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.726908+0000","last_change":"2023-11-24T06:17:32.724224+0000","last_active":"2023-11-24T06:17:32.726908+0000","last_peered":"2023-11-24T06:17:32.726908+0000","last_clean":"2023-11-24T06:17:32.726908+0000","last_became_active":"2023-11-24T06:17:32.723795+0000","last_became_peered":"2023-11-24T06:17:32.723795+0000","last_unstale":"2023-11-24T06:17:32.726908+0000","last_undegraded":"2023-11-24T06:17:32.726908+0000","last_fullsized":"2023-11-24T06:17:32.726908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:49.937740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691578+0000","last_change":"2023-11-24T06:17:32.720018+0000","last_active":"2023-11-24T06:17:33.691578+0000","last_peered":"2023-11-24T06:17:33.691578+0000","last_clean":"2023-11-24T06:17:33.691578+0000","last_became_active":"2023-11-24T06:17:32.719753+0000","last_became_peered":"2023-11-24T06:17:32.719753+0000","last_unstale":"2023-11-24T06:17:33.691578+0000","last_undegraded":"2023-11-24T06:17:33.691578+0000","last_fullsized":"2023-11-24T06:17:33.691578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:52:07.683192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691244+0000","last_change":"2023-11-24T06:17:32.718725+0000","last_active":"2023-11-24T06:17:33.691244+0000","last_peered":"2023-11-24T06:17:33.691244+0000","last_clean":"2023-11-24T06:17:33.691244+0000","last_became_active":"2023-11-24T06:17:32.718406+0000","last_became_peered":"2023-11-24T06:17:32.718406+0000","last_unstale":"2023-11-24T06:17:33.691244+0000","last_undegraded":"2023-11-24T06:17:33.691244+0000","last_fullsized":"2023-11-24T06:17:33.691244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:53:10.683577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.723115+0000","last_change":"2023-11-24T06:17:32.716871+0000","last_active":"2023-11-24T06:17:32.723115+0000","last_peered":"2023-11-24T06:17:32.723115+0000","last_clean":"2023-11-24T06:17:32.723115+0000","last_became_active":"2023-11-24T06:17:32.716390+0000","last_became_peered":"2023-11-24T06:17:32.716390+0000","last_unstale":"2023-11-24T06:17:32.723115+0000","last_undegraded":"2023-11-24T06:17:32.723115+0000","last_fullsized":"2023-11-24T06:17:32.723115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:20.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.727785+0000","last_change":"2023-11-24T06:17:32.724494+0000","last_active":"2023-11-24T06:17:32.727785+0000","last_peered":"2023-11-24T06:17:32.727785+0000","last_clean":"2023-11-24T06:17:32.727785+0000","last_became_active":"2023-11-24T06:17:32.724185+0000","last_became_peered":"2023-11-24T06:17:32.724185+0000","last_unstale":"2023-11-24T06:17:32.727785+0000","last_undegraded":"2023-11-24T06:17:32.727785+0000","last_fullsized":"2023-11-24T06:17:32.727785+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:21.980927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692313+0000","last_change":"2023-11-24T06:17:32.718277+0000","last_active":"2023-11-24T06:17:33.692313+0000","last_peered":"2023-11-24T06:17:33.692313+0000","last_clean":"2023-11-24T06:17:33.692313+0000","last_became_active":"2023-11-24T06:17:32.716503+0000","last_became_peered":"2023-11-24T06:17:32.716503+0000","last_unstale":"2023-11-24T06:17:33.692313+0000","last_undegraded":"2023-11-24T06:17:33.692313+0000","last_fullsized":"2023-11-24T06:17:33.692313+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:53:26.363767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691688+0000","last_change":"2023-11-24T06:17:32.720018+0000","last_active":"2023-11-24T06:17:33.691688+0000","last_peered":"2023-11-24T06:17:33.691688+0000","last_clean":"2023-11-24T06:17:33.691688+0000","last_became_active":"2023-11-24T06:17:32.719531+0000","last_became_peered":"2023-11-24T06:17:32.719531+0000","last_unstale":"2023-11-24T06:17:33.691688+0000","last_undegraded":"2023-11-24T06:17:33.691688+0000","last_fullsized":"2023-11-24T06:17:33.691688+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:03:03.492480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721562+0000","last_change":"2023-11-24T06:17:32.716693+0000","last_active":"2023-11-24T06:17:32.721562+0000","last_peered":"2023-11-24T06:17:32.721562+0000","last_clean":"2023-11-24T06:17:32.721562+0000","last_became_active":"2023-11-24T06:17:32.716355+0000","last_became_peered":"2023-11-24T06:17:32.716355+0000","last_unstale":"2023-11-24T06:17:32.721562+0000","last_undegraded":"2023-11-24T06:17:32.721562+0000","last_fullsized":"2023-11-24T06:17:32.721562+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:45.712303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692549+0000","last_change":"2023-11-24T06:17:32.718200+0000","last_active":"2023-11-24T06:17:33.692549+0000","last_peered":"2023-11-24T06:17:33.692549+0000","last_clean":"2023-11-24T06:17:33.692549+0000","last_became_active":"2023-11-24T06:17:32.717845+0000","last_became_peered":"2023-11-24T06:17:32.717845+0000","last_unstale":"2023-11-24T06:17:33.692549+0000","last_undegraded":"2023-11-24T06:17:33.692549+0000","last_fullsized":"2023-11-24T06:17:33.692549+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:43.199442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.708543+0000","last_change":"2023-11-24T06:17:32.701799+0000","last_active":"2023-11-24T06:17:32.708543+0000","last_peered":"2023-11-24T06:17:32.708543+0000","last_clean":"2023-11-24T06:17:32.708543+0000","last_became_active":"2023-11-24T06:17:32.700446+0000","last_became_peered":"2023-11-24T06:17:32.700446+0000","last_unstale":"2023-11-24T06:17:32.708543+0000","last_undegraded":"2023-11-24T06:17:32.708543+0000","last_fullsized":"2023-11-24T06:17:32.708543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:30:58.641441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690689+0000","last_change":"2023-11-24T06:17:32.713368+0000","last_active":"2023-11-24T06:17:33.690689+0000","last_peered":"2023-11-24T06:17:33.690689+0000","last_clean":"2023-11-24T06:17:33.690689+0000","last_became_active":"2023-11-24T06:17:32.712400+0000","last_became_peered":"2023-11-24T06:17:32.712400+0000","last_unstale":"2023-11-24T06:17:33.690689+0000","last_undegraded":"2023-11-24T06:17:33.690689+0000","last_fullsized":"2023-11-24T06:17:33.690689+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:19.687998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691178+0000","last_change":"2023-11-24T06:17:32.715032+0000","last_active":"2023-11-24T06:17:33.691178+0000","last_peered":"2023-11-24T06:17:33.691178+0000","last_clean":"2023-11-24T06:17:33.691178+0000","last_became_active":"2023-11-24T06:17:32.714740+0000","last_became_peered":"2023-11-24T06:17:32.714740+0000","last_unstale":"2023-11-24T06:17:33.691178+0000","last_undegraded":"2023-11-24T06:17:33.691178+0000","last_fullsized":"2023-11-24T06:17:33.691178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:08.913100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724580+0000","last_change":"2023-11-24T06:17:32.721933+0000","last_active":"2023-11-24T06:17:32.724580+0000","last_peered":"2023-11-24T06:17:32.724580+0000","last_clean":"2023-11-24T06:17:32.724580+0000","last_became_active":"2023-11-24T06:17:32.721655+0000","last_became_peered":"2023-11-24T06:17:32.721655+0000","last_unstale":"2023-11-24T06:17:32.724580+0000","last_undegraded":"2023-11-24T06:17:32.724580+0000","last_fullsized":"2023-11-24T06:17:32.724580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:41.263858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728358+0000","last_change":"2023-11-24T06:17:32.724675+0000","last_active":"2023-11-24T06:17:32.728358+0000","last_peered":"2023-11-24T06:17:32.728358+0000","last_clean":"2023-11-24T06:17:32.728358+0000","last_became_active":"2023-11-24T06:17:32.724347+0000","last_became_peered":"2023-11-24T06:17:32.724347+0000","last_unstale":"2023-11-24T06:17:32.728358+0000","last_undegraded":"2023-11-24T06:17:32.728358+0000","last_fullsized":"2023-11-24T06:17:32.728358+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:24.001288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.745334+0000","last_change":"2023-11-24T06:17:31.697723+0000","last_active":"2023-11-24T06:17:32.745334+0000","last_peered":"2023-11-24T06:17:32.745334+0000","last_clean":"2023-11-24T06:17:32.745334+0000","last_became_active":"2023-11-24T06:17:31.697190+0000","last_became_peered":"2023-11-24T06:17:31.697190+0000","last_unstale":"2023-11-24T06:17:32.745334+0000","last_undegraded":"2023-11-24T06:17:32.745334+0000","last_fullsized":"2023-11-24T06:17:32.745334+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:28:06.182577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732608+0000","last_change":"2023-11-24T06:17:32.729905+0000","last_active":"2023-11-24T06:17:32.732608+0000","last_peered":"2023-11-24T06:17:32.732608+0000","last_clean":"2023-11-24T06:17:32.732608+0000","last_became_active":"2023-11-24T06:17:32.721306+0000","last_became_peered":"2023-11-24T06:17:32.721306+0000","last_unstale":"2023-11-24T06:17:32.732608+0000","last_undegraded":"2023-11-24T06:17:32.732608+0000","last_fullsized":"2023-11-24T06:17:32.732608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:45:18.936606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.738814+0000","last_change":"2023-11-24T06:17:31.691591+0000","last_active":"2023-11-24T06:17:32.738814+0000","last_peered":"2023-11-24T06:17:32.738814+0000","last_clean":"2023-11-24T06:17:32.738814+0000","last_became_active":"2023-11-24T06:17:31.690821+0000","last_became_peered":"2023-11-24T06:17:31.690821+0000","last_unstale":"2023-11-24T06:17:32.738814+0000","last_undegraded":"2023-11-24T06:17:32.738814+0000","last_fullsized":"2023-11-24T06:17:32.738814+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:27.439322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.725635+0000","last_change":"2023-11-24T06:17:32.722349+0000","last_active":"2023-11-24T06:17:32.725635+0000","last_peered":"2023-11-24T06:17:32.725635+0000","last_clean":"2023-11-24T06:17:32.725635+0000","last_became_active":"2023-11-24T06:17:32.722056+0000","last_became_peered":"2023-11-24T06:17:32.722056+0000","last_unstale":"2023-11-24T06:17:32.725635+0000","last_undegraded":"2023-11-24T06:17:32.725635+0000","last_fullsized":"2023-11-24T06:17:32.725635+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:16:26.161130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"64'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692292+0000","last_change":"2023-11-24T06:17:31.702187+0000","last_active":"2023-11-24T06:17:33.692292+0000","last_peered":"2023-11-24T06:17:33.692292+0000","last_clean":"2023-11-24T06:17:33.692292+0000","last_became_active":"2023-11-24T06:17:31.701872+0000","last_became_peered":"2023-11-24T06:17:31.701872+0000","last_unstale":"2023-11-24T06:17:33.692292+0000","last_undegraded":"2023-11-24T06:17:33.692292+0000","last_fullsized":"2023-11-24T06:17:33.692292+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:17:13.096340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.728636+0000","last_change":"2023-11-24T06:17:32.726082+0000","last_active":"2023-11-24T06:17:32.728636+0000","last_peered":"2023-11-24T06:17:32.728636+0000","last_clean":"2023-11-24T06:17:32.728636+0000","last_became_active":"2023-11-24T06:17:32.725787+0000","last_became_peered":"2023-11-24T06:17:32.725787+0000","last_unstale":"2023-11-24T06:17:32.728636+0000","last_undegraded":"2023-11-24T06:17:32.728636+0000","last_fullsized":"2023-11-24T06:17:32.728636+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:40:20.249310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.743061+0000","last_change":"2023-11-24T06:17:31.687630+0000","last_active":"2023-11-24T06:17:32.743061+0000","last_peered":"2023-11-24T06:17:32.743061+0000","last_clean":"2023-11-24T06:17:32.743061+0000","last_became_active":"2023-11-24T06:17:31.687169+0000","last_became_peered":"2023-11-24T06:17:31.687169+0000","last_unstale":"2023-11-24T06:17:32.743061+0000","last_undegraded":"2023-11-24T06:17:32.743061+0000","last_fullsized":"2023-11-24T06:17:32.743061+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:36:29.354316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690451+0000","last_change":"2023-11-24T06:17:32.698746+0000","last_active":"2023-11-24T06:17:33.690451+0000","last_peered":"2023-11-24T06:17:33.690451+0000","last_clean":"2023-11-24T06:17:33.690451+0000","last_became_active":"2023-11-24T06:17:32.697979+0000","last_became_peered":"2023-11-24T06:17:32.697979+0000","last_unstale":"2023-11-24T06:17:33.690451+0000","last_undegraded":"2023-11-24T06:17:33.690451+0000","last_fullsized":"2023-11-24T06:17:33.690451+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:28:07.197493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.739569+0000","last_change":"2023-11-24T06:17:31.698341+0000","last_active":"2023-11-24T06:17:32.739569+0000","last_peered":"2023-11-24T06:17:32.739569+0000","last_clean":"2023-11-24T06:17:32.739569+0000","last_became_active":"2023-11-24T06:17:31.698105+0000","last_became_peered":"2023-11-24T06:17:31.698105+0000","last_unstale":"2023-11-24T06:17:32.739569+0000","last_undegraded":"2023-11-24T06:17:32.739569+0000","last_fullsized":"2023-11-24T06:17:32.739569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:16:23.728251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691912+0000","last_change":"2023-11-24T06:17:32.712443+0000","last_active":"2023-11-24T06:17:33.691912+0000","last_peered":"2023-11-24T06:17:33.691912+0000","last_clean":"2023-11-24T06:17:33.691912+0000","last_became_active":"2023-11-24T06:17:32.712138+0000","last_became_peered":"2023-11-24T06:17:32.712138+0000","last_unstale":"2023-11-24T06:17:33.691912+0000","last_undegraded":"2023-11-24T06:17:33.691912+0000","last_fullsized":"2023-11-24T06:17:33.691912+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:10:18.813045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.742548+0000","last_change":"2023-11-24T06:17:31.693222+0000","last_active":"2023-11-24T06:17:32.742548+0000","last_peered":"2023-11-24T06:17:32.742548+0000","last_clean":"2023-11-24T06:17:32.742548+0000","last_became_active":"2023-11-24T06:17:31.692954+0000","last_became_peered":"2023-11-24T06:17:31.692954+0000","last_unstale":"2023-11-24T06:17:32.742548+0000","last_undegraded":"2023-11-24T06:17:32.742548+0000","last_fullsized":"2023-11-24T06:17:32.742548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:00.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.727357+0000","last_change":"2023-11-24T06:17:32.715191+0000","last_active":"2023-11-24T06:17:32.727357+0000","last_peered":"2023-11-24T06:17:32.727357+0000","last_clean":"2023-11-24T06:17:32.727357+0000","last_became_active":"2023-11-24T06:17:32.714876+0000","last_became_peered":"2023-11-24T06:17:32.714876+0000","last_unstale":"2023-11-24T06:17:32.727357+0000","last_undegraded":"2023-11-24T06:17:32.727357+0000","last_fullsized":"2023-11-24T06:17:32.727357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:13:50.185055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686511+0000","last_change":"2023-11-24T06:17:31.699669+0000","last_active":"2023-11-24T06:17:33.686511+0000","last_peered":"2023-11-24T06:17:33.686511+0000","last_clean":"2023-11-24T06:17:33.686511+0000","last_became_active":"2023-11-24T06:17:31.698650+0000","last_became_peered":"2023-11-24T06:17:31.698650+0000","last_unstale":"2023-11-24T06:17:33.686511+0000","last_undegraded":"2023-11-24T06:17:33.686511+0000","last_fullsized":"2023-11-24T06:17:33.686511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:28:03.823322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.720372+0000","last_change":"2023-11-24T06:17:32.716662+0000","last_active":"2023-11-24T06:17:32.720372+0000","last_peered":"2023-11-24T06:17:32.720372+0000","last_clean":"2023-11-24T06:17:32.720372+0000","last_became_active":"2023-11-24T06:17:32.715872+0000","last_became_peered":"2023-11-24T06:17:32.715872+0000","last_unstale":"2023-11-24T06:17:32.720372+0000","last_undegraded":"2023-11-24T06:17:32.720372+0000","last_fullsized":"2023-11-24T06:17:32.720372+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:53:26.363767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.698086+0000","last_change":"2023-11-24T06:17:31.686137+0000","last_active":"2023-11-24T06:17:32.698086+0000","last_peered":"2023-11-24T06:17:32.698086+0000","last_clean":"2023-11-24T06:17:32.698086+0000","last_became_active":"2023-11-24T06:17:31.684865+0000","last_became_peered":"2023-11-24T06:17:31.684865+0000","last_unstale":"2023-11-24T06:17:32.698086+0000","last_undegraded":"2023-11-24T06:17:32.698086+0000","last_fullsized":"2023-11-24T06:17:32.698086+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:41.703713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.691848+0000","last_change":"2023-11-24T06:17:32.707170+0000","last_active":"2023-11-24T06:17:33.691848+0000","last_peered":"2023-11-24T06:17:33.691848+0000","last_clean":"2023-11-24T06:17:33.691848+0000","last_became_active":"2023-11-24T06:17:32.706862+0000","last_became_peered":"2023-11-24T06:17:32.706862+0000","last_unstale":"2023-11-24T06:17:33.691848+0000","last_undegraded":"2023-11-24T06:17:33.691848+0000","last_fullsized":"2023-11-24T06:17:33.691848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:24.293482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692538+0000","last_change":"2023-11-24T06:17:31.698166+0000","last_active":"2023-11-24T06:17:33.692538+0000","last_peered":"2023-11-24T06:17:33.692538+0000","last_clean":"2023-11-24T06:17:33.692538+0000","last_became_active":"2023-11-24T06:17:31.697394+0000","last_became_peered":"2023-11-24T06:17:31.697394+0000","last_unstale":"2023-11-24T06:17:33.692538+0000","last_undegraded":"2023-11-24T06:17:33.692538+0000","last_fullsized":"2023-11-24T06:17:33.692538+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:49.537913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729235+0000","last_change":"2023-11-24T06:17:32.727391+0000","last_active":"2023-11-24T06:17:32.729235+0000","last_peered":"2023-11-24T06:17:32.729235+0000","last_clean":"2023-11-24T06:17:32.729235+0000","last_became_active":"2023-11-24T06:17:32.726921+0000","last_became_peered":"2023-11-24T06:17:32.726921+0000","last_unstale":"2023-11-24T06:17:32.729235+0000","last_undegraded":"2023-11-24T06:17:32.729235+0000","last_fullsized":"2023-11-24T06:17:32.729235+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:34.869885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706244+0000","last_change":"2023-11-24T06:17:31.694482+0000","last_active":"2023-11-24T06:17:32.706244+0000","last_peered":"2023-11-24T06:17:32.706244+0000","last_clean":"2023-11-24T06:17:32.706244+0000","last_became_active":"2023-11-24T06:17:31.694176+0000","last_became_peered":"2023-11-24T06:17:31.694176+0000","last_unstale":"2023-11-24T06:17:32.706244+0000","last_undegraded":"2023-11-24T06:17:32.706244+0000","last_fullsized":"2023-11-24T06:17:32.706244+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:03:38.336905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721751+0000","last_change":"2023-11-24T06:17:32.714251+0000","last_active":"2023-11-24T06:17:32.721751+0000","last_peered":"2023-11-24T06:17:32.721751+0000","last_clean":"2023-11-24T06:17:32.721751+0000","last_became_active":"2023-11-24T06:17:32.713034+0000","last_became_peered":"2023-11-24T06:17:32.713034+0000","last_unstale":"2023-11-24T06:17:32.721751+0000","last_undegraded":"2023-11-24T06:17:32.721751+0000","last_fullsized":"2023-11-24T06:17:32.721751+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:56.039090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.742860+0000","last_change":"2023-11-24T06:17:31.696519+0000","last_active":"2023-11-24T06:17:32.742860+0000","last_peered":"2023-11-24T06:17:32.742860+0000","last_clean":"2023-11-24T06:17:32.742860+0000","last_became_active":"2023-11-24T06:17:31.696265+0000","last_became_peered":"2023-11-24T06:17:31.696265+0000","last_unstale":"2023-11-24T06:17:32.742860+0000","last_undegraded":"2023-11-24T06:17:32.742860+0000","last_fullsized":"2023-11-24T06:17:32.742860+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:41:23.510776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729297+0000","last_change":"2023-11-24T06:17:32.719575+0000","last_active":"2023-11-24T06:17:32.729297+0000","last_peered":"2023-11-24T06:17:32.729297+0000","last_clean":"2023-11-24T06:17:32.729297+0000","last_became_active":"2023-11-24T06:17:32.719309+0000","last_became_peered":"2023-11-24T06:17:32.719309+0000","last_unstale":"2023-11-24T06:17:32.729297+0000","last_undegraded":"2023-11-24T06:17:32.729297+0000","last_fullsized":"2023-11-24T06:17:32.729297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:49.116839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"64'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.687122+0000","last_change":"2023-11-24T06:17:31.685099+0000","last_active":"2023-11-24T06:17:33.687122+0000","last_peered":"2023-11-24T06:17:33.687122+0000","last_clean":"2023-11-24T06:17:33.687122+0000","last_became_active":"2023-11-24T06:17:31.684747+0000","last_became_peered":"2023-11-24T06:17:31.684747+0000","last_unstale":"2023-11-24T06:17:33.687122+0000","last_undegraded":"2023-11-24T06:17:33.687122+0000","last_fullsized":"2023-11-24T06:17:33.687122+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:53:41.232553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.725588+0000","last_change":"2023-11-24T06:17:32.721073+0000","last_active":"2023-11-24T06:17:32.725588+0000","last_peered":"2023-11-24T06:17:32.725588+0000","last_clean":"2023-11-24T06:17:32.725588+0000","last_became_active":"2023-11-24T06:17:32.720773+0000","last_became_peered":"2023-11-24T06:17:32.720773+0000","last_unstale":"2023-11-24T06:17:32.725588+0000","last_undegraded":"2023-11-24T06:17:32.725588+0000","last_fullsized":"2023-11-24T06:17:32.725588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:28.454238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"64'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686785+0000","last_change":"2023-11-24T06:17:31.694191+0000","last_active":"2023-11-24T06:17:33.686785+0000","last_peered":"2023-11-24T06:17:33.686785+0000","last_clean":"2023-11-24T06:17:33.686785+0000","last_became_active":"2023-11-24T06:17:31.693737+0000","last_became_peered":"2023-11-24T06:17:31.693737+0000","last_unstale":"2023-11-24T06:17:33.686785+0000","last_undegraded":"2023-11-24T06:17:33.686785+0000","last_fullsized":"2023-11-24T06:17:33.686785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:03:38.336905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689783+0000","last_change":"2023-11-24T06:17:32.703920+0000","last_active":"2023-11-24T06:17:33.689783+0000","last_peered":"2023-11-24T06:17:33.689783+0000","last_clean":"2023-11-24T06:17:33.689783+0000","last_became_active":"2023-11-24T06:17:32.703278+0000","last_became_peered":"2023-11-24T06:17:32.703278+0000","last_unstale":"2023-11-24T06:17:33.689783+0000","last_undegraded":"2023-11-24T06:17:33.689783+0000","last_fullsized":"2023-11-24T06:17:33.689783+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:09.093203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706127+0000","last_change":"2023-11-24T06:17:31.685487+0000","last_active":"2023-11-24T06:17:32.706127+0000","last_peered":"2023-11-24T06:17:32.706127+0000","last_clean":"2023-11-24T06:17:32.706127+0000","last_became_active":"2023-11-24T06:17:31.685112+0000","last_became_peered":"2023-11-24T06:17:31.685112+0000","last_unstale":"2023-11-24T06:17:32.706127+0000","last_undegraded":"2023-11-24T06:17:32.706127+0000","last_fullsized":"2023-11-24T06:17:32.706127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:28:03.823322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724862+0000","last_change":"2023-11-24T06:17:32.718023+0000","last_active":"2023-11-24T06:17:32.724862+0000","last_peered":"2023-11-24T06:17:32.724862+0000","last_clean":"2023-11-24T06:17:32.724862+0000","last_became_active":"2023-11-24T06:17:32.717715+0000","last_became_peered":"2023-11-24T06:17:32.717715+0000","last_unstale":"2023-11-24T06:17:32.724862+0000","last_undegraded":"2023-11-24T06:17:32.724862+0000","last_fullsized":"2023-11-24T06:17:32.724862+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:10:18.813045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689431+0000","last_change":"2023-11-24T06:17:31.696297+0000","last_active":"2023-11-24T06:17:33.689431+0000","last_peered":"2023-11-24T06:17:33.689431+0000","last_clean":"2023-11-24T06:17:33.689431+0000","last_became_active":"2023-11-24T06:17:31.696056+0000","last_became_peered":"2023-11-24T06:17:31.696056+0000","last_unstale":"2023-11-24T06:17:33.689431+0000","last_undegraded":"2023-11-24T06:17:33.689431+0000","last_fullsized":"2023-11-24T06:17:33.689431+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:04:13.286606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729221+0000","last_change":"2023-11-24T06:17:32.718777+0000","last_active":"2023-11-24T06:17:32.729221+0000","last_peered":"2023-11-24T06:17:32.729221+0000","last_clean":"2023-11-24T06:17:32.729221+0000","last_became_active":"2023-11-24T06:17:32.718449+0000","last_became_peered":"2023-11-24T06:17:32.718449+0000","last_unstale":"2023-11-24T06:17:32.729221+0000","last_undegraded":"2023-11-24T06:17:32.729221+0000","last_fullsized":"2023-11-24T06:17:32.729221+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:36:37.058638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"64'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.689940+0000","last_change":"2023-11-24T06:17:31.694543+0000","last_active":"2023-11-24T06:17:33.689940+0000","last_peered":"2023-11-24T06:17:33.689940+0000","last_clean":"2023-11-24T06:17:33.689940+0000","last_became_active":"2023-11-24T06:17:31.694248+0000","last_became_peered":"2023-11-24T06:17:31.694248+0000","last_unstale":"2023-11-24T06:17:33.689940+0000","last_undegraded":"2023-11-24T06:17:33.689940+0000","last_fullsized":"2023-11-24T06:17:33.689940+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:20:16.164964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692610+0000","last_change":"2023-11-24T06:17:32.717211+0000","last_active":"2023-11-24T06:17:33.692610+0000","last_peered":"2023-11-24T06:17:33.692610+0000","last_clean":"2023-11-24T06:17:33.692610+0000","last_became_active":"2023-11-24T06:17:32.714466+0000","last_became_peered":"2023-11-24T06:17:32.714466+0000","last_unstale":"2023-11-24T06:17:33.692610+0000","last_undegraded":"2023-11-24T06:17:33.692610+0000","last_fullsized":"2023-11-24T06:17:33.692610+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:20.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.745540+0000","last_change":"2023-11-24T06:17:31.694034+0000","last_active":"2023-11-24T06:17:32.745540+0000","last_peered":"2023-11-24T06:17:32.745540+0000","last_clean":"2023-11-24T06:17:32.745540+0000","last_became_active":"2023-11-24T06:17:31.693720+0000","last_became_peered":"2023-11-24T06:17:31.693720+0000","last_unstale":"2023-11-24T06:17:32.745540+0000","last_undegraded":"2023-11-24T06:17:32.745540+0000","last_fullsized":"2023-11-24T06:17:32.745540+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:50.768505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729196+0000","last_change":"2023-11-24T06:17:32.727193+0000","last_active":"2023-11-24T06:17:32.729196+0000","last_peered":"2023-11-24T06:17:32.729196+0000","last_clean":"2023-11-24T06:17:32.729196+0000","last_became_active":"2023-11-24T06:17:32.726546+0000","last_became_peered":"2023-11-24T06:17:32.726546+0000","last_unstale":"2023-11-24T06:17:32.729196+0000","last_undegraded":"2023-11-24T06:17:32.729196+0000","last_fullsized":"2023-11-24T06:17:32.729196+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:19.687998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"64'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692578+0000","last_change":"2023-11-24T06:17:31.697299+0000","last_active":"2023-11-24T06:17:33.692578+0000","last_peered":"2023-11-24T06:17:33.692578+0000","last_clean":"2023-11-24T06:17:33.692578+0000","last_became_active":"2023-11-24T06:17:31.696994+0000","last_became_peered":"2023-11-24T06:17:31.696994+0000","last_unstale":"2023-11-24T06:17:33.692578+0000","last_undegraded":"2023-11-24T06:17:33.692578+0000","last_fullsized":"2023-11-24T06:17:33.692578+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:42:24.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.687146+0000","last_change":"2023-11-24T06:17:32.727860+0000","last_active":"2023-11-24T06:17:33.687146+0000","last_peered":"2023-11-24T06:17:33.687146+0000","last_clean":"2023-11-24T06:17:33.687146+0000","last_became_active":"2023-11-24T06:17:32.727188+0000","last_became_peered":"2023-11-24T06:17:32.727188+0000","last_unstale":"2023-11-24T06:17:33.687146+0000","last_undegraded":"2023-11-24T06:17:33.687146+0000","last_fullsized":"2023-11-24T06:17:33.687146+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:04.024574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.741367+0000","last_change":"2023-11-24T06:17:31.699450+0000","last_active":"2023-11-24T06:17:32.741367+0000","last_peered":"2023-11-24T06:17:32.741367+0000","last_clean":"2023-11-24T06:17:32.741367+0000","last_became_active":"2023-11-24T06:17:31.699044+0000","last_became_peered":"2023-11-24T06:17:31.699044+0000","last_unstale":"2023-11-24T06:17:32.741367+0000","last_undegraded":"2023-11-24T06:17:32.741367+0000","last_fullsized":"2023-11-24T06:17:32.741367+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:59.703333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.727874+0000","last_change":"2023-11-24T06:17:32.717749+0000","last_active":"2023-11-24T06:17:32.727874+0000","last_peered":"2023-11-24T06:17:32.727874+0000","last_clean":"2023-11-24T06:17:32.727874+0000","last_became_active":"2023-11-24T06:17:32.714412+0000","last_became_peered":"2023-11-24T06:17:32.714412+0000","last_unstale":"2023-11-24T06:17:32.727874+0000","last_undegraded":"2023-11-24T06:17:32.727874+0000","last_fullsized":"2023-11-24T06:17:32.727874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:24:13.084969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.707829+0000","last_change":"2023-11-24T06:17:31.700940+0000","last_active":"2023-11-24T06:17:32.707829+0000","last_peered":"2023-11-24T06:17:32.707829+0000","last_clean":"2023-11-24T06:17:32.707829+0000","last_became_active":"2023-11-24T06:17:31.700647+0000","last_became_peered":"2023-11-24T06:17:31.700647+0000","last_unstale":"2023-11-24T06:17:32.707829+0000","last_undegraded":"2023-11-24T06:17:32.707829+0000","last_fullsized":"2023-11-24T06:17:32.707829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:09:26.155841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721347+0000","last_change":"2023-11-24T06:17:32.715768+0000","last_active":"2023-11-24T06:17:32.721347+0000","last_peered":"2023-11-24T06:17:32.721347+0000","last_clean":"2023-11-24T06:17:32.721347+0000","last_became_active":"2023-11-24T06:17:32.715477+0000","last_became_peered":"2023-11-24T06:17:32.715477+0000","last_unstale":"2023-11-24T06:17:32.721347+0000","last_undegraded":"2023-11-24T06:17:32.721347+0000","last_fullsized":"2023-11-24T06:17:32.721347+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:48.495192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706253+0000","last_change":"2023-11-24T06:17:31.693076+0000","last_active":"2023-11-24T06:17:32.706253+0000","last_peered":"2023-11-24T06:17:32.706253+0000","last_clean":"2023-11-24T06:17:32.706253+0000","last_became_active":"2023-11-24T06:17:31.692762+0000","last_became_peered":"2023-11-24T06:17:31.692762+0000","last_unstale":"2023-11-24T06:17:32.706253+0000","last_undegraded":"2023-11-24T06:17:32.706253+0000","last_fullsized":"2023-11-24T06:17:32.706253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:46:19.481669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.720980+0000","last_change":"2023-11-24T06:17:32.712498+0000","last_active":"2023-11-24T06:17:32.720980+0000","last_peered":"2023-11-24T06:17:32.720980+0000","last_clean":"2023-11-24T06:17:32.720980+0000","last_became_active":"2023-11-24T06:17:32.712149+0000","last_became_peered":"2023-11-24T06:17:32.712149+0000","last_unstale":"2023-11-24T06:17:32.720980+0000","last_undegraded":"2023-11-24T06:17:32.720980+0000","last_fullsized":"2023-11-24T06:17:32.720980+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:16.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690507+0000","last_change":"2023-11-24T06:17:31.700392+0000","last_active":"2023-11-24T06:17:33.690507+0000","last_peered":"2023-11-24T06:17:33.690507+0000","last_clean":"2023-11-24T06:17:33.690507+0000","last_became_active":"2023-11-24T06:17:31.699609+0000","last_became_peered":"2023-11-24T06:17:31.699609+0000","last_unstale":"2023-11-24T06:17:33.690507+0000","last_undegraded":"2023-11-24T06:17:33.690507+0000","last_fullsized":"2023-11-24T06:17:33.690507+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:48.922824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.714809+0000","last_change":"2023-11-24T06:17:32.707177+0000","last_active":"2023-11-24T06:17:32.714809+0000","last_peered":"2023-11-24T06:17:32.714809+0000","last_clean":"2023-11-24T06:17:32.714809+0000","last_became_active":"2023-11-24T06:17:32.706299+0000","last_became_peered":"2023-11-24T06:17:32.706299+0000","last_unstale":"2023-11-24T06:17:32.714809+0000","last_undegraded":"2023-11-24T06:17:32.714809+0000","last_fullsized":"2023-11-24T06:17:32.714809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:26.812148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.708230+0000","last_change":"2023-11-24T06:17:31.692103+0000","last_active":"2023-11-24T06:17:32.708230+0000","last_peered":"2023-11-24T06:17:32.708230+0000","last_clean":"2023-11-24T06:17:32.708230+0000","last_became_active":"2023-11-24T06:17:31.691195+0000","last_became_peered":"2023-11-24T06:17:31.691195+0000","last_unstale":"2023-11-24T06:17:32.708230+0000","last_undegraded":"2023-11-24T06:17:32.708230+0000","last_fullsized":"2023-11-24T06:17:32.708230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:52:19.857288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.732852+0000","last_change":"2023-11-24T06:17:32.727859+0000","last_active":"2023-11-24T06:17:32.732852+0000","last_peered":"2023-11-24T06:17:32.732852+0000","last_clean":"2023-11-24T06:17:32.732852+0000","last_became_active":"2023-11-24T06:17:32.727572+0000","last_became_peered":"2023-11-24T06:17:32.727572+0000","last_unstale":"2023-11-24T06:17:32.732852+0000","last_undegraded":"2023-11-24T06:17:32.732852+0000","last_fullsized":"2023-11-24T06:17:32.732852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:21.980927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.745472+0000","last_change":"2023-11-24T06:17:31.691234+0000","last_active":"2023-11-24T06:17:32.745472+0000","last_peered":"2023-11-24T06:17:32.745472+0000","last_clean":"2023-11-24T06:17:32.745472+0000","last_became_active":"2023-11-24T06:17:31.690342+0000","last_became_peered":"2023-11-24T06:17:31.690342+0000","last_unstale":"2023-11-24T06:17:32.745472+0000","last_undegraded":"2023-11-24T06:17:32.745472+0000","last_fullsized":"2023-11-24T06:17:32.745472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:58.417357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690452+0000","last_change":"2023-11-24T06:17:32.715792+0000","last_active":"2023-11-24T06:17:33.690452+0000","last_peered":"2023-11-24T06:17:33.690452+0000","last_clean":"2023-11-24T06:17:33.690452+0000","last_became_active":"2023-11-24T06:17:32.715410+0000","last_became_peered":"2023-11-24T06:17:32.715410+0000","last_unstale":"2023-11-24T06:17:33.690452+0000","last_undegraded":"2023-11-24T06:17:33.690452+0000","last_fullsized":"2023-11-24T06:17:33.690452+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:24.001288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.692785+0000","last_change":"2023-11-24T06:17:31.694736+0000","last_active":"2023-11-24T06:17:33.692785+0000","last_peered":"2023-11-24T06:17:33.692785+0000","last_clean":"2023-11-24T06:17:33.692785+0000","last_became_active":"2023-11-24T06:17:31.693965+0000","last_became_peered":"2023-11-24T06:17:31.693965+0000","last_unstale":"2023-11-24T06:17:33.692785+0000","last_undegraded":"2023-11-24T06:17:33.692785+0000","last_fullsized":"2023-11-24T06:17:33.692785+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:40:19.234394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.729310+0000","last_change":"2023-11-24T06:17:32.727914+0000","last_active":"2023-11-24T06:17:32.729310+0000","last_peered":"2023-11-24T06:17:32.729310+0000","last_clean":"2023-11-24T06:17:32.729310+0000","last_became_active":"2023-11-24T06:17:32.725992+0000","last_became_peered":"2023-11-24T06:17:32.725992+0000","last_unstale":"2023-11-24T06:17:32.729310+0000","last_undegraded":"2023-11-24T06:17:32.729310+0000","last_fullsized":"2023-11-24T06:17:32.729310+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:49.760487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.710095+0000","last_change":"2023-11-24T06:17:31.693018+0000","last_active":"2023-11-24T06:17:32.710095+0000","last_peered":"2023-11-24T06:17:32.710095+0000","last_clean":"2023-11-24T06:17:32.710095+0000","last_became_active":"2023-11-24T06:17:31.692785+0000","last_became_peered":"2023-11-24T06:17:31.692785+0000","last_unstale":"2023-11-24T06:17:32.710095+0000","last_undegraded":"2023-11-24T06:17:32.710095+0000","last_fullsized":"2023-11-24T06:17:32.710095+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:43.793062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.725979+0000","last_change":"2023-11-24T06:17:32.722402+0000","last_active":"2023-11-24T06:17:32.725979+0000","last_peered":"2023-11-24T06:17:32.725979+0000","last_clean":"2023-11-24T06:17:32.725979+0000","last_became_active":"2023-11-24T06:17:32.722135+0000","last_became_peered":"2023-11-24T06:17:32.722135+0000","last_unstale":"2023-11-24T06:17:32.725979+0000","last_undegraded":"2023-11-24T06:17:32.725979+0000","last_fullsized":"2023-11-24T06:17:32.725979+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:09.093203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.712194+0000","last_change":"2023-11-24T06:17:31.697514+0000","last_active":"2023-11-24T06:17:32.712194+0000","last_peered":"2023-11-24T06:17:32.712194+0000","last_clean":"2023-11-24T06:17:32.712194+0000","last_became_active":"2023-11-24T06:17:31.697115+0000","last_became_peered":"2023-11-24T06:17:31.697115+0000","last_unstale":"2023-11-24T06:17:32.712194+0000","last_undegraded":"2023-11-24T06:17:32.712194+0000","last_fullsized":"2023-11-24T06:17:32.712194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:46:48.745571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.731679+0000","last_change":"2023-11-24T06:17:32.720786+0000","last_active":"2023-11-24T06:17:32.731679+0000","last_peered":"2023-11-24T06:17:32.731679+0000","last_clean":"2023-11-24T06:17:32.731679+0000","last_became_active":"2023-11-24T06:17:32.719902+0000","last_became_peered":"2023-11-24T06:17:32.719902+0000","last_unstale":"2023-11-24T06:17:32.731679+0000","last_undegraded":"2023-11-24T06:17:32.731679+0000","last_fullsized":"2023-11-24T06:17:32.731679+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:25.663401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.699305+0000","last_change":"2023-11-24T06:17:31.696510+0000","last_active":"2023-11-24T06:17:32.699305+0000","last_peered":"2023-11-24T06:17:32.699305+0000","last_clean":"2023-11-24T06:17:32.699305+0000","last_became_active":"2023-11-24T06:17:31.696239+0000","last_became_peered":"2023-11-24T06:17:31.696239+0000","last_unstale":"2023-11-24T06:17:32.699305+0000","last_undegraded":"2023-11-24T06:17:32.699305+0000","last_fullsized":"2023-11-24T06:17:32.699305+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:20.997565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724544+0000","last_change":"2023-11-24T06:17:32.722022+0000","last_active":"2023-11-24T06:17:32.724544+0000","last_peered":"2023-11-24T06:17:32.724544+0000","last_clean":"2023-11-24T06:17:32.724544+0000","last_became_active":"2023-11-24T06:17:32.721743+0000","last_became_peered":"2023-11-24T06:17:32.721743+0000","last_unstale":"2023-11-24T06:17:32.724544+0000","last_undegraded":"2023-11-24T06:17:32.724544+0000","last_fullsized":"2023-11-24T06:17:32.724544+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:26:34.970555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686656+0000","last_change":"2023-11-24T06:17:31.700032+0000","last_active":"2023-11-24T06:17:33.686656+0000","last_peered":"2023-11-24T06:17:33.686656+0000","last_clean":"2023-11-24T06:17:33.686656+0000","last_became_active":"2023-11-24T06:17:31.699676+0000","last_became_peered":"2023-11-24T06:17:31.699676+0000","last_unstale":"2023-11-24T06:17:33.686656+0000","last_undegraded":"2023-11-24T06:17:33.686656+0000","last_fullsized":"2023-11-24T06:17:33.686656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:50:00.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.686692+0000","last_change":"2023-11-24T06:17:32.719855+0000","last_active":"2023-11-24T06:17:33.686692+0000","last_peered":"2023-11-24T06:17:33.686692+0000","last_clean":"2023-11-24T06:17:33.686692+0000","last_became_active":"2023-11-24T06:17:32.714543+0000","last_became_peered":"2023-11-24T06:17:32.714543+0000","last_unstale":"2023-11-24T06:17:33.686692+0000","last_undegraded":"2023-11-24T06:17:33.686692+0000","last_fullsized":"2023-11-24T06:17:33.686692+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:21:33.368300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:33.690026+0000","last_change":"2023-11-24T06:17:31.698757+0000","last_active":"2023-11-24T06:17:33.690026+0000","last_peered":"2023-11-24T06:17:33.690026+0000","last_clean":"2023-11-24T06:17:33.690026+0000","last_became_active":"2023-11-24T06:17:31.698449+0000","last_became_peered":"2023-11-24T06:17:31.698449+0000","last_unstale":"2023-11-24T06:17:33.690026+0000","last_undegraded":"2023-11-24T06:17:33.690026+0000","last_fullsized":"2023-11-24T06:17:33.690026+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:29:15.286599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.724393+0000","last_change":"2023-11-24T06:17:32.720627+0000","last_active":"2023-11-24T06:17:32.724393+0000","last_peered":"2023-11-24T06:17:32.724393+0000","last_clean":"2023-11-24T06:17:32.724393+0000","last_became_active":"2023-11-24T06:17:32.720365+0000","last_became_peered":"2023-11-24T06:17:32.720365+0000","last_unstale":"2023-11-24T06:17:32.724393+0000","last_undegraded":"2023-11-24T06:17:32.724393+0000","last_fullsized":"2023-11-24T06:17:32.724393+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:01:33.036641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.706387+0000","last_change":"2023-11-24T06:17:31.685766+0000","last_active":"2023-11-24T06:17:32.706387+0000","last_peered":"2023-11-24T06:17:32.706387+0000","last_clean":"2023-11-24T06:17:32.706387+0000","last_became_active":"2023-11-24T06:17:31.685428+0000","last_became_peered":"2023-11-24T06:17:31.685428+0000","last_unstale":"2023-11-24T06:17:32.706387+0000","last_undegraded":"2023-11-24T06:17:32.706387+0000","last_fullsized":"2023-11-24T06:17:32.706387+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:14.889238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.721416+0000","last_change":"2023-11-24T06:17:32.715073+0000","last_active":"2023-11-24T06:17:32.721416+0000","last_peered":"2023-11-24T06:17:32.721416+0000","last_clean":"2023-11-24T06:17:32.721416+0000","last_became_active":"2023-11-24T06:17:32.714661+0000","last_became_peered":"2023-11-24T06:17:32.714661+0000","last_unstale":"2023-11-24T06:17:32.721416+0000","last_undegraded":"2023-11-24T06:17:32.721416+0000","last_fullsized":"2023-11-24T06:17:32.721416+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:31.652693+0000","last_clean_scrub_stamp":"2023-11-24T06:17:31.652693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:54.235225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T06:17:32.743171+0000","last_change":"2023-11-24T06:17:31.686740+0000","last_active":"2023-11-24T06:17:32.743171+0000","last_peered":"2023-11-24T06:17:32.743171+0000","last_clean":"2023-11-24T06:17:32.743171+0000","last_became_active":"2023-11-24T06:17:31.686453+0000","last_became_peered":"2023-11-24T06:17:31.686453+0000","last_unstale":"2023-11-24T06:17:32.743171+0000","last_undegraded":"2023-11-24T06:17:32.743171+0000","last_fullsized":"2023-11-24T06:17:32.743171+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:17:30.637777+0000","last_clean_scrub_stamp":"2023-11-24T06:17:30.637777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:37.256107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-24T06:17:31.684676+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:17:31.684676+0000","last_peered":"2023-11-24T06:17:31.684676+0000","last_clean":"2023-11-24T06:17:31.684676+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:17:31.684676+0000","last_undegraded":"2023-11-24T06:17:31.684676+0000","last_fullsized":"2023-11-24T06:17:31.684676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1380352,"data_stored":924819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.056,"15min":1.0489999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.012,"15min":0.98799999999999999},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.448}]},{"osd":1,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.536,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.583},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2430000000000001},"min":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.6220000000000001,"5min":2.004,"15min":2.004},"last":1.4159999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.198},"min":{"1min":0.79700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1579999999999999,"15min":1.153},"min":{"1min":0.72399999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.637,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.234,"15min":1.23},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.8069999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.548},{"interface":"front","average":{"1min":1.325,"5min":1.337,"15min":1.339},"min":{"1min":0.95999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.71,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.371}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.351,"15min":1.347},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.4590000000000001,"15min":1.46},"min":{"1min":1.139,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.873,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.252}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4430000000000001,"15min":1.4390000000000001},"min":{"1min":0.89800000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.704,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.997},{"interface":"front","average":{"1min":1.444,"5min":1.4790000000000001,"15min":1.4850000000000001},"min":{"1min":1.0980000000000001,"5min":1.022,"15min":1.022},"max":{"1min":1.8300000000000001,"5min":1.944,"15min":1.944},"last":1.5169999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5429999999999999,"15min":1.55},"min":{"1min":1.042,"5min":0.623,"15min":0.623},"max":{"1min":1.7589999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.292},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.476,"15min":1.48},"min":{"1min":0.95699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6859999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.1599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":333927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.085,"15min":1.087},"min":{"1min":0.72699999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.52,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.0269999999999999,"15min":1.016},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5660000000000001,"5min":1.615,"15min":1.615},"last":1.077},{"interface":"front","average":{"1min":1.145,"5min":1.181,"15min":1.1870000000000001},"min":{"1min":0.76100000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.6419999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.1120000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.323,"15min":1.325},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9339999999999999,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.204},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.351,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.645,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.5309999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.359,"15min":1.3779999999999999},"min":{"1min":0.90300000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.0350000000000001,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9119999999999999,"5min":2.056,"15min":2.056},"last":1.387}]},{"osd":4,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.4470000000000001,"15min":1.456},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8029999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3},{"interface":"front","average":{"1min":1.506,"5min":1.5389999999999999,"15min":1.5449999999999999},"min":{"1min":0.80500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0219999999999998,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.6040000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.458,"15min":1.4650000000000001},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.825,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.635,"15min":1.641},"min":{"1min":0.71399999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0649999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.4750000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.5509999999999999,"15min":1.5389999999999999},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9079999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.431},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.498,"15min":1.484},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.024,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.508}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":333925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0449999999999999,"15min":1.0569999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.464,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.246},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5429999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.1040000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1579999999999999,"15min":1.171},"min":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.619,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.292,"15min":1.3069999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.542,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.145}]},{"osd":2,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.2629999999999999,"15min":1.2709999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.647,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4379999999999999,"15min":1.444},"min":{"1min":0.98199999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.0720000000000001,"5min":2.198,"15min":2.198},"last":1.4470000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6359999999999999,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.198},{"interface":"front","average":{"1min":1.407,"5min":1.4450000000000001,"15min":1.4510000000000001},"min":{"1min":1.0149999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.9470000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.532}]},{"osd":4,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3340000000000001,"15min":1.355},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6659999999999999,"5min":2.427,"15min":2.427},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.375,"5min":1.4670000000000001,"15min":1.4830000000000001},"min":{"1min":0.83299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8680000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.3029999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.5780000000000001,"15min":1.5940000000000001},"min":{"1min":1.1000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.8029999999999999,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.587,"15min":1.6200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8069999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.0429999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.651,"15min":1.663},"min":{"1min":1.042,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0230000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.395},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.706,"15min":1.712},"min":{"1min":1.234,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1789999999999998,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.6870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":333905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0129999999999999,"15min":0.997},"min":{"1min":0.69699999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.407},{"interface":"front","average":{"1min":1.101,"5min":1.073,"15min":1.069},"min":{"1min":0.77800000000000002,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.103}]},{"osd":1,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.083,"15min":1.0780000000000001},"min":{"1min":0.73399999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.258},"min":{"1min":0.88900000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.71,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.266}]},{"osd":2,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.216,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.766,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.232,"15min":1.2470000000000001},"min":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5820000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.056}]},{"osd":3,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.327,"15min":1.339},"min":{"1min":0.95099999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.643,"5min":2.089,"15min":2.089},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3360000000000001,"15min":1.337},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.873,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.1479999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.304,"15min":1.3049999999999999},"min":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3899999999999999,"15min":1.4019999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.47}]},{"osd":6,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.6100000000000001,"15min":1.6240000000000001},"min":{"1min":1.1819999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2730000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.454},{"interface":"front","average":{"1min":1.52,"5min":1.5840000000000001,"15min":1.595},"min":{"1min":1.0920000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.1789999999999998,"5min":2.222,"15min":2.222},"last":1.5580000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:16:43 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.5069999999999999,"15min":1.524},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.595,"5min":1.7030000000000001,"15min":1.7210000000000001},"min":{"1min":1.2729999999999999,"5min":1.157,"15min":1.157},"max":{"1min":2.0190000000000001,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.5}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":333947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.363,"5min":1.71,"15min":1.71},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.008,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.2769999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.95899999999999996,"15min":0.98099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.242,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97499999999999998,"15min":0.97399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.8859999999999999,"5min":1.998,"15min":1.998},"last":0.95999999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.673,"5min":1.802,"15min":1.802},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1000000000000001,"15min":1.095},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.667,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.2150000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":9.7599999999999998,"15min":11.188000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.833,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.4139999999999999,"15min":1.448},"min":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.714,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.7350000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.4450000000000001,"15min":1.4770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9370000000000001,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.399,"15min":1.417},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9159999999999999,"5min":4.274,"15min":4.274},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.7669999999999999,"15min":1.825},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.1190000000000002,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.399,"15min":1.4219999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.0369999999999999,"5min":3.157,"15min":3.157},"last":1.6319999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.5389999999999999,"15min":1.5680000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1709999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5029999999999999,"15min":1.5209999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.1829999999999998,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.7090000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":335447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2190000000000001,"5min":1.304,"15min":1.304},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0589999999999999,"15min":1.0680000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6879999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.625},{"interface":"front","average":{"1min":1.036,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.357,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.131,"15min":1.137},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6950000000000001,"5min":2.355,"15min":2.355},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.159,"5min":1.1910000000000001,"15min":1.1970000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.278}]},{"osd":4,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3,"15min":1.294},"min":{"1min":0.85499999999999998,"5min":0.747,"15min":0.747},"max":{"1min":1.875,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.996},{"interface":"front","average":{"1min":1.468,"5min":1.4490000000000001,"15min":1.446},"min":{"1min":0.95499999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.0979999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4159999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.4990000000000001,"15min":1.502},"min":{"1min":0.95899999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.47},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3979999999999999,"15min":1.3999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7869999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.373}]},{"osd":6,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.5349999999999999,"15min":1.5389999999999999},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.4119999999999999,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.591,"15min":1.589},"min":{"1min":0.92100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.595}]},{"osd":7,"last update":"Fri Nov 24 06:16:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.544,"15min":1.5509999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0070000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.577,"15min":1.5840000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.266,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.153}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":336063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92800000000000005,"15min":0.94099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1830000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.109},{"interface":"front","average":{"1min":1,"5min":1.002,"15min":1.002},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.879,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.145}]},{"osd":2,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.999,"15min":1.0089999999999999},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.6000000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.2450000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.712,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.907,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.377},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.712,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0840000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.365,"15min":1.393},"min":{"1min":0.84599999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.609,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.5209999999999999,"15min":1.552},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7769999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.2150000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.621,"15min":1.661},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8360000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.202},{"interface":"front","average":{"1min":1.341,"5min":1.6799999999999999,"15min":1.736},"min":{"1min":0.91200000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5860000000000001,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.3420000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.5760000000000001,"15min":1.5960000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.246,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.45},{"interface":"front","average":{"1min":1.492,"5min":1.8320000000000001,"15min":1.8879999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.1619999999999999,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.405}]},{"osd":7,"last update":"Fri Nov 24 06:16:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.5960000000000001,"15min":1.6080000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.004,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.476},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.611,"15min":1.639},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.8240000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.1619999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1372160,"data_stored":924203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.97399999999999998,"15min":0.96999999999999997},"min":{"1min":0.53800000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.6919999999999999,"5min":2.452,"15min":2.452},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.056,"15min":1.0740000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3360000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2529999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6950000000000001,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.258},{"interface":"front","average":{"1min":1.004,"5min":1.113,"15min":1.131},"min":{"1min":0.498,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5109999999999999,"5min":3.411,"15min":3.411},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.645,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.258,"15min":1.264},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.579,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.599}]},{"osd":4,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.446,"15min":1.452},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7949999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.554},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.575,"15min":1.605},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.9379999999999999,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.212}]},{"osd":5,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.532,"15min":1.5469999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0150000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5469999999999999,"15min":1.5680000000000001},"min":{"1min":0.876,"5min":0.875,"15min":0.875},"max":{"1min":2.0019999999999998,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.355}]},{"osd":6,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.9039999999999999,"15min":1.9870000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0510000000000002,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.7989999999999999,"15min":1.847},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9470000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.508}]},{"osd":7,"last update":"Fri Nov 24 06:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.5680000000000001,"15min":1.5760000000000001},"min":{"1min":0.95599999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0379999999999998,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.46},{"interface":"front","average":{"1min":1.536,"5min":1.841,"15min":1.8919999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0609999999999999,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.6459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:17:37.721 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:17:37.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:17:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.992+0000 7f2e65735640 1 Processor -- start 2023-11-24T06:17:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.993+0000 7f2e65735640 1 -- start start 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.994+0000 7f2e65735640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e6015d3c0 0x7f2e600d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.994+0000 7f2e65735640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e600d0360 0x7f2e600b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.994+0000 7f2e65735640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600b6090 con 0x7f2e600d0e10 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.994+0000 7f2e65735640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600cf0b0 con 0x7f2e6015d3c0 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.994+0000 7f2e65735640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600d1c80 con 0x7f2e600d0360 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e5ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e6015d3c0 0x7f2e600d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e57fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2e600d0e10 0x7f2e600cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55858/0 (socket says 172.21.15.37:55858) 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e57fff640 1 -- 172.21.15.37:0/809268861 learned_addr learned my addr 172.21.15.37:0/809268861 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e64f34640 1 --2- 172.21.15.37:0/809268861 >> v2:172.21.15.188:3300/0 conn(0x7f2e600d0360 0x7f2e600b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e5f7fe640 1 -- 172.21.15.37:0/809268861 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203214628 0 0) 0x7f2e600b6090 con 0x7f2e600d0e10 2023-11-24T06:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e5ffff640 1 -- 172.21.15.37:0/809268861 >> v2:172.21.15.188:3300/0 conn(0x7f2e600d0360 msgr2=0x7f2e600b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e5ffff640 1 --2- 172.21.15.37:0/809268861 >> v2:172.21.15.188:3300/0 conn(0x7f2e600d0360 0x7f2e600b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e5ffff640 1 -- 172.21.15.37:0/809268861 >> v1:172.21.15.37:6789/0 conn(0x7f2e600d0e10 legacy=0x7f2e600cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.995+0000 7f2e5ffff640 1 -- 172.21.15.37:0/809268861 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600d1f60 con 0x7f2e6015d3c0 2023-11-24T06:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.996+0000 7f2e5ffff640 1 --2- 172.21.15.37:0/809268861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e600d15f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2e6008cbc0 tx=0x7f2e5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f40f00c63da8bd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e5f7fe640 1 -- 172.21.15.37:0/809268861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50031830 con 0x7f2e6015d3c0 2023-11-24T06:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e5f7fe640 1 -- 172.21.15.37:0/809268861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50031990 con 0x7f2e6015d3c0 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e5f7fe640 1 -- 172.21.15.37:0/809268861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50031d20 con 0x7f2e6015d3c0 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e65735640 1 -- 172.21.15.37:0/809268861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 msgr2=0x7f2e600d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e65735640 1 --2- 172.21.15.37:0/809268861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e600d15f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2e6008cbc0 tx=0x7f2e5002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e65735640 1 -- 172.21.15.37:0/809268861 shutdown_connections 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e65735640 1 --2- 172.21.15.37:0/809268861 >> v2:172.21.15.188:3300/0 conn(0x7f2e600d0360 0x7f2e600b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e65735640 1 --2- 172.21.15.37:0/809268861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e600d15f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.997+0000 7f2e65735640 1 -- 172.21.15.37:0/809268861 >> 172.21.15.37:0/809268861 conn(0x7f2e6009c570 msgr2=0x7f2e600d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.998+0000 7f2e65735640 1 -- 172.21.15.37:0/809268861 shutdown_connections 2023-11-24T06:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.998+0000 7f2e65735640 1 -- 172.21.15.37:0/809268861 wait complete. 2023-11-24T06:17:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.999+0000 7f2e65735640 1 Processor -- start 2023-11-24T06:17:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:37.999+0000 7f2e65735640 1 -- start start 2023-11-24T06:17:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e65735640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e600d0360 0x7f2e601f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e65735640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e600d0e10 0x7f2e6009fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e65735640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e6006c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e65735640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601f6c30 con 0x7f2e6015d3c0 2023-11-24T06:17:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e65735640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6014c6f0 con 0x7f2e600d0e10 2023-11-24T06:17:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e65735640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6014c9d0 con 0x7f2e600d0360 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e64f34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e6006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.000+0000 7f2e64f34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e6006c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60414/0 (socket says 172.21.15.37:60414) 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e64f34640 1 -- 172.21.15.37:0/1364604263 learned_addr learned my addr 172.21.15.37:0/1364604263 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e57fff640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e600d0e10 0x7f2e6009fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e5ffff640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e600d0360 0x7f2e601f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e64f34640 1 -- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e600d0360 msgr2=0x7f2e601f66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e64f34640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e600d0360 0x7f2e601f66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e64f34640 1 -- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e600d0e10 msgr2=0x7f2e6009fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e64f34640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e600d0e10 0x7f2e6009fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e64f34640 1 -- 172.21.15.37:0/1364604263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e50009400 con 0x7f2e6015d3c0 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e5ffff640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e600d0360 0x7f2e601f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.001+0000 7f2e64f34640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e6006c640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007de0 tx=0x7f2e5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.002+0000 7f2e5d7fa640 1 -- 172.21.15.37:0/1364604263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58014620 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.002+0000 7f2e5d7fa640 1 -- 172.21.15.37:0/1364604263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5800ee90 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.002+0000 7f2e5d7fa640 1 -- 172.21.15.37:0/1364604263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580149e0 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.002+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6014ccb0 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.002+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6014d270 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.003+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6014d490 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.004+0000 7f2e5d7fa640 1 -- 172.21.15.37:0/1364604263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f2e58014b40 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.005+0000 7f2e5d7fa640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4006aed0 0x7f2e4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.005+0000 7f2e5d7fa640 1 -- 172.21.15.37:0/1364604263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e5808a1c0 con 0x7f2e6015d3c0 2023-11-24T06:17:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.005+0000 7f2e5ffff640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4006aed0 0x7f2e4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.006+0000 7f2e5ffff640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4006aed0 0x7f2e4006d390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e50036000 tx=0x7f2e50008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.009+0000 7f2e5d7fa640 1 -- 172.21.15.37:0/1364604263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e58055190 con 0x7f2e6015d3c0 2023-11-24T06:17:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.269+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2e6004e840 con 0x7f2e6015d3c0 2023-11-24T06:17:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.274+0000 7f2e5d7fa640 1 -- 172.21.15.37:0/1364604263 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2e580587b0 con 0x7f2e6015d3c0 2023-11-24T06:17:38.277 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-11-24T06:17:38.277 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYP2Bln5oXFhAAb5H4zAAe1yPpGiUJEBtYaA== 2023-11-24T06:17:38.277 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-11-24T06:17:38.277 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-11-24T06:17:38.277 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:17:38.278 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-11-24T06:17:38.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4006aed0 msgr2=0x7f2e4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4006aed0 0x7f2e4006d390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2e50036000 tx=0x7f2e50008030 comp rx=0 tx=0).stop 2023-11-24T06:17:38.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 msgr2=0x7f2e6006c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e6006c640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007de0 tx=0x7f2e5800e4b0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 shutdown_connections 2023-11-24T06:17:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2e4006aed0 0x7f2e4006d390 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e600d0e10 0x7f2e6009fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e6015d3c0 0x7f2e6006c640 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 --2- 172.21.15.37:0/1364604263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e600d0360 0x7f2e601f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 >> 172.21.15.37:0/1364604263 conn(0x7f2e6009c570 msgr2=0x7f2e6006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.277+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 shutdown_connections 2023-11-24T06:17:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.278+0000 7f2e65735640 1 -- 172.21.15.37:0/1364604263 wait complete. 2023-11-24T06:17:38.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.523+0000 7f72e4b27640 1 Processor -- start 2023-11-24T06:17:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.523+0000 7f72e4b27640 1 -- start start 2023-11-24T06:17:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72e4b27640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72e0144b30 0x7f72e015f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72e4b27640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e015bf80 con 0x7f72e00b1de0 2023-11-24T06:17:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72e4b27640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00b1560 con 0x7f72e015c410 2023-11-24T06:17:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72e4b27640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00b1280 con 0x7f72e0144b30 2023-11-24T06:17:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72df7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72e0144b30 0x7f72e015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72df7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72e0144b30 0x7f72e015f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60424/0 (socket says 172.21.15.37:60424) 2023-11-24T06:17:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72df7fe640 1 -- 172.21.15.37:0/309511949 learned_addr learned my addr 172.21.15.37:0/309511949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72df7fe640 1 -- 172.21.15.37:0/309511949 >> v1:172.21.15.188:6789/0 conn(0x7f72e015c410 legacy=0x7f72e00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.525+0000 7f72df7fe640 1 -- 172.21.15.37:0/309511949 >> v1:172.21.15.37:6789/0 conn(0x7f72e00b1de0 legacy=0x7f72e00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.526+0000 7f72df7fe640 1 -- 172.21.15.37:0/309511949 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e015b930 con 0x7f72e0144b30 2023-11-24T06:17:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.527+0000 7f72df7fe640 1 --2- 172.21.15.37:0/309511949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e015f920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009870 tx=0x7f72d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a725223c514351fb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.527+0000 7f72de7fc640 1 -- 172.21.15.37:0/309511949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0030860 con 0x7f72e0144b30 2023-11-24T06:17:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.527+0000 7f72de7fc640 1 -- 172.21.15.37:0/309511949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d00309c0 con 0x7f72e0144b30 2023-11-24T06:17:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.527+0000 7f72de7fc640 1 -- 172.21.15.37:0/309511949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0030d50 con 0x7f72e0144b30 2023-11-24T06:17:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.528+0000 7f72e4b27640 1 -- 172.21.15.37:0/309511949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 msgr2=0x7f72e015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.528+0000 7f72e4b27640 1 --2- 172.21.15.37:0/309511949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e015f920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009870 tx=0x7f72d002b9a0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.528+0000 7f72e4b27640 1 -- 172.21.15.37:0/309511949 shutdown_connections 2023-11-24T06:17:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.528+0000 7f72e4b27640 1 --2- 172.21.15.37:0/309511949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e015f920 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.528+0000 7f72e4b27640 1 -- 172.21.15.37:0/309511949 >> 172.21.15.37:0/309511949 conn(0x7f72e00cb830 msgr2=0x7f72e00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.528+0000 7f72e4b27640 1 -- 172.21.15.37:0/309511949 shutdown_connections 2023-11-24T06:17:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.528+0000 7f72e4b27640 1 -- 172.21.15.37:0/309511949 wait complete. 2023-11-24T06:17:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.530+0000 7f72e4b27640 1 Processor -- start 2023-11-24T06:17:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.530+0000 7f72e4b27640 1 -- start start 2023-11-24T06:17:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.531+0000 7f72e4b27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72e00b1de0 0x7f72e0140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.531+0000 7f72e4b27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e01f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.531+0000 7f72e4b27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72e015c410 0x7f72e0071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.531+0000 7f72e4b27640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e013ae90 con 0x7f72e0144b30 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.531+0000 7f72e4b27640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01f6f40 con 0x7f72e015c410 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.531+0000 7f72e4b27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01f6c60 con 0x7f72e00b1de0 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.531+0000 7f72deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e01f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e01f73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60428/0 (socket says 172.21.15.37:60428) 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 -- 172.21.15.37:0/190722592 learned_addr learned my addr 172.21.15.37:0/190722592 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72dffff640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72e015c410 0x7f72e0071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72df7fe640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72e00b1de0 0x7f72e0140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 -- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72e00b1de0 msgr2=0x7f72e0140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72e00b1de0 0x7f72e0140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 -- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72e015c410 msgr2=0x7f72e0071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72e015c410 0x7f72e0071b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 -- 172.21.15.37:0/190722592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d00094d0 con 0x7f72e0144b30 2023-11-24T06:17:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72df7fe640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72e00b1de0 0x7f72e0140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.532+0000 7f72deffd640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e01f73d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c460 tx=0x7f72d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.533+0000 7f72c7fff640 1 -- 172.21.15.37:0/190722592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4012830 con 0x7f72e0144b30 2023-11-24T06:17:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.533+0000 7f72c7fff640 1 -- 172.21.15.37:0/190722592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d40129d0 con 0x7f72e0144b30 2023-11-24T06:17:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.533+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e0140ca0 con 0x7f72e0144b30 2023-11-24T06:17:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.533+0000 7f72c7fff640 1 -- 172.21.15.37:0/190722592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4012d80 con 0x7f72e0144b30 2023-11-24T06:17:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.533+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e00ca570 con 0x7f72e0144b30 2023-11-24T06:17:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.534+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e004e840 con 0x7f72e0144b30 2023-11-24T06:17:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.535+0000 7f72c7fff640 1 -- 172.21.15.37:0/190722592 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f72d401b400 con 0x7f72e0144b30 2023-11-24T06:17:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.536+0000 7f72c7fff640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f72cc06aed0 0x7f72cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.536+0000 7f72c7fff640 1 -- 172.21.15.37:0/190722592 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72d4089670 con 0x7f72e0144b30 2023-11-24T06:17:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.536+0000 7f72df7fe640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f72cc06aed0 0x7f72cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.537+0000 7f72df7fe640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f72cc06aed0 0x7f72cc06d390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f72d0036000 tx=0x7f72d003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.540+0000 7f72c7fff640 1 -- 172.21.15.37:0/190722592 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72d40546c0 con 0x7f72e0144b30 2023-11-24T06:17:38.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.771+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72e006d860 con 0x7f72e0144b30 2023-11-24T06:17:38.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.772+0000 7f72c7fff640 1 -- 172.21.15.37:0/190722592 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f72d4057ce0 con 0x7f72e0144b30 2023-11-24T06:17:38.775 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:38.775 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2892400858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2892400858},{"type":"v1","addr":"172.21.15.188:6835","nonce":2892400858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":4961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/4008465884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":4008465884},{"type":"v1","addr":"172.21.15.37:6837","nonce":4008465884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/2245601301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":2245601301},{"type":"v1","addr":"172.21.15.188:6834","nonce":2245601301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:17:32.142253+0000","modified":"2023-11-24T06:17:35.237267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6836/2581426871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2581426871},{"type":"v1","addr":"172.21.15.37:6836","nonce":2581426871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:17:38.775 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-11-24T06:17:38.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f72cc06aed0 msgr2=0x7f72cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f72cc06aed0 0x7f72cc06d390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f72d0036000 tx=0x7f72d003b040 comp rx=0 tx=0).stop 2023-11-24T06:17:38.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 msgr2=0x7f72e01f73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:38.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e01f73d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c460 tx=0x7f72d400c920 comp rx=0 tx=0).stop 2023-11-24T06:17:38.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 shutdown_connections 2023-11-24T06:17:38.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f72cc06aed0 0x7f72cc06d390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72e015c410 0x7f72e0071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e0144b30 0x7f72e01f73d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 --2- 172.21.15.37:0/190722592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72e00b1de0 0x7f72e0140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 >> 172.21.15.37:0/190722592 conn(0x7f72e00cb830 msgr2=0x7f72e00cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 shutdown_connections 2023-11-24T06:17:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:38.775+0000 7f72e4b27640 1 -- 172.21.15.37:0/190722592 wait complete. 2023-11-24T06:17:39.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:17:32.142253+0000', 'modified': '2023-11-24T06:17:35.237267+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6015}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6015': {'gid': 6015, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6836/2581426871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 2581426871}, {'type': 'v1', 'addr': '172.21.15.37:6836', 'nonce': 2581426871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:17:39.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:17:39.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T06:17:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.440+0000 7f2a190cf640 1 Processor -- start 2023-11-24T06:17:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.440+0000 7f2a190cf640 1 -- start start 2023-11-24T06:17:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.441+0000 7f2a190cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a1415b440 0x7f2a140cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.441+0000 7f2a190cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2a140c59b0 0x7f2a1406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.441+0000 7f2a190cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140c5dc0 con 0x7f2a140cbf20 2023-11-24T06:17:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.441+0000 7f2a190cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a140cc3d0 con 0x7f2a1415b440 2023-11-24T06:17:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.441+0000 7f2a190cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1415b820 con 0x7f2a140c59b0 2023-11-24T06:17:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a12d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a1415b440 0x7f2a140cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a12d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a1415b440 0x7f2a140cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60436/0 (socket says 172.21.15.37:60436) 2023-11-24T06:17:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a12d9d640 1 -- 172.21.15.37:0/2424768407 learned_addr learned my addr 172.21.15.37:0/2424768407 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a1359e640 1 --2- 172.21.15.37:0/2424768407 >> v2:172.21.15.188:3300/0 conn(0x7f2a140c59b0 0x7f2a1406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a12d9d640 1 -- 172.21.15.37:0/2424768407 >> v2:172.21.15.188:3300/0 conn(0x7f2a140c59b0 msgr2=0x7f2a1406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/2424768407 >> v2:172.21.15.188:3300/0 conn(0x7f2a140c59b0 0x7f2a1406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a12d9d640 1 -- 172.21.15.37:0/2424768407 >> v1:172.21.15.188:6789/0 conn(0x7f2a140cbf20 legacy=0x7f2a140c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a12d9d640 1 -- 172.21.15.37:0/2424768407 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1415eea0 con 0x7f2a1415b440 2023-11-24T06:17:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.442+0000 7f2a1359e640 1 --2- 172.21.15.37:0/2424768407 >> v2:172.21.15.188:3300/0 conn(0x7f2a140c59b0 0x7f2a1406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.443+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/2424768407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415b440 0x7f2a140cb9e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2a140cb910 tx=0x7f2a0402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39222e1d017ae949 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.444+0000 7f2a11d9b640 1 -- 172.21.15.37:0/2424768407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0402c9f0 con 0x7f2a1415b440 2023-11-24T06:17:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.444+0000 7f2a11d9b640 1 -- 172.21.15.37:0/2424768407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0402cb50 con 0x7f2a1415b440 2023-11-24T06:17:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.444+0000 7f2a11d9b640 1 -- 172.21.15.37:0/2424768407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040343f0 con 0x7f2a1415b440 2023-11-24T06:17:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.444+0000 7f2a190cf640 1 -- 172.21.15.37:0/2424768407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415b440 msgr2=0x7f2a140cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.444+0000 7f2a190cf640 1 --2- 172.21.15.37:0/2424768407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415b440 0x7f2a140cb9e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2a140cb910 tx=0x7f2a0402be50 comp rx=0 tx=0).stop 2023-11-24T06:17:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.444+0000 7f2a190cf640 1 -- 172.21.15.37:0/2424768407 shutdown_connections 2023-11-24T06:17:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.445+0000 7f2a190cf640 1 --2- 172.21.15.37:0/2424768407 >> v2:172.21.15.188:3300/0 conn(0x7f2a140c59b0 0x7f2a1406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.445+0000 7f2a190cf640 1 --2- 172.21.15.37:0/2424768407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1415b440 0x7f2a140cb9e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.445+0000 7f2a190cf640 1 -- 172.21.15.37:0/2424768407 >> 172.21.15.37:0/2424768407 conn(0x7f2a140b0c50 msgr2=0x7f2a140b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.445+0000 7f2a190cf640 1 -- 172.21.15.37:0/2424768407 shutdown_connections 2023-11-24T06:17:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.445+0000 7f2a190cf640 1 -- 172.21.15.37:0/2424768407 wait complete. 2023-11-24T06:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.446+0000 7f2a190cf640 1 Processor -- start 2023-11-24T06:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.447+0000 7f2a190cf640 1 -- start start 2023-11-24T06:17:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.447+0000 7f2a190cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140c59b0 0x7f2a140b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.447+0000 7f2a190cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a140cbf20 0x7f2a1415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.447+0000 7f2a190cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a1415b440 0x7f2a1414c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a190cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b3730 con 0x7f2a140c59b0 2023-11-24T06:17:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a190cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b42b0 con 0x7f2a140cbf20 2023-11-24T06:17:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a190cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b4c80 con 0x7f2a1415b440 2023-11-24T06:17:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140c59b0 0x7f2a140b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140c59b0 0x7f2a140b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60446/0 (socket says 172.21.15.37:60446) 2023-11-24T06:17:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 -- 172.21.15.37:0/1505937418 learned_addr learned my addr 172.21.15.37:0/1505937418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a1259c640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a140cbf20 0x7f2a1415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a1359e640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a1415b440 0x7f2a1414c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 -- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a1415b440 msgr2=0x7f2a1414c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a1415b440 0x7f2a1414c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 -- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a140cbf20 msgr2=0x7f2a1415cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a140cbf20 0x7f2a1415cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a12d9d640 1 -- 172.21.15.37:0/1505937418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04009b30 con 0x7f2a140c59b0 2023-11-24T06:17:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.448+0000 7f2a1259c640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a140cbf20 0x7f2a1415cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.449+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140c59b0 0x7f2a140b4740 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2a04036040 tx=0x7f2a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.449+0000 7f2a0b7fe640 1 -- 172.21.15.37:0/1505937418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0403e450 con 0x7f2a140c59b0 2023-11-24T06:17:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.449+0000 7f2a0b7fe640 1 -- 172.21.15.37:0/1505937418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0403e5f0 con 0x7f2a140c59b0 2023-11-24T06:17:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.449+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a140b3980 con 0x7f2a140c59b0 2023-11-24T06:17:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.449+0000 7f2a0b7fe640 1 -- 172.21.15.37:0/1505937418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0403e9a0 con 0x7f2a140c59b0 2023-11-24T06:17:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.449+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a140b3f40 con 0x7f2a140c59b0 2023-11-24T06:17:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.451+0000 7f2a0b7fe640 1 -- 172.21.15.37:0/1505937418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f2a0403eb00 con 0x7f2a140c59b0 2023-11-24T06:17:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.452+0000 7f2a0b7fe640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406aed0 0x7f29f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.452+0000 7f2a0b7fe640 1 -- 172.21.15.37:0/1505937418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a040ac5e0 con 0x7f2a140c59b0 2023-11-24T06:17:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.453+0000 7f2a1259c640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406aed0 0x7f29f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.453+0000 7f2a1bc68740 1 Processor -- start 2023-11-24T06:17:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.453+0000 7f2a1bc68740 1 -- start start 2023-11-24T06:17:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.453+0000 7f2a1259c640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406aed0 0x7f29f406d390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2a140ade50 tx=0x7f29fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.454+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746032b0 0x564474603690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.454+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644745fdfb0 0x5644746024b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.454+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x564474646970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.454+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56447455d880 con 0x5644745fdfb0 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.454+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x56447456cae0 con 0x5644746032b0 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.454+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x56447456a1d0 con 0x5644746029f0 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644745fdfb0 0x5644746024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644745fdfb0 0x5644746024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60450/0 (socket says 172.21.15.37:60450) 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 -- 172.21.15.37:0/2433872763 learned_addr learned my addr 172.21.15.37:0/2433872763 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746032b0 0x564474603690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 -- 172.21.15.37:0/2433872763 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 msgr2=0x564474646970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x564474646970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 -- 172.21.15.37:0/2433872763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746032b0 msgr2=0x564474603690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746032b0 0x564474603690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 -- 172.21.15.37:0/2433872763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56447452d860 con 0x5644745fdfb0 2023-11-24T06:17:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.455+0000 7f2a1259c640 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644745fdfb0 0x5644746024b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00da90 tx=0x7f29fc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29d72cf1346d76c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a08ff9640 1 -- 172.21.15.37:0/2433872763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0149a0 con 0x5644745fdfb0 2023-11-24T06:17:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a08ff9640 1 -- 172.21.15.37:0/2433872763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc014b00 con 0x5644745fdfb0 2023-11-24T06:17:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a08ff9640 1 -- 172.21.15.37:0/2433872763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc01f400 con 0x5644745fdfb0 2023-11-24T06:17:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a1bc68740 1 -- 172.21.15.37:0/2433872763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644745fdfb0 msgr2=0x5644746024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644745fdfb0 0x5644746024b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00da90 tx=0x7f29fc010000 comp rx=0 tx=0).stop 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a1bc68740 1 -- 172.21.15.37:0/2433872763 shutdown_connections 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x564474646970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644745fdfb0 0x5644746024b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/2433872763 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746032b0 0x564474603690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.456+0000 7f2a1bc68740 1 -- 172.21.15.37:0/2433872763 >> 172.21.15.37:0/2433872763 conn(0x5644745c0c70 msgr2=0x564474648da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.457+0000 7f2a1bc68740 1 -- 172.21.15.37:0/2433872763 shutdown_connections 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.457+0000 7f2a1bc68740 1 -- 172.21.15.37:0/2433872763 wait complete. 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.457+0000 7f2a1bc68740 1 -- start start 2023-11-24T06:17:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.458+0000 7f2a1bc68740 1 Processor -- start 2023-11-24T06:17:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x564474642c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x564474624800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564474565ac0 con 0x5644746032b0 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644745022f0 con 0x5644745fdfb0 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x56447451fc70 con 0x5644746029f0 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1bc68740 10 client.0 _ll_register_callbacks cb 0x5644745243b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60458/0 (socket says 172.21.15.37:60458) 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1359e640 1 -- 172.21.15.37:0/1529604337 learned_addr learned my addr 172.21.15.37:0/1529604337 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x564474642c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.459+0000 7f2a1259c640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x564474624800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a1359e640 1 -- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 msgr2=0x564474624800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a1359e640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x564474624800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a1359e640 1 -- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 msgr2=0x564474642c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a1359e640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x564474642c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a1359e640 1 -- 172.21.15.37:0/1529604337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc00d7a0 con 0x5644746032b0 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x564474642c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a1359e640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464e550 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00bfa0 tx=0x7f2a0c00d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6694179b6ee516ea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f29f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f29f1ffb640 1 -- 172.21.15.37:0/1529604337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c012870 con 0x5644746032b0 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f29f1ffb640 1 -- 172.21.15.37:0/1529604337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a0c00de50 con 0x5644746032b0 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.460+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56447455eaa0 con 0x5644746032b0 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f29f1ffb640 1 -- 172.21.15.37:0/1529604337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a0c0129d0 con 0x5644746032b0 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 10 client.6150 fetch_fsmap learned FSMap version 40 2023-11-24T06:17:39.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x564474564140 con 0x5644746032b0 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f29f1ffb640 1 -- 172.21.15.37:0/1529604337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56447455eaa0 con 0x5644746032b0 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f29f1ffb640 1 -- 172.21.15.37:0/1529604337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a0c012b30 con 0x5644746032b0 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 10 client.6150 fetch_fsmap finished waiting for FSMap version 40 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 10 client.6150 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 20 client.6150 populate_metadata read hostname 'smithi037' 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644746459d0 0x564474640780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 4 client.6150 mds_command: new command op to 6015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 --> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56447455e7c0 con 0x5644746459d0 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.461+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644746459d0 0x564474640780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.462+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644746459d0 0x564474640780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b5d6bc6d728ac4e server_cookie=841e41bc2c648768 in_seq=0 out_seq=0 2023-11-24T06:17:39.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.462+0000 7f29f1ffb640 10 client.6150 ms_handle_connect on v2:172.21.15.37:6834/2581426871 2023-11-24T06:17:39.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f29f1ffb640 1 -- 172.21.15.37:0/1529604337 <== mds.0 v2:172.21.15.37:6834/2581426871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56447455e7c0 con 0x5644746459d0 2023-11-24T06:17:39.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f29f1ffb640 10 client.6150 handle_command_reply: tid=0 2023-11-24T06:17:39.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 client.6150 shutdown 2023-11-24T06:17:39.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 msgr2=0x56447464e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464e550 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00bfa0 tx=0x7f2a0c00d650 comp rx=0 tx=0).stop 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 shutdown_connections 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644746459d0 0x564474640780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464e550 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x564474624800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/1529604337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x564474642c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f29f1ffb640 0 client.6150 ms_handle_reset on v2:172.21.15.37:6834/2581426871 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 >> 172.21.15.37:0/1529604337 conn(0x5644745c0c70 msgr2=0x5644745f8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.463+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 shutdown_connections 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.464+0000 7f2a1bc68740 1 -- 172.21.15.37:0/1529604337 wait complete. 2023-11-24T06:17:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.464+0000 7f2a1bc68740 20 client.6150 trim_cache size 0 max 16384 2023-11-24T06:17:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.481+0000 7f2a1bc68740 1 Processor -- start 2023-11-24T06:17:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.481+0000 7f2a1bc68740 1 -- start start 2023-11-24T06:17:39.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644745fdfb0 0x564474647270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746029f0 0x5644746237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x564474623cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644742c8f20 con 0x5644746032b0 2023-11-24T06:17:39.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564474628cb0 con 0x5644746029f0 2023-11-24T06:17:39.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644746477b0 con 0x5644745fdfb0 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x564474623cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x564474623cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60462/0 (socket says 172.21.15.37:60462) 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.482+0000 7f2a1359e640 1 -- 172.21.15.37:0/770648108 learned_addr learned my addr 172.21.15.37:0/770648108 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a1259c640 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746029f0 0x5644746237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644745fdfb0 0x564474647270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a1359e640 1 -- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644745fdfb0 msgr2=0x564474647270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a1359e640 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644745fdfb0 0x564474647270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a1359e640 1 -- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746029f0 msgr2=0x5644746237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a1359e640 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746029f0 0x5644746237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a1359e640 1 -- 172.21.15.37:0/770648108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564474501b80 con 0x5644746032b0 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a1359e640 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x564474623cf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c004700 tx=0x7f2a0c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf8e2d9120a61e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.483+0000 7f2a097fa640 1 -- 172.21.15.37:0/770648108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c012870 con 0x5644746032b0 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a097fa640 1 -- 172.21.15.37:0/770648108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00c040 con 0x5644746032b0 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a097fa640 1 -- 172.21.15.37:0/770648108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c012c30 con 0x5644746032b0 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 -- 172.21.15.37:0/770648108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 msgr2=0x564474623cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x564474623cf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c004700 tx=0x7f2a0c012000 comp rx=0 tx=0).stop 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 -- 172.21.15.37:0/770648108 shutdown_connections 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644746029f0 0x5644746237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x564474623cf0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/770648108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644745fdfb0 0x564474647270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 -- 172.21.15.37:0/770648108 >> 172.21.15.37:0/770648108 conn(0x5644745c0c70 msgr2=0x564474603690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:39.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 -- 172.21.15.37:0/770648108 shutdown_connections 2023-11-24T06:17:39.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.484+0000 7f2a1bc68740 1 -- 172.21.15.37:0/770648108 wait complete. 2023-11-24T06:17:39.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.485+0000 7f2a1bc68740 1 -- start start 2023-11-24T06:17:39.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.485+0000 7f2a1bc68740 1 Processor -- start 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.486+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x5644745f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.486+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x5644746b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.486+0000 7f2a1bc68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.486+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644745f9480 con 0x5644746032b0 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.486+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x564474631df0 con 0x5644745fdfb0 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.486+0000 7f2a1bc68740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x564474632030 con 0x5644746029f0 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1bc68740 10 client.0 _ll_register_callbacks cb 0x7f2a0c006ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60476/0 (socket says 172.21.15.37:60476) 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 -- 172.21.15.37:0/260841046 learned_addr learned my addr 172.21.15.37:0/260841046 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x5644745f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1259c640 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x5644746b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 -- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 msgr2=0x5644746b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x5644746b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 -- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 msgr2=0x5644745f8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x5644745f8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.487+0000 7f2a1359e640 1 -- 172.21.15.37:0/260841046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564474564140 con 0x5644746032b0 2023-11-24T06:17:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f2a1359e640 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464d660 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00d690 tx=0x7f2a0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7124e16013ff020d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f29f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f29f1ffb640 1 -- 172.21.15.37:0/260841046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c01ba90 con 0x5644746032b0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f29f1ffb640 1 -- 172.21.15.37:0/260841046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a0c000e40 con 0x5644746032b0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29fc014b00 con 0x5644746032b0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f29f1ffb640 1 -- 172.21.15.37:0/260841046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a0c00de50 con 0x5644746032b0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f2a1bc68740 10 client.6156 fetch_fsmap learned FSMap version 40 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.488+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x564474527170 con 0x5644746032b0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f29f1ffb640 1 -- 172.21.15.37:0/260841046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc014b00 con 0x5644746032b0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f29f1ffb640 1 -- 172.21.15.37:0/260841046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a0c01bbf0 con 0x5644746032b0 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f2a1bc68740 10 client.6156 fetch_fsmap finished waiting for FSMap version 40 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f2a1bc68740 10 client.6156 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f2a1bc68740 20 client.6156 populate_metadata read hostname 'smithi037' 2023-11-24T06:17:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644745fe390 0x5644745fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f2a1bc68740 4 client.6156 mds_command: new command op to 6015 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 --> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5644742666c0 con 0x5644745fe390 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.489+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644745fe390 0x5644745fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a12d9d640 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644745fe390 0x5644745fe770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3570777dffd55d6 server_cookie=4df45a4592d4ff26 in_seq=0 out_seq=0 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f29f1ffb640 10 client.6156 ms_handle_connect on v2:172.21.15.37:6834/2581426871 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f29f1ffb640 1 -- 172.21.15.37:0/260841046 <== mds.0 v2:172.21.15.37:6834/2581426871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5644742666c0 con 0x5644745fe390 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f29f1ffb640 10 client.6156 handle_command_reply: tid=0 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 client.6156 shutdown 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 msgr2=0x56447464d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464d660 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00d690 tx=0x7f2a0c008040 comp rx=0 tx=0).stop 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 shutdown_connections 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:6834/2581426871,v1:172.21.15.37:6836/2581426871] conn(0x5644745fe390 0x5644745fe770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644746032b0 0x56447464d660 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644746029f0 0x5644746b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f29f1ffb640 0 client.6156 ms_handle_reset on v2:172.21.15.37:6834/2581426871 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 --2- 172.21.15.37:0/260841046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5644745fdfb0 0x5644745f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 >> 172.21.15.37:0/260841046 conn(0x5644745c0c70 msgr2=0x5644746316e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 shutdown_connections 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.490+0000 7f2a1bc68740 1 -- 172.21.15.37:0/260841046 wait complete. 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a1bc68740 20 client.6156 trim_cache size 0 max 16384 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3", 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-11-24T06:17:39.496 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6015, 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 6.775393395, 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 40, 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 65, 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 65, 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 13.545927066000001 2023-11-24T06:17:39.497 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:17:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406aed0 msgr2=0x7f29f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406aed0 0x7f29f406d390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2a140ade50 tx=0x7f29fc009040 comp rx=0 tx=0).stop 2023-11-24T06:17:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140c59b0 msgr2=0x7f2a140b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140c59b0 0x7f2a140b4740 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2a04036040 tx=0x7f2a04004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 shutdown_connections 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f29f406aed0 0x7f29f406d390 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a140cbf20 0x7f2a1415cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a1415b440 0x7f2a1414c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 --2- 172.21.15.37:0/1505937418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a140c59b0 0x7f2a140b4740 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 >> 172.21.15.37:0/1505937418 conn(0x7f2a140b0c50 msgr2=0x7f2a140cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 shutdown_connections 2023-11-24T06:17:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.491+0000 7f2a190cf640 1 -- 172.21.15.37:0/1505937418 wait complete. 2023-11-24T06:17:39.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:17:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.737+0000 7fa68bf01640 1 Processor -- start 2023-11-24T06:17:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.737+0000 7fa68bf01640 1 -- start start 2023-11-24T06:17:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa68bf01640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 0x7fa6840abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa68bf01640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa6840ce640 0x7fa6840b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa68bf01640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6840ce270 con 0x7fa6840cc470 2023-11-24T06:17:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa68bf01640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68406c560 con 0x7fa6840ce640 2023-11-24T06:17:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa68bf01640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68406d0a0 con 0x7fa6840cfb60 2023-11-24T06:17:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa689c9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa6840cc470 0x7fa6840cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55876/0 (socket says 172.21.15.37:55876) 2023-11-24T06:17:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa689c9d640 1 -- 172.21.15.37:0/537305975 learned_addr learned my addr 172.21.15.37:0/537305975 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa68949c640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 0x7fa6840abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa68a49e640 1 --2- 172.21.15.37:0/537305975 >> v2:172.21.15.188:3300/0 conn(0x7fa6840ce640 0x7fa6840b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.739+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279297278 0 0) 0x7fa6840ce270 con 0x7fa6840cc470 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa670003520 con 0x7fa6840cc470 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2445942517 0 0) 0x7fa670003520 con 0x7fa6840cc470 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 msgr2=0x7fa6840abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 0x7fa6840abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 >> v2:172.21.15.188:3300/0 conn(0x7fa6840ce640 msgr2=0x7fa6840b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 --2- 172.21.15.37:0/537305975 >> v2:172.21.15.188:3300/0 conn(0x7fa6840ce640 0x7fa6840b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840b4200 con 0x7fa6840cc470 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fa680001670 con 0x7fa6840cc470 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 >> v1:172.21.15.37:6789/0 conn(0x7fa6840cc470 legacy=0x7fa6840cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670003970 0x7fa670003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 0x7fa6700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa670004d00 0x7fa670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68406c560 con 0x7fa670004d00 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68406d0a0 con 0x7fa670003970 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.740+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67000b980 con 0x7fa6840cfb60 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa68a49e640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa670004d00 0x7fa670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa689c9d640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670003970 0x7fa670003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa68949c640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 0x7fa6700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa68a49e640 1 -- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 msgr2=0x7fa6700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa68a49e640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6840cfb60 0x7fa6700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa68a49e640 1 -- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670003970 msgr2=0x7fa670003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa68a49e640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670003970 0x7fa670003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.741+0000 7fa68a49e640 1 -- 172.21.15.37:0/537305975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670003520 con 0x7fa670004d00 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.742+0000 7fa68a49e640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa670004d00 0x7fa670005180 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009fc0 tx=0x7fa6700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1eaf536a96888f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.742+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c02cc60 con 0x7fa670004d00 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.742+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c00f040 con 0x7fa670004d00 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa688c9b640 1 -- 172.21.15.37:0/537305975 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c034440 con 0x7fa670004d00 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa68bf01640 1 -- 172.21.15.37:0/537305975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa670004d00 msgr2=0x7fa670005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa68bf01640 1 --2- 172.21.15.37:0/537305975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa670004d00 0x7fa670005180 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009fc0 tx=0x7fa6700057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa68a49e640 1 -- 172.21.15.37:0/537305975 reap_dead start 2023-11-24T06:17:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa68bf01640 1 -- 172.21.15.37:0/537305975 shutdown_connections 2023-11-24T06:17:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa68bf01640 1 -- 172.21.15.37:0/537305975 >> 172.21.15.37:0/537305975 conn(0x7fa68406a920 msgr2=0x7fa68406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa68bf01640 1 -- 172.21.15.37:0/537305975 shutdown_connections 2023-11-24T06:17:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.743+0000 7fa68bf01640 1 -- 172.21.15.37:0/537305975 wait complete. 2023-11-24T06:17:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.745+0000 7fa68bf01640 1 Processor -- start 2023-11-24T06:17:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.745+0000 7fa68bf01640 1 -- start start 2023-11-24T06:17:39.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.746+0000 7fa68bf01640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670004d00 0x7fa6841f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.746+0000 7fa68bf01640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa684154270 0x7fa6840b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.746+0000 7fa68bf01640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6841f75f0 0x7fa6840b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.746+0000 7fa68bf01640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68409a2b0 con 0x7fa684154270 2023-11-24T06:17:39.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.746+0000 7fa68bf01640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684154080 con 0x7fa670004d00 2023-11-24T06:17:39.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.746+0000 7fa68bf01640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68409cdc0 con 0x7fa6841f75f0 2023-11-24T06:17:39.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa684154270 0x7fa6840b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa684154270 0x7fa6840b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60484/0 (socket says 172.21.15.37:60484) 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 -- 172.21.15.37:0/1672281943 learned_addr learned my addr 172.21.15.37:0/1672281943 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa689c9d640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670004d00 0x7fa6841f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68a49e640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6841f75f0 0x7fa6840b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 -- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6841f75f0 msgr2=0x7fa6840b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6841f75f0 0x7fa6840b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 -- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670004d00 msgr2=0x7fa6841f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670004d00 0x7fa6841f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68949c640 1 -- 172.21.15.37:0/1672281943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684099bf0 con 0x7fa684154270 2023-11-24T06:17:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.747+0000 7fa68a49e640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6841f75f0 0x7fa6840b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.748+0000 7fa68949c640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa684154270 0x7fa6840b31b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa674011600 tx=0x7fa674011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.748+0000 7fa67a7fc640 1 -- 172.21.15.37:0/1672281943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400f920 con 0x7fa684154270 2023-11-24T06:17:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.748+0000 7fa67a7fc640 1 -- 172.21.15.37:0/1672281943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400fa80 con 0x7fa684154270 2023-11-24T06:17:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.748+0000 7fa67a7fc640 1 -- 172.21.15.37:0/1672281943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400fdf0 con 0x7fa684154270 2023-11-24T06:17:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.748+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa684099ed0 con 0x7fa684154270 2023-11-24T06:17:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.748+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68409c970 con 0x7fa684154270 2023-11-24T06:17:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.749+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa684067470 con 0x7fa684154270 2023-11-24T06:17:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.751+0000 7fa67a7fc640 1 -- 172.21.15.37:0/1672281943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fa674015460 con 0x7fa684154270 2023-11-24T06:17:39.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.751+0000 7fa67a7fc640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa66806af50 0x7fa66806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:39.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.752+0000 7fa67a7fc640 1 -- 172.21.15.37:0/1672281943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa674089ec0 con 0x7fa684154270 2023-11-24T06:17:39.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.752+0000 7fa689c9d640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa66806af50 0x7fa66806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.753+0000 7fa689c9d640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa66806af50 0x7fa66806d410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa680000fb0 tx=0x7fa680009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.757+0000 7fa67a7fc640 1 -- 172.21.15.37:0/1672281943 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa674054f90 con 0x7fa684154270 2023-11-24T06:17:39.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:39.913 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:17:39.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.996+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6841646a0 con 0x7fa684154270 2023-11-24T06:17:40.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.997+0000 7fa67a7fc640 1 -- 172.21.15.37:0/1672281943 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa6740585b0 con 0x7fa684154270 2023-11-24T06:17:40.000 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:17:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.999+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa66806af50 msgr2=0x7fa66806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.999+0000 7fa68bf01640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa66806af50 0x7fa66806d410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa680000fb0 tx=0x7fa680009040 comp rx=0 tx=0).stop 2023-11-24T06:17:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.999+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa684154270 msgr2=0x7fa6840b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:39.999+0000 7fa68bf01640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa684154270 0x7fa6840b31b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa674011600 tx=0x7fa674011ac0 comp rx=0 tx=0).stop 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 shutdown_connections 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa66806af50 0x7fa66806d410 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6841f75f0 0x7fa6840b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa684154270 0x7fa6840b31b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 --2- 172.21.15.37:0/1672281943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa670004d00 0x7fa6841f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 >> 172.21.15.37:0/1672281943 conn(0x7fa68406a920 msgr2=0x7fa6840ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 shutdown_connections 2023-11-24T06:17:40.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:40.000+0000 7fa68bf01640 1 -- 172.21.15.37:0/1672281943 wait complete. 2023-11-24T06:17:40.021 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:17:40.021 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:17:40.021 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-11-24T06:17:40.021 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:17:40.021 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:40.022 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:17:40.022 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:17:40.022 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:17:40.022 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:17:40.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.023 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-11-24T06:17:40.080 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:17:40.080 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:17:40.081 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:17:40.081 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:40.081 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-11-24T06:17:40.081 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:40.081 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:40.082 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:40.082 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-11-24T06:17:40.082 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:40.082 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:40.082 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-11-24T06:17:40.082 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:17:40.083 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:40.083 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-11-24T06:17:40.083 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-24T06:17:40.083 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42199sec preferred_lft 42199sec 2023-11-24T06:17:40.083 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-11-24T06:17:40.083 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:40.083 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:40.084 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:40.084 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-11-24T06:17:40.084 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:17:40.084 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:40.084 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:17:40.084 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::40b6:eeff:fe98:3c34/64 scope link 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether a6:62:2e:c6:62:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a462:2eff:fec6:6249/64 scope link 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether d2:91:7f:1d:c0:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d091:7fff:fe1d:c078/64 scope link 2023-11-24T06:17:40.085 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:40.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.086 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:17:40.224 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-11-24T06:17:40.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.229 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-11-24T06:17:40.289 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-11-24T06:17:40.290 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:17:40.290 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-24T06:17:40.290 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-24T06:17:40.290 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:17:40.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.290 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-11-24T06:17:40.290 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-11-24T06:17:40.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T06:17:40.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T06:17:40.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T06:17:40.291 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-11-24T06:17:40.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.486 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:17:40.541 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:17:40.541 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:17:40.542 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:17:40.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-11-24T06:17:40.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:40.641 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:40.700 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:17:40.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:40.700 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:40.756 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T06:17:40.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-11-24T06:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:17:40.930 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:17:40.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:40.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:41.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:41.015 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout:client5386 2023-11-24T06:17:41.080 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:41.080 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:41.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:17:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.357+0000 7f01e6021640 1 Processor -- start 2023-11-24T06:17:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.357+0000 7f01e6021640 1 -- start start 2023-11-24T06:17:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.359+0000 7f01e6021640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f01e013d120 0x7f01e015af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.359+0000 7f01e6021640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e00cec00 con 0x7f01e006d6c0 2023-11-24T06:17:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.359+0000 7f01e6021640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e00b1890 con 0x7f01e006db20 2023-11-24T06:17:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.359+0000 7f01e6021640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e013f9e0 con 0x7f01e013d120 2023-11-24T06:17:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.359+0000 7f01e481e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f01e006d6c0 0x7f01e00b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57954/0 (socket says 172.21.15.37:57954) 2023-11-24T06:17:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.359+0000 7f01e481e640 1 -- 172.21.15.37:0/808604126 learned_addr learned my addr 172.21.15.37:0/808604126 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01e501f640 1 --2- 172.21.15.37:0/808604126 >> v2:172.21.15.188:3300/0 conn(0x7f01e013d120 0x7f01e015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852539028 0 0) 0x7f01e00cec00 con 0x7f01e006d6c0 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01cc003520 con 0x7f01e006d6c0 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1339941839 0 0) 0x7f01cc003520 con 0x7f01e006d6c0 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 >> v2:172.21.15.188:3300/0 conn(0x7f01e013d120 msgr2=0x7f01e015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 --2- 172.21.15.37:0/808604126 >> v2:172.21.15.188:3300/0 conn(0x7f01e013d120 0x7f01e015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 >> v1:172.21.15.188:6789/0 conn(0x7f01e006db20 legacy=0x7f01e00b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e013fcc0 con 0x7f01e006d6c0 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f01d0001670 con 0x7f01e006d6c0 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 >> v1:172.21.15.37:6789/0 conn(0x7f01e006d6c0 legacy=0x7f01e00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc003970 0x7f01cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01cc0047c0 0x7f01cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01cc005180 0x7f01cc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e013f9e0 con 0x7f01cc0047c0 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc00e330 con 0x7f01cc005180 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.360+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc00e4f0 con 0x7f01cc003970 2023-11-24T06:17:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e481e640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01cc0047c0 0x7f01cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e481e640 1 -- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc003970 msgr2=0x7f01cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e481e640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc003970 0x7f01cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e481e640 1 -- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01cc005180 msgr2=0x7f01cc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e5820640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01cc005180 0x7f01cc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e481e640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01cc005180 0x7f01cc00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e481e640 1 -- 172.21.15.37:0/808604126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc003520 con 0x7f01cc0047c0 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e5820640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01cc005180 0x7f01cc00db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:41.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.361+0000 7f01e5820640 1 -- 172.21.15.37:0/808604126 reap_dead start 2023-11-24T06:17:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.362+0000 7f01e481e640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01cc0047c0 0x7f01cc004c40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c240 tx=0x7f01cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427f8b77fd3e037f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0005ad0 con 0x7f01cc0047c0 2023-11-24T06:17:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d0005c30 con 0x7f01cc0047c0 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01d7fff640 1 -- 172.21.15.37:0/808604126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d002caf0 con 0x7f01cc0047c0 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01e6021640 1 -- 172.21.15.37:0/808604126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01cc0047c0 msgr2=0x7f01cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01e6021640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01cc0047c0 0x7f01cc004c40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c240 tx=0x7f01cc0057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01e6021640 1 -- 172.21.15.37:0/808604126 shutdown_connections 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01e6021640 1 --2- 172.21.15.37:0/808604126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01cc0047c0 0x7f01cc004c40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01e6021640 1 -- 172.21.15.37:0/808604126 >> 172.21.15.37:0/808604126 conn(0x7f01e00cb830 msgr2=0x7f01e00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01e6021640 1 -- 172.21.15.37:0/808604126 shutdown_connections 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.363+0000 7f01e6021640 1 -- 172.21.15.37:0/808604126 wait complete. 2023-11-24T06:17:41.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.365+0000 7f01e6021640 1 Processor -- start 2023-11-24T06:17:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.365+0000 7f01e6021640 1 -- start start 2023-11-24T06:17:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.366+0000 7f01e6021640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc0047c0 0x7f01e01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.366+0000 7f01e6021640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e015bf00 0x7f01e015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.366+0000 7f01e6021640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01e01f4750 0x7f01e01f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.366+0000 7f01e6021640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e015c8a0 con 0x7f01e015bf00 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.366+0000 7f01e6021640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e01f7820 con 0x7f01e01f4750 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.366+0000 7f01e6021640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e0153120 con 0x7f01cc0047c0 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e015bf00 0x7f01e015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e015bf00 0x7f01e015c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42686/0 (socket says 172.21.15.37:42686) 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 -- 172.21.15.37:0/1333225102 learned_addr learned my addr 172.21.15.37:0/1333225102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e501f640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc0047c0 0x7f01e01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 -- 172.21.15.37:0/1333225102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc0047c0 msgr2=0x7f01e01516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc0047c0 0x7f01e01516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 -- 172.21.15.37:0/1333225102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01e01f4750 msgr2=0x7f01e01f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01e01f4750 0x7f01e01f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 -- 172.21.15.37:0/1333225102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e01f6930 con 0x7f01e015bf00 2023-11-24T06:17:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.367+0000 7f01e481e640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e015bf00 0x7f01e015c360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c360 tx=0x7f01d002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.368+0000 7f01d5ffb640 1 -- 172.21.15.37:0/1333225102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d003c040 con 0x7f01e015bf00 2023-11-24T06:17:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.368+0000 7f01d5ffb640 1 -- 172.21.15.37:0/1333225102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d002ccc0 con 0x7f01e015bf00 2023-11-24T06:17:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.368+0000 7f01d5ffb640 1 -- 172.21.15.37:0/1333225102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0007270 con 0x7f01e015bf00 2023-11-24T06:17:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.368+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e01f6c10 con 0x7f01e015bf00 2023-11-24T06:17:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.368+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e01f71d0 con 0x7f01e015bf00 2023-11-24T06:17:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.369+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e01f4470 con 0x7f01e015bf00 2023-11-24T06:17:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.370+0000 7f01d5ffb640 1 -- 172.21.15.37:0/1333225102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f01d0032070 con 0x7f01e015bf00 2023-11-24T06:17:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.371+0000 7f01d5ffb640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f01c406af00 0x7f01c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.372+0000 7f01d5ffb640 1 -- 172.21.15.37:0/1333225102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01d00aaa10 con 0x7f01e015bf00 2023-11-24T06:17:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.372+0000 7f01e501f640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f01c406af00 0x7f01c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.372+0000 7f01e501f640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f01c406af00 0x7f01c406d3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0099f0 tx=0x7f01dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.376+0000 7f01d5ffb640 1 -- 172.21.15.37:0/1333225102 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01e01f4470 con 0x7f01e015bf00 2023-11-24T06:17:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.610+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f01e01f4450 con 0x7f01e015bf00 2023-11-24T06:17:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.610+0000 7f01d5ffb640 1 -- 172.21.15.37:0/1333225102 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f01d0075ad0 con 0x7f01e015bf00 2023-11-24T06:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:17:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f01c406af00 msgr2=0x7f01c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f01c406af00 0x7f01c406d3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0099f0 tx=0x7f01dc008040 comp rx=0 tx=0).stop 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e015bf00 msgr2=0x7f01e015c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e015bf00 0x7f01e015c360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c360 tx=0x7f01d002e070 comp rx=0 tx=0).stop 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 shutdown_connections 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f01c406af00 0x7f01c406d3c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01e01f4750 0x7f01e01f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e015bf00 0x7f01e015c360 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 --2- 172.21.15.37:0/1333225102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01cc0047c0 0x7f01e01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 >> 172.21.15.37:0/1333225102 conn(0x7f01e00cb830 msgr2=0x7f01e0071660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 shutdown_connections 2023-11-24T06:17:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:41.613+0000 7f01e6021640 1 -- 172.21.15.37:0/1333225102 wait complete. 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:17:41.636 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:17:41.637 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:17:41.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:41.637 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-11-24T06:17:41.698 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:17:41.698 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:17:41.698 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:17:41.698 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:41.699 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2023-11-24T06:17:41.700 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:17:41.700 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:41.700 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:17:41.700 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:41.700 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:17:41.700 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42205sec preferred_lft 42205sec 2023-11-24T06:17:41.700 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9460:4eff:fe42:69c0/64 scope link 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 8a:b7:c8:f4:7a:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::88b7:c8ff:fef4:7a4d/64 scope link 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:41.701 INFO:teuthology.orchestra.run.smithi188.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:17:41.702 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 92:37:27:cd:69:4e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:17:41.702 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9037:27ff:fecd:694e/64 scope link 2023-11-24T06:17:41.702 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:17:41.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:41.703 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:17:41.797 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-11-24T06:17:41.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:41.801 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-11-24T06:17:41.854 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-11-24T06:17:41.855 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:17:41.855 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:17:41.855 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:17:41.855 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:17:41.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:41.856 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-11-24T06:17:41.856 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-11-24T06:17:41.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:17:41.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:17:41.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:17:41.857 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-11-24T06:17:42.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:42.040 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:17:42.092 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:17:42.092 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:17:42.092 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:17:42.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:42.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2023-11-24T06:17:42.187 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:42.187 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:42.242 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:17:42.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:17:42.243 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:42.294 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T06:17:42.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:42.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:42.433 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:42.433 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:42.473 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T06:17:42.474 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T06:17:42.474 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.188:3300,172.21.15.188:3301" 2023-11-24T06:17:42.474 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with new device syntax: 1@f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3.cephfs=/ 2023-11-24T06:17:42.475 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.188:3300/172.21.15.188:3301" will pass to kernel 2023-11-24T06:17:42.476 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-11-24T06:17:42.477 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2023-11-24T06:17:42.477 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-11-24T06:17:42.477 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2023-11-24T06:17:42.477 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-11-24T06:17:42.480 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:17:42.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:42.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:42.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:42.559 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:17:42.615 INFO:teuthology.orchestra.run.smithi188.stdout:client6171 2023-11-24T06:17:42.615 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:42.615 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:42.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:17:42.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.915+0000 7f34098e6640 1 Processor -- start 2023-11-24T06:17:42.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.915+0000 7f34098e6640 1 -- start start 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.916+0000 7f34098e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34041431f0 0x7f340415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f34098e6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34040b2ad0 0x7f340406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f34098e6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340415ec20 con 0x7f34040b2f30 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f34098e6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34040b4fd0 con 0x7f34040b2ad0 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f34098e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3404143c10 con 0x7f34041431f0 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f3403fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34040b2ad0 0x7f340406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f3403fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34040b2ad0 0x7f340406d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42700/0 (socket says 172.21.15.37:42700) 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f3403fff640 1 -- 172.21.15.37:0/3934084765 learned_addr learned my addr 172.21.15.37:0/3934084765 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f3403fff640 1 -- 172.21.15.37:0/3934084765 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34041431f0 msgr2=0x7f340415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f3403fff640 1 --2- 172.21.15.37:0/3934084765 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34041431f0 0x7f340415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f3403fff640 1 -- 172.21.15.37:0/3934084765 >> v1:172.21.15.37:6789/0 conn(0x7f34040b2f30 legacy=0x7f3404071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.917+0000 7f3403fff640 1 -- 172.21.15.37:0/3934084765 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040705b0 con 0x7f34040b2ad0 2023-11-24T06:17:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.919+0000 7f3403fff640 1 --2- 172.21.15.37:0/3934084765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34040b2ad0 0x7f340406d6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f34040b5110 tx=0x7f33f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df190c344ea50a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.919+0000 7f34037fe640 1 -- 172.21.15.37:0/3934084765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0004230 con 0x7f34040b2ad0 2023-11-24T06:17:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.919+0000 7f34037fe640 1 -- 172.21.15.37:0/3934084765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0004390 con 0x7f34040b2ad0 2023-11-24T06:17:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.919+0000 7f34037fe640 1 -- 172.21.15.37:0/3934084765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0031830 con 0x7f34040b2ad0 2023-11-24T06:17:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.919+0000 7f34098e6640 1 -- 172.21.15.37:0/3934084765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34040b2ad0 msgr2=0x7f340406d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.919+0000 7f34098e6640 1 --2- 172.21.15.37:0/3934084765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34040b2ad0 0x7f340406d6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f34040b5110 tx=0x7f33f002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.920+0000 7f34098e6640 1 -- 172.21.15.37:0/3934084765 shutdown_connections 2023-11-24T06:17:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.920+0000 7f34098e6640 1 --2- 172.21.15.37:0/3934084765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34040b2ad0 0x7f340406d6a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.920+0000 7f34098e6640 1 --2- 172.21.15.37:0/3934084765 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34041431f0 0x7f340415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.920+0000 7f34098e6640 1 -- 172.21.15.37:0/3934084765 >> 172.21.15.37:0/3934084765 conn(0x7f34040cb8a0 msgr2=0x7f34040cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.920+0000 7f34098e6640 1 -- 172.21.15.37:0/3934084765 shutdown_connections 2023-11-24T06:17:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.920+0000 7f34098e6640 1 -- 172.21.15.37:0/3934084765 wait complete. 2023-11-24T06:17:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.921+0000 7f34098e6640 1 Processor -- start 2023-11-24T06:17:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.922+0000 7f34098e6640 1 -- start start 2023-11-24T06:17:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.922+0000 7f34098e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34040b2ad0 0x7f340415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34098e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34040b2f30 0x7f34041330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34098e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34041431f0 0x7f340415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34098e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404133630 con 0x7f34041431f0 2023-11-24T06:17:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34098e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340414eeb0 con 0x7f34040b2f30 2023-11-24T06:17:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34098e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3404142950 con 0x7f34040b2ad0 2023-11-24T06:17:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34041431f0 0x7f340415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34041431f0 0x7f340415b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42708/0 (socket says 172.21.15.37:42708) 2023-11-24T06:17:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 -- 172.21.15.37:0/1861362911 learned_addr learned my addr 172.21.15.37:0/1861362911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f3403fff640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34040b2f30 0x7f34041330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 -- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34040b2ad0 msgr2=0x7f340415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34088e4640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34040b2ad0 0x7f340415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34040b2ad0 0x7f340415d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 -- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34040b2f30 msgr2=0x7f34041330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34040b2f30 0x7f34041330f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f34090e5640 1 -- 172.21.15.37:0/1861362911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0009460 con 0x7f34041431f0 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.923+0000 7f3403fff640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34040b2f30 0x7f34041330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.924+0000 7f34090e5640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34041431f0 0x7f340415b6b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00c7d0 tx=0x7f33fc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.924+0000 7f34017fa640 1 -- 172.21.15.37:0/1861362911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc003b70 con 0x7f34041431f0 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.924+0000 7f34017fa640 1 -- 172.21.15.37:0/1861362911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc003cf0 con 0x7f34041431f0 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.924+0000 7f34017fa640 1 -- 172.21.15.37:0/1861362911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00aa90 con 0x7f34041431f0 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.924+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340415c250 con 0x7f34041431f0 2023-11-24T06:17:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.924+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340415c810 con 0x7f34041431f0 2023-11-24T06:17:42.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.925+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3404067990 con 0x7f34041431f0 2023-11-24T06:17:42.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.927+0000 7f34017fa640 1 -- 172.21.15.37:0/1861362911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f33fc00abf0 con 0x7f34041431f0 2023-11-24T06:17:42.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.927+0000 7f34017fa640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f33e806af20 0x7f33e806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:42.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.928+0000 7f34017fa640 1 -- 172.21.15.37:0/1861362911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33fc089520 con 0x7f34041431f0 2023-11-24T06:17:42.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.928+0000 7f34088e4640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f33e806af20 0x7f33e806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.929+0000 7f34088e4640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f33e806af20 0x7f33e806d3e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f33f800a770 tx=0x7f33f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:42.932+0000 7f34017fa640 1 -- 172.21.15.37:0/1861362911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33fc054560 con 0x7f34041431f0 2023-11-24T06:17:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.168+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f340404e840 con 0x7f34041431f0 2023-11-24T06:17:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.784+0000 7f34017fa640 1 -- 172.21.15.37:0/1861362911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 136+0+0 (secure 0 0 0) 0x7f33fc057b80 con 0x7f34041431f0 2023-11-24T06:17:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f33e806af20 msgr2=0x7f33e806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f33e806af20 0x7f33e806d3e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f33f800a770 tx=0x7f33f8008040 comp rx=0 tx=0).stop 2023-11-24T06:17:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34041431f0 msgr2=0x7f340415b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34041431f0 0x7f340415b6b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00c7d0 tx=0x7f33fc00cc90 comp rx=0 tx=0).stop 2023-11-24T06:17:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 shutdown_connections 2023-11-24T06:17:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f33e806af20 0x7f33e806d3e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34040b2f30 0x7f34041330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34041431f0 0x7f340415b6b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 --2- 172.21.15.37:0/1861362911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34040b2ad0 0x7f340415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.788+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 >> 172.21.15.37:0/1861362911 conn(0x7f34040cb8a0 msgr2=0x7f340413ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.789+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 shutdown_connections 2023-11-24T06:17:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:43.789+0000 7f34098e6640 1 -- 172.21.15.37:0/1861362911 wait complete. 2023-11-24T06:17:43.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:17:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.041+0000 7f7ba0a08640 1 Processor -- start 2023-11-24T06:17:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.042+0000 7f7ba0a08640 1 -- start start 2023-11-24T06:17:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.044+0000 7f7ba0a08640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 0x7f7b9c0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.044+0000 7f7ba0a08640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b9c0b63d0 0x7f7b9c0d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.044+0000 7f7ba0a08640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c0cea30 con 0x7f7b9c0ce270 2023-11-24T06:17:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.044+0000 7f7ba0a08640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0d0450 con 0x7f7b9c0b63d0 2023-11-24T06:17:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.044+0000 7f7ba0a08640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0d0bf0 con 0x7f7b9c15d490 2023-11-24T06:17:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b9c0b63d0 0x7f7b9c0d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b9c0b63d0 0x7f7b9c0d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42712/0 (socket says 172.21.15.37:42712) 2023-11-24T06:17:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9a59c640 1 -- 172.21.15.37:0/2411729973 learned_addr learned my addr 172.21.15.37:0/2411729973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9ad9d640 1 --2- 172.21.15.37:0/2411729973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 0x7f7b9c0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9a59c640 1 -- 172.21.15.37:0/2411729973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 msgr2=0x7f7b9c0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9a59c640 1 --2- 172.21.15.37:0/2411729973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 0x7f7b9c0cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9a59c640 1 -- 172.21.15.37:0/2411729973 >> v1:172.21.15.188:6789/0 conn(0x7f7b9c0ce270 legacy=0x7f7b9c160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.045+0000 7f7b9a59c640 1 -- 172.21.15.37:0/2411729973 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0d2260 con 0x7f7b9c0b63d0 2023-11-24T06:17:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.046+0000 7f7b9a59c640 1 --2- 172.21.15.37:0/2411729973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0b63d0 0x7f7b9c0d3230 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009870 tx=0x7f7b9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9f2fc33b763e9e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7b99d9b640 1 -- 172.21.15.37:0/2411729973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90031640 con 0x7f7b9c0b63d0 2023-11-24T06:17:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7b99d9b640 1 -- 172.21.15.37:0/2411729973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b900317a0 con 0x7f7b9c0b63d0 2023-11-24T06:17:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7b99d9b640 1 -- 172.21.15.37:0/2411729973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90031b30 con 0x7f7b9c0b63d0 2023-11-24T06:17:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7ba0a08640 1 -- 172.21.15.37:0/2411729973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0b63d0 msgr2=0x7f7b9c0d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/2411729973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0b63d0 0x7f7b9c0d3230 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009870 tx=0x7f7b9002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7ba0a08640 1 -- 172.21.15.37:0/2411729973 shutdown_connections 2023-11-24T06:17:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/2411729973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0b63d0 0x7f7b9c0d3230 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/2411729973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 0x7f7b9c0cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.047+0000 7f7ba0a08640 1 -- 172.21.15.37:0/2411729973 >> 172.21.15.37:0/2411729973 conn(0x7f7b9c061340 msgr2=0x7f7b9c061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:44.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.048+0000 7f7ba0a08640 1 -- 172.21.15.37:0/2411729973 shutdown_connections 2023-11-24T06:17:44.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.048+0000 7f7ba0a08640 1 -- 172.21.15.37:0/2411729973 wait complete. 2023-11-24T06:17:44.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.049+0000 7f7ba0a08640 1 Processor -- start 2023-11-24T06:17:44.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.050+0000 7f7ba0a08640 1 -- start start 2023-11-24T06:17:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7ba0a08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0ce270 0x7f7b9c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7ba0a08640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 0x7f7b9c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7ba0a08640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b9c0c8790 0x7f7b9c0b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7ba0a08640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c8c10 con 0x7f7b9c0ce270 2023-11-24T06:17:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7ba0a08640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c8e10 con 0x7f7b9c0c8790 2023-11-24T06:17:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7ba0a08640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c90f0 con 0x7f7b9c15d490 2023-11-24T06:17:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0ce270 0x7f7b9c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0ce270 0x7f7b9c14f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42720/0 (socket says 172.21.15.37:42720) 2023-11-24T06:17:44.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 -- 172.21.15.37:0/3736687196 learned_addr learned my addr 172.21.15.37:0/3736687196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:44.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 -- 172.21.15.37:0/3736687196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 msgr2=0x7f7b9c0c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 0x7f7b9c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 -- 172.21.15.37:0/3736687196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b9c0c8790 msgr2=0x7f7b9c0b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b9c0c8790 0x7f7b9c0b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.051+0000 7f7b9ad9d640 1 -- 172.21.15.37:0/3736687196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900094d0 con 0x7f7b9c0ce270 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.052+0000 7f7b9ad9d640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0ce270 0x7f7b9c14f5d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c007e40 tx=0x7f7b8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.052+0000 7f7b837fe640 1 -- 172.21.15.37:0/3736687196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c014620 con 0x7f7b9c0ce270 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.052+0000 7f7b837fe640 1 -- 172.21.15.37:0/3736687196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c00ee90 con 0x7f7b9c0ce270 2023-11-24T06:17:44.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.052+0000 7f7b837fe640 1 -- 172.21.15.37:0/3736687196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0149c0 con 0x7f7b9c0ce270 2023-11-24T06:17:44.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.052+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c0c93d0 con 0x7f7b9c0ce270 2023-11-24T06:17:44.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.052+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c0c9990 con 0x7f7b9c0ce270 2023-11-24T06:17:44.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.053+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c0c9b20 con 0x7f7b9c0ce270 2023-11-24T06:17:44.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.054+0000 7f7b837fe640 1 -- 172.21.15.37:0/3736687196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f7b8c014b20 con 0x7f7b9c0ce270 2023-11-24T06:17:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.056+0000 7f7b837fe640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b8806af20 0x7f7b8806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.056+0000 7f7b837fe640 1 -- 172.21.15.37:0/3736687196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b8c089eb0 con 0x7f7b9c0ce270 2023-11-24T06:17:44.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.056+0000 7f7b9a59c640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b8806af20 0x7f7b8806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.057+0000 7f7b9a59c640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b8806af20 0x7f7b8806d3e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7b90036000 tx=0x7f7b90030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.060+0000 7f7b837fe640 1 -- 172.21.15.37:0/3736687196 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b8c055080 con 0x7f7b9c0ce270 2023-11-24T06:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.278+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b9c0d0910 con 0x7f7b8806af20 2023-11-24T06:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.281+0000 7f7b837fe640 1 -- 172.21.15.37:0/3736687196 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7b90031990 con 0x7f7b8806af20 2023-11-24T06:17:44.285 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-11-24T06:17:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-11-24T06:17:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-11-24T06:17:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-11-24T06:17:44.286 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b8806af20 msgr2=0x7f7b8806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b8806af20 0x7f7b8806d3e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7b90036000 tx=0x7f7b90030000 comp rx=0 tx=0).stop 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0ce270 msgr2=0x7f7b9c14f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0ce270 0x7f7b9c14f5d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c007e40 tx=0x7f7b8c00e4b0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 shutdown_connections 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b8806af20 0x7f7b8806d3e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b9c0c8790 0x7f7b9c0b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9c15d490 0x7f7b9c0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 --2- 172.21.15.37:0/3736687196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0ce270 0x7f7b9c14f5d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 >> 172.21.15.37:0/3736687196 conn(0x7f7b9c061340 msgr2=0x7f7b9c160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 shutdown_connections 2023-11-24T06:17:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.284+0000 7f7ba0a08640 1 -- 172.21.15.37:0/3736687196 wait complete. 2023-11-24T06:17:44.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:17:44.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.530+0000 7f0ba359e640 1 Processor -- start 2023-11-24T06:17:44.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.530+0000 7f0ba359e640 1 -- start start 2023-11-24T06:17:44.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.531+0000 7f0ba359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ba40d0e10 0x7f0ba40d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.531+0000 7f0ba359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40b6090 con 0x7f0ba415d3c0 2023-11-24T06:17:44.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.531+0000 7f0ba359e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40cf0b0 con 0x7f0ba40d0360 2023-11-24T06:17:44.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.531+0000 7f0ba359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40d1c80 con 0x7f0ba40d0e10 2023-11-24T06:17:44.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.532+0000 7f0ba259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ba415d3c0 0x7f0ba40cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57976/0 (socket says 172.21.15.37:57976) 2023-11-24T06:17:44.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.532+0000 7f0ba259c640 1 -- 172.21.15.37:0/514409553 learned_addr learned my addr 172.21.15.37:0/514409553 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:44.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.532+0000 7f0ba2d9d640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ba40d0e10 0x7f0ba40d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.532+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132491793 0 0) 0x7f0ba40b6090 con 0x7f0ba415d3c0 2023-11-24T06:17:44.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.532+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b90003520 con 0x7f0ba415d3c0 2023-11-24T06:17:44.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 573286029 0 0) 0x7f0b90003520 con 0x7f0ba415d3c0 2023-11-24T06:17:44.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ba40d0e10 msgr2=0x7f0ba40d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ba40d0e10 0x7f0ba40d15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 >> v1:172.21.15.188:6789/0 conn(0x7f0ba40d0360 legacy=0x7f0ba40b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40d1f60 con 0x7f0ba415d3c0 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f0b940019f0 con 0x7f0ba415d3c0 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 >> v1:172.21.15.37:6789/0 conn(0x7f0ba415d3c0 legacy=0x7f0ba40cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b900039a0 0x7f0b90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ba40d0e10 0x7f0b900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40d1c80 con 0x7f0b90004d00 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9000ba30 con 0x7f0b900039a0 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9000bbf0 con 0x7f0ba40d0e10 2023-11-24T06:17:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba2d9d640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.533+0000 7f0ba259c640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b900039a0 0x7f0b90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.534+0000 7f0ba2d9d640 1 -- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ba40d0e10 msgr2=0x7f0b900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.534+0000 7f0ba2d9d640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ba40d0e10 0x7f0b900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.534+0000 7f0ba2d9d640 1 -- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b900039a0 msgr2=0x7f0b90003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.534+0000 7f0ba2d9d640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b900039a0 0x7f0b90003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.534+0000 7f0ba2d9d640 1 -- 172.21.15.37:0/514409553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90003520 con 0x7f0b90004d00 2023-11-24T06:17:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.535+0000 7f0ba2d9d640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009a90 tx=0x7f0b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e279eaeeda79aee2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.535+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c02c6b0 con 0x7f0b90004d00 2023-11-24T06:17:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.535+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c02c810 con 0x7f0b90004d00 2023-11-24T06:17:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.535+0000 7f0ba159a640 1 -- 172.21.15.37:0/514409553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c02cba0 con 0x7f0b90004d00 2023-11-24T06:17:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.536+0000 7f0ba359e640 1 -- 172.21.15.37:0/514409553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b90004d00 msgr2=0x7f0b90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.536+0000 7f0ba359e640 1 --2- 172.21.15.37:0/514409553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b90004d00 0x7f0b90005180 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009a90 tx=0x7f0b900057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.536+0000 7f0ba2d9d640 1 -- 172.21.15.37:0/514409553 reap_dead start 2023-11-24T06:17:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.536+0000 7f0ba359e640 1 -- 172.21.15.37:0/514409553 shutdown_connections 2023-11-24T06:17:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.536+0000 7f0ba359e640 1 -- 172.21.15.37:0/514409553 >> 172.21.15.37:0/514409553 conn(0x7f0ba409c570 msgr2=0x7f0ba40d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.536+0000 7f0ba359e640 1 -- 172.21.15.37:0/514409553 shutdown_connections 2023-11-24T06:17:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.536+0000 7f0ba359e640 1 -- 172.21.15.37:0/514409553 wait complete. 2023-11-24T06:17:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.538+0000 7f0ba359e640 1 Processor -- start 2023-11-24T06:17:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.538+0000 7f0ba359e640 1 -- start start 2023-11-24T06:17:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b90004d00 0x7f0ba415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b2560 0x7f0ba40b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ba40afed0 0x7f0ba40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40b2f20 con 0x7f0ba40b2560 2023-11-24T06:17:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba415c6b0 con 0x7f0ba40afed0 2023-11-24T06:17:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40b0890 con 0x7f0b90004d00 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b2560 0x7f0ba40b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b2560 0x7f0ba40b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42738/0 (socket says 172.21.15.37:42738) 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.539+0000 7f0ba1d9b640 1 -- 172.21.15.37:0/1076181565 learned_addr learned my addr 172.21.15.37:0/1076181565 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba2d9d640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ba40afed0 0x7f0ba40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba259c640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b90004d00 0x7f0ba415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba1d9b640 1 -- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b90004d00 msgr2=0x7f0ba415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba1d9b640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b90004d00 0x7f0ba415c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba1d9b640 1 -- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ba40afed0 msgr2=0x7f0ba40b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba1d9b640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ba40afed0 0x7f0ba40b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba1d9b640 1 -- 172.21.15.37:0/1076181565 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40b0b50 con 0x7f0ba40b2560 2023-11-24T06:17:44.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba1d9b640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b2560 0x7f0ba40b29e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c480 tx=0x7f0b8c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0b9affd640 1 -- 172.21.15.37:0/1076181565 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0052d0 con 0x7f0ba40b2560 2023-11-24T06:17:44.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0b9affd640 1 -- 172.21.15.37:0/1076181565 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c005430 con 0x7f0ba40b2560 2023-11-24T06:17:44.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0b9affd640 1 -- 172.21.15.37:0/1076181565 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c012870 con 0x7f0ba40b2560 2023-11-24T06:17:44.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.540+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba40b0e30 con 0x7f0ba40b2560 2023-11-24T06:17:44.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.541+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba40b13f0 con 0x7f0ba40b2560 2023-11-24T06:17:44.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.542+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba404e840 con 0x7f0ba40b2560 2023-11-24T06:17:44.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.543+0000 7f0b9affd640 1 -- 172.21.15.37:0/1076181565 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f0b8c0129d0 con 0x7f0ba40b2560 2023-11-24T06:17:44.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.544+0000 7f0b9affd640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0b8406aed0 0x7f0b8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.544+0000 7f0b9affd640 1 -- 172.21.15.37:0/1076181565 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b8c089270 con 0x7f0ba40b2560 2023-11-24T06:17:44.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.544+0000 7f0ba259c640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0b8406aed0 0x7f0b8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.545+0000 7f0ba259c640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0b8406aed0 0x7f0b8406d390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0b94002000 tx=0x7f0b94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.549+0000 7f0b9affd640 1 -- 172.21.15.37:0/1076181565 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b8c0542c0 con 0x7f0ba40b2560 2023-11-24T06:17:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.740+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ba406cea0 con 0x7f0ba40b2560 2023-11-24T06:17:44.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.741+0000 7f0b9affd640 1 -- 172.21.15.37:0/1076181565 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0b8c0578e0 con 0x7f0ba40b2560 2023-11-24T06:17:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0b8406aed0 msgr2=0x7f0b8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0b8406aed0 0x7f0b8406d390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0b94002000 tx=0x7f0b94009040 comp rx=0 tx=0).stop 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b2560 msgr2=0x7f0ba40b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b2560 0x7f0ba40b29e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c480 tx=0x7f0b8c00c940 comp rx=0 tx=0).stop 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 shutdown_connections 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0b8406aed0 0x7f0b8406d390 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ba40afed0 0x7f0ba40b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b2560 0x7f0ba40b29e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 --2- 172.21.15.37:0/1076181565 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b90004d00 0x7f0ba415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 >> 172.21.15.37:0/1076181565 conn(0x7f0ba409c570 msgr2=0x7f0ba40cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 shutdown_connections 2023-11-24T06:17:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.744+0000 7f0ba359e640 1 -- 172.21.15.37:0/1076181565 wait complete. 2023-11-24T06:17:44.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol8163 --mode=777 2023-11-24T06:17:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.969+0000 7faff830f640 1 Processor -- start 2023-11-24T06:17:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.969+0000 7faff830f640 1 -- start start 2023-11-24T06:17:44.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.971+0000 7faff830f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faff00cf450 0x7faff00cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.971+0000 7faff830f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff00cdfb0 0x7faff00ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.971+0000 7faff830f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00cece0 con 0x7faff015c7f0 2023-11-24T06:17:44.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.971+0000 7faff830f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00cfe40 con 0x7faff00cf450 2023-11-24T06:17:44.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.971+0000 7faff830f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff0156010 con 0x7faff00cdfb0 2023-11-24T06:17:44.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.972+0000 7faff58aa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faff00cf450 0x7faff00cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.972+0000 7faff58aa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faff00cf450 0x7faff00cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38498/0 (socket says 172.21.15.37:38498) 2023-11-24T06:17:44.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.972+0000 7faff58aa640 1 -- 172.21.15.37:0/171697221 learned_addr learned my addr 172.21.15.37:0/171697221 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:44.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.972+0000 7faff68ac640 1 --2- 172.21.15.37:0/171697221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff00cdfb0 0x7faff00ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.973+0000 7faff68ac640 1 -- 172.21.15.37:0/171697221 >> v2:172.21.15.188:3300/0 conn(0x7faff00cf450 msgr2=0x7faff00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:44.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.973+0000 7faff68ac640 1 --2- 172.21.15.37:0/171697221 >> v2:172.21.15.188:3300/0 conn(0x7faff00cf450 0x7faff00cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.973+0000 7faff68ac640 1 -- 172.21.15.37:0/171697221 >> v1:172.21.15.188:6789/0 conn(0x7faff015c7f0 legacy=0x7faff006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.973+0000 7faff68ac640 1 -- 172.21.15.37:0/171697221 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff006d040 con 0x7faff00cdfb0 2023-11-24T06:17:44.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.973+0000 7faff58aa640 1 --2- 172.21.15.37:0/171697221 >> v2:172.21.15.188:3300/0 conn(0x7faff00cf450 0x7faff00cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:44.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.973+0000 7faff50a9640 1 -- 172.21.15.37:0/171697221 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386633722 0 0) 0x7faff00cece0 con 0x7faff015c7f0 2023-11-24T06:17:44.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.974+0000 7faff68ac640 1 --2- 172.21.15.37:0/171697221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff00cdfb0 0x7faff00ce420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009d90 tx=0x7fafe802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d907f2994d741bfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.975+0000 7faff50a9640 1 -- 172.21.15.37:0/171697221 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe802cc60 con 0x7faff00cdfb0 2023-11-24T06:17:44.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.975+0000 7faff50a9640 1 -- 172.21.15.37:0/171697221 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe802cdc0 con 0x7faff00cdfb0 2023-11-24T06:17:44.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.975+0000 7faff50a9640 1 -- 172.21.15.37:0/171697221 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8034660 con 0x7faff00cdfb0 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 -- 172.21.15.37:0/171697221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff00cdfb0 msgr2=0x7faff00ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 --2- 172.21.15.37:0/171697221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff00cdfb0 0x7faff00ce420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009d90 tx=0x7fafe802beb0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 -- 172.21.15.37:0/171697221 shutdown_connections 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 --2- 172.21.15.37:0/171697221 >> v2:172.21.15.188:3300/0 conn(0x7faff00cf450 0x7faff00cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 --2- 172.21.15.37:0/171697221 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff00cdfb0 0x7faff00ce420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 -- 172.21.15.37:0/171697221 >> 172.21.15.37:0/171697221 conn(0x7faff006a920 msgr2=0x7faff006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 -- 172.21.15.37:0/171697221 shutdown_connections 2023-11-24T06:17:44.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.976+0000 7faff830f640 1 -- 172.21.15.37:0/171697221 wait complete. 2023-11-24T06:17:44.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.979+0000 7faff830f640 1 Processor -- start 2023-11-24T06:17:44.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.979+0000 7faff830f640 1 -- start start 2023-11-24T06:17:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff830f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff00cdfb0 0x7faff00c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff830f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff00cf450 0x7faff015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff830f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff015c7f0 0x7faff0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff830f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff015a790 con 0x7faff00cf450 2023-11-24T06:17:44.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff830f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff01561f0 con 0x7faff00cdfb0 2023-11-24T06:17:44.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff830f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff0156490 con 0x7faff015c7f0 2023-11-24T06:17:44.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff00cf450 0x7faff015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff00cf450 0x7faff015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42750/0 (socket says 172.21.15.37:42750) 2023-11-24T06:17:44.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 -- 172.21.15.37:0/3183614833 learned_addr learned my addr 172.21.15.37:0/3183614833 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:44.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff60ab640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff00cdfb0 0x7faff00c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff68ac640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff015c7f0 0x7faff0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 -- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff015c7f0 msgr2=0x7faff0159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff015c7f0 0x7faff0159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 -- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff00cdfb0 msgr2=0x7faff00c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff00cdfb0 0x7faff00c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff58aa640 1 -- 172.21.15.37:0/3183614833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00094d0 con 0x7faff00cf450 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.981+0000 7faff60ab640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff00cdfb0 0x7faff00c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.982+0000 7faff58aa640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff00cf450 0x7faff015f6d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fafe000e9d0 tx=0x7fafe000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.982+0000 7fafe6ffd640 1 -- 172.21.15.37:0/3183614833 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000ca60 con 0x7faff00cf450 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.982+0000 7fafe6ffd640 1 -- 172.21.15.37:0/3183614833 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000cbc0 con 0x7faff00cf450 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.982+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe8009a70 con 0x7faff00cf450 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.982+0000 7fafe6ffd640 1 -- 172.21.15.37:0/3183614833 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0013470 con 0x7faff00cf450 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.982+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff015a420 con 0x7faff00cf450 2023-11-24T06:17:44.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.983+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff0070810 con 0x7faff00cf450 2023-11-24T06:17:44.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.985+0000 7fafe6ffd640 1 -- 172.21.15.37:0/3183614833 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fafe00135d0 con 0x7faff00cf450 2023-11-24T06:17:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.986+0000 7fafe6ffd640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fafd406aed0 0x7fafd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.986+0000 7fafe6ffd640 1 -- 172.21.15.37:0/3183614833 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafe00899f0 con 0x7faff00cf450 2023-11-24T06:17:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.986+0000 7faff60ab640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fafd406aed0 0x7fafd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.986+0000 7faff60ab640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fafd406aed0 0x7fafd406d390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fafec000f60 tx=0x7fafec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:44.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:44.990+0000 7fafe6ffd640 1 -- 172.21.15.37:0/3183614833 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafe0054a40 con 0x7faff00cf450 2023-11-24T06:17:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.209+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol8163", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7faff00ce960 con 0x7fafd406aed0 2023-11-24T06:17:45.222 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:45.219+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:45.222 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:45.219+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:45.222 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:45.219+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:45.222 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:45.219+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:45.222 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-11-24T06:17:45.219+0000 7f7b716d8640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T06:17:45.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.269+0000 7fafe6ffd640 1 -- 172.21.15.37:0/3183614833 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fafec001320 con 0x7fafd406aed0 2023-11-24T06:17:45.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fafd406aed0 msgr2=0x7fafd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fafd406aed0 0x7fafd406d390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fafec000f60 tx=0x7fafec009040 comp rx=0 tx=0).stop 2023-11-24T06:17:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff00cf450 msgr2=0x7faff015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff00cf450 0x7faff015f6d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fafe000e9d0 tx=0x7fafe000ee90 comp rx=0 tx=0).stop 2023-11-24T06:17:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 shutdown_connections 2023-11-24T06:17:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fafd406aed0 0x7fafd406d390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff015c7f0 0x7faff0159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff00cf450 0x7faff015f6d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 --2- 172.21.15.37:0/3183614833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff00cdfb0 0x7faff00c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.271+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 >> 172.21.15.37:0/3183614833 conn(0x7faff006a920 msgr2=0x7faff00b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.272+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 shutdown_connections 2023-11-24T06:17:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.272+0000 7faff830f640 1 -- 172.21.15.37:0/3183614833 wait complete. 2023-11-24T06:17:45.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol8163 2023-11-24T06:17:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.500+0000 7fccabfff640 1 Processor -- start 2023-11-24T06:17:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.501+0000 7fccabfff640 1 -- start start 2023-11-24T06:17:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccabfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fccac0b0b40 0x7fccac0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccabfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccac0cce40 0x7fccac0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccabfff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac0b14d0 con 0x7fccac15d310 2023-11-24T06:17:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccabfff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac06cd10 con 0x7fccac0cce40 2023-11-24T06:17:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccabfff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac0ae5d0 con 0x7fccac0b0b40 2023-11-24T06:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccab7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccac0cce40 0x7fccac0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccab7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccac0cce40 0x7fccac0cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42786/0 (socket says 172.21.15.37:42786) 2023-11-24T06:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fccab7fe640 1 -- 172.21.15.37:0/1703162359 learned_addr learned my addr 172.21.15.37:0/1703162359 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.503+0000 7fcca3fff640 1 --2- 172.21.15.37:0/1703162359 >> v2:172.21.15.188:3300/0 conn(0x7fccac0b0b40 0x7fccac0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.504+0000 7fccab7fe640 1 -- 172.21.15.37:0/1703162359 >> v2:172.21.15.188:3300/0 conn(0x7fccac0b0b40 msgr2=0x7fccac0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.504+0000 7fccab7fe640 1 --2- 172.21.15.37:0/1703162359 >> v2:172.21.15.188:3300/0 conn(0x7fccac0b0b40 0x7fccac0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.504+0000 7fccab7fe640 1 -- 172.21.15.37:0/1703162359 >> v1:172.21.15.188:6789/0 conn(0x7fccac15d310 legacy=0x7fccac0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.504+0000 7fccab7fe640 1 -- 172.21.15.37:0/1703162359 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0ae8b0 con 0x7fccac0cce40 2023-11-24T06:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.505+0000 7fccab7fe640 1 --2- 172.21.15.37:0/1703162359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd2a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fccac0b1cb0 tx=0x7fcca402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361b88bebaefff03 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.505+0000 7fccaa7fc640 1 -- 172.21.15.37:0/1703162359 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca402cb20 con 0x7fccac0cce40 2023-11-24T06:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.505+0000 7fccaa7fc640 1 -- 172.21.15.37:0/1703162359 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca402cc80 con 0x7fccac0cce40 2023-11-24T06:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.505+0000 7fccaa7fc640 1 -- 172.21.15.37:0/1703162359 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40343f0 con 0x7fccac0cce40 2023-11-24T06:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 -- 172.21.15.37:0/1703162359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 msgr2=0x7fccac0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 --2- 172.21.15.37:0/1703162359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd2a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fccac0b1cb0 tx=0x7fcca402bf80 comp rx=0 tx=0).stop 2023-11-24T06:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 -- 172.21.15.37:0/1703162359 shutdown_connections 2023-11-24T06:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 --2- 172.21.15.37:0/1703162359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd2a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 --2- 172.21.15.37:0/1703162359 >> v2:172.21.15.188:3300/0 conn(0x7fccac0b0b40 0x7fccac0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 -- 172.21.15.37:0/1703162359 >> 172.21.15.37:0/1703162359 conn(0x7fccac0cbb40 msgr2=0x7fccac0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 -- 172.21.15.37:0/1703162359 shutdown_connections 2023-11-24T06:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.506+0000 7fccabfff640 1 -- 172.21.15.37:0/1703162359 wait complete. 2023-11-24T06:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.508+0000 7fccabfff640 1 Processor -- start 2023-11-24T06:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.508+0000 7fccabfff640 1 -- start start 2023-11-24T06:17:45.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fccabfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccac0b0b40 0x7fccac09c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fccabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fccabfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccac15d310 0x7fccac0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fccabfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac09b530 con 0x7fccac0cce40 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fccabfff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac099d70 con 0x7fccac0b0b40 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fccabfff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac09b740 con 0x7fccac15d310 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fcca3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fcca3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42794/0 (socket says 172.21.15.37:42794) 2023-11-24T06:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.509+0000 7fcca3fff640 1 -- 172.21.15.37:0/1443580949 learned_addr learned my addr 172.21.15.37:0/1443580949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:45.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fccaaffd640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccac0b0b40 0x7fccac09c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:45.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca3fff640 1 -- 172.21.15.37:0/1443580949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccac15d310 msgr2=0x7fccac0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca3fff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccac15d310 0x7fccac0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca3fff640 1 -- 172.21.15.37:0/1443580949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccac0b0b40 msgr2=0x7fccac09c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca3fff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccac0b0b40 0x7fccac09c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca3fff640 1 -- 172.21.15.37:0/1443580949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4009b30 con 0x7fccac0cce40 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca3fff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd220 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e9b0 tx=0x7fcc9400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca37fe640 1 -- 172.21.15.37:0/1443580949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94009670 con 0x7fccac0cce40 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca37fe640 1 -- 172.21.15.37:0/1443580949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400c9a0 con 0x7fccac0cce40 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fcca37fe640 1 -- 172.21.15.37:0/1443580949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400cd50 con 0x7fccac0cce40 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac09ba20 con 0x7fccac0cce40 2023-11-24T06:17:45.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.510+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac09a050 con 0x7fccac0cce40 2023-11-24T06:17:45.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.511+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac04e840 con 0x7fccac0cce40 2023-11-24T06:17:45.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.513+0000 7fcca37fe640 1 -- 172.21.15.37:0/1443580949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fcc94013470 con 0x7fccac0cce40 2023-11-24T06:17:45.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.513+0000 7fcca37fe640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcc8c06aed0 0x7fcc8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:45.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.513+0000 7fcca37fe640 1 -- 172.21.15.37:0/1443580949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc94089990 con 0x7fccac0cce40 2023-11-24T06:17:45.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.514+0000 7fccaaffd640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcc8c06aed0 0x7fcc8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.514+0000 7fccaaffd640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcc8c06aed0 0x7fcc8c06d390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:45.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.518+0000 7fcca37fe640 1 -- 172.21.15.37:0/1443580949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc94054950 con 0x7fccac0cce40 2023-11-24T06:17:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.741+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol8163", "target": ["mon-mgr", ""]}) v1 -- 0x7fccac06c930 con 0x7fcc8c06aed0 2023-11-24T06:17:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.755+0000 7fcca37fe640 1 -- 172.21.15.37:0/1443580949 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fcc9c001240 con 0x7fcc8c06aed0 2023-11-24T06:17:45.759 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/subvol8163/b19b51f4-5223-4c69-9158-7edc2ce6a8fb 2023-11-24T06:17:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcc8c06aed0 msgr2=0x7fcc8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcc8c06aed0 0x7fcc8c06d390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c009040 comp rx=0 tx=0).stop 2023-11-24T06:17:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 msgr2=0x7fccac0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd220 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e9b0 tx=0x7fcc9400ee70 comp rx=0 tx=0).stop 2023-11-24T06:17:45.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 shutdown_connections 2023-11-24T06:17:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fcc8c06aed0 0x7fcc8c06d390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccac15d310 0x7fccac0cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccac0cce40 0x7fccac0cd220 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 --2- 172.21.15.37:0/1443580949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccac0b0b40 0x7fccac09c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 >> 172.21.15.37:0/1443580949 conn(0x7fccac0cbb40 msgr2=0x7fccac0afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 shutdown_connections 2023-11-24T06:17:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:45.758+0000 7fccabfff640 1 -- 172.21.15.37:0/1443580949 wait complete. 2023-11-24T06:17:45.779 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol8163 with 3000 files each 0MB size under directory volumes/_nogroup/subvol8163/b19b51f4-5223-4c69-9158-7edc2ce6a8fb 2023-11-24T06:17:45.779 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:17:45.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:17:45.891 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:17:46.020 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:17:46.020 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:46.020 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:46.085 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:46.085 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:46.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:46.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.372+0000 7f7bd4bc9640 1 Processor -- start 2023-11-24T06:17:46.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.372+0000 7f7bd4bc9640 1 -- start start 2023-11-24T06:17:46.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.373+0000 7f7bd4bc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.373+0000 7f7bd4bc9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7bd00b28d0 0x7f7bd00cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.373+0000 7f7bd4bc9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd00b2690 con 0x7f7bd00cf420 2023-11-24T06:17:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.373+0000 7f7bd4bc9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd00cc7f0 con 0x7f7bd00b28d0 2023-11-24T06:17:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.373+0000 7f7bd4bc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd006ed00 con 0x7f7bd006aa30 2023-11-24T06:17:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.374+0000 7f7bce59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.374+0000 7f7bcdd9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7bd00b28d0 0x7f7bd00cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.374+0000 7f7bce59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:50830/0 (socket says 172.21.15.37:50830) 2023-11-24T06:17:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.374+0000 7f7bce59c640 1 -- 172.21.15.37:0/1102606184 learned_addr learned my addr 172.21.15.37:0/1102606184 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.375+0000 7f7bce59c640 1 -- 172.21.15.37:0/1102606184 >> v2:172.21.15.188:3300/0 conn(0x7f7bd00b28d0 msgr2=0x7f7bd00cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.375+0000 7f7bce59c640 1 --2- 172.21.15.37:0/1102606184 >> v2:172.21.15.188:3300/0 conn(0x7f7bd00b28d0 0x7f7bd00cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.375+0000 7f7bce59c640 1 -- 172.21.15.37:0/1102606184 >> v1:172.21.15.188:6789/0 conn(0x7f7bd00cf420 legacy=0x7f7bd01616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.375+0000 7f7bce59c640 1 -- 172.21.15.37:0/1102606184 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd006efe0 con 0x7f7bd006aa30 2023-11-24T06:17:46.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.375+0000 7f7bcdd9b640 1 --2- 172.21.15.37:0/1102606184 >> v2:172.21.15.188:3300/0 conn(0x7f7bd00b28d0 0x7f7bd00cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:46.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.376+0000 7f7bce59c640 1 --2- 172.21.15.37:0/1102606184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00cc2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009e50 tx=0x7f7bc002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c23921eb60f2d03 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bcd59a640 1 -- 172.21.15.37:0/1102606184 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc002cb90 con 0x7f7bd006aa30 2023-11-24T06:17:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bcd59a640 1 -- 172.21.15.37:0/1102606184 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc002ccf0 con 0x7f7bd006aa30 2023-11-24T06:17:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bcd59a640 1 -- 172.21.15.37:0/1102606184 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0034610 con 0x7f7bd006aa30 2023-11-24T06:17:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/1102606184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 msgr2=0x7f7bd00cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/1102606184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00cc2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009e50 tx=0x7f7bc002bff0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/1102606184 shutdown_connections 2023-11-24T06:17:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/1102606184 >> v2:172.21.15.188:3300/0 conn(0x7f7bd00b28d0 0x7f7bd00cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/1102606184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00cc2b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.377+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/1102606184 >> 172.21.15.37:0/1102606184 conn(0x7f7bd00999d0 msgr2=0x7f7bd00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.378+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/1102606184 shutdown_connections 2023-11-24T06:17:46.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.378+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/1102606184 wait complete. 2023-11-24T06:17:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.379+0000 7f7bd4bc9640 1 Processor -- start 2023-11-24T06:17:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.380+0000 7f7bd4bc9640 1 -- start start 2023-11-24T06:17:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bd4bc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bd4bc9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bd00b28d0 0x7f7bd00b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bd4bc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00cf420 0x7f7bd00b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bd4bc9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd00c7d80 con 0x7f7bd00cf420 2023-11-24T06:17:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bd4bc9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd014dd20 con 0x7f7bd00b28d0 2023-11-24T06:17:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bd4bc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd014e5c0 con 0x7f7bd006aa30 2023-11-24T06:17:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bced9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00cf420 0x7f7bd00b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bced9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00cf420 0x7f7bd00b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42800/0 (socket says 172.21.15.37:42800) 2023-11-24T06:17:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bced9d640 1 -- 172.21.15.37:0/2394676615 learned_addr learned my addr 172.21.15.37:0/2394676615 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bce59c640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.381+0000 7f7bcdd9b640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bd00b28d0 0x7f7bd00b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bced9d640 1 -- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 msgr2=0x7f7bd00c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bced9d640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bced9d640 1 -- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bd00b28d0 msgr2=0x7f7bd00b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bced9d640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bd00b28d0 0x7f7bd00b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bced9d640 1 -- 172.21.15.37:0/2394676615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009400 con 0x7f7bd00cf420 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bce59c640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bced9d640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00cf420 0x7f7bd00b18a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8001eb0 tx=0x7f7bc800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bc6ffd640 1 -- 172.21.15.37:0/2394676615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80052d0 con 0x7f7bd00cf420 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bc6ffd640 1 -- 172.21.15.37:0/2394676615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc8005430 con 0x7f7bd00cf420 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc0009b30 con 0x7f7bd00cf420 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.382+0000 7f7bc6ffd640 1 -- 172.21.15.37:0/2394676615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8003810 con 0x7f7bd00cf420 2023-11-24T06:17:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.383+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd014df70 con 0x7f7bd00cf420 2023-11-24T06:17:46.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.384+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd014e730 con 0x7f7bd00cf420 2023-11-24T06:17:46.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.386+0000 7f7bc6ffd640 1 -- 172.21.15.37:0/2394676615 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f7bc8003970 con 0x7f7bd00cf420 2023-11-24T06:17:46.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.387+0000 7f7bc6ffd640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7bb006af00 0x7f7bb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.387+0000 7f7bc6ffd640 1 -- 172.21.15.37:0/2394676615 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bc8088ce0 con 0x7f7bd00cf420 2023-11-24T06:17:46.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.387+0000 7f7bce59c640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7bb006af00 0x7f7bb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.387+0000 7f7bce59c640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7bb006af00 0x7f7bb006d3c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0035000 tx=0x7f7bc0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.390+0000 7f7bc6ffd640 1 -- 172.21.15.37:0/2394676615 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7bc8053cb0 con 0x7f7bd00cf420 2023-11-24T06:17:46.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.586+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bd0067470 con 0x7f7bd00cf420 2023-11-24T06:17:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.588+0000 7f7bc6ffd640 1 -- 172.21.15.37:0/2394676615 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f7bc80572d0 con 0x7f7bd00cf420 2023-11-24T06:17:46.592 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:46.592 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:33.680484+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:46.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7bb006af00 msgr2=0x7f7bb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7bb006af00 0x7f7bb006d3c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0035000 tx=0x7f7bc0030000 comp rx=0 tx=0).stop 2023-11-24T06:17:46.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00cf420 msgr2=0x7f7bd00b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00cf420 0x7f7bd00b18a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8001eb0 tx=0x7f7bc800c890 comp rx=0 tx=0).stop 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 shutdown_connections 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7bb006af00 0x7f7bb006d3c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bd00b28d0 0x7f7bd00b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd00cf420 0x7f7bd00b18a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 --2- 172.21.15.37:0/2394676615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bd006aa30 0x7f7bd00c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 >> 172.21.15.37:0/2394676615 conn(0x7f7bd00999d0 msgr2=0x7f7bd015f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 shutdown_connections 2023-11-24T06:17:46.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.591+0000 7f7bd4bc9640 1 -- 172.21.15.37:0/2394676615 wait complete. 2023-11-24T06:17:46.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:17:30.069208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:17:31.179643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:46.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.844+0000 7fa489459640 1 Processor -- start 2023-11-24T06:17:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.844+0000 7fa489459640 1 -- start start 2023-11-24T06:17:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.845+0000 7fa489459640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa48415d3f0 0x7fa4840d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.845+0000 7fa489459640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa48415d7d0 0x7fa4840d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.845+0000 7fa489459640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840d15e0 con 0x7fa4840d0e40 2023-11-24T06:17:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.845+0000 7fa489459640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4840d0280 con 0x7fa48415d7d0 2023-11-24T06:17:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.845+0000 7fa489459640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840d1300 con 0x7fa48415d3f0 2023-11-24T06:17:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.846+0000 7fa4837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa48415d7d0 0x7fa4840d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.846+0000 7fa4837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa48415d7d0 0x7fa4840d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42804/0 (socket says 172.21.15.37:42804) 2023-11-24T06:17:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.846+0000 7fa4837fe640 1 -- 172.21.15.37:0/2217366442 learned_addr learned my addr 172.21.15.37:0/2217366442 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.846+0000 7fa483fff640 1 --2- 172.21.15.37:0/2217366442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa48415d3f0 0x7fa4840d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.846+0000 7fa4837fe640 1 -- 172.21.15.37:0/2217366442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa48415d3f0 msgr2=0x7fa4840d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.846+0000 7fa4837fe640 1 --2- 172.21.15.37:0/2217366442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa48415d3f0 0x7fa4840d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.847+0000 7fa4837fe640 1 -- 172.21.15.37:0/2217366442 >> v1:172.21.15.188:6789/0 conn(0x7fa4840d0e40 legacy=0x7fa4840afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.847+0000 7fa4837fe640 1 -- 172.21.15.37:0/2217366442 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840cfc30 con 0x7fa48415d7d0 2023-11-24T06:17:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.849+0000 7fa4837fe640 1 --2- 172.21.15.37:0/2217366442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840d1d70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa478009870 tx=0x7fa47802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca2f1cec8dbe00 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.849+0000 7fa482ffd640 1 -- 172.21.15.37:0/2217366442 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478030840 con 0x7fa48415d7d0 2023-11-24T06:17:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.849+0000 7fa482ffd640 1 -- 172.21.15.37:0/2217366442 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4780309a0 con 0x7fa48415d7d0 2023-11-24T06:17:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.849+0000 7fa482ffd640 1 -- 172.21.15.37:0/2217366442 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478030d30 con 0x7fa48415d7d0 2023-11-24T06:17:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 -- 172.21.15.37:0/2217366442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 msgr2=0x7fa4840d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 --2- 172.21.15.37:0/2217366442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840d1d70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa478009870 tx=0x7fa47802b980 comp rx=0 tx=0).stop 2023-11-24T06:17:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 -- 172.21.15.37:0/2217366442 shutdown_connections 2023-11-24T06:17:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 --2- 172.21.15.37:0/2217366442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840d1d70 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 --2- 172.21.15.37:0/2217366442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa48415d3f0 0x7fa4840d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 -- 172.21.15.37:0/2217366442 >> 172.21.15.37:0/2217366442 conn(0x7fa48409c5b0 msgr2=0x7fa4840d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 -- 172.21.15.37:0/2217366442 shutdown_connections 2023-11-24T06:17:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.850+0000 7fa489459640 1 -- 172.21.15.37:0/2217366442 wait complete. 2023-11-24T06:17:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.851+0000 7fa489459640 1 Processor -- start 2023-11-24T06:17:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.851+0000 7fa489459640 1 -- start start 2023-11-24T06:17:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.852+0000 7fa489459640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840d0e40 0x7fa4840b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.852+0000 7fa489459640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48415d3f0 0x7fa48414ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.852+0000 7fa489459640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.852+0000 7fa489459640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840b5800 con 0x7fa48415d7d0 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.852+0000 7fa489459640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840b7130 con 0x7fa48415d3f0 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.852+0000 7fa489459640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840b6520 con 0x7fa4840d0e40 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.852+0000 7fa488c58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42810/0 (socket says 172.21.15.37:42810) 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 -- 172.21.15.37:0/2691634416 learned_addr learned my addr 172.21.15.37:0/2691634416 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa483fff640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840d0e40 0x7fa4840b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa4837fe640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48415d3f0 0x7fa48414ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 -- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840d0e40 msgr2=0x7fa4840b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840d0e40 0x7fa4840b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 -- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48415d3f0 msgr2=0x7fa48414ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48415d3f0 0x7fa48414ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 -- 172.21.15.37:0/2691634416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4780094d0 con 0x7fa48415d7d0 2023-11-24T06:17:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.853+0000 7fa488c58640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840b52c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c3a0 tx=0x7fa47c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.854+0000 7fa480ff9640 1 -- 172.21.15.37:0/2691634416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0052d0 con 0x7fa48415d7d0 2023-11-24T06:17:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.854+0000 7fa480ff9640 1 -- 172.21.15.37:0/2691634416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c005430 con 0x7fa48415d7d0 2023-11-24T06:17:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.854+0000 7fa480ff9640 1 -- 172.21.15.37:0/2691634416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c003830 con 0x7fa48415d7d0 2023-11-24T06:17:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.854+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4840b6800 con 0x7fa48415d7d0 2023-11-24T06:17:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.854+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4840b6dc0 con 0x7fa48415d7d0 2023-11-24T06:17:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.855+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48404e840 con 0x7fa48415d7d0 2023-11-24T06:17:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.856+0000 7fa480ff9640 1 -- 172.21.15.37:0/2691634416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fa47c003990 con 0x7fa48415d7d0 2023-11-24T06:17:46.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.857+0000 7fa480ff9640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa47006aed0 0x7fa47006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.857+0000 7fa480ff9640 1 -- 172.21.15.37:0/2691634416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa47c088c60 con 0x7fa48415d7d0 2023-11-24T06:17:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.857+0000 7fa483fff640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa47006aed0 0x7fa47006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.859+0000 7fa483fff640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa47006aed0 0x7fa47006d390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa474009a60 tx=0x7fa474003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:46.862+0000 7fa480ff9640 1 -- 172.21.15.37:0/2691634416 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa47c053ce0 con 0x7fa48415d7d0 2023-11-24T06:17:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.054+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4840b7270 con 0x7fa48415d7d0 2023-11-24T06:17:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.055+0000 7fa480ff9640 1 -- 172.21.15.37:0/2691634416 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa47c0170a0 con 0x7fa48415d7d0 2023-11-24T06:17:47.058 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:47.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.057+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa47006aed0 msgr2=0x7fa47006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.057+0000 7fa489459640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa47006aed0 0x7fa47006d390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa474009a60 tx=0x7fa474003990 comp rx=0 tx=0).stop 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.057+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 msgr2=0x7fa4840b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.057+0000 7fa489459640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840b52c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c3a0 tx=0x7fa47c00c860 comp rx=0 tx=0).stop 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.057+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 shutdown_connections 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.057+0000 7fa489459640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fa47006aed0 0x7fa47006d390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.057+0000 7fa489459640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48415d3f0 0x7fa48414ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.058+0000 7fa489459640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48415d7d0 0x7fa4840b52c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.058+0000 7fa489459640 1 --2- 172.21.15.37:0/2691634416 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840d0e40 0x7fa4840b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.058+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 >> 172.21.15.37:0/2691634416 conn(0x7fa48409c5b0 msgr2=0x7fa4840c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.058+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 shutdown_connections 2023-11-24T06:17:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.058+0000 7fa489459640 1 -- 172.21.15.37:0/2691634416 wait complete. 2023-11-24T06:17:47.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:17:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.300+0000 7f39fd748640 1 Processor -- start 2023-11-24T06:17:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.300+0000 7f39fd748640 1 -- start start 2023-11-24T06:17:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.302+0000 7f39fd748640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f39f815d620 0x7f39f80b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.302+0000 7f39fd748640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.302+0000 7f39fd748640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f80b37b0 con 0x7f39f80b5260 2023-11-24T06:17:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.302+0000 7f39fd748640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f806d900 con 0x7f39f815d620 2023-11-24T06:17:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.302+0000 7f39fd748640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f806dbe0 con 0x7f39f80999d0 2023-11-24T06:17:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39ee7fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39f6ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f39f815d620 0x7f39f80b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39f6ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f39f815d620 0x7f39f80b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38584/0 (socket says 172.21.15.37:38584) 2023-11-24T06:17:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39f6ffd640 1 -- 172.21.15.37:0/1550817264 learned_addr learned my addr 172.21.15.37:0/1550817264 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39ee7fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f80b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:50856/0 (socket says 172.21.15.37:50856) 2023-11-24T06:17:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39ee7fc640 1 -- 172.21.15.37:0/1550817264 >> v2:172.21.15.188:3300/0 conn(0x7f39f815d620 msgr2=0x7f39f80b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39ee7fc640 1 --2- 172.21.15.37:0/1550817264 >> v2:172.21.15.188:3300/0 conn(0x7f39f815d620 0x7f39f80b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39ee7fc640 1 -- 172.21.15.37:0/1550817264 >> v1:172.21.15.188:6789/0 conn(0x7f39f80b5260 legacy=0x7f39f806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.303+0000 7f39ee7fc640 1 -- 172.21.15.37:0/1550817264 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f806dec0 con 0x7f39f80999d0 2023-11-24T06:17:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.304+0000 7f39f6ffd640 1 --2- 172.21.15.37:0/1550817264 >> v2:172.21.15.188:3300/0 conn(0x7f39f815d620 0x7f39f80b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:17:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.305+0000 7f39ee7fc640 1 --2- 172.21.15.37:0/1550817264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f80b4d20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009d90 tx=0x7f39e002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b44add036cbf73a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.305+0000 7f39f67fc640 1 -- 172.21.15.37:0/1550817264 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e002cc50 con 0x7f39f80999d0 2023-11-24T06:17:47.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.305+0000 7f39f67fc640 1 -- 172.21.15.37:0/1550817264 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e002cdb0 con 0x7f39f80999d0 2023-11-24T06:17:47.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.305+0000 7f39f67fc640 1 -- 172.21.15.37:0/1550817264 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0034660 con 0x7f39f80999d0 2023-11-24T06:17:47.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 -- 172.21.15.37:0/1550817264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 msgr2=0x7f39f80b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 --2- 172.21.15.37:0/1550817264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f80b4d20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009d90 tx=0x7f39e002bea0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 -- 172.21.15.37:0/1550817264 shutdown_connections 2023-11-24T06:17:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 --2- 172.21.15.37:0/1550817264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f80b4d20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 --2- 172.21.15.37:0/1550817264 >> v2:172.21.15.188:3300/0 conn(0x7f39f815d620 0x7f39f80b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 -- 172.21.15.37:0/1550817264 >> 172.21.15.37:0/1550817264 conn(0x7f39f806c090 msgr2=0x7f39f80b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 -- 172.21.15.37:0/1550817264 shutdown_connections 2023-11-24T06:17:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.306+0000 7f39fd748640 1 -- 172.21.15.37:0/1550817264 wait complete. 2023-11-24T06:17:47.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.308+0000 7f39fd748640 1 Processor -- start 2023-11-24T06:17:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.308+0000 7f39fd748640 1 -- start start 2023-11-24T06:17:47.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39fd748640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39fd748640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39f80b5260 0x7f39f814edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39fd748640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39f815d620 0x7f39f815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39fd748640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f815ea10 con 0x7f39f80b5260 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39fd748640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f814f310 con 0x7f39f815d620 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39fd748640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f815df40 con 0x7f39f80999d0 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39f80b5260 0x7f39f814edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39f80b5260 0x7f39f814edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42826/0 (socket says 172.21.15.37:42826) 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39ee7fc640 1 -- 172.21.15.37:0/4073149361 learned_addr learned my addr 172.21.15.37:0/4073149361 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39f6ffd640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.310+0000 7f39f77fe640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39f815d620 0x7f39f815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39ee7fc640 1 -- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 msgr2=0x7f39f814a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39ee7fc640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f814a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39ee7fc640 1 -- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39f815d620 msgr2=0x7f39f815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39ee7fc640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39f815d620 0x7f39f815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39ee7fc640 1 -- 172.21.15.37:0/4073149361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80094d0 con 0x7f39f80b5260 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39f77fe640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39f815d620 0x7f39f815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39ee7fc640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39f80b5260 0x7f39f814edd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009d90 tx=0x7f39e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:47.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.311+0000 7f39effff640 1 -- 172.21.15.37:0/4073149361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e003e610 con 0x7f39f80b5260 2023-11-24T06:17:47.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.312+0000 7f39effff640 1 -- 172.21.15.37:0/4073149361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e003e790 con 0x7f39f80b5260 2023-11-24T06:17:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.312+0000 7f39effff640 1 -- 172.21.15.37:0/4073149361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e003eb40 con 0x7f39f80b5260 2023-11-24T06:17:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.312+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e0009a70 con 0x7f39f80b5260 2023-11-24T06:17:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.312+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f815f230 con 0x7f39f80b5260 2023-11-24T06:17:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.313+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f815f000 con 0x7f39f80b5260 2023-11-24T06:17:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.314+0000 7f39effff640 1 -- 172.21.15.37:0/4073149361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f39e003b050 con 0x7f39f80b5260 2023-11-24T06:17:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.315+0000 7f39effff640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f39d806aed0 0x7f39d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.315+0000 7f39effff640 1 -- 172.21.15.37:0/4073149361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39e00abf60 con 0x7f39f80b5260 2023-11-24T06:17:47.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.315+0000 7f39f6ffd640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f39d806aed0 0x7f39d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.316+0000 7f39f6ffd640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f39d806aed0 0x7f39d806d390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f39e8006ca0 tx=0x7f39e8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:47.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.319+0000 7f39effff640 1 -- 172.21.15.37:0/4073149361 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39f815f000 con 0x7f39f80b5260 2023-11-24T06:17:47.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.506+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39f815f000 con 0x7f39f80b5260 2023-11-24T06:17:47.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.508+0000 7f39effff640 1 -- 172.21.15.37:0/4073149361 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39f815f000 con 0x7f39f80b5260 2023-11-24T06:17:47.510 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f39d806aed0 msgr2=0x7f39d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f39d806aed0 0x7f39d806d390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f39e8006ca0 tx=0x7f39e8009240 comp rx=0 tx=0).stop 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39f80b5260 msgr2=0x7f39f814edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39f80b5260 0x7f39f814edd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009d90 tx=0x7f39e0004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 shutdown_connections 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f39d806aed0 0x7f39d806d390 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39f815d620 0x7f39f815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39f80b5260 0x7f39f814edd0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 --2- 172.21.15.37:0/4073149361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39f80999d0 0x7f39f814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 >> 172.21.15.37:0/4073149361 conn(0x7f39f806c090 msgr2=0x7f39f8157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:47.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 shutdown_connections 2023-11-24T06:17:47.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.510+0000 7f39fd748640 1 -- 172.21.15.37:0/4073149361 wait complete. 2023-11-24T06:17:47.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:47.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.750+0000 7fbf9637a640 1 Processor -- start 2023-11-24T06:17:47.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.750+0000 7fbf9637a640 1 -- start start 2023-11-24T06:17:47.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.752+0000 7fbf9637a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbf900b0b40 0x7fbf900b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.752+0000 7fbf9637a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9015ed20 con 0x7fbf9006c5b0 2023-11-24T06:17:47.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.752+0000 7fbf9637a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9015f8a0 con 0x7fbf9015b260 2023-11-24T06:17:47.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.752+0000 7fbf9637a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9015b640 con 0x7fbf900b0b40 2023-11-24T06:17:47.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.752+0000 7fbf95b79640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbf9006c5b0 0x7fbf9006ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57984/0 (socket says 172.21.15.37:57984) 2023-11-24T06:17:47.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.752+0000 7fbf95b79640 1 -- 172.21.15.37:0/3068408488 learned_addr learned my addr 172.21.15.37:0/3068408488 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:47.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.753+0000 7fbf94b77640 1 --2- 172.21.15.37:0/3068408488 >> v2:172.21.15.188:3300/0 conn(0x7fbf900b0b40 0x7fbf900b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.753+0000 7fbf87fff640 1 -- 172.21.15.37:0/3068408488 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899219885 0 0) 0x7fbf9015ed20 con 0x7fbf9006c5b0 2023-11-24T06:17:47.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.753+0000 7fbf87fff640 1 -- 172.21.15.37:0/3068408488 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf7c003520 con 0x7fbf9006c5b0 2023-11-24T06:17:47.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.753+0000 7fbf94b77640 1 -- 172.21.15.37:0/3068408488 >> v1:172.21.15.188:6789/0 conn(0x7fbf9015b260 legacy=0x7fbf9006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.753+0000 7fbf94b77640 1 -- 172.21.15.37:0/3068408488 >> v1:172.21.15.37:6789/0 conn(0x7fbf9006c5b0 legacy=0x7fbf9006ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.753+0000 7fbf87fff640 1 -- 172.21.15.37:0/3068408488 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1895679527 0 0) 0x7fbf7c003520 con 0x7fbf9006c5b0 2023-11-24T06:17:47.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.753+0000 7fbf94b77640 1 -- 172.21.15.37:0/3068408488 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9006e750 con 0x7fbf900b0b40 2023-11-24T06:17:47.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.755+0000 7fbf94b77640 1 --2- 172.21.15.37:0/3068408488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf900b0fb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf800097a0 tx=0x7fbf8002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6d76b3d9633064 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:47.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.755+0000 7fbf87fff640 1 -- 172.21.15.37:0/3068408488 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880019f0 con 0x7fbf900b0b40 2023-11-24T06:17:47.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.755+0000 7fbf87fff640 1 -- 172.21.15.37:0/3068408488 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8002e050 con 0x7fbf900b0b40 2023-11-24T06:17:47.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.755+0000 7fbf87fff640 1 -- 172.21.15.37:0/3068408488 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80030710 con 0x7fbf900b0b40 2023-11-24T06:17:47.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.756+0000 7fbf9637a640 1 -- 172.21.15.37:0/3068408488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 msgr2=0x7fbf900b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.756+0000 7fbf9637a640 1 --2- 172.21.15.37:0/3068408488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf900b0fb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf800097a0 tx=0x7fbf8002b710 comp rx=0 tx=0).stop 2023-11-24T06:17:47.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.756+0000 7fbf9637a640 1 -- 172.21.15.37:0/3068408488 shutdown_connections 2023-11-24T06:17:47.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.756+0000 7fbf9637a640 1 --2- 172.21.15.37:0/3068408488 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf900b0fb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.756+0000 7fbf9637a640 1 -- 172.21.15.37:0/3068408488 >> 172.21.15.37:0/3068408488 conn(0x7fbf900cbb40 msgr2=0x7fbf900cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:47.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.756+0000 7fbf9637a640 1 -- 172.21.15.37:0/3068408488 shutdown_connections 2023-11-24T06:17:47.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.756+0000 7fbf9637a640 1 -- 172.21.15.37:0/3068408488 wait complete. 2023-11-24T06:17:47.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.758+0000 7fbf9637a640 1 Processor -- start 2023-11-24T06:17:47.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.758+0000 7fbf9637a640 1 -- start start 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf9637a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf9006c5b0 0x7fbf90158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf9637a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf90099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf9637a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf9015b260 0x7fbf900c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf9637a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b1ce0 con 0x7fbf9006c5b0 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf9637a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b1fc0 con 0x7fbf900b0b40 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf9637a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b22a0 con 0x7fbf9015b260 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf95378640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf9006c5b0 0x7fbf90158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf95378640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf9006c5b0 0x7fbf90158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42836/0 (socket says 172.21.15.37:42836) 2023-11-24T06:17:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.759+0000 7fbf95378640 1 -- 172.21.15.37:0/4154089753 learned_addr learned my addr 172.21.15.37:0/4154089753 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:47.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95b79640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf9015b260 0x7fbf900c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf94b77640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf90099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95378640 1 -- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf9015b260 msgr2=0x7fbf900c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95378640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf9015b260 0x7fbf900c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95378640 1 -- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 msgr2=0x7fbf90099cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95378640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf90099cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95378640 1 -- 172.21.15.37:0/4154089753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80009400 con 0x7fbf9006c5b0 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95b79640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf9015b260 0x7fbf900c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf94b77640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf90099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf95378640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf9006c5b0 0x7fbf90158a10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c400 tx=0x7fbf8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.760+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0052d0 con 0x7fbf9006c5b0 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.761+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c005430 con 0x7fbf9006c5b0 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.761+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c003830 con 0x7fbf9006c5b0 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.761+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900b2580 con 0x7fbf9006c5b0 2023-11-24T06:17:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.761+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf900b2b40 con 0x7fbf9006c5b0 2023-11-24T06:17:47.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.762+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9004e840 con 0x7fbf9006c5b0 2023-11-24T06:17:47.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.763+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fbf8c003990 con 0x7fbf9006c5b0 2023-11-24T06:17:47.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.764+0000 7fbf85ffb640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbf7406aed0 0x7fbf7406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:47.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.764+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf8c088cc0 con 0x7fbf9006c5b0 2023-11-24T06:17:47.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.764+0000 7fbf94b77640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbf7406aed0 0x7fbf7406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:47.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.765+0000 7fbf94b77640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbf7406aed0 0x7fbf7406d390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbf80034000 tx=0x7fbf80008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:47.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.768+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf8c08f080 con 0x7fbf9006c5b0 2023-11-24T06:17:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.821+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fbf8c054050 con 0x7fbf9006c5b0 2023-11-24T06:17:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.965+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf900ce640 con 0x7fbf9006c5b0 2023-11-24T06:17:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.966+0000 7fbf85ffb640 1 -- 172.21.15.37:0/4154089753 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf8c0722e0 con 0x7fbf9006c5b0 2023-11-24T06:17:47.969 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:17:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbf7406aed0 msgr2=0x7fbf7406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbf7406aed0 0x7fbf7406d390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbf80034000 tx=0x7fbf80008030 comp rx=0 tx=0).stop 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf9006c5b0 msgr2=0x7fbf90158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf9006c5b0 0x7fbf90158a10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c400 tx=0x7fbf8c00c8c0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 shutdown_connections 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbf7406aed0 0x7fbf7406d390 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf900b0b40 0x7fbf90099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf9015b260 0x7fbf900c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 --2- 172.21.15.37:0/4154089753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf9006c5b0 0x7fbf90158a10 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 >> 172.21.15.37:0/4154089753 conn(0x7fbf900cbb40 msgr2=0x7fbf900afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 shutdown_connections 2023-11-24T06:17:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:47.969+0000 7fbf9637a640 1 -- 172.21.15.37:0/4154089753 wait complete. 2023-11-24T06:17:47.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:17:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.211+0000 7f1b25f97640 1 Processor -- start 2023-11-24T06:17:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.211+0000 7f1b25f97640 1 -- start start 2023-11-24T06:17:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.212+0000 7f1b25f97640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b2015b440 0x7f1b200cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b25f97640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 0x7f1b2006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b25f97640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2015eea0 con 0x7f1b200cbf20 2023-11-24T06:17:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b25f97640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200c5e00 con 0x7f1b2015b440 2023-11-24T06:17:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b25f97640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200cc3d0 con 0x7f1b200c59b0 2023-11-24T06:17:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b1effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1b200cbf20 0x7f1b200c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57990/0 (socket says 172.21.15.37:57990) 2023-11-24T06:17:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b1effd640 1 -- 172.21.15.37:0/4023070836 learned_addr learned my addr 172.21.15.37:0/4023070836 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b1ffff640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 0x7f1b2006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059634637 0 0) 0x7f1b2015eea0 con 0x7f1b200cbf20 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b0c003520 con 0x7f1b200cbf20 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.213+0000 7f1b1f7fe640 1 --2- 172.21.15.37:0/4023070836 >> v2:172.21.15.188:3300/0 conn(0x7f1b2015b440 0x7f1b200cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 151313689 0 0) 0x7f1b0c003520 con 0x7f1b200cbf20 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 msgr2=0x7f1b2006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 0x7f1b2006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 >> v2:172.21.15.188:3300/0 conn(0x7f1b2015b440 msgr2=0x7f1b200cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 --2- 172.21.15.37:0/4023070836 >> v2:172.21.15.188:3300/0 conn(0x7f1b2015b440 0x7f1b200cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200abf30 con 0x7f1b200cbf20 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f1b08001670 con 0x7f1b200cbf20 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1f7fe640 1 --2- 172.21.15.37:0/4023070836 >> v2:172.21.15.188:3300/0 conn(0x7f1b2015b440 0x7f1b200cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 >> v1:172.21.15.37:6789/0 conn(0x7f1b200cbf20 legacy=0x7f1b200c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b0c003970 0x7f1b0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 0x7f1b0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200cc3d0 con 0x7f1b0c004d00 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c00b9b0 con 0x7f1b0c003970 2023-11-24T06:17:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c00bb70 con 0x7f1b200c59b0 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.214+0000 7f1b1ffff640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1f7fe640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b0c003970 0x7f1b0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1effd640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 0x7f1b0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1ffff640 1 -- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 msgr2=0x7f1b0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1ffff640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 0x7f1b0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1ffff640 1 -- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b0c003970 msgr2=0x7f1b0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1ffff640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b0c003970 0x7f1b0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1ffff640 1 -- 172.21.15.37:0/4023070836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c003520 con 0x7f1b0c004d00 2023-11-24T06:17:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.215+0000 7f1b1effd640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c59b0 0x7f1b0c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.216+0000 7f1b1ffff640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b0c005180 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009ac0 tx=0x7f1b0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb8a50c29d7355b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.216+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1802c6b0 con 0x7f1b0c004d00 2023-11-24T06:17:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.216+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1802c810 con 0x7f1b0c004d00 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.216+0000 7f1b1e7fc640 1 -- 172.21.15.37:0/4023070836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1802cba0 con 0x7f1b0c004d00 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.217+0000 7f1b25f97640 1 -- 172.21.15.37:0/4023070836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 msgr2=0x7f1b0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.217+0000 7f1b25f97640 1 --2- 172.21.15.37:0/4023070836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b0c005180 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009ac0 tx=0x7f1b0c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.217+0000 7f1b1ffff640 1 -- 172.21.15.37:0/4023070836 reap_dead start 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.217+0000 7f1b25f97640 1 -- 172.21.15.37:0/4023070836 shutdown_connections 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.217+0000 7f1b25f97640 1 -- 172.21.15.37:0/4023070836 >> 172.21.15.37:0/4023070836 conn(0x7f1b200b0c50 msgr2=0x7f1b200b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.217+0000 7f1b25f97640 1 -- 172.21.15.37:0/4023070836 shutdown_connections 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.217+0000 7f1b25f97640 1 -- 172.21.15.37:0/4023070836 wait complete. 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.219+0000 7f1b25f97640 1 Processor -- start 2023-11-24T06:17:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.219+0000 7f1b25f97640 1 -- start start 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b25f97640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b201589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b25f97640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b20157890 0x7f1b20157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b25f97640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c80a0 0x7f1b200c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b25f97640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c70a0 con 0x7f1b0c004d00 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b25f97640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20158f00 con 0x7f1b20157890 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b25f97640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c6dc0 con 0x7f1b200c80a0 2023-11-24T06:17:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b201589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b1f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b201589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42850/0 (socket says 172.21.15.37:42850) 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.220+0000 7f1b1f7fe640 1 -- 172.21.15.37:0/1893036327 learned_addr learned my addr 172.21.15.37:0/1893036327 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b1f7fe640 1 -- 172.21.15.37:0/1893036327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c80a0 msgr2=0x7f1b200c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b1f7fe640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c80a0 0x7f1b200c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b1f7fe640 1 -- 172.21.15.37:0/1893036327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b20157890 msgr2=0x7f1b20157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b1f7fe640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b20157890 0x7f1b20157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b1f7fe640 1 -- 172.21.15.37:0/1893036327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200c75c0 con 0x7f1b0c004d00 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b1f7fe640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b201589c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1b100046b0 tx=0x7f1b10007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b17fff640 1 -- 172.21.15.37:0/1893036327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10014610 con 0x7f1b0c004d00 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b17fff640 1 -- 172.21.15.37:0/1893036327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1000f050 con 0x7f1b0c004d00 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b17fff640 1 -- 172.21.15.37:0/1893036327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100149b0 con 0x7f1b0c004d00 2023-11-24T06:17:48.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.221+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200c78a0 con 0x7f1b0c004d00 2023-11-24T06:17:48.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.222+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200aebd0 con 0x7f1b0c004d00 2023-11-24T06:17:48.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.223+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b200c7420 con 0x7f1b0c004d00 2023-11-24T06:17:48.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.224+0000 7f1b17fff640 1 -- 172.21.15.37:0/1893036327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f1b10014b10 con 0x7f1b0c004d00 2023-11-24T06:17:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.225+0000 7f1b17fff640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b0006af60 0x7f1b0006d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.225+0000 7f1b17fff640 1 -- 172.21.15.37:0/1893036327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b1008a230 con 0x7f1b0c004d00 2023-11-24T06:17:48.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.225+0000 7f1b1effd640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b0006af60 0x7f1b0006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.226+0000 7f1b1effd640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b0006af60 0x7f1b0006d420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1b080017a0 tx=0x7f1b08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:48.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.229+0000 7f1b17fff640 1 -- 172.21.15.37:0/1893036327 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b200c7420 con 0x7f1b0c004d00 2023-11-24T06:17:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.436+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1b200c7420 con 0x7f1b0c004d00 2023-11-24T06:17:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.437+0000 7f1b17fff640 1 -- 172.21.15.37:0/1893036327 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1b200c7420 con 0x7f1b0c004d00 2023-11-24T06:17:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:17:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b0006af60 msgr2=0x7f1b0006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b0006af60 0x7f1b0006d420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1b080017a0 tx=0x7f1b08009040 comp rx=0 tx=0).stop 2023-11-24T06:17:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 msgr2=0x7f1b201589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b201589c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1b100046b0 tx=0x7f1b10007700 comp rx=0 tx=0).stop 2023-11-24T06:17:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 shutdown_connections 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1b0006af60 0x7f1b0006d420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b20157890 0x7f1b20157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b200c80a0 0x7f1b200c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.439+0000 7f1b25f97640 1 --2- 172.21.15.37:0/1893036327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b0c004d00 0x7f1b201589c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.440+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 >> 172.21.15.37:0/1893036327 conn(0x7f1b200b0c50 msgr2=0x7f1b200cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.440+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 shutdown_connections 2023-11-24T06:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.440+0000 7f1b25f97640 1 -- 172.21.15.37:0/1893036327 wait complete. 2023-11-24T06:17:48.462 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:17:48.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:48.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:17:48.575 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:17:48.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:48.576 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:17:48.629 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:48.629 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:48.687 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:48.687 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:48.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.966+0000 7fde34ee7640 1 Processor -- start 2023-11-24T06:17:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.966+0000 7fde34ee7640 1 -- start start 2023-11-24T06:17:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.967+0000 7fde34ee7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde3015df80 0x7fde300ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.967+0000 7fde34ee7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fde300cd470 0x7fde3015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.967+0000 7fde34ee7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3015ab80 con 0x7fde300b2250 2023-11-24T06:17:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.967+0000 7fde34ee7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3015a990 con 0x7fde300cd470 2023-11-24T06:17:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.967+0000 7fde34ee7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3015e3c0 con 0x7fde3015df80 2023-11-24T06:17:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.968+0000 7fde2ed9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fde300cd470 0x7fde3015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.968+0000 7fde2dd9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde3015df80 0x7fde300ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.968+0000 7fde2e59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fde300b2250 0x7fde300b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:48266/0 (socket says 172.21.15.37:48266) 2023-11-24T06:17:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.968+0000 7fde2e59c640 1 -- 172.21.15.37:0/2887464638 learned_addr learned my addr 172.21.15.37:0/2887464638 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.969+0000 7fde2ed9d640 1 -- 172.21.15.37:0/2887464638 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde3015df80 msgr2=0x7fde300ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.969+0000 7fde2ed9d640 1 --2- 172.21.15.37:0/2887464638 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde3015df80 0x7fde300ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.969+0000 7fde2ed9d640 1 -- 172.21.15.37:0/2887464638 >> v1:172.21.15.188:6789/0 conn(0x7fde300b2250 legacy=0x7fde300b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.969+0000 7fde2ed9d640 1 -- 172.21.15.37:0/2887464638 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300b2d40 con 0x7fde300cd470 2023-11-24T06:17:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.969+0000 7fde2d59a640 1 -- 172.21.15.37:0/2887464638 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705184867 0 0) 0x7fde3015ab80 con 0x7fde300b2250 2023-11-24T06:17:48.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.970+0000 7fde2ed9d640 1 --2- 172.21.15.37:0/2887464638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde300cd470 0x7fde3015b080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde2800ba40 tx=0x7fde2802e080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930ce07218959955 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:48.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.971+0000 7fde2d59a640 1 -- 172.21.15.37:0/2887464638 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2802ee30 con 0x7fde300cd470 2023-11-24T06:17:48.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.971+0000 7fde2d59a640 1 -- 172.21.15.37:0/2887464638 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28036440 con 0x7fde300cd470 2023-11-24T06:17:48.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.971+0000 7fde2d59a640 1 -- 172.21.15.37:0/2887464638 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280367d0 con 0x7fde300cd470 2023-11-24T06:17:48.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 -- 172.21.15.37:0/2887464638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde300cd470 msgr2=0x7fde3015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 --2- 172.21.15.37:0/2887464638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde300cd470 0x7fde3015b080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde2800ba40 tx=0x7fde2802e080 comp rx=0 tx=0).stop 2023-11-24T06:17:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 -- 172.21.15.37:0/2887464638 shutdown_connections 2023-11-24T06:17:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 --2- 172.21.15.37:0/2887464638 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde300cd470 0x7fde3015b080 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 --2- 172.21.15.37:0/2887464638 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde3015df80 0x7fde300ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 -- 172.21.15.37:0/2887464638 >> 172.21.15.37:0/2887464638 conn(0x7fde3006a920 msgr2=0x7fde3006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 -- 172.21.15.37:0/2887464638 shutdown_connections 2023-11-24T06:17:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.972+0000 7fde34ee7640 1 -- 172.21.15.37:0/2887464638 wait complete. 2023-11-24T06:17:48.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.974+0000 7fde34ee7640 1 Processor -- start 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.974+0000 7fde34ee7640 1 -- start start 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde34ee7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde300b2250 0x7fde3009ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde34ee7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde300cd470 0x7fde30099140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde34ee7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde3015df80 0x7fde30152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde34ee7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30099840 con 0x7fde300b2250 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde34ee7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3013f920 con 0x7fde3015df80 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde34ee7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3013fc00 con 0x7fde300cd470 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde300b2250 0x7fde3009ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde300b2250 0x7fde3009ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42856/0 (socket says 172.21.15.37:42856) 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2e59c640 1 -- 172.21.15.37:0/1741816344 learned_addr learned my addr 172.21.15.37:0/1741816344 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2e59c640 1 -- 172.21.15.37:0/1741816344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde300cd470 msgr2=0x7fde30099140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2e59c640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde300cd470 0x7fde30099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2e59c640 1 -- 172.21.15.37:0/1741816344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde3015df80 msgr2=0x7fde30152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2ed9d640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde3015df80 0x7fde30152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.975+0000 7fde2e59c640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde3015df80 0x7fde30152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.976+0000 7fde2e59c640 1 -- 172.21.15.37:0/1741816344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2800b6a0 con 0x7fde300b2250 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.976+0000 7fde2e59c640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde300b2250 0x7fde3009ac60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c4d0 tx=0x7fde2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.976+0000 7fde26ffd640 1 -- 172.21.15.37:0/1741816344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde200074e0 con 0x7fde300b2250 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.976+0000 7fde26ffd640 1 -- 172.21.15.37:0/1741816344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde20007640 con 0x7fde300b2250 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.976+0000 7fde26ffd640 1 -- 172.21.15.37:0/1741816344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20004a20 con 0x7fde300b2250 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.976+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3013fee0 con 0x7fde300b2250 2023-11-24T06:17:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.976+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde30152c40 con 0x7fde300b2250 2023-11-24T06:17:48.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.977+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde30067470 con 0x7fde300b2250 2023-11-24T06:17:48.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.979+0000 7fde26ffd640 1 -- 172.21.15.37:0/1741816344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fde20004b80 con 0x7fde300b2250 2023-11-24T06:17:48.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.980+0000 7fde26ffd640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde1406af60 0x7fde1406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:48.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.980+0000 7fde26ffd640 1 -- 172.21.15.37:0/1741816344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde20088a00 con 0x7fde300b2250 2023-11-24T06:17:48.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.980+0000 7fde2dd9b640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde1406af60 0x7fde1406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:48.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.981+0000 7fde2dd9b640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde1406af60 0x7fde1406d420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fde300cd110 tx=0x7fde1800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:48.984+0000 7fde26ffd640 1 -- 172.21.15.37:0/1741816344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde20053900 con 0x7fde300b2250 2023-11-24T06:17:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.184+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde300cea00 con 0x7fde300b2250 2023-11-24T06:17:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.186+0000 7fde26ffd640 1 -- 172.21.15.37:0/1741816344 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16532 (secure 0 0 0) 0x7fde20018020 con 0x7fde300b2250 2023-11-24T06:17:49.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:49.189 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:33.680484+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde1406af60 msgr2=0x7fde1406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde1406af60 0x7fde1406d420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fde300cd110 tx=0x7fde1800b040 comp rx=0 tx=0).stop 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde300b2250 msgr2=0x7fde3009ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde300b2250 0x7fde3009ac60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c4d0 tx=0x7fde2000c990 comp rx=0 tx=0).stop 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 shutdown_connections 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fde1406af60 0x7fde1406d420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde3015df80 0x7fde30152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde300cd470 0x7fde30099140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 --2- 172.21.15.37:0/1741816344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde300b2250 0x7fde3009ac60 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 >> 172.21.15.37:0/1741816344 conn(0x7fde3006a920 msgr2=0x7fde3015d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:49.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 shutdown_connections 2023-11-24T06:17:49.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.189+0000 7fde34ee7640 1 -- 172.21.15.37:0/1741816344 wait complete. 2023-11-24T06:17:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:17:30.069208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:17:31.179643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:49.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.443+0000 7f21dbfff640 1 Processor -- start 2023-11-24T06:17:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.443+0000 7f21dbfff640 1 -- start start 2023-11-24T06:17:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.444+0000 7f21dbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21dc15d3f0 0x7f21dc0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.444+0000 7f21dbfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d7d0 0x7f21dc0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.444+0000 7f21dbfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f21dc0d0e40 0x7f21dc0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.444+0000 7f21dbfff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc0d15e0 con 0x7f21dc15d3f0 2023-11-24T06:17:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.444+0000 7f21dbfff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc0d0280 con 0x7f21dc0d0e40 2023-11-24T06:17:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.444+0000 7f21dbfff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0d1300 con 0x7f21dc15d7d0 2023-11-24T06:17:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21dc15d3f0 0x7f21dc0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21dc15d3f0 0x7f21dc0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42864/0 (socket says 172.21.15.37:42864) 2023-11-24T06:17:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 -- 172.21.15.37:0/863580395 learned_addr learned my addr 172.21.15.37:0/863580395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21da7fc640 1 --2- 172.21.15.37:0/863580395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d7d0 0x7f21dc0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21db7fe640 1 --2- 172.21.15.37:0/863580395 >> v2:172.21.15.188:3300/0 conn(0x7f21dc0d0e40 0x7f21dc0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 -- 172.21.15.37:0/863580395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d7d0 msgr2=0x7f21dc0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 --2- 172.21.15.37:0/863580395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d7d0 0x7f21dc0d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 -- 172.21.15.37:0/863580395 >> v2:172.21.15.188:3300/0 conn(0x7f21dc0d0e40 msgr2=0x7f21dc0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 --2- 172.21.15.37:0/863580395 >> v2:172.21.15.188:3300/0 conn(0x7f21dc0d0e40 0x7f21dc0afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.445+0000 7f21daffd640 1 -- 172.21.15.37:0/863580395 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0cfc30 con 0x7f21dc15d3f0 2023-11-24T06:17:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.446+0000 7f21daffd640 1 --2- 172.21.15.37:0/863580395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d3f0 0x7f21dc0d1830 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0d0dd0 tx=0x7f21c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ca51ff74753033 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21d9ffb640 1 -- 172.21.15.37:0/863580395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4031870 con 0x7f21dc15d3f0 2023-11-24T06:17:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21d9ffb640 1 -- 172.21.15.37:0/863580395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40319d0 con 0x7f21dc15d3f0 2023-11-24T06:17:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21d9ffb640 1 -- 172.21.15.37:0/863580395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4031d60 con 0x7f21dc15d3f0 2023-11-24T06:17:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21dbfff640 1 -- 172.21.15.37:0/863580395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d3f0 msgr2=0x7f21dc0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21dbfff640 1 --2- 172.21.15.37:0/863580395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d3f0 0x7f21dc0d1830 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0d0dd0 tx=0x7f21c402b910 comp rx=0 tx=0).stop 2023-11-24T06:17:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21dbfff640 1 -- 172.21.15.37:0/863580395 shutdown_connections 2023-11-24T06:17:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21dbfff640 1 --2- 172.21.15.37:0/863580395 >> v2:172.21.15.188:3300/0 conn(0x7f21dc0d0e40 0x7f21dc0afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21dbfff640 1 --2- 172.21.15.37:0/863580395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d7d0 0x7f21dc0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21dbfff640 1 --2- 172.21.15.37:0/863580395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d3f0 0x7f21dc0d1830 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.447+0000 7f21dbfff640 1 -- 172.21.15.37:0/863580395 >> 172.21.15.37:0/863580395 conn(0x7f21dc09c5b0 msgr2=0x7f21dc0d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.448+0000 7f21dbfff640 1 -- 172.21.15.37:0/863580395 shutdown_connections 2023-11-24T06:17:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.448+0000 7f21dbfff640 1 -- 172.21.15.37:0/863580395 wait complete. 2023-11-24T06:17:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.449+0000 7f21dbfff640 1 Processor -- start 2023-11-24T06:17:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.450+0000 7f21dbfff640 1 -- start start 2023-11-24T06:17:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.450+0000 7f21dbfff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21dc0d0e40 0x7f21dc1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21dbfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d3f0 0x7f21dc0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d7d0 0x7f21dc0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21dbfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc15c440 con 0x7f21dc15d7d0 2023-11-24T06:17:49.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21dbfff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0c9ba0 con 0x7f21dc0d0e40 2023-11-24T06:17:49.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21dbfff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0b83e0 con 0x7f21dc15d3f0 2023-11-24T06:17:49.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d7d0 0x7f21dc0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d7d0 0x7f21dc0c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42878/0 (socket says 172.21.15.37:42878) 2023-11-24T06:17:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 -- 172.21.15.37:0/2874349094 learned_addr learned my addr 172.21.15.37:0/2874349094 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21daffd640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21dc0d0e40 0x7f21dc1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 -- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d3f0 msgr2=0x7f21dc0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21da7fc640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d3f0 0x7f21dc0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d3f0 0x7f21dc0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 -- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21dc0d0e40 msgr2=0x7f21dc1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21dc0d0e40 0x7f21dc1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21db7fe640 1 -- 172.21.15.37:0/2874349094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40094d0 con 0x7f21dc15d7d0 2023-11-24T06:17:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.451+0000 7f21daffd640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21dc0d0e40 0x7f21dc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.452+0000 7f21db7fe640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d7d0 0x7f21dc0c8390 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f21d400d5d0 tx=0x7f21d400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.452+0000 7f21d37fe640 1 -- 172.21.15.37:0/2874349094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40125f0 con 0x7f21dc15d7d0 2023-11-24T06:17:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.452+0000 7f21d37fe640 1 -- 172.21.15.37:0/2874349094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4012750 con 0x7f21dc15d7d0 2023-11-24T06:17:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.452+0000 7f21d37fe640 1 -- 172.21.15.37:0/2874349094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4012b00 con 0x7f21dc15d7d0 2023-11-24T06:17:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.452+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc0b86c0 con 0x7f21dc15d7d0 2023-11-24T06:17:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.452+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc0b8c80 con 0x7f21dc15d7d0 2023-11-24T06:17:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.454+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc0d06f0 con 0x7f21dc15d7d0 2023-11-24T06:17:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.454+0000 7f21d37fe640 1 -- 172.21.15.37:0/2874349094 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f21d4012c60 con 0x7f21dc15d7d0 2023-11-24T06:17:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.455+0000 7f21d37fe640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21bc06af60 0x7f21bc06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.455+0000 7f21d37fe640 1 -- 172.21.15.37:0/2874349094 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21d4089d00 con 0x7f21dc15d7d0 2023-11-24T06:17:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.456+0000 7f21daffd640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21bc06af60 0x7f21bc06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.456+0000 7f21daffd640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21bc06af60 0x7f21bc06d420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f21c4036000 tx=0x7f21c403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:49.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.460+0000 7f21d37fe640 1 -- 172.21.15.37:0/2874349094 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21dc0d06f0 con 0x7f21dc15d7d0 2023-11-24T06:17:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.650+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21dc0d06f0 con 0x7f21dc15d7d0 2023-11-24T06:17:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.651+0000 7f21d37fe640 1 -- 172.21.15.37:0/2874349094 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21dc0d06f0 con 0x7f21dc15d7d0 2023-11-24T06:17:49.654 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.654+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21bc06af60 msgr2=0x7f21bc06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.654+0000 7f21dbfff640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21bc06af60 0x7f21bc06d420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f21c4036000 tx=0x7f21c403c040 comp rx=0 tx=0).stop 2023-11-24T06:17:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.654+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d7d0 msgr2=0x7f21dc0c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.654+0000 7f21dbfff640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d7d0 0x7f21dc0c8390 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f21d400d5d0 tx=0x7f21d400da90 comp rx=0 tx=0).stop 2023-11-24T06:17:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.654+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 shutdown_connections 2023-11-24T06:17:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.654+0000 7f21dbfff640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f21bc06af60 0x7f21bc06d420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.655+0000 7f21dbfff640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21dc15d7d0 0x7f21dc0c8390 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.655+0000 7f21dbfff640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21dc15d3f0 0x7f21dc0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.655+0000 7f21dbfff640 1 --2- 172.21.15.37:0/2874349094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21dc0d0e40 0x7f21dc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.655+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 >> 172.21.15.37:0/2874349094 conn(0x7f21dc09c5b0 msgr2=0x7f21dc160360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.655+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 shutdown_connections 2023-11-24T06:17:49.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.655+0000 7f21dbfff640 1 -- 172.21.15.37:0/2874349094 wait complete. 2023-11-24T06:17:49.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:17:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.908+0000 7f7f0a6d1640 1 Processor -- start 2023-11-24T06:17:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.908+0000 7f7f0a6d1640 1 -- start start 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.909+0000 7f7f0a6d1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d3f0 0x7f7f040d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.909+0000 7f7f0a6d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f0415d7d0 0x7f7f040d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.909+0000 7f7f0a6d1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040d15e0 con 0x7f7f040d0e40 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.909+0000 7f7f0a6d1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040d0280 con 0x7f7f0415d7d0 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.909+0000 7f7f0a6d1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040d1300 con 0x7f7f0415d3f0 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f08ece640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f0415d7d0 0x7f7f040d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f08ece640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f0415d7d0 0x7f7f040d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42884/0 (socket says 172.21.15.37:42884) 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f08ece640 1 -- 172.21.15.37:0/1364044077 learned_addr learned my addr 172.21.15.37:0/1364044077 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f096cf640 1 --2- 172.21.15.37:0/1364044077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d3f0 0x7f7f040d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f08ece640 1 -- 172.21.15.37:0/1364044077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d3f0 msgr2=0x7f7f040d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:49.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f08ece640 1 --2- 172.21.15.37:0/1364044077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d3f0 0x7f7f040d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f08ece640 1 -- 172.21.15.37:0/1364044077 >> v1:172.21.15.188:6789/0 conn(0x7f7f040d0e40 legacy=0x7f7f040afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:49.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f08ece640 1 -- 172.21.15.37:0/1364044077 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040cfc30 con 0x7f7f0415d7d0 2023-11-24T06:17:49.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.910+0000 7f7f096cf640 1 --2- 172.21.15.37:0/1364044077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d3f0 0x7f7f040d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.911+0000 7f7f08ece640 1 --2- 172.21.15.37:0/1364044077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d7d0 0x7f7f040d1d70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009870 tx=0x7f7ef402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc109dff1daadc94 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7efbfff640 1 -- 172.21.15.37:0/1364044077 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031640 con 0x7f7f0415d7d0 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7efbfff640 1 -- 172.21.15.37:0/1364044077 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef40317a0 con 0x7f7f0415d7d0 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7efbfff640 1 -- 172.21.15.37:0/1364044077 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4031b30 con 0x7f7f0415d7d0 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/1364044077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d7d0 msgr2=0x7f7f040d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/1364044077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d7d0 0x7f7f040d1d70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009870 tx=0x7f7ef402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/1364044077 shutdown_connections 2023-11-24T06:17:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/1364044077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d7d0 0x7f7f040d1d70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/1364044077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d3f0 0x7f7f040d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/1364044077 >> 172.21.15.37:0/1364044077 conn(0x7f7f0409c5b0 msgr2=0x7f7f040d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:49.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/1364044077 shutdown_connections 2023-11-24T06:17:49.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.912+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/1364044077 wait complete. 2023-11-24T06:17:49.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.914+0000 7f7f0a6d1640 1 Processor -- start 2023-11-24T06:17:49.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.914+0000 7f7f0a6d1640 1 -- start start 2023-11-24T06:17:49.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.915+0000 7f7f0a6d1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f040d0e40 0x7f7f0415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.915+0000 7f7f0a6d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d3f0 0x7f7f0415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.915+0000 7f7f0a6d1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d7d0 0x7f7f041602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.915+0000 7f7f0a6d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0415a8e0 con 0x7f7f0415d3f0 2023-11-24T06:17:49.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.915+0000 7f7f0a6d1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040b2970 con 0x7f7f040d0e40 2023-11-24T06:17:49.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.915+0000 7f7f0a6d1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040b8360 con 0x7f7f0415d7d0 2023-11-24T06:17:49.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.915+0000 7f7f08ece640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d3f0 0x7f7f0415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d3f0 0x7f7f0415fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42892/0 (socket says 172.21.15.37:42892) 2023-11-24T06:17:49.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 -- 172.21.15.37:0/3771367364 learned_addr learned my addr 172.21.15.37:0/3771367364 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f096cf640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f040d0e40 0x7f7f0415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f09ed0640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d7d0 0x7f7f041602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 -- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d7d0 msgr2=0x7f7f041602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d7d0 0x7f7f041602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 -- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f040d0e40 msgr2=0x7f7f0415a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f040d0e40 0x7f7f0415a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 -- 172.21.15.37:0/3771367364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40094d0 con 0x7f7f0415d3f0 2023-11-24T06:17:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.916+0000 7f7f08ece640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d3f0 0x7f7f0415fd80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009870 tx=0x7f7ef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.917+0000 7f7ef9ffb640 1 -- 172.21.15.37:0/3771367364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef403ac60 con 0x7f7f0415d3f0 2023-11-24T06:17:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.917+0000 7f7ef9ffb640 1 -- 172.21.15.37:0/3771367364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef403adc0 con 0x7f7f0415d3f0 2023-11-24T06:17:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.917+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f040b8640 con 0x7f7f0415d3f0 2023-11-24T06:17:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.917+0000 7f7ef9ffb640 1 -- 172.21.15.37:0/3771367364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4044630 con 0x7f7f0415d3f0 2023-11-24T06:17:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.917+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f040b8c00 con 0x7f7f0415d3f0 2023-11-24T06:17:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.918+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0404e840 con 0x7f7f0415d3f0 2023-11-24T06:17:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.919+0000 7f7ef9ffb640 1 -- 172.21.15.37:0/3771367364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f7ef402f050 con 0x7f7f0415d3f0 2023-11-24T06:17:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.920+0000 7f7ef9ffb640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7ee806af90 0x7f7ee806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.921+0000 7f7ef9ffb640 1 -- 172.21.15.37:0/3771367364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ef40ab840 con 0x7f7f0415d3f0 2023-11-24T06:17:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.921+0000 7f7f096cf640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7ee806af90 0x7f7ee806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.922+0000 7f7f096cf640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7ee806af90 0x7f7ee806d450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000a990 tx=0x7f7f00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:49.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:49.925+0000 7f7ef9ffb640 1 -- 172.21.15.37:0/3771367364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ef40766d0 con 0x7f7f0415d3f0 2023-11-24T06:17:50.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.117+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f040c64e0 con 0x7f7f0415d3f0 2023-11-24T06:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.118+0000 7f7ef9ffb640 1 -- 172.21.15.37:0/3771367364 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ef4031e60 con 0x7f7f0415d3f0 2023-11-24T06:17:50.121 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7ee806af90 msgr2=0x7f7ee806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7ee806af90 0x7f7ee806d450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000a990 tx=0x7f7f00008040 comp rx=0 tx=0).stop 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d3f0 msgr2=0x7f7f0415fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d3f0 0x7f7f0415fd80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009870 tx=0x7f7ef40046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 shutdown_connections 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7ee806af90 0x7f7ee806d450 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f0415d7d0 0x7f7f041602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0415d3f0 0x7f7f0415fd80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 --2- 172.21.15.37:0/3771367364 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f040d0e40 0x7f7f0415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 >> 172.21.15.37:0/3771367364 conn(0x7f7f0409c5b0 msgr2=0x7f7f0406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 shutdown_connections 2023-11-24T06:17:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.121+0000 7f7f0a6d1640 1 -- 172.21.15.37:0/3771367364 wait complete. 2023-11-24T06:17:50.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.365+0000 7fb6db46d640 1 Processor -- start 2023-11-24T06:17:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.365+0000 7fb6db46d640 1 -- start start 2023-11-24T06:17:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.367+0000 7fb6db46d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 0x7fb6d4142d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.367+0000 7fb6db46d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d40d0de0 con 0x7fb6d415e4e0 2023-11-24T06:17:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.367+0000 7fb6db46d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d40d10c0 con 0x7fb6d40d1ba0 2023-11-24T06:17:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.367+0000 7fb6db46d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40d13a0 con 0x7fb6d40ce170 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.367+0000 7fb6dac6c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb6d415e4e0 0x7fb6d4140c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57998/0 (socket says 172.21.15.37:57998) 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.367+0000 7fb6dac6c640 1 -- 172.21.15.37:0/3344817695 learned_addr learned my addr 172.21.15.37:0/3344817695 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.367+0000 7fb6da46b640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 0x7fb6d4142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305343003 0 0) 0x7fb6d40d0de0 con 0x7fb6d415e4e0 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6c0003520 con 0x7fb6d415e4e0 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1079354343 0 0) 0x7fb6c0003520 con 0x7fb6d415e4e0 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 msgr2=0x7fb6d4142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 0x7fb6d4142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 >> v1:172.21.15.188:6789/0 conn(0x7fb6d40d1ba0 legacy=0x7fb6d415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d40d1680 con 0x7fb6d415e4e0 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fb6cc001670 con 0x7fb6d415e4e0 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 >> v1:172.21.15.37:6789/0 conn(0x7fb6d415e4e0 legacy=0x7fb6d4140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.368+0000 7fb6d9469640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 0x7fb6c00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9469640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c0003ee0 0x7fb6c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9469640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c0004d00 0x7fb6c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40d13a0 con 0x7fb6c0003ee0 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c000bac0 con 0x7fb6c0004d00 2023-11-24T06:17:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c000bc80 con 0x7fb6d40ce170 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9c6a640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c0003ee0 0x7fb6c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6da46b640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 0x7fb6c00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6dac6c640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c0004d00 0x7fb6c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9c6a640 1 -- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 msgr2=0x7fb6c00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9c6a640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ce170 0x7fb6c00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9c6a640 1 -- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c0004d00 msgr2=0x7fb6c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9c6a640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c0004d00 0x7fb6c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.369+0000 7fb6d9c6a640 1 -- 172.21.15.37:0/3344817695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0003520 con 0x7fb6c0003ee0 2023-11-24T06:17:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.371+0000 7fb6d9c6a640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c0003ee0 0x7fb6c00047c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4001f60 tx=0x7fb6c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbd5e64ec0b564d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.371+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c402d6f0 con 0x7fb6c0003ee0 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.371+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c402d870 con 0x7fb6c0003ee0 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.371+0000 7fb6d9469640 1 -- 172.21.15.37:0/3344817695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c402dc60 con 0x7fb6c0003ee0 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.371+0000 7fb6db46d640 1 -- 172.21.15.37:0/3344817695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c0003ee0 msgr2=0x7fb6c00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.371+0000 7fb6db46d640 1 --2- 172.21.15.37:0/3344817695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6c0003ee0 0x7fb6c00047c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4001f60 tx=0x7fb6c00057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.372+0000 7fb6dac6c640 1 -- 172.21.15.37:0/3344817695 reap_dead start 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.372+0000 7fb6db46d640 1 -- 172.21.15.37:0/3344817695 shutdown_connections 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.372+0000 7fb6db46d640 1 -- 172.21.15.37:0/3344817695 >> 172.21.15.37:0/3344817695 conn(0x7fb6d4060f20 msgr2=0x7fb6d4061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.372+0000 7fb6db46d640 1 -- 172.21.15.37:0/3344817695 shutdown_connections 2023-11-24T06:17:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.372+0000 7fb6db46d640 1 -- 172.21.15.37:0/3344817695 wait complete. 2023-11-24T06:17:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.374+0000 7fb6db46d640 1 Processor -- start 2023-11-24T06:17:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.374+0000 7fb6db46d640 1 -- start start 2023-11-24T06:17:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6db46d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6d41f2820 0x7fb6d40ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6db46d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ca640 0x7fb6d41f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6db46d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d41f6a00 0x7fb6d40c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6db46d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4144680 con 0x7fb6d41f6a00 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6db46d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40caac0 con 0x7fb6d41f2820 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6db46d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d41f71f0 con 0x7fb6d40ca640 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d41f6a00 0x7fb6d40c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d41f6a00 0x7fb6d40c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42912/0 (socket says 172.21.15.37:42912) 2023-11-24T06:17:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 -- 172.21.15.37:0/3758851694 learned_addr learned my addr 172.21.15.37:0/3758851694 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6da46b640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6d41f2820 0x7fb6d40ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 -- 172.21.15.37:0/3758851694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ca640 msgr2=0x7fb6d41f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ca640 0x7fb6d41f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 -- 172.21.15.37:0/3758851694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6d41f2820 msgr2=0x7fb6d40ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6d41f2820 0x7fb6d40ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.375+0000 7fb6dac6c640 1 -- 172.21.15.37:0/3758851694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4143fc0 con 0x7fb6d41f6a00 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.376+0000 7fb6dac6c640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d41f6a00 0x7fb6d40c8190 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb6d415e8c0 tx=0x7fb6cc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.376+0000 7fb6caffd640 1 -- 172.21.15.37:0/3758851694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc00eed0 con 0x7fb6d41f6a00 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.376+0000 7fb6caffd640 1 -- 172.21.15.37:0/3758851694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc00c610 con 0x7fb6d41f6a00 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.376+0000 7fb6caffd640 1 -- 172.21.15.37:0/3758851694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc00c9a0 con 0x7fb6d41f6a00 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.376+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d41442a0 con 0x7fb6d41f6a00 2023-11-24T06:17:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.376+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d41f2c00 con 0x7fb6d41f6a00 2023-11-24T06:17:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.378+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d404e840 con 0x7fb6d41f6a00 2023-11-24T06:17:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.378+0000 7fb6caffd640 1 -- 172.21.15.37:0/3758851694 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fb6cc00cb00 con 0x7fb6d41f6a00 2023-11-24T06:17:50.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.380+0000 7fb6caffd640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb6b806af60 0x7fb6b806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.380+0000 7fb6caffd640 1 -- 172.21.15.37:0/3758851694 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6cc089380 con 0x7fb6d41f6a00 2023-11-24T06:17:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.380+0000 7fb6da46b640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb6b806af60 0x7fb6b806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.381+0000 7fb6da46b640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb6b806af60 0x7fb6b806d420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009950 tx=0x7fb6d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:50.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.384+0000 7fb6caffd640 1 -- 172.21.15.37:0/3758851694 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6cc054310 con 0x7fb6d41f6a00 2023-11-24T06:17:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.582+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6d406f0a0 con 0x7fb6d41f6a00 2023-11-24T06:17:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.583+0000 7fb6caffd640 1 -- 172.21.15.37:0/3758851694 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb6cc05ce60 con 0x7fb6d41f6a00 2023-11-24T06:17:50.586 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:17:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb6b806af60 msgr2=0x7fb6b806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb6b806af60 0x7fb6b806d420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009950 tx=0x7fb6d0008040 comp rx=0 tx=0).stop 2023-11-24T06:17:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d41f6a00 msgr2=0x7fb6d40c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d41f6a00 0x7fb6d40c8190 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb6d415e8c0 tx=0x7fb6cc00eb90 comp rx=0 tx=0).stop 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 shutdown_connections 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb6b806af60 0x7fb6b806d420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d41f6a00 0x7fb6d40c8190 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6d40ca640 0x7fb6d41f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 --2- 172.21.15.37:0/3758851694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6d41f2820 0x7fb6d40ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.585+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 >> 172.21.15.37:0/3758851694 conn(0x7fb6d4060f20 msgr2=0x7fb6d40cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.586+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 shutdown_connections 2023-11-24T06:17:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.586+0000 7fb6db46d640 1 -- 172.21.15.37:0/3758851694 wait complete. 2023-11-24T06:17:50.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:17:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.836+0000 7f884f7be640 1 Processor -- start 2023-11-24T06:17:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.836+0000 7f884f7be640 1 -- start start 2023-11-24T06:17:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.838+0000 7f884f7be640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8848072160 0x7f884815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.838+0000 7f884f7be640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88480c49f0 0x7f884806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.838+0000 7f884f7be640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884815ec90 con 0x7f884806dc40 2023-11-24T06:17:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.838+0000 7f884f7be640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884806e0f0 con 0x7f8848072160 2023-11-24T06:17:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.838+0000 7f884f7be640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88480cd530 con 0x7f88480c49f0 2023-11-24T06:17:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.838+0000 7f884d55a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8848072160 0x7f884815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884dd5b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f884806dc40 0x7f88480cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52258/0 (socket says 172.21.15.37:52258) 2023-11-24T06:17:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884dd5b640 1 -- 172.21.15.37:0/2892951225 learned_addr learned my addr 172.21.15.37:0/2892951225 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884cd59640 1 --2- 172.21.15.37:0/2892951225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88480c49f0 0x7f884806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884d55a640 1 -- 172.21.15.37:0/2892951225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88480c49f0 msgr2=0x7f884806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884d55a640 1 --2- 172.21.15.37:0/2892951225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88480c49f0 0x7f884806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884d55a640 1 -- 172.21.15.37:0/2892951225 >> v1:172.21.15.37:6789/0 conn(0x7f884806dc40 legacy=0x7f88480cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884d55a640 1 -- 172.21.15.37:0/2892951225 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480c4ed0 con 0x7f8848072160 2023-11-24T06:17:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f884cd59640 1 --2- 172.21.15.37:0/2892951225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88480c49f0 0x7f884806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.839+0000 7f883ffff640 1 -- 172.21.15.37:0/2892951225 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42182598 0 0) 0x7f8840001490 con 0x7f884806dc40 2023-11-24T06:17:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.840+0000 7f884d55a640 1 --2- 172.21.15.37:0/2892951225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8848072160 0x7f884815e750 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f88440097a0 tx=0x7f884402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47ed0d4d188c707 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f883ffff640 1 -- 172.21.15.37:0/2892951225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884402d040 con 0x7f8848072160 2023-11-24T06:17:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f883ffff640 1 -- 172.21.15.37:0/2892951225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844031810 con 0x7f8848072160 2023-11-24T06:17:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f883ffff640 1 -- 172.21.15.37:0/2892951225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844031ba0 con 0x7f8848072160 2023-11-24T06:17:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 -- 172.21.15.37:0/2892951225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8848072160 msgr2=0x7f884815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 --2- 172.21.15.37:0/2892951225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8848072160 0x7f884815e750 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f88440097a0 tx=0x7f884402b8b0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 -- 172.21.15.37:0/2892951225 shutdown_connections 2023-11-24T06:17:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 --2- 172.21.15.37:0/2892951225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88480c49f0 0x7f884806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 --2- 172.21.15.37:0/2892951225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8848072160 0x7f884815e750 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 -- 172.21.15.37:0/2892951225 >> 172.21.15.37:0/2892951225 conn(0x7f88480b0c50 msgr2=0x7f88480b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 -- 172.21.15.37:0/2892951225 shutdown_connections 2023-11-24T06:17:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.841+0000 7f884f7be640 1 -- 172.21.15.37:0/2892951225 wait complete. 2023-11-24T06:17:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.843+0000 7f884f7be640 1 Processor -- start 2023-11-24T06:17:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.843+0000 7f884f7be640 1 -- start start 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.844+0000 7f884f7be640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884806dc40 0x7f88481f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.844+0000 7f884f7be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8848072160 0x7f884809a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.844+0000 7f884f7be640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88480c49f0 0x7f88481efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.844+0000 7f884f7be640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481f30c0 con 0x7f88480c49f0 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.844+0000 7f884f7be640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481f1fb0 con 0x7f8848072160 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.844+0000 7f884f7be640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88481eeb70 con 0x7f884806dc40 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.844+0000 7f884dd5b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88480c49f0 0x7f88481efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88480c49f0 0x7f88481efc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38416/0 (socket says 172.21.15.37:38416) 2023-11-24T06:17:50.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 -- 172.21.15.37:0/368086884 learned_addr learned my addr 172.21.15.37:0/368086884 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884cd59640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8848072160 0x7f884809a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884d55a640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884806dc40 0x7f88481f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 -- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884806dc40 msgr2=0x7f88481f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884806dc40 0x7f88481f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 -- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8848072160 msgr2=0x7f884809a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8848072160 0x7f884809a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 -- 172.21.15.37:0/368086884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009400 con 0x7f88480c49f0 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f884dd5b640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88480c49f0 0x7f88481efc80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f884000c7f0 tx=0x7f884000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.845+0000 7f883dffb640 1 -- 172.21.15.37:0/368086884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000a5e0 con 0x7f88480c49f0 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.846+0000 7f883dffb640 1 -- 172.21.15.37:0/368086884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884000a760 con 0x7f88480c49f0 2023-11-24T06:17:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.846+0000 7f883dffb640 1 -- 172.21.15.37:0/368086884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000ab50 con 0x7f88480c49f0 2023-11-24T06:17:50.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.846+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884809a900 con 0x7f88480c49f0 2023-11-24T06:17:50.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.846+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88481f2820 con 0x7f88480c49f0 2023-11-24T06:17:50.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.847+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88481eece0 con 0x7f88480c49f0 2023-11-24T06:17:50.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.848+0000 7f883dffb640 1 -- 172.21.15.37:0/368086884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f884000acb0 con 0x7f88480c49f0 2023-11-24T06:17:50.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.849+0000 7f883dffb640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f882c06af60 0x7f882c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:50.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.849+0000 7f883dffb640 1 -- 172.21.15.37:0/368086884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8840088b90 con 0x7f88480c49f0 2023-11-24T06:17:50.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.849+0000 7f884d55a640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f882c06af60 0x7f882c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:50.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.850+0000 7f884d55a640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f882c06af60 0x7f882c06d420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8844036000 tx=0x7f8844008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:50.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:50.854+0000 7f883dffb640 1 -- 172.21.15.37:0/368086884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88481eece0 con 0x7f88480c49f0 2023-11-24T06:17:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.068+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f884815ec90 con 0x7f88480c49f0 2023-11-24T06:17:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.069+0000 7f883dffb640 1 -- 172.21.15.37:0/368086884 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f884815ec90 con 0x7f88480c49f0 2023-11-24T06:17:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-11-24T06:17:51.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f882c06af60 msgr2=0x7f882c06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:51.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f882c06af60 0x7f882c06d420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8844036000 tx=0x7f8844008030 comp rx=0 tx=0).stop 2023-11-24T06:17:51.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88480c49f0 msgr2=0x7f88481efc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:51.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88480c49f0 0x7f88481efc80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f884000c7f0 tx=0x7f884000ccb0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 shutdown_connections 2023-11-24T06:17:51.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f882c06af60 0x7f882c06d420 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8848072160 0x7f884809a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88480c49f0 0x7f88481efc80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 --2- 172.21.15.37:0/368086884 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884806dc40 0x7f88481f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.071+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 >> 172.21.15.37:0/368086884 conn(0x7f88480b0c50 msgr2=0x7f88480ac820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:51.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.072+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 shutdown_connections 2023-11-24T06:17:51.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.072+0000 7f884f7be640 1 -- 172.21.15.37:0/368086884 wait complete. 2023-11-24T06:17:51.093 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:17:51.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:51.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:17:51.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:17:51.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:17:51.211 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:17:51.264 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:17:51.264 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:51.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:17:51.328 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:17:51.328 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:17:51.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:17:51.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.621+0000 7f7a78850640 1 Processor -- start 2023-11-24T06:17:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.621+0000 7f7a78850640 1 -- start start 2023-11-24T06:17:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a78850640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a74144b30 0x7f7a7415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a78850640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a740b1de0 0x7f7a740b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a78850640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7415bf80 con 0x7f7a7415c410 2023-11-24T06:17:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a78850640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740b27b0 con 0x7f7a740b1de0 2023-11-24T06:17:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a78850640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740b1560 con 0x7f7a74144b30 2023-11-24T06:17:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a7359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a740b1de0 0x7f7a740b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a7359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a740b1de0 0x7f7a740b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38428/0 (socket says 172.21.15.37:38428) 2023-11-24T06:17:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.623+0000 7f7a7359e640 1 -- 172.21.15.37:0/74548945 learned_addr learned my addr 172.21.15.37:0/74548945 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.624+0000 7f7a72d9d640 1 --2- 172.21.15.37:0/74548945 >> v2:172.21.15.188:3300/0 conn(0x7f7a74144b30 0x7f7a7415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.624+0000 7f7a7359e640 1 -- 172.21.15.37:0/74548945 >> v2:172.21.15.188:3300/0 conn(0x7f7a74144b30 msgr2=0x7f7a7415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.624+0000 7f7a7359e640 1 --2- 172.21.15.37:0/74548945 >> v2:172.21.15.188:3300/0 conn(0x7f7a74144b30 0x7f7a7415f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.624+0000 7f7a7359e640 1 -- 172.21.15.37:0/74548945 >> v1:172.21.15.188:6789/0 conn(0x7f7a7415c410 legacy=0x7f7a740b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.624+0000 7f7a7359e640 1 -- 172.21.15.37:0/74548945 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740b1280 con 0x7f7a740b1de0 2023-11-24T06:17:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.625+0000 7f7a7359e640 1 --2- 172.21.15.37:0/74548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a740b2270 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7a7406f690 tx=0x7f7a6c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14f9193588206bd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a7259c640 1 -- 172.21.15.37:0/74548945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c02cb20 con 0x7f7a740b1de0 2023-11-24T06:17:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a7259c640 1 -- 172.21.15.37:0/74548945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c02cc80 con 0x7f7a740b1de0 2023-11-24T06:17:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a7259c640 1 -- 172.21.15.37:0/74548945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c0343f0 con 0x7f7a740b1de0 2023-11-24T06:17:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a78850640 1 -- 172.21.15.37:0/74548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 msgr2=0x7f7a740b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a78850640 1 --2- 172.21.15.37:0/74548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a740b2270 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7a7406f690 tx=0x7f7a6c02bf80 comp rx=0 tx=0).stop 2023-11-24T06:17:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a78850640 1 -- 172.21.15.37:0/74548945 shutdown_connections 2023-11-24T06:17:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a78850640 1 --2- 172.21.15.37:0/74548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a740b2270 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a78850640 1 --2- 172.21.15.37:0/74548945 >> v2:172.21.15.188:3300/0 conn(0x7f7a74144b30 0x7f7a7415f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a78850640 1 -- 172.21.15.37:0/74548945 >> 172.21.15.37:0/74548945 conn(0x7f7a740cb830 msgr2=0x7f7a740cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.626+0000 7f7a78850640 1 -- 172.21.15.37:0/74548945 shutdown_connections 2023-11-24T06:17:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.627+0000 7f7a78850640 1 -- 172.21.15.37:0/74548945 wait complete. 2023-11-24T06:17:51.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.629+0000 7f7a78850640 1 Processor -- start 2023-11-24T06:17:51.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.629+0000 7f7a78850640 1 -- start start 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.630+0000 7f7a78850640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a7413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.630+0000 7f7a78850640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a74144b30 0x7f7a7406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.630+0000 7f7a78850640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7415c410 0x7f7a74142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.630+0000 7f7a78850640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7415a840 con 0x7f7a740b1de0 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.630+0000 7f7a78850640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7406d470 con 0x7f7a74144b30 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.630+0000 7f7a78850640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a741391c0 con 0x7f7a7415c410 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a7413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a7413f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38444/0 (socket says 172.21.15.37:38444) 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 -- 172.21.15.37:0/2302946175 learned_addr learned my addr 172.21.15.37:0/2302946175 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a6a59c640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a74144b30 0x7f7a7406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a7359e640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7415c410 0x7f7a74142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 -- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7415c410 msgr2=0x7f7a74142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7415c410 0x7f7a74142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 -- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a74144b30 msgr2=0x7f7a7406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a74144b30 0x7f7a7406cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a72d9d640 1 -- 172.21.15.37:0/2302946175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c009b30 con 0x7f7a740b1de0 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.631+0000 7f7a6a59c640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a74144b30 0x7f7a7406cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.632+0000 7f7a72d9d640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a7413f270 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400d800 tx=0x7f7a6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.632+0000 7f7a6bfff640 1 -- 172.21.15.37:0/2302946175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400b6c0 con 0x7f7a740b1de0 2023-11-24T06:17:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.632+0000 7f7a6bfff640 1 -- 172.21.15.37:0/2302946175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6400b820 con 0x7f7a740b1de0 2023-11-24T06:17:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.632+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a741394a0 con 0x7f7a740b1de0 2023-11-24T06:17:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.632+0000 7f7a6bfff640 1 -- 172.21.15.37:0/2302946175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400bbb0 con 0x7f7a740b1de0 2023-11-24T06:17:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.632+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a741430a0 con 0x7f7a740b1de0 2023-11-24T06:17:51.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.633+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a741432c0 con 0x7f7a740b1de0 2023-11-24T06:17:51.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.634+0000 7f7a6bfff640 1 -- 172.21.15.37:0/2302946175 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f7a6400bd10 con 0x7f7a740b1de0 2023-11-24T06:17:51.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.635+0000 7f7a6bfff640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a5406af90 0x7f7a5406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:51.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.635+0000 7f7a6bfff640 1 -- 172.21.15.37:0/2302946175 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a64089ce0 con 0x7f7a740b1de0 2023-11-24T06:17:51.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.635+0000 7f7a6a59c640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a5406af90 0x7f7a5406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:51.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.636+0000 7f7a6a59c640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a5406af90 0x7f7a5406d450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a74071740 tx=0x7f7a5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.639+0000 7f7a6bfff640 1 -- 172.21.15.37:0/2302946175 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a64054c70 con 0x7f7a740b1de0 2023-11-24T06:17:51.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.875+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a7404e840 con 0x7f7a740b1de0 2023-11-24T06:17:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.876+0000 7f7a6bfff640 1 -- 172.21.15.37:0/2302946175 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f7a64058290 con 0x7f7a740b1de0 2023-11-24T06:17:51.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:51.879 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2892400858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2892400858},{"type":"v1","addr":"172.21.15.188:6835","nonce":2892400858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":4961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/4008465884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":4008465884},{"type":"v1","addr":"172.21.15.37:6837","nonce":4008465884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/2245601301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":2245601301},{"type":"v1","addr":"172.21.15.188:6834","nonce":2245601301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:17:32.142253+0000","modified":"2023-11-24T06:17:35.237267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6836/2581426871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2581426871},{"type":"v1","addr":"172.21.15.37:6836","nonce":2581426871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:17:51.880 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 41 2023-11-24T06:17:51.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a5406af90 msgr2=0x7f7a5406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:51.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a5406af90 0x7f7a5406d450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a74071740 tx=0x7f7a5c009040 comp rx=0 tx=0).stop 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 msgr2=0x7f7a7413f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a7413f270 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400d800 tx=0x7f7a6400dcc0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 shutdown_connections 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7a5406af90 0x7f7a5406d450 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a74144b30 0x7f7a7406cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7415c410 0x7f7a74142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 --2- 172.21.15.37:0/2302946175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a740b1de0 0x7f7a7413f270 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.879+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 >> 172.21.15.37:0/2302946175 conn(0x7f7a740cb830 msgr2=0x7f7a7415de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.880+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 shutdown_connections 2023-11-24T06:17:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:51.880+0000 7f7a78850640 1 -- 172.21.15.37:0/2302946175 wait complete. 2023-11-24T06:17:51.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.120+0000 7f85acdac640 1 Processor -- start 2023-11-24T06:17:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.120+0000 7f85acdac640 1 -- start start 2023-11-24T06:17:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.121+0000 7f85acdac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85a815d4e0 0x7f85a80d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.121+0000 7f85acdac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f85a80d38e0 0x7f85a80cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.121+0000 7f85acdac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80ce990 con 0x7f85a80d0070 2023-11-24T06:17:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.121+0000 7f85acdac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80d4110 con 0x7f85a815d4e0 2023-11-24T06:17:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.121+0000 7f85acdac640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80d04e0 con 0x7f85a80d38e0 2023-11-24T06:17:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85a815d4e0 0x7f85a80d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85a80d0070 0x7f85a80d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52270/0 (socket says 172.21.15.37:52270) 2023-11-24T06:17:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a7fff640 1 -- 172.21.15.37:0/790342452 learned_addr learned my addr 172.21.15.37:0/790342452 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a6ffd640 1 --2- 172.21.15.37:0/790342452 >> v2:172.21.15.188:3300/0 conn(0x7f85a80d38e0 0x7f85a80cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a77fe640 1 -- 172.21.15.37:0/790342452 >> v2:172.21.15.188:3300/0 conn(0x7f85a80d38e0 msgr2=0x7f85a80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a67fc640 1 -- 172.21.15.37:0/790342452 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801540339 0 0) 0x7f85a80ce990 con 0x7f85a80d0070 2023-11-24T06:17:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a77fe640 1 --2- 172.21.15.37:0/790342452 >> v2:172.21.15.188:3300/0 conn(0x7f85a80d38e0 0x7f85a80cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a77fe640 1 -- 172.21.15.37:0/790342452 >> v1:172.21.15.37:6789/0 conn(0x7f85a80d0070 legacy=0x7f85a80d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.122+0000 7f85a77fe640 1 -- 172.21.15.37:0/790342452 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80cec70 con 0x7f85a815d4e0 2023-11-24T06:17:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.124+0000 7f85a77fe640 1 --2- 172.21.15.37:0/790342452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a815d4e0 0x7f85a80d1e20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f85a80b9280 tx=0x7f859802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94010c8751b95907 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.124+0000 7f85a67fc640 1 -- 172.21.15.37:0/790342452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859802cc60 con 0x7f85a815d4e0 2023-11-24T06:17:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.124+0000 7f85a67fc640 1 -- 172.21.15.37:0/790342452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859802cdc0 con 0x7f85a815d4e0 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.124+0000 7f85a67fc640 1 -- 172.21.15.37:0/790342452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598034660 con 0x7f85a815d4e0 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.124+0000 7f85acdac640 1 -- 172.21.15.37:0/790342452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a815d4e0 msgr2=0x7f85a80d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.124+0000 7f85acdac640 1 --2- 172.21.15.37:0/790342452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a815d4e0 0x7f85a80d1e20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f85a80b9280 tx=0x7f859802beb0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.125+0000 7f85acdac640 1 -- 172.21.15.37:0/790342452 shutdown_connections 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.125+0000 7f85acdac640 1 --2- 172.21.15.37:0/790342452 >> v2:172.21.15.188:3300/0 conn(0x7f85a80d38e0 0x7f85a80cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.125+0000 7f85acdac640 1 --2- 172.21.15.37:0/790342452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a815d4e0 0x7f85a80d1e20 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.125+0000 7f85acdac640 1 -- 172.21.15.37:0/790342452 >> 172.21.15.37:0/790342452 conn(0x7f85a809c510 msgr2=0x7f85a80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.125+0000 7f85acdac640 1 -- 172.21.15.37:0/790342452 shutdown_connections 2023-11-24T06:17:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.125+0000 7f85acdac640 1 -- 172.21.15.37:0/790342452 wait complete. 2023-11-24T06:17:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.127+0000 7f85acdac640 1 Processor -- start 2023-11-24T06:17:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.127+0000 7f85acdac640 1 -- start start 2023-11-24T06:17:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85acdac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80d0070 0x7f85a80cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85acdac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a80d38e0 0x7f85a80b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85acdac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a815d4e0 0x7f85a80b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85acdac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80b6bb0 con 0x7f85a80d38e0 2023-11-24T06:17:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85acdac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80ccce0 con 0x7f85a815d4e0 2023-11-24T06:17:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85acdac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80b8b30 con 0x7f85a80d0070 2023-11-24T06:17:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a80d38e0 0x7f85a80b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a80d38e0 0x7f85a80b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38456/0 (socket says 172.21.15.37:38456) 2023-11-24T06:17:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85a6ffd640 1 -- 172.21.15.37:0/3289557032 learned_addr learned my addr 172.21.15.37:0/3289557032 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85a6ffd640 1 -- 172.21.15.37:0/3289557032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80d0070 msgr2=0x7f85a80cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85a6ffd640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80d0070 0x7f85a80cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.128+0000 7f85a6ffd640 1 -- 172.21.15.37:0/3289557032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a815d4e0 msgr2=0x7f85a80b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f85a6ffd640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a815d4e0 0x7f85a80b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f85a6ffd640 1 -- 172.21.15.37:0/3289557032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598009a70 con 0x7f85a80d38e0 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f85a6ffd640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a80d38e0 0x7f85a80b7f70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f859c00d800 tx=0x7f859c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f858ffff640 1 -- 172.21.15.37:0/3289557032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c00b6c0 con 0x7f85a80d38e0 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f858ffff640 1 -- 172.21.15.37:0/3289557032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c00b820 con 0x7f85a80d38e0 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f858ffff640 1 -- 172.21.15.37:0/3289557032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c00bbb0 con 0x7f85a80d38e0 2023-11-24T06:17:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a815e490 con 0x7f85a80d38e0 2023-11-24T06:17:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.129+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a815ea50 con 0x7f85a80d38e0 2023-11-24T06:17:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.131+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a815ec10 con 0x7f85a80d38e0 2023-11-24T06:17:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.132+0000 7f858ffff640 1 -- 172.21.15.37:0/3289557032 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f859c00bd10 con 0x7f85a80d38e0 2023-11-24T06:17:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.133+0000 7f858ffff640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f859406af60 0x7f859406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.133+0000 7f858ffff640 1 -- 172.21.15.37:0/3289557032 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f859c089d10 con 0x7f85a80d38e0 2023-11-24T06:17:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.133+0000 7f85a77fe640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f859406af60 0x7f859406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.134+0000 7f85a77fe640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f859406af60 0x7f859406d420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8598036000 tx=0x7f859802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.137+0000 7f858ffff640 1 -- 172.21.15.37:0/3289557032 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f859c054cb0 con 0x7f85a80d38e0 2023-11-24T06:17:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.331+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85a815e2f0 con 0x7f85a80d38e0 2023-11-24T06:17:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.334+0000 7f858ffff640 1 -- 172.21.15.37:0/3289557032 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f85a815e2f0 con 0x7f85a80d38e0 2023-11-24T06:17:52.337 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:52.338 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:33.680484+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:52.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.337+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f859406af60 msgr2=0x7f859406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.337+0000 7f85acdac640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f859406af60 0x7f859406d420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8598036000 tx=0x7f859802e000 comp rx=0 tx=0).stop 2023-11-24T06:17:52.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a80d38e0 msgr2=0x7f85a80b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a80d38e0 0x7f85a80b7f70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f859c00d800 tx=0x7f859c00dcc0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 shutdown_connections 2023-11-24T06:17:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f859406af60 0x7f859406d420 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a815d4e0 0x7f85a80b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85a80d38e0 0x7f85a80b7f70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 --2- 172.21.15.37:0/3289557032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80d0070 0x7f85a80cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 >> 172.21.15.37:0/3289557032 conn(0x7f85a809c510 msgr2=0x7f85a80b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 shutdown_connections 2023-11-24T06:17:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.338+0000 7f85acdac640 1 -- 172.21.15.37:0/3289557032 wait complete. 2023-11-24T06:17:52.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:14:38.894675+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:17:30.069208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:17:31.179643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:17:52.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:17:52.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.581+0000 7fd636cef640 1 Processor -- start 2023-11-24T06:17:52.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.581+0000 7fd636cef640 1 -- start start 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.583+0000 7fd636cef640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd63015d3f0 0x7fd6300d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.583+0000 7fd636cef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd63015d7d0 0x7fd6300d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.583+0000 7fd636cef640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6300d15e0 con 0x7fd6300d0e40 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.583+0000 7fd636cef640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6300d0280 con 0x7fd63015d3f0 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.583+0000 7fd636cef640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6300d1300 con 0x7fd63015d7d0 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd635ced640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd63015d3f0 0x7fd6300d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd6364ee640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd6300d0e40 0x7fd6300afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52286/0 (socket says 172.21.15.37:52286) 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd6364ee640 1 -- 172.21.15.37:0/2668505342 learned_addr learned my addr 172.21.15.37:0/2668505342 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd6354ec640 1 --2- 172.21.15.37:0/2668505342 >> v2:172.21.15.188:3300/0 conn(0x7fd63015d7d0 0x7fd6300d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd634ceb640 1 -- 172.21.15.37:0/2668505342 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864213726 0 0) 0x7fd6300d15e0 con 0x7fd6300d0e40 2023-11-24T06:17:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd635ced640 1 -- 172.21.15.37:0/2668505342 >> v2:172.21.15.188:3300/0 conn(0x7fd63015d7d0 msgr2=0x7fd6300d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd635ced640 1 --2- 172.21.15.37:0/2668505342 >> v2:172.21.15.188:3300/0 conn(0x7fd63015d7d0 0x7fd6300d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd635ced640 1 -- 172.21.15.37:0/2668505342 >> v1:172.21.15.37:6789/0 conn(0x7fd6300d0e40 legacy=0x7fd6300afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd635ced640 1 -- 172.21.15.37:0/2668505342 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6300cfc30 con 0x7fd63015d3f0 2023-11-24T06:17:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.584+0000 7fd6354ec640 1 --2- 172.21.15.37:0/2668505342 >> v2:172.21.15.188:3300/0 conn(0x7fd63015d7d0 0x7fd6300d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:52.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.585+0000 7fd635ced640 1 --2- 172.21.15.37:0/2668505342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300d1830 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd630067bd0 tx=0x7fd62c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb4e2577a1f05a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:52.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.586+0000 7fd634ceb640 1 -- 172.21.15.37:0/2668505342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c031830 con 0x7fd63015d3f0 2023-11-24T06:17:52.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.586+0000 7fd634ceb640 1 -- 172.21.15.37:0/2668505342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c031990 con 0x7fd63015d3f0 2023-11-24T06:17:52.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.586+0000 7fd634ceb640 1 -- 172.21.15.37:0/2668505342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c031d20 con 0x7fd63015d3f0 2023-11-24T06:17:52.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.586+0000 7fd636cef640 1 -- 172.21.15.37:0/2668505342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 msgr2=0x7fd6300d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.586+0000 7fd636cef640 1 --2- 172.21.15.37:0/2668505342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300d1830 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd630067bd0 tx=0x7fd62c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.586+0000 7fd636cef640 1 -- 172.21.15.37:0/2668505342 shutdown_connections 2023-11-24T06:17:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.587+0000 7fd636cef640 1 --2- 172.21.15.37:0/2668505342 >> v2:172.21.15.188:3300/0 conn(0x7fd63015d7d0 0x7fd6300d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.587+0000 7fd636cef640 1 --2- 172.21.15.37:0/2668505342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300d1830 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.587+0000 7fd636cef640 1 -- 172.21.15.37:0/2668505342 >> 172.21.15.37:0/2668505342 conn(0x7fd63009c5b0 msgr2=0x7fd6300d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.587+0000 7fd636cef640 1 -- 172.21.15.37:0/2668505342 shutdown_connections 2023-11-24T06:17:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.587+0000 7fd636cef640 1 -- 172.21.15.37:0/2668505342 wait complete. 2023-11-24T06:17:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.588+0000 7fd636cef640 1 Processor -- start 2023-11-24T06:17:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.589+0000 7fd636cef640 1 -- start start 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd636cef640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6300d0e40 0x7fd630159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd636cef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd636cef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd63015d7d0 0x7fd6300b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd636cef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300b8cf0 con 0x7fd63015d3f0 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd636cef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63015a040 con 0x7fd63015d7d0 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd636cef640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300b6400 con 0x7fd6300d0e40 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38476/0 (socket says 172.21.15.37:38476) 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 -- 172.21.15.37:0/2550019593 learned_addr learned my addr 172.21.15.37:0/2550019593 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 -- 172.21.15.37:0/2550019593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6300d0e40 msgr2=0x7fd630159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6300d0e40 0x7fd630159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 -- 172.21.15.37:0/2550019593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd63015d7d0 msgr2=0x7fd6300b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd63015d7d0 0x7fd6300b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.590+0000 7fd6354ec640 1 -- 172.21.15.37:0/2550019593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c009400 con 0x7fd63015d3f0 2023-11-24T06:17:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.591+0000 7fd6354ec640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300b8270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c7c0 tx=0x7fd62000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.591+0000 7fd6267fc640 1 -- 172.21.15.37:0/2550019593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620007820 con 0x7fd63015d3f0 2023-11-24T06:17:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.591+0000 7fd6267fc640 1 -- 172.21.15.37:0/2550019593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620007980 con 0x7fd63015d3f0 2023-11-24T06:17:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.591+0000 7fd6267fc640 1 -- 172.21.15.37:0/2550019593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620007d10 con 0x7fd63015d3f0 2023-11-24T06:17:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.591+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6300c7790 con 0x7fd63015d3f0 2023-11-24T06:17:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.591+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6300c7d50 con 0x7fd63015d3f0 2023-11-24T06:17:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.592+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6300d06f0 con 0x7fd63015d3f0 2023-11-24T06:17:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.593+0000 7fd6267fc640 1 -- 172.21.15.37:0/2550019593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fd6200113f0 con 0x7fd63015d3f0 2023-11-24T06:17:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.594+0000 7fd6267fc640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd61406af90 0x7fd61406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:52.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.594+0000 7fd6267fc640 1 -- 172.21.15.37:0/2550019593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd620089810 con 0x7fd63015d3f0 2023-11-24T06:17:52.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.595+0000 7fd635ced640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd61406af90 0x7fd61406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:52.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.595+0000 7fd635ced640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd61406af90 0x7fd61406d450 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd62c036000 tx=0x7fd62c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:52.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.599+0000 7fd6267fc640 1 -- 172.21.15.37:0/2550019593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6300d06f0 con 0x7fd63015d3f0 2023-11-24T06:17:52.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.793+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6300d06f0 con 0x7fd63015d3f0 2023-11-24T06:17:52.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.793+0000 7fd6267fc640 1 -- 172.21.15.37:0/2550019593 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6300d06f0 con 0x7fd63015d3f0 2023-11-24T06:17:52.796 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd61406af90 msgr2=0x7fd61406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd61406af90 0x7fd61406d450 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd62c036000 tx=0x7fd62c030000 comp rx=0 tx=0).stop 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 msgr2=0x7fd6300b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300b8270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c7c0 tx=0x7fd62000cc80 comp rx=0 tx=0).stop 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 shutdown_connections 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd61406af90 0x7fd61406d450 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd63015d7d0 0x7fd6300b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd63015d3f0 0x7fd6300b8270 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 --2- 172.21.15.37:0/2550019593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6300d0e40 0x7fd630159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:52.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 >> 172.21.15.37:0/2550019593 conn(0x7fd63009c5b0 msgr2=0x7fd63006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:52.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 shutdown_connections 2023-11-24T06:17:52.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:52.796+0000 7fd636cef640 1 -- 172.21.15.37:0/2550019593 wait complete. 2023-11-24T06:17:52.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:17:53.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.036+0000 7fd6a7c5c640 1 Processor -- start 2023-11-24T06:17:53.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.036+0000 7fd6a7c5c640 1 -- start start 2023-11-24T06:17:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a7c5c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6a00ccbd0 0x7fd6a01660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a7c5c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd6a00c9650 0x7fd6a00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a7c5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a01655f0 con 0x7fd6a00ccfb0 2023-11-24T06:17:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a7c5c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a00cc380 con 0x7fd6a00ccbd0 2023-11-24T06:17:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a7c5c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a0162b30 con 0x7fd6a00c9650 2023-11-24T06:17:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a59f8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6a00ccbd0 0x7fd6a01660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a51f7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd6a00ccfb0 0x7fd6a0162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52300/0 (socket says 172.21.15.37:52300) 2023-11-24T06:17:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.038+0000 7fd6a51f7640 1 -- 172.21.15.37:0/4017837733 learned_addr learned my addr 172.21.15.37:0/4017837733 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.039+0000 7fd6a61f9640 1 --2- 172.21.15.37:0/4017837733 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00c9650 0x7fd6a00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.039+0000 7fd6a59f8640 1 -- 172.21.15.37:0/4017837733 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00c9650 msgr2=0x7fd6a00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.039+0000 7fd6a59f8640 1 --2- 172.21.15.37:0/4017837733 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00c9650 0x7fd6a00c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.039+0000 7fd6a59f8640 1 -- 172.21.15.37:0/4017837733 >> v1:172.21.15.37:6789/0 conn(0x7fd6a00ccfb0 legacy=0x7fd6a0162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.039+0000 7fd6a59f8640 1 -- 172.21.15.37:0/4017837733 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0162e10 con 0x7fd6a00ccbd0 2023-11-24T06:17:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.039+0000 7fd6a49f6640 1 -- 172.21.15.37:0/4017837733 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948195004 0 0) 0x7fd6a01655f0 con 0x7fd6a00ccfb0 2023-11-24T06:17:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.040+0000 7fd6a59f8640 1 --2- 172.21.15.37:0/4017837733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00ccbd0 0x7fd6a01660b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00c5fe0 tx=0x7fd69c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c7397fca048bf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.040+0000 7fd6a49f6640 1 -- 172.21.15.37:0/4017837733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c031830 con 0x7fd6a00ccbd0 2023-11-24T06:17:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.040+0000 7fd6a49f6640 1 -- 172.21.15.37:0/4017837733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c031990 con 0x7fd6a00ccbd0 2023-11-24T06:17:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.040+0000 7fd6a49f6640 1 -- 172.21.15.37:0/4017837733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c031d20 con 0x7fd6a00ccbd0 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/4017837733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00ccbd0 msgr2=0x7fd6a01660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/4017837733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00ccbd0 0x7fd6a01660b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00c5fe0 tx=0x7fd69c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/4017837733 shutdown_connections 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/4017837733 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00c9650 0x7fd6a00c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/4017837733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00ccbd0 0x7fd6a01660b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/4017837733 >> 172.21.15.37:0/4017837733 conn(0x7fd6a00b0c50 msgr2=0x7fd6a00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/4017837733 shutdown_connections 2023-11-24T06:17:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.041+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/4017837733 wait complete. 2023-11-24T06:17:53.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.043+0000 7fd6a7c5c640 1 Processor -- start 2023-11-24T06:17:53.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.043+0000 7fd6a7c5c640 1 -- start start 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a7c5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00c9650 0x7fd6a0165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a7c5c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00ccbd0 0x7fd6a0158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a7c5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00ccfb0 0x7fd6a01609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a7c5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0165580 con 0x7fd6a00c9650 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a7c5c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00ad8b0 con 0x7fd6a00ccfb0 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a7c5c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00ac3c0 con 0x7fd6a00ccbd0 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a59f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00c9650 0x7fd6a0165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.044+0000 7fd6a59f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00c9650 0x7fd6a0165040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38484/0 (socket says 172.21.15.37:38484) 2023-11-24T06:17:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a59f8640 1 -- 172.21.15.37:0/3133540158 learned_addr learned my addr 172.21.15.37:0/3133540158 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a51f7640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00ccbd0 0x7fd6a0158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a61f9640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00ccfb0 0x7fd6a01609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a59f8640 1 -- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00ccbd0 msgr2=0x7fd6a0158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a59f8640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00ccbd0 0x7fd6a0158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a59f8640 1 -- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00ccfb0 msgr2=0x7fd6a01609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a59f8640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00ccfb0 0x7fd6a01609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a59f8640 1 -- 172.21.15.37:0/3133540158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c009400 con 0x7fd6a00c9650 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a61f9640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00ccfb0 0x7fd6a01609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.045+0000 7fd6a59f8640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00c9650 0x7fd6a0165040 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009890 tx=0x7fd69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.046+0000 7fd6967fc640 1 -- 172.21.15.37:0/3133540158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c03ba70 con 0x7fd6a00c9650 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.046+0000 7fd6967fc640 1 -- 172.21.15.37:0/3133540158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c03bbf0 con 0x7fd6a00c9650 2023-11-24T06:17:53.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.046+0000 7fd6967fc640 1 -- 172.21.15.37:0/3133540158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0453f0 con 0x7fd6a00c9650 2023-11-24T06:17:53.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.046+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a00ac6a0 con 0x7fd6a00c9650 2023-11-24T06:17:53.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.046+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a00acc60 con 0x7fd6a00c9650 2023-11-24T06:17:53.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.047+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a00c7530 con 0x7fd6a00c9650 2023-11-24T06:17:53.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.048+0000 7fd6967fc640 1 -- 172.21.15.37:0/3133540158 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fd69c045550 con 0x7fd6a00c9650 2023-11-24T06:17:53.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.049+0000 7fd6967fc640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd68406af60 0x7fd68406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.049+0000 7fd6967fc640 1 -- 172.21.15.37:0/3133540158 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd69c0abba0 con 0x7fd6a00c9650 2023-11-24T06:17:53.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.049+0000 7fd6a51f7640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd68406af60 0x7fd68406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.050+0000 7fd6a51f7640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd68406af60 0x7fd68406d420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00af460 tx=0x7fd690007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.053+0000 7fd6967fc640 1 -- 172.21.15.37:0/3133540158 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd69c076ab0 con 0x7fd6a00c9650 2023-11-24T06:17:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.254+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6a004e8b0 con 0x7fd6a00c9650 2023-11-24T06:17:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.255+0000 7fd6967fc640 1 -- 172.21.15.37:0/3133540158 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd69c07a0d0 con 0x7fd6a00c9650 2023-11-24T06:17:53.257 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-11-24T06:17:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd68406af60 msgr2=0x7fd68406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd68406af60 0x7fd68406d420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00af460 tx=0x7fd690007b50 comp rx=0 tx=0).stop 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00c9650 msgr2=0x7fd6a0165040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00c9650 0x7fd6a0165040 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009890 tx=0x7fd69c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 shutdown_connections 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd68406af60 0x7fd68406d420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00ccfb0 0x7fd6a01609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00ccbd0 0x7fd6a0158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 --2- 172.21.15.37:0/3133540158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a00c9650 0x7fd6a0165040 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 >> 172.21.15.37:0/3133540158 conn(0x7fd6a00b0c50 msgr2=0x7fd6a00aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 shutdown_connections 2023-11-24T06:17:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.258+0000 7fd6a7c5c640 1 -- 172.21.15.37:0/3133540158 wait complete. 2023-11-24T06:17:53.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:17:53.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.505+0000 7fdc2afdb640 1 Processor -- start 2023-11-24T06:17:53.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.506+0000 7fdc2afdb640 1 -- start start 2023-11-24T06:17:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.507+0000 7fdc2afdb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 0x7fdc240ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.507+0000 7fdc2afdb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240d15e0 con 0x7fdc2415d3f0 2023-11-24T06:17:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.507+0000 7fdc2afdb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240d0280 con 0x7fdc2415d7d0 2023-11-24T06:17:53.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.507+0000 7fdc2afdb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b0eb0 con 0x7fdc240d1f40 2023-11-24T06:17:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.508+0000 7fdc29fd9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdc2415d3f0 0x7fdc240d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52316/0 (socket says 172.21.15.37:52316) 2023-11-24T06:17:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.508+0000 7fdc29fd9640 1 -- 172.21.15.37:0/968344930 learned_addr learned my addr 172.21.15.37:0/968344930 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.508+0000 7fdc2a7da640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 0x7fdc240ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.508+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965157174 0 0) 0x7fdc240d15e0 con 0x7fdc2415d3f0 2023-11-24T06:17:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.508+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc0c003520 con 0x7fdc2415d3f0 2023-11-24T06:17:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104581372 0 0) 0x7fdc0c003520 con 0x7fdc2415d3f0 2023-11-24T06:17:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 msgr2=0x7fdc240ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 0x7fdc240ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 >> v1:172.21.15.188:6789/0 conn(0x7fdc2415d7d0 legacy=0x7fdc240cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240d1300 con 0x7fdc2415d3f0 2023-11-24T06:17:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fdc14001670 con 0x7fdc2415d3f0 2023-11-24T06:17:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 >> v1:172.21.15.37:6789/0 conn(0x7fdc2415d3f0 legacy=0x7fdc240d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc0c0047c0 0x7fdc0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 0x7fdc0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b0eb0 con 0x7fdc0c0039a0 2023-11-24T06:17:53.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c00ba90 con 0x7fdc0c0047c0 2023-11-24T06:17:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c00bc50 con 0x7fdc240d1f40 2023-11-24T06:17:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc29fd9640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.509+0000 7fdc297d8640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc0c0047c0 0x7fdc0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.510+0000 7fdc2a7da640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 0x7fdc0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.510+0000 7fdc29fd9640 1 -- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 msgr2=0x7fdc0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.510+0000 7fdc29fd9640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 0x7fdc0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.510+0000 7fdc29fd9640 1 -- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc0c0047c0 msgr2=0x7fdc0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.510+0000 7fdc29fd9640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc0c0047c0 0x7fdc0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.510+0000 7fdc29fd9640 1 -- 172.21.15.37:0/968344930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c003520 con 0x7fdc0c0039a0 2023-11-24T06:17:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.510+0000 7fdc2a7da640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240d1f40 0x7fdc0c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.511+0000 7fdc29fd9640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc0c003dc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fdc14001eb0 tx=0x7fdc0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e8e8b3706a883e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.511+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14005ad0 con 0x7fdc0c0039a0 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.511+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14005c30 con 0x7fdc0c0039a0 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.511+0000 7fdc28fd7640 1 -- 172.21.15.37:0/968344930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1402c7a0 con 0x7fdc0c0039a0 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.511+0000 7fdc2afdb640 1 -- 172.21.15.37:0/968344930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 msgr2=0x7fdc0c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.511+0000 7fdc2afdb640 1 --2- 172.21.15.37:0/968344930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc0c003dc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fdc14001eb0 tx=0x7fdc0c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.511+0000 7fdc2a7da640 1 -- 172.21.15.37:0/968344930 reap_dead start 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.512+0000 7fdc2afdb640 1 -- 172.21.15.37:0/968344930 shutdown_connections 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.512+0000 7fdc2afdb640 1 -- 172.21.15.37:0/968344930 >> 172.21.15.37:0/968344930 conn(0x7fdc2409c5b0 msgr2=0x7fdc240d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.512+0000 7fdc2afdb640 1 -- 172.21.15.37:0/968344930 shutdown_connections 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.512+0000 7fdc2afdb640 1 -- 172.21.15.37:0/968344930 wait complete. 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.514+0000 7fdc2afdb640 1 Processor -- start 2023-11-24T06:17:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.514+0000 7fdc2afdb640 1 -- start start 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc2afdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc240cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc2afdb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc240b61a0 0x7fdc240c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc2afdb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240c7350 0x7fdc240c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc2afdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b6630 con 0x7fdc0c0039a0 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc2afdb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b6910 con 0x7fdc240b61a0 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc2afdb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b6bf0 con 0x7fdc240c7350 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc29fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc240cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc29fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc240cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38498/0 (socket says 172.21.15.37:38498) 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.515+0000 7fdc29fd9640 1 -- 172.21.15.37:0/908976677 learned_addr learned my addr 172.21.15.37:0/908976677 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc29fd9640 1 -- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240c7350 msgr2=0x7fdc240c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc29fd9640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240c7350 0x7fdc240c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc29fd9640 1 -- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc240b61a0 msgr2=0x7fdc240c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc297d8640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc240b61a0 0x7fdc240c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc29fd9640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc240b61a0 0x7fdc240c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc29fd9640 1 -- 172.21.15.37:0/908976677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240b6ed0 con 0x7fdc0c0039a0 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc297d8640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc240b61a0 0x7fdc240c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc29fd9640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc240cc890 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdc14001eb0 tx=0x7fdc14001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc227fc640 1 -- 172.21.15.37:0/908976677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14039070 con 0x7fdc0c0039a0 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc227fc640 1 -- 172.21.15.37:0/908976677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1402cbb0 con 0x7fdc0c0039a0 2023-11-24T06:17:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc227fc640 1 -- 172.21.15.37:0/908976677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1403c040 con 0x7fdc0c0039a0 2023-11-24T06:17:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.516+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240b71b0 con 0x7fdc0c0039a0 2023-11-24T06:17:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.517+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc240ccfb0 con 0x7fdc0c0039a0 2023-11-24T06:17:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.518+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc240b7340 con 0x7fdc0c0039a0 2023-11-24T06:17:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.519+0000 7fdc227fc640 1 -- 172.21.15.37:0/908976677 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fdc14032070 con 0x7fdc0c0039a0 2023-11-24T06:17:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.520+0000 7fdc227fc640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdc1006af60 0x7fdc1006d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.520+0000 7fdc227fc640 1 -- 172.21.15.37:0/908976677 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc140aa990 con 0x7fdc0c0039a0 2023-11-24T06:17:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.520+0000 7fdc297d8640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdc1006af60 0x7fdc1006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.521+0000 7fdc297d8640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdc1006af60 0x7fdc1006d420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdc2415dbb0 tx=0x7fdc18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.524+0000 7fdc227fc640 1 -- 172.21.15.37:0/908976677 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc14075930 con 0x7fdc0c0039a0 2023-11-24T06:17:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.720+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc2404e840 con 0x7fdc0c0039a0 2023-11-24T06:17:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.721+0000 7fdc227fc640 1 -- 172.21.15.37:0/908976677 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc14078f50 con 0x7fdc0c0039a0 2023-11-24T06:17:53.723 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-11-24T06:17:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.723+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdc1006af60 msgr2=0x7fdc1006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.723+0000 7fdc2afdb640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdc1006af60 0x7fdc1006d420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdc2415dbb0 tx=0x7fdc18009040 comp rx=0 tx=0).stop 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.723+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 msgr2=0x7fdc240cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.723+0000 7fdc2afdb640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc240cc890 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdc14001eb0 tx=0x7fdc14001930 comp rx=0 tx=0).stop 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 shutdown_connections 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdc1006af60 0x7fdc1006d420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc240b61a0 0x7fdc240c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc240c7350 0x7fdc240c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 --2- 172.21.15.37:0/908976677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c0039a0 0x7fdc240cc890 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 >> 172.21.15.37:0/908976677 conn(0x7fdc2409c5b0 msgr2=0x7fdc24160360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 shutdown_connections 2023-11-24T06:17:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.724+0000 7fdc2afdb640 1 -- 172.21.15.37:0/908976677 wait complete. 2023-11-24T06:17:53.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:53.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.967+0000 7f0344a1c640 1 Processor -- start 2023-11-24T06:17:53.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.968+0000 7f0344a1c640 1 -- start start 2023-11-24T06:17:53.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.969+0000 7f0344a1c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cf450 0x7f03400cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.969+0000 7f0344a1c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03400cdfb0 0x7f03400ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.969+0000 7f0344a1c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03400cece0 con 0x7f034015c7f0 2023-11-24T06:17:53.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.969+0000 7f0344a1c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0340156010 con 0x7f03400cdfb0 2023-11-24T06:17:53.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.969+0000 7f0344a1c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034006ce30 con 0x7f03400cf450 2023-11-24T06:17:53.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f034015c7f0 0x7f034006db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52328/0 (socket says 172.21.15.37:52328) 2023-11-24T06:17:53.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033e59c640 1 -- 172.21.15.37:0/2767531829 learned_addr learned my addr 172.21.15.37:0/2767531829 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:53.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033ed9d640 1 --2- 172.21.15.37:0/2767531829 >> v2:172.21.15.37:3300/0 conn(0x7f03400cdfb0 0x7f03400ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033dd9b640 1 --2- 172.21.15.37:0/2767531829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cf450 0x7f03400cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033d59a640 1 -- 172.21.15.37:0/2767531829 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949720714 0 0) 0x7f03400cece0 con 0x7f034015c7f0 2023-11-24T06:17:53.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033d59a640 1 -- 172.21.15.37:0/2767531829 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f032c003520 con 0x7f034015c7f0 2023-11-24T06:17:53.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033ed9d640 1 -- 172.21.15.37:0/2767531829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cf450 msgr2=0x7f03400cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:53.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033ed9d640 1 --2- 172.21.15.37:0/2767531829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cf450 0x7f03400cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033ed9d640 1 -- 172.21.15.37:0/2767531829 >> v1:172.21.15.37:6789/0 conn(0x7f034015c7f0 legacy=0x7f034006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.970+0000 7f033ed9d640 1 -- 172.21.15.37:0/2767531829 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034006d040 con 0x7f03400cdfb0 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f033ed9d640 1 --2- 172.21.15.37:0/2767531829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cdfb0 0x7f03400ce440 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f03380097a0 tx=0x7f033802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f8747b316f560a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f033d59a640 1 -- 172.21.15.37:0/2767531829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033802d040 con 0x7f03400cdfb0 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f033d59a640 1 -- 172.21.15.37:0/2767531829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338031810 con 0x7f03400cdfb0 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f033d59a640 1 -- 172.21.15.37:0/2767531829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338031ba0 con 0x7f03400cdfb0 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f0344a1c640 1 -- 172.21.15.37:0/2767531829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cdfb0 msgr2=0x7f03400ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f0344a1c640 1 --2- 172.21.15.37:0/2767531829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cdfb0 0x7f03400ce440 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f03380097a0 tx=0x7f033802b8b0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f0344a1c640 1 -- 172.21.15.37:0/2767531829 shutdown_connections 2023-11-24T06:17:53.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f0344a1c640 1 --2- 172.21.15.37:0/2767531829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cdfb0 0x7f03400ce440 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f0344a1c640 1 --2- 172.21.15.37:0/2767531829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cf450 0x7f03400cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.972+0000 7f0344a1c640 1 -- 172.21.15.37:0/2767531829 >> 172.21.15.37:0/2767531829 conn(0x7f034006a920 msgr2=0x7f034006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:53.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.973+0000 7f0344a1c640 1 -- 172.21.15.37:0/2767531829 shutdown_connections 2023-11-24T06:17:53.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.973+0000 7f0344a1c640 1 -- 172.21.15.37:0/2767531829 wait complete. 2023-11-24T06:17:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.974+0000 7f0344a1c640 1 Processor -- start 2023-11-24T06:17:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.974+0000 7f0344a1c640 1 -- start start 2023-11-24T06:17:53.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.975+0000 7f0344a1c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cdfb0 0x7f0340153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.975+0000 7f0344a1c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cf450 0x7f0340156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.975+0000 7f0344a1c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f034015c7f0 0x7f0340156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.975+0000 7f0344a1c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0340157840 con 0x7f03400cf450 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.975+0000 7f0344a1c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0340099f30 con 0x7f034015c7f0 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.975+0000 7f0344a1c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03400adf50 con 0x7f03400cdfb0 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cf450 0x7f0340156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cf450 0x7f0340156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38522/0 (socket says 172.21.15.37:38522) 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 -- 172.21.15.37:0/1724263307 learned_addr learned my addr 172.21.15.37:0/1724263307 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033ed9d640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f034015c7f0 0x7f0340156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 -- 172.21.15.37:0/1724263307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cdfb0 msgr2=0x7f0340153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cdfb0 0x7f0340153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 -- 172.21.15.37:0/1724263307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f034015c7f0 msgr2=0x7f0340156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f034015c7f0 0x7f0340156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.976+0000 7f033dd9b640 1 -- 172.21.15.37:0/1724263307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0338009400 con 0x7f03400cf450 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.977+0000 7f033dd9b640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cf450 0x7f0340156150 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f032800d800 tx=0x7f032800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.977+0000 7f0336ffd640 1 -- 172.21.15.37:0/1724263307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800b6c0 con 0x7f03400cf450 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.977+0000 7f0336ffd640 1 -- 172.21.15.37:0/1724263307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800b820 con 0x7f03400cf450 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.977+0000 7f0336ffd640 1 -- 172.21.15.37:0/1724263307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800bbb0 con 0x7f03400cf450 2023-11-24T06:17:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.977+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0340156cc0 con 0x7f03400cf450 2023-11-24T06:17:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.977+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0340157280 con 0x7f03400cf450 2023-11-24T06:17:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.978+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034009a0a0 con 0x7f03400cf450 2023-11-24T06:17:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.979+0000 7f0336ffd640 1 -- 172.21.15.37:0/1724263307 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f032800bd10 con 0x7f03400cf450 2023-11-24T06:17:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.980+0000 7f0336ffd640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f032006af60 0x7f032006d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.980+0000 7f0336ffd640 1 -- 172.21.15.37:0/1724263307 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0328089dd0 con 0x7f03400cf450 2023-11-24T06:17:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.981+0000 7f033e59c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f032006af60 0x7f032006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.981+0000 7f033e59c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f032006af60 0x7f032006d420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0330002000 tx=0x7f03300015f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:53.985+0000 7f0336ffd640 1 -- 172.21.15.37:0/1724263307 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f034009a0a0 con 0x7f03400cf450 2023-11-24T06:17:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.220+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f034009a0a0 con 0x7f03400cf450 2023-11-24T06:17:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.221+0000 7f0336ffd640 1 -- 172.21.15.37:0/1724263307 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f034009a0a0 con 0x7f03400cf450 2023-11-24T06:17:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:54.224 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2892400858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2892400858},{"type":"v1","addr":"172.21.15.188:6835","nonce":2892400858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":4961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/4008465884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":4008465884},{"type":"v1","addr":"172.21.15.37:6837","nonce":4008465884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/2245601301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":2245601301},{"type":"v1","addr":"172.21.15.188:6834","nonce":2245601301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:17:32.142253+0000","modified":"2023-11-24T06:17:35.237267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6836/2581426871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2581426871},{"type":"v1","addr":"172.21.15.37:6836","nonce":2581426871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:17:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 41 2023-11-24T06:17:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f032006af60 msgr2=0x7f032006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f032006af60 0x7f032006d420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0330002000 tx=0x7f03300015f0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cf450 msgr2=0x7f0340156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cf450 0x7f0340156150 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f032800d800 tx=0x7f032800dcc0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 shutdown_connections 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f032006af60 0x7f032006d420 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f034015c7f0 0x7f0340156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03400cf450 0x7f0340156150 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 --2- 172.21.15.37:0/1724263307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03400cdfb0 0x7f0340153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 >> 172.21.15.37:0/1724263307 conn(0x7f034006a920 msgr2=0x7f03400aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 shutdown_connections 2023-11-24T06:17:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.224+0000 7f0344a1c640 1 -- 172.21.15.37:0/1724263307 wait complete. 2023-11-24T06:17:54.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.469+0000 7f2022e56640 1 Processor -- start 2023-11-24T06:17:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.469+0000 7f2022e56640 1 -- start start 2023-11-24T06:17:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f2022e56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f201c0cf450 0x7f201c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f2022e56640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c0cdfb0 0x7f201c0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f2022e56640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c0cece0 con 0x7f201c15c7f0 2023-11-24T06:17:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f2022e56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0cfe40 con 0x7f201c0cf450 2023-11-24T06:17:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f2022e56640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c156010 con 0x7f201c0cdfb0 2023-11-24T06:17:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f201bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f201c0cf450 0x7f201c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f201bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f201c0cf450 0x7f201c0cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38528/0 (socket says 172.21.15.37:38528) 2023-11-24T06:17:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.470+0000 7f201bfff640 1 -- 172.21.15.37:0/4289843188 learned_addr learned my addr 172.21.15.37:0/4289843188 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.471+0000 7f201bfff640 1 -- 172.21.15.37:0/4289843188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c0cdfb0 msgr2=0x7f201c0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.471+0000 7f201bfff640 1 --2- 172.21.15.37:0/4289843188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c0cdfb0 0x7f201c0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.471+0000 7f201bfff640 1 -- 172.21.15.37:0/4289843188 >> v1:172.21.15.188:6789/0 conn(0x7f201c15c7f0 legacy=0x7f201c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.471+0000 7f201bfff640 1 -- 172.21.15.37:0/4289843188 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c06d040 con 0x7f201c0cf450 2023-11-24T06:17:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.472+0000 7f201bfff640 1 --2- 172.21.15.37:0/4289843188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c0cf900 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2004009870 tx=0x7f200402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ee7dff4d6c8da4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.472+0000 7f201b7fe640 1 -- 172.21.15.37:0/4289843188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004031640 con 0x7f201c0cf450 2023-11-24T06:17:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.472+0000 7f201b7fe640 1 -- 172.21.15.37:0/4289843188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040317a0 con 0x7f201c0cf450 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.472+0000 7f201b7fe640 1 -- 172.21.15.37:0/4289843188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004031b30 con 0x7f201c0cf450 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.473+0000 7f2022e56640 1 -- 172.21.15.37:0/4289843188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 msgr2=0x7f201c0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.473+0000 7f2022e56640 1 --2- 172.21.15.37:0/4289843188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c0cf900 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2004009870 tx=0x7f200402b8f0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.473+0000 7f2022e56640 1 -- 172.21.15.37:0/4289843188 shutdown_connections 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.473+0000 7f2022e56640 1 --2- 172.21.15.37:0/4289843188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c0cf900 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.473+0000 7f2022e56640 1 --2- 172.21.15.37:0/4289843188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c0cdfb0 0x7f201c0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.473+0000 7f2022e56640 1 -- 172.21.15.37:0/4289843188 >> 172.21.15.37:0/4289843188 conn(0x7f201c06a920 msgr2=0x7f201c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.473+0000 7f2022e56640 1 -- 172.21.15.37:0/4289843188 shutdown_connections 2023-11-24T06:17:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.474+0000 7f2022e56640 1 -- 172.21.15.37:0/4289843188 wait complete. 2023-11-24T06:17:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.475+0000 7f2022e56640 1 Processor -- start 2023-11-24T06:17:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.475+0000 7f2022e56640 1 -- start start 2023-11-24T06:17:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.476+0000 7f2022e56640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f201c0cdfb0 0x7f201c1f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.476+0000 7f2022e56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.476+0000 7f2022e56640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c15c7f0 0x7f201c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.476+0000 7f2022e56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c1f7db0 con 0x7f201c0cf450 2023-11-24T06:17:54.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.476+0000 7f2022e56640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15b3d0 con 0x7f201c0cdfb0 2023-11-24T06:17:54.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.476+0000 7f2022e56640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15abc0 con 0x7f201c15c7f0 2023-11-24T06:17:54.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:54.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38530/0 (socket says 172.21.15.37:38530) 2023-11-24T06:17:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 -- 172.21.15.37:0/50317100 learned_addr learned my addr 172.21.15.37:0/50317100 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f2020bf2640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f201c0cdfb0 0x7f201c1f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 -- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c15c7f0 msgr2=0x7f201c0af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c15c7f0 0x7f201c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 -- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f201c0cdfb0 msgr2=0x7f201c1f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f201c0cdfb0 0x7f201c1f7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f201bfff640 1 -- 172.21.15.37:0/50317100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20040094d0 con 0x7f201c0cf450 2023-11-24T06:17:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.477+0000 7f2020bf2640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f201c0cdfb0 0x7f201c1f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.478+0000 7f201bfff640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c158a20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2004000c00 tx=0x7f20040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.478+0000 7f20197fa640 1 -- 172.21.15.37:0/50317100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200403ac60 con 0x7f201c0cf450 2023-11-24T06:17:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.478+0000 7f20197fa640 1 -- 172.21.15.37:0/50317100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200403ade0 con 0x7f201c0cf450 2023-11-24T06:17:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.478+0000 7f20197fa640 1 -- 172.21.15.37:0/50317100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004044630 con 0x7f201c0cf450 2023-11-24T06:17:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.478+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c15b900 con 0x7f201c0cf450 2023-11-24T06:17:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.478+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c15b620 con 0x7f201c0cf450 2023-11-24T06:17:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.479+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c15ad00 con 0x7f201c0cf450 2023-11-24T06:17:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.480+0000 7f20197fa640 1 -- 172.21.15.37:0/50317100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f200402f050 con 0x7f201c0cf450 2023-11-24T06:17:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.481+0000 7f20197fa640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1ffc06af60 0x7f1ffc06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.481+0000 7f20197fa640 1 -- 172.21.15.37:0/50317100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20040abad0 con 0x7f201c0cf450 2023-11-24T06:17:54.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.481+0000 7f2020bf2640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1ffc06af60 0x7f1ffc06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:54.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.482+0000 7f2020bf2640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1ffc06af60 0x7f1ffc06d420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f200c00a830 tx=0x7f200c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:54.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.486+0000 7f20197fa640 1 -- 172.21.15.37:0/50317100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f201c15ad00 con 0x7f201c0cf450 2023-11-24T06:17:54.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.682+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f201c15ad00 con 0x7f201c0cf450 2023-11-24T06:17:54.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.685+0000 7f20197fa640 1 -- 172.21.15.37:0/50317100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f201c15ad00 con 0x7f201c0cf450 2023-11-24T06:17:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:54.689 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:33.680484+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:54.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1ffc06af60 msgr2=0x7f1ffc06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1ffc06af60 0x7f1ffc06d420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f200c00a830 tx=0x7f200c008040 comp rx=0 tx=0).stop 2023-11-24T06:17:54.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 msgr2=0x7f201c158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c158a20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2004000c00 tx=0x7f20040046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 shutdown_connections 2023-11-24T06:17:54.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f1ffc06af60 0x7f1ffc06d420 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f201c15c7f0 0x7f201c0af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c0cf450 0x7f201c158a20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 --2- 172.21.15.37:0/50317100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f201c0cdfb0 0x7f201c1f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 >> 172.21.15.37:0/50317100 conn(0x7f201c06a920 msgr2=0x7f201c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:54.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 shutdown_connections 2023-11-24T06:17:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.689+0000 7f2022e56640 1 -- 172.21.15.37:0/50317100 wait complete. 2023-11-24T06:17:54.712 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:17:54.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:54.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.927+0000 7f16ea35a640 1 Processor -- start 2023-11-24T06:17:54.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.927+0000 7f16ea35a640 1 -- start start 2023-11-24T06:17:54.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16ea35a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16e40cfb60 0x7f16e4161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16ea35a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 0x7f16e415e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16ea35a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e40ce0b0 con 0x7f16e4157c70 2023-11-24T06:17:54.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16ea35a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e4161960 con 0x7f16e40cfb60 2023-11-24T06:17:54.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16ea35a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e415e670 con 0x7f16e415dc80 2023-11-24T06:17:54.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16dbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16e40cfb60 0x7f16e4161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:54.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16dbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16e40cfb60 0x7f16e4161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38538/0 (socket says 172.21.15.37:38538) 2023-11-24T06:17:54.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16dbfff640 1 -- 172.21.15.37:0/4021507548 learned_addr learned my addr 172.21.15.37:0/4021507548 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16dbfff640 1 -- 172.21.15.37:0/4021507548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 msgr2=0x7f16e415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16dbfff640 1 --2- 172.21.15.37:0/4021507548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 0x7f16e415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16dbfff640 1 -- 172.21.15.37:0/4021507548 >> v1:172.21.15.188:6789/0 conn(0x7f16e4157c70 legacy=0x7f16e40cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.929+0000 7f16dbfff640 1 -- 172.21.15.37:0/4021507548 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e415e8d0 con 0x7f16e40cfb60 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.931+0000 7f16dbfff640 1 --2- 172.21.15.37:0/4021507548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e40cfb60 0x7f16e4161df0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cf2f9df5450666 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.931+0000 7f16e37fe640 1 -- 172.21.15.37:0/4021507548 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0317c0 con 0x7f16e40cfb60 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.931+0000 7f16e37fe640 1 -- 172.21.15.37:0/4021507548 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc031920 con 0x7f16e40cfb60 2023-11-24T06:17:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.931+0000 7f16e37fe640 1 -- 172.21.15.37:0/4021507548 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc031cb0 con 0x7f16e40cfb60 2023-11-24T06:17:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 -- 172.21.15.37:0/4021507548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e40cfb60 msgr2=0x7f16e4161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 --2- 172.21.15.37:0/4021507548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e40cfb60 0x7f16e4161df0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc02b860 comp rx=0 tx=0).stop 2023-11-24T06:17:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 -- 172.21.15.37:0/4021507548 shutdown_connections 2023-11-24T06:17:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 --2- 172.21.15.37:0/4021507548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e40cfb60 0x7f16e4161df0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 --2- 172.21.15.37:0/4021507548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 0x7f16e415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 -- 172.21.15.37:0/4021507548 >> 172.21.15.37:0/4021507548 conn(0x7f16e406a920 msgr2=0x7f16e406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 -- 172.21.15.37:0/4021507548 shutdown_connections 2023-11-24T06:17:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.932+0000 7f16ea35a640 1 -- 172.21.15.37:0/4021507548 wait complete. 2023-11-24T06:17:54.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.934+0000 7f16ea35a640 1 Processor -- start 2023-11-24T06:17:54.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.934+0000 7f16ea35a640 1 -- start start 2023-11-24T06:17:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16ea35a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16e40cfb60 0x7f16e41f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16ea35a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e4157c70 0x7f16e4144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16ea35a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 0x7f16e4156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16ea35a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e41f7090 con 0x7f16e4157c70 2023-11-24T06:17:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16ea35a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4147f80 con 0x7f16e40cfb60 2023-11-24T06:17:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16ea35a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4147ca0 con 0x7f16e415dc80 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e4157c70 0x7f16e4144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e4157c70 0x7f16e4144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38550/0 (socket says 172.21.15.37:38550) 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.935+0000 7f16dbfff640 1 -- 172.21.15.37:0/964293571 learned_addr learned my addr 172.21.15.37:0/964293571 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16dbfff640 1 -- 172.21.15.37:0/964293571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 msgr2=0x7f16e4156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16dbfff640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 0x7f16e4156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16dbfff640 1 -- 172.21.15.37:0/964293571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16e40cfb60 msgr2=0x7f16e41f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16dbfff640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16e40cfb60 0x7f16e41f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16dbfff640 1 -- 172.21.15.37:0/964293571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0094d0 con 0x7f16e4157c70 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16dbfff640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e4157c70 0x7f16e4144840 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f16cc000c00 tx=0x7f16cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16e17fa640 1 -- 172.21.15.37:0/964293571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc032860 con 0x7f16e4157c70 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.936+0000 7f16e17fa640 1 -- 172.21.15.37:0/964293571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0329e0 con 0x7f16e4157c70 2023-11-24T06:17:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.937+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e41f69d0 con 0x7f16e4157c70 2023-11-24T06:17:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.937+0000 7f16e17fa640 1 -- 172.21.15.37:0/964293571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc032d90 con 0x7f16e4157c70 2023-11-24T06:17:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.937+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e4156950 con 0x7f16e4157c70 2023-11-24T06:17:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.938+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e41f71d0 con 0x7f16e4157c70 2023-11-24T06:17:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.939+0000 7f16e17fa640 1 -- 172.21.15.37:0/964293571 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f16cc04e450 con 0x7f16e4157c70 2023-11-24T06:17:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.940+0000 7f16e17fa640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f16c406af60 0x7f16c406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.940+0000 7f16e17fa640 1 -- 172.21.15.37:0/964293571 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16cc0aba70 con 0x7f16e4157c70 2023-11-24T06:17:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.940+0000 7f16e3fff640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f16c406af60 0x7f16c406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.941+0000 7f16e3fff640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f16c406af60 0x7f16c406d420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001560 tx=0x7f16d4007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:54.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:54.944+0000 7f16e17fa640 1 -- 172.21.15.37:0/964293571 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16e41f71d0 con 0x7f16e4157c70 2023-11-24T06:17:55.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.175+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16e41f71d0 con 0x7f16e4157c70 2023-11-24T06:17:55.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.176+0000 7f16e17fa640 1 -- 172.21.15.37:0/964293571 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f16e41f71d0 con 0x7f16e4157c70 2023-11-24T06:17:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:55.179 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2892400858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2892400858},{"type":"v1","addr":"172.21.15.188:6835","nonce":2892400858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":4961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/4008465884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":4008465884},{"type":"v1","addr":"172.21.15.37:6837","nonce":4008465884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/2245601301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":2245601301},{"type":"v1","addr":"172.21.15.188:6834","nonce":2245601301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:17:32.142253+0000","modified":"2023-11-24T06:17:35.237267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6836/2581426871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2581426871},{"type":"v1","addr":"172.21.15.37:6836","nonce":2581426871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:17:55.179 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 41 2023-11-24T06:17:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.178+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f16c406af60 msgr2=0x7f16c406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.178+0000 7f16ea35a640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f16c406af60 0x7f16c406d420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001560 tx=0x7f16d4007990 comp rx=0 tx=0).stop 2023-11-24T06:17:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.178+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e4157c70 msgr2=0x7f16e4144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.178+0000 7f16ea35a640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e4157c70 0x7f16e4144840 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f16cc000c00 tx=0x7f16cc0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 shutdown_connections 2023-11-24T06:17:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f16c406af60 0x7f16c406d420 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16e415dc80 0x7f16e4156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e4157c70 0x7f16e4144840 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 --2- 172.21.15.37:0/964293571 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16e40cfb60 0x7f16e41f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 >> 172.21.15.37:0/964293571 conn(0x7f16e406a920 msgr2=0x7f16e40ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:55.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 shutdown_connections 2023-11-24T06:17:55.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.179+0000 7f16ea35a640 1 -- 172.21.15.37:0/964293571 wait complete. 2023-11-24T06:17:55.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:17:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.427+0000 7f5ba060e640 1 Processor -- start 2023-11-24T06:17:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.427+0000 7f5ba060e640 1 -- start start 2023-11-24T06:17:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.428+0000 7f5ba060e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5b9815af40 0x7f5b9806d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.428+0000 7f5ba060e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9815e8b0 con 0x7f5b980cf5d0 2023-11-24T06:17:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.428+0000 7f5ba060e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b98070180 con 0x7f5b9815b320 2023-11-24T06:17:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.428+0000 7f5ba060e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9815eb90 con 0x7f5b9815af40 2023-11-24T06:17:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.429+0000 7f5b9ebab640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5b980cf5d0 0x7f5b9806b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52338/0 (socket says 172.21.15.37:52338) 2023-11-24T06:17:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.429+0000 7f5b9ebab640 1 -- 172.21.15.37:0/2539204086 learned_addr learned my addr 172.21.15.37:0/2539204086 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.429+0000 7f5b9e3aa640 1 --2- 172.21.15.37:0/2539204086 >> v2:172.21.15.188:3300/0 conn(0x7f5b9815af40 0x7f5b9806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.429+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145722790 0 0) 0x7f5b9815e8b0 con 0x7f5b980cf5d0 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.429+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b84003520 con 0x7f5b980cf5d0 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659392741 0 0) 0x7f5b84003520 con 0x7f5b980cf5d0 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 >> v2:172.21.15.188:3300/0 conn(0x7f5b9815af40 msgr2=0x7f5b9806d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 --2- 172.21.15.37:0/2539204086 >> v2:172.21.15.188:3300/0 conn(0x7f5b9815af40 0x7f5b9806d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 >> v1:172.21.15.188:6789/0 conn(0x7f5b9815b320 legacy=0x7f5b980ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98070460 con 0x7f5b980cf5d0 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f5b900019f0 con 0x7f5b980cf5d0 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 >> v1:172.21.15.37:6789/0 conn(0x7f5b980cf5d0 legacy=0x7f5b9806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b84003970 0x7f5b84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b84005180 0x7f5b8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9815eb90 con 0x7f5b840047c0 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8400c020 con 0x7f5b84003970 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8400c1e0 con 0x7f5b84005180 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.430+0000 7f5b9dba9640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9e3aa640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b84003970 0x7f5b84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9ebab640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b84005180 0x7f5b8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9dba9640 1 -- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b84005180 msgr2=0x7f5b8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9dba9640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b84005180 0x7f5b8400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9dba9640 1 -- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b84003970 msgr2=0x7f5b84003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9dba9640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b84003970 0x7f5b84003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9dba9640 1 -- 172.21.15.37:0/2539204086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84003520 con 0x7f5b840047c0 2023-11-24T06:17:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.431+0000 7f5b9ebab640 1 -- 172.21.15.37:0/2539204086 reap_dead start 2023-11-24T06:17:55.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.432+0000 7f5b9dba9640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b84004c40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5b88001750 tx=0x7f5b840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4339f06014c1e74e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:55.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.432+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880052d0 con 0x7f5b840047c0 2023-11-24T06:17:55.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.432+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8802e050 con 0x7f5b840047c0 2023-11-24T06:17:55.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.432+0000 7f5b9d3a8640 1 -- 172.21.15.37:0/2539204086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88003830 con 0x7f5b840047c0 2023-11-24T06:17:55.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.433+0000 7f5ba060e640 1 -- 172.21.15.37:0/2539204086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 msgr2=0x7f5b84004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.433+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b84004c40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5b88001750 tx=0x7f5b840057f0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.433+0000 7f5ba060e640 1 -- 172.21.15.37:0/2539204086 shutdown_connections 2023-11-24T06:17:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.433+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2539204086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b84004c40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.433+0000 7f5ba060e640 1 -- 172.21.15.37:0/2539204086 >> 172.21.15.37:0/2539204086 conn(0x7f5b9806e7f0 msgr2=0x7f5b9806ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.433+0000 7f5ba060e640 1 -- 172.21.15.37:0/2539204086 shutdown_connections 2023-11-24T06:17:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.433+0000 7f5ba060e640 1 -- 172.21.15.37:0/2539204086 wait complete. 2023-11-24T06:17:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.435+0000 7f5ba060e640 1 Processor -- start 2023-11-24T06:17:55.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.435+0000 7f5ba060e640 1 -- start start 2023-11-24T06:17:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5ba060e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b981497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5ba060e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b980ae920 0x7f5b980af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5ba060e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b980af7b0 0x7f5b980acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5ba060e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980ae500 con 0x7f5b840047c0 2023-11-24T06:17:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5ba060e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98149ce0 con 0x7f5b980af7b0 2023-11-24T06:17:55.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5ba060e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980afc30 con 0x7f5b980ae920 2023-11-24T06:17:55.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5b9e3aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b981497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5b9e3aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b981497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38576/0 (socket says 172.21.15.37:38576) 2023-11-24T06:17:55.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.436+0000 7f5b9e3aa640 1 -- 172.21.15.37:0/2024004093 learned_addr learned my addr 172.21.15.37:0/2024004093 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:55.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9e3aa640 1 -- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b980ae920 msgr2=0x7f5b980af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9dba9640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b980ae920 0x7f5b980af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9ebab640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b980af7b0 0x7f5b980acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9e3aa640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b980ae920 0x7f5b980af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9e3aa640 1 -- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b980af7b0 msgr2=0x7f5b980acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9e3aa640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b980af7b0 0x7f5b980acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9e3aa640 1 -- 172.21.15.37:0/2024004093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b980ad880 con 0x7f5b840047c0 2023-11-24T06:17:55.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9ebab640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b980af7b0 0x7f5b980acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:55.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b9e3aa640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b981497a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5b940116d0 tx=0x7f5b94011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:55.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b8effd640 1 -- 172.21.15.37:0/2024004093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400f9c0 con 0x7f5b840047c0 2023-11-24T06:17:55.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b8effd640 1 -- 172.21.15.37:0/2024004093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9400fb20 con 0x7f5b840047c0 2023-11-24T06:17:55.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.437+0000 7f5b8effd640 1 -- 172.21.15.37:0/2024004093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400fe90 con 0x7f5b840047c0 2023-11-24T06:17:55.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.438+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b980adb60 con 0x7f5b840047c0 2023-11-24T06:17:55.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.438+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b980ae120 con 0x7f5b840047c0 2023-11-24T06:17:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.439+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b980ae770 con 0x7f5b840047c0 2023-11-24T06:17:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.440+0000 7f5b8effd640 1 -- 172.21.15.37:0/2024004093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f5b94015460 con 0x7f5b840047c0 2023-11-24T06:17:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.440+0000 7f5b8effd640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5b7c06af60 0x7f5b7c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.441+0000 7f5b8effd640 1 -- 172.21.15.37:0/2024004093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b94089c60 con 0x7f5b840047c0 2023-11-24T06:17:55.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.441+0000 7f5b9dba9640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5b7c06af60 0x7f5b7c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.442+0000 7f5b9dba9640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5b7c06af60 0x7f5b7c06d420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b88033000 tx=0x7f5b88009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:55.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.445+0000 7f5b8effd640 1 -- 172.21.15.37:0/2024004093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b94054c90 con 0x7f5b840047c0 2023-11-24T06:17:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.681+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b98067470 con 0x7f5b840047c0 2023-11-24T06:17:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.682+0000 7f5b8effd640 1 -- 172.21.15.37:0/2024004093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f5b94022090 con 0x7f5b840047c0 2023-11-24T06:17:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:55.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2892400858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2892400858},{"type":"v1","addr":"172.21.15.188:6835","nonce":2892400858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":4961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/4008465884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":4008465884},{"type":"v1","addr":"172.21.15.37:6837","nonce":4008465884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/2245601301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":2245601301},{"type":"v1","addr":"172.21.15.188:6834","nonce":2245601301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:17:32.142253+0000","modified":"2023-11-24T06:17:35.237267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6836/2581426871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2581426871},{"type":"v1","addr":"172.21.15.37:6836","nonce":2581426871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-24T06:17:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 41 2023-11-24T06:17:55.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5b7c06af60 msgr2=0x7f5b7c06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5b7c06af60 0x7f5b7c06d420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b88033000 tx=0x7f5b88009030 comp rx=0 tx=0).stop 2023-11-24T06:17:55.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 msgr2=0x7f5b981497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b981497a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5b940116d0 tx=0x7f5b94011b90 comp rx=0 tx=0).stop 2023-11-24T06:17:55.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 shutdown_connections 2023-11-24T06:17:55.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f5b7c06af60 0x7f5b7c06d420 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b980af7b0 0x7f5b980acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b980ae920 0x7f5b980af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 --2- 172.21.15.37:0/2024004093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b840047c0 0x7f5b981497a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.685+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 >> 172.21.15.37:0/2024004093 conn(0x7f5b9806e7f0 msgr2=0x7f5b980b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:55.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.686+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 shutdown_connections 2023-11-24T06:17:55.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.686+0000 7f5ba060e640 1 -- 172.21.15.37:0/2024004093 wait complete. 2023-11-24T06:17:55.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:17:55.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.936+0000 7f98109be640 1 Processor -- start 2023-11-24T06:17:55.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.936+0000 7f98109be640 1 -- start start 2023-11-24T06:17:55.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f98109be640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f980c0b2250 0x7f980c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f98109be640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f980c0b2aa0 0x7f980c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f98109be640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c15ab80 con 0x7f980c0b2630 2023-11-24T06:17:55.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f98109be640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c15a990 con 0x7f980c0b2aa0 2023-11-24T06:17:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f98109be640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c15e680 con 0x7f980c0b2250 2023-11-24T06:17:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f980ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f980c0b2aa0 0x7f980c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f9809d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f980c0b2630 0x7f980c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52340/0 (socket says 172.21.15.37:52340) 2023-11-24T06:17:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.937+0000 7f9809d9b640 1 -- 172.21.15.37:0/1825285722 learned_addr learned my addr 172.21.15.37:0/1825285722 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.938+0000 7f980a59c640 1 --2- 172.21.15.37:0/1825285722 >> v2:172.21.15.188:3300/0 conn(0x7f980c0b2250 0x7f980c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.938+0000 7f980ad9d640 1 -- 172.21.15.37:0/1825285722 >> v2:172.21.15.188:3300/0 conn(0x7f980c0b2250 msgr2=0x7f980c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.938+0000 7f980ad9d640 1 --2- 172.21.15.37:0/1825285722 >> v2:172.21.15.188:3300/0 conn(0x7f980c0b2250 0x7f980c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.938+0000 7f980ad9d640 1 -- 172.21.15.37:0/1825285722 >> v1:172.21.15.37:6789/0 conn(0x7f980c0b2630 legacy=0x7f980c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.938+0000 7f980ad9d640 1 -- 172.21.15.37:0/1825285722 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c15e960 con 0x7f980c0b2aa0 2023-11-24T06:17:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.939+0000 7f980ad9d640 1 --2- 172.21.15.37:0/1825285722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15b080 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f980c072a70 tx=0x7f980402dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad904596ff7cacf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.939+0000 7f980959a640 1 -- 172.21.15.37:0/1825285722 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980402f8a0 con 0x7f980c0b2aa0 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f980959a640 1 -- 172.21.15.37:0/1825285722 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980402fa00 con 0x7f980c0b2aa0 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f980959a640 1 -- 172.21.15.37:0/1825285722 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980402fd90 con 0x7f980c0b2aa0 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 -- 172.21.15.37:0/1825285722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 msgr2=0x7f980c15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 --2- 172.21.15.37:0/1825285722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15b080 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f980c072a70 tx=0x7f980402dae0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 -- 172.21.15.37:0/1825285722 shutdown_connections 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 --2- 172.21.15.37:0/1825285722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15b080 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 --2- 172.21.15.37:0/1825285722 >> v2:172.21.15.188:3300/0 conn(0x7f980c0b2250 0x7f980c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 -- 172.21.15.37:0/1825285722 >> 172.21.15.37:0/1825285722 conn(0x7f980c06a920 msgr2=0x7f980c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:55.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 -- 172.21.15.37:0/1825285722 shutdown_connections 2023-11-24T06:17:55.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.940+0000 7f98109be640 1 -- 172.21.15.37:0/1825285722 wait complete. 2023-11-24T06:17:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.942+0000 7f98109be640 1 Processor -- start 2023-11-24T06:17:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.942+0000 7f98109be640 1 -- start start 2023-11-24T06:17:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.943+0000 7f98109be640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f980c0b2250 0x7f980c14e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.943+0000 7f98109be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f980c0b2630 0x7f980c0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.943+0000 7f98109be640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.943+0000 7f98109be640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1531e0 con 0x7f980c0b2aa0 2023-11-24T06:17:55.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.943+0000 7f98109be640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c152560 con 0x7f980c0b2630 2023-11-24T06:17:55.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.943+0000 7f98109be640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c152840 con 0x7f980c0b2250 2023-11-24T06:17:55.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38592/0 (socket says 172.21.15.37:38592) 2023-11-24T06:17:55.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 -- 172.21.15.37:0/3229186707 learned_addr learned my addr 172.21.15.37:0/3229186707 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:55.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 -- 172.21.15.37:0/3229186707 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f980c0b2250 msgr2=0x7f980c14e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f980c0b2250 0x7f980c14e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 -- 172.21.15.37:0/3229186707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f980c0b2630 msgr2=0x7f980c0acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:55.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f980c0b2630 0x7f980c0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:55.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 -- 172.21.15.37:0/3229186707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9804009400 con 0x7f980c0b2aa0 2023-11-24T06:17:55.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.944+0000 7f980ad9d640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15cb00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f980402e0f0 tx=0x7f98040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:55.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.945+0000 7f9802ffd640 1 -- 172.21.15.37:0/3229186707 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804030a30 con 0x7f980c0b2aa0 2023-11-24T06:17:55.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.945+0000 7f9802ffd640 1 -- 172.21.15.37:0/3229186707 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804030bb0 con 0x7f980c0b2aa0 2023-11-24T06:17:55.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.945+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c0cd7c0 con 0x7f980c0b2aa0 2023-11-24T06:17:55.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.945+0000 7f9802ffd640 1 -- 172.21.15.37:0/3229186707 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804042410 con 0x7f980c0b2aa0 2023-11-24T06:17:55.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.945+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c152e00 con 0x7f980c0b2aa0 2023-11-24T06:17:55.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.946+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c067470 con 0x7f980c0b2aa0 2023-11-24T06:17:55.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.947+0000 7f9802ffd640 1 -- 172.21.15.37:0/3229186707 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f9804039400 con 0x7f980c0b2aa0 2023-11-24T06:17:55.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.948+0000 7f9802ffd640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f97ec06af60 0x7f97ec06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:55.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.948+0000 7f9802ffd640 1 -- 172.21.15.37:0/3229186707 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98040ab4b0 con 0x7f980c0b2aa0 2023-11-24T06:17:55.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.949+0000 7f980a59c640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f97ec06af60 0x7f97ec06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:55.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.950+0000 7f980a59c640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f97ec06af60 0x7f97ec06d420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0070b0 tx=0x7f97fc007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:55.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:55.954+0000 7f9802ffd640 1 -- 172.21.15.37:0/3229186707 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9804076330 con 0x7f980c0b2aa0 2023-11-24T06:17:56.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.148+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f980c0cea00 con 0x7f980c0b2aa0 2023-11-24T06:17:56.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.151+0000 7f9802ffd640 1 -- 172.21.15.37:0/3229186707 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f9804079950 con 0x7f980c0b2aa0 2023-11-24T06:17:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:17:56.154 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:33.680484+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:17:30.069208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-24T06:17:31.179643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:17:56.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f97ec06af60 msgr2=0x7f97ec06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f97ec06af60 0x7f97ec06d420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0070b0 tx=0x7f97fc007040 comp rx=0 tx=0).stop 2023-11-24T06:17:56.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 msgr2=0x7f980c15cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15cb00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f980402e0f0 tx=0x7f98040046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 shutdown_connections 2023-11-24T06:17:56.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f97ec06af60 0x7f97ec06d420 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f980c0b2630 0x7f980c0acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980c0b2aa0 0x7f980c15cb00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 --2- 172.21.15.37:0/3229186707 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f980c0b2250 0x7f980c14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.154+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 >> 172.21.15.37:0/3229186707 conn(0x7f980c06a920 msgr2=0x7f980c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:56.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.155+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 shutdown_connections 2023-11-24T06:17:56.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.155+0000 7f98109be640 1 -- 172.21.15.37:0/3229186707 wait complete. 2023-11-24T06:17:56.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:17:56.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.408+0000 7f764b59e640 1 Processor -- start 2023-11-24T06:17:56.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.408+0000 7f764b59e640 1 -- start start 2023-11-24T06:17:56.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.409+0000 7f764b59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f764c161810 0x7f764c0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.409+0000 7f764b59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c0c27a0 0x7f764c165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.409+0000 7f764b59e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0cec30 con 0x7f764c0ce480 2023-11-24T06:17:56.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.409+0000 7f764b59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c0ce950 con 0x7f764c161810 2023-11-24T06:17:56.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.409+0000 7f764b59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0ccdc0 con 0x7f764c0c27a0 2023-11-24T06:17:56.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f764c161810 0x7f764c0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f764c161810 0x7f764c0cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38606/0 (socket says 172.21.15.37:38606) 2023-11-24T06:17:56.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764a59c640 1 -- 172.21.15.37:0/765469675 learned_addr learned my addr 172.21.15.37:0/765469675 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:56.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764ad9d640 1 --2- 172.21.15.37:0/765469675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c0c27a0 0x7f764c165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764a59c640 1 -- 172.21.15.37:0/765469675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c0c27a0 msgr2=0x7f764c165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:56.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764a59c640 1 --2- 172.21.15.37:0/765469675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c0c27a0 0x7f764c165380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764a59c640 1 -- 172.21.15.37:0/765469675 >> v1:172.21.15.188:6789/0 conn(0x7f764c0ce480 legacy=0x7f764c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:56.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764a59c640 1 -- 172.21.15.37:0/765469675 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0cd0a0 con 0x7f764c161810 2023-11-24T06:17:56.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.410+0000 7f764ad9d640 1 --2- 172.21.15.37:0/765469675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c0c27a0 0x7f764c165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:56.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.411+0000 7f764a59c640 1 --2- 172.21.15.37:0/765469675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c161810 0x7f764c0cdf40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f763c009870 tx=0x7f763c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b137f154dac20bc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:56.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.412+0000 7f7649d9b640 1 -- 172.21.15.37:0/765469675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0317c0 con 0x7f764c161810 2023-11-24T06:17:56.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.412+0000 7f7649d9b640 1 -- 172.21.15.37:0/765469675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c031920 con 0x7f764c161810 2023-11-24T06:17:56.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.412+0000 7f7649d9b640 1 -- 172.21.15.37:0/765469675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c031cb0 con 0x7f764c161810 2023-11-24T06:17:56.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.412+0000 7f764b59e640 1 -- 172.21.15.37:0/765469675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c161810 msgr2=0x7f764c0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.412+0000 7f764b59e640 1 --2- 172.21.15.37:0/765469675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c161810 0x7f764c0cdf40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f763c009870 tx=0x7f763c02b860 comp rx=0 tx=0).stop 2023-11-24T06:17:56.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.413+0000 7f764b59e640 1 -- 172.21.15.37:0/765469675 shutdown_connections 2023-11-24T06:17:56.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.413+0000 7f764b59e640 1 --2- 172.21.15.37:0/765469675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c0c27a0 0x7f764c165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.413+0000 7f764b59e640 1 --2- 172.21.15.37:0/765469675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c161810 0x7f764c0cdf40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.413+0000 7f764b59e640 1 -- 172.21.15.37:0/765469675 >> 172.21.15.37:0/765469675 conn(0x7f764c0cbb40 msgr2=0x7f764c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:56.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.413+0000 7f764b59e640 1 -- 172.21.15.37:0/765469675 shutdown_connections 2023-11-24T06:17:56.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.413+0000 7f764b59e640 1 -- 172.21.15.37:0/765469675 wait complete. 2023-11-24T06:17:56.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.414+0000 7f764b59e640 1 Processor -- start 2023-11-24T06:17:56.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.415+0000 7f764b59e640 1 -- start start 2023-11-24T06:17:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.415+0000 7f764b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c0c27a0 0x7f764c1fb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764b59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f764c0ce480 0x7f764c09c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764b59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c161810 0x7f764c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764b59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c1fb6e0 con 0x7f764c0c27a0 2023-11-24T06:17:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764b59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0c3dc0 con 0x7f764c0ce480 2023-11-24T06:17:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764b59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0c40a0 con 0x7f764c161810 2023-11-24T06:17:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c0c27a0 0x7f764c1fb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c0c27a0 0x7f764c1fb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38618/0 (socket says 172.21.15.37:38618) 2023-11-24T06:17:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 -- 172.21.15.37:0/2404462533 learned_addr learned my addr 172.21.15.37:0/2404462533 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:56.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764ad9d640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c161810 0x7f764c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f7643fff640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f764c0ce480 0x7f764c09c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 -- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c161810 msgr2=0x7f764c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c161810 0x7f764c0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 -- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f764c0ce480 msgr2=0x7f764c09c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f764c0ce480 0x7f764c09c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764a59c640 1 -- 172.21.15.37:0/2404462533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0094d0 con 0x7f764c0c27a0 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f7643fff640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f764c0ce480 0x7f764c09c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.416+0000 7f764ad9d640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c161810 0x7f764c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.417+0000 7f764a59c640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c0c27a0 0x7f764c1fb1a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f763c000c00 tx=0x7f763c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.417+0000 7f7642ffd640 1 -- 172.21.15.37:0/2404462533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0329a0 con 0x7f764c0c27a0 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.417+0000 7f7642ffd640 1 -- 172.21.15.37:0/2404462533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c032b20 con 0x7f764c0c27a0 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.417+0000 7f7642ffd640 1 -- 172.21.15.37:0/2404462533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0453f0 con 0x7f764c0c27a0 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.417+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c0c4380 con 0x7f764c0c27a0 2023-11-24T06:17:56.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.417+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c0c4940 con 0x7f764c0c27a0 2023-11-24T06:17:56.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.418+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c0c41e0 con 0x7f764c0c27a0 2023-11-24T06:17:56.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.419+0000 7f7642ffd640 1 -- 172.21.15.37:0/2404462533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f763c04d3f0 con 0x7f764c0c27a0 2023-11-24T06:17:56.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.420+0000 7f7642ffd640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f762c06af60 0x7f762c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.421+0000 7f7642ffd640 1 -- 172.21.15.37:0/2404462533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f763c0ab730 con 0x7f764c0c27a0 2023-11-24T06:17:56.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.421+0000 7f7643fff640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f762c06af60 0x7f762c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.422+0000 7f7643fff640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f762c06af60 0x7f762c06d420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f764c0717e0 tx=0x7f7634009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:56.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.425+0000 7f7642ffd640 1 -- 172.21.15.37:0/2404462533 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f764c0c41e0 con 0x7f764c0c27a0 2023-11-24T06:17:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.659+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f764c0c41e0 con 0x7f764c0c27a0 2023-11-24T06:17:56.662 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-11-24T06:17:56.660+0000 7fe7fc218640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:17:56.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.664+0000 7f7642ffd640 1 -- 172.21.15.37:0/2404462533 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f764c0c41e0 con 0x7f764c0c27a0 2023-11-24T06:17:56.666 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:17:56.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.667+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f762c06af60 msgr2=0x7f762c06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.667+0000 7f764b59e640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f762c06af60 0x7f762c06d420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f764c0717e0 tx=0x7f7634009040 comp rx=0 tx=0).stop 2023-11-24T06:17:56.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.667+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c0c27a0 msgr2=0x7f764c1fb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.667+0000 7f764b59e640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c0c27a0 0x7f764c1fb1a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f763c000c00 tx=0x7f763c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 shutdown_connections 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f762c06af60 0x7f762c06d420 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f764c0ce480 0x7f764c09c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f764c161810 0x7f764c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 --2- 172.21.15.37:0/2404462533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c0c27a0 0x7f764c1fb1a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 >> 172.21.15.37:0/2404462533 conn(0x7f764c0cbb40 msgr2=0x7f764c071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 shutdown_connections 2023-11-24T06:17:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.668+0000 7f764b59e640 1 -- 172.21.15.37:0/2404462533 wait complete. 2023-11-24T06:17:56.680 INFO:tasks.ceph.mds.c.smithi037.stderr: -6155> 2023-11-24T06:17:36.715+0000 7f28393e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:17:56.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:17:56.741 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-11-24T06:17:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.889+0000 7f195b2df640 1 Processor -- start 2023-11-24T06:17:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.889+0000 7f195b2df640 1 -- start start 2023-11-24T06:17:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.890+0000 7f195b2df640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f19541609f0 0x7f19540d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.891+0000 7f195b2df640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19540b2050 0x7f19540d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.891+0000 7f195b2df640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540b41b0 con 0x7f1954160dd0 2023-11-24T06:17:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.891+0000 7f195b2df640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540b4490 con 0x7f19540b2050 2023-11-24T06:17:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.891+0000 7f195b2df640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540b0090 con 0x7f19541609f0 2023-11-24T06:17:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.891+0000 7f195aade640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19540b2050 0x7f19540d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.891+0000 7f195aade640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19540b2050 0x7f19540d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38650/0 (socket says 172.21.15.37:38650) 2023-11-24T06:17:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.891+0000 7f195aade640 1 -- 172.21.15.37:0/3306690503 learned_addr learned my addr 172.21.15.37:0/3306690503 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.892+0000 7f195a2dd640 1 --2- 172.21.15.37:0/3306690503 >> v2:172.21.15.188:3300/0 conn(0x7f19541609f0 0x7f19540d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.892+0000 7f195aade640 1 -- 172.21.15.37:0/3306690503 >> v2:172.21.15.188:3300/0 conn(0x7f19541609f0 msgr2=0x7f19540d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.892+0000 7f195aade640 1 --2- 172.21.15.37:0/3306690503 >> v2:172.21.15.188:3300/0 conn(0x7f19541609f0 0x7f19540d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.892+0000 7f195aade640 1 -- 172.21.15.37:0/3306690503 >> v1:172.21.15.188:6789/0 conn(0x7f1954160dd0 legacy=0x7f19540b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.892+0000 7f195aade640 1 -- 172.21.15.37:0/3306690503 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540b0370 con 0x7f19540b2050 2023-11-24T06:17:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.892+0000 7f195a2dd640 1 --2- 172.21.15.37:0/3306690503 >> v2:172.21.15.188:3300/0 conn(0x7f19541609f0 0x7f19540d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.893+0000 7f195aade640 1 --2- 172.21.15.37:0/3306690503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f19540d1830 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1954067bb0 tx=0x7f194c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62ff134724d02de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.893+0000 7f19592db640 1 -- 172.21.15.37:0/3306690503 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c030870 con 0x7f19540b2050 2023-11-24T06:17:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.893+0000 7f19592db640 1 -- 172.21.15.37:0/3306690503 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c0309d0 con 0x7f19540b2050 2023-11-24T06:17:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.893+0000 7f19592db640 1 -- 172.21.15.37:0/3306690503 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c030d60 con 0x7f19540b2050 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 -- 172.21.15.37:0/3306690503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 msgr2=0x7f19540d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 --2- 172.21.15.37:0/3306690503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f19540d1830 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1954067bb0 tx=0x7f194c02b9b0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 -- 172.21.15.37:0/3306690503 shutdown_connections 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 --2- 172.21.15.37:0/3306690503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f19540d1830 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 --2- 172.21.15.37:0/3306690503 >> v2:172.21.15.188:3300/0 conn(0x7f19541609f0 0x7f19540d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 -- 172.21.15.37:0/3306690503 >> 172.21.15.37:0/3306690503 conn(0x7f195409c5b0 msgr2=0x7f19540d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 -- 172.21.15.37:0/3306690503 shutdown_connections 2023-11-24T06:17:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.894+0000 7f195b2df640 1 -- 172.21.15.37:0/3306690503 wait complete. 2023-11-24T06:17:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.896+0000 7f195b2df640 1 Processor -- start 2023-11-24T06:17:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.896+0000 7f195b2df640 1 -- start start 2023-11-24T06:17:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195b2df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f195414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195b2df640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19541609f0 0x7f19540cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195b2df640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1954160dd0 0x7f19540cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195b2df640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195414bb70 con 0x7f19540b2050 2023-11-24T06:17:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195b2df640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540ccb20 con 0x7f19541609f0 2023-11-24T06:17:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195b2df640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1954154a70 con 0x7f1954160dd0 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195a2dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f195414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.897+0000 7f195a2dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f195414b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38652/0 (socket says 172.21.15.37:38652) 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f195a2dd640 1 -- 172.21.15.37:0/1399634325 learned_addr learned my addr 172.21.15.37:0/1399634325 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f195a2dd640 1 -- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1954160dd0 msgr2=0x7f19540cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f195a2dd640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1954160dd0 0x7f19540cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f195a2dd640 1 -- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19541609f0 msgr2=0x7f19540cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f1959adc640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19541609f0 0x7f19540cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f195a2dd640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19541609f0 0x7f19540cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f195a2dd640 1 -- 172.21.15.37:0/1399634325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0094d0 con 0x7f19540b2050 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f1959adc640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19541609f0 0x7f19540cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.898+0000 7f195a2dd640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f195414b630 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f195000cf60 tx=0x7f195000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.899+0000 7f194affd640 1 -- 172.21.15.37:0/1399634325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000d840 con 0x7f19540b2050 2023-11-24T06:17:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.899+0000 7f194affd640 1 -- 172.21.15.37:0/1399634325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195000d9a0 con 0x7f19540b2050 2023-11-24T06:17:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.899+0000 7f194affd640 1 -- 172.21.15.37:0/1399634325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000dd30 con 0x7f19540b2050 2023-11-24T06:17:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.899+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19540cbf10 con 0x7f19540b2050 2023-11-24T06:17:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.899+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540cc4d0 con 0x7f19540b2050 2023-11-24T06:17:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.900+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1954160550 con 0x7f19540b2050 2023-11-24T06:17:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.901+0000 7f194affd640 1 -- 172.21.15.37:0/1399634325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f1950015440 con 0x7f19540b2050 2023-11-24T06:17:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.902+0000 7f194affd640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f193806af60 0x7f193806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.902+0000 7f194affd640 1 -- 172.21.15.37:0/1399634325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f195008a250 con 0x7f19540b2050 2023-11-24T06:17:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.902+0000 7f1959adc640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f193806af60 0x7f193806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.903+0000 7f1959adc640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f193806af60 0x7f193806d420 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f195414be00 tx=0x7f1944009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:56.906+0000 7f194affd640 1 -- 172.21.15.37:0/1399634325 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19500551a0 con 0x7f19540b2050 2023-11-24T06:17:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.136+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f195404e840 con 0x7f19540b2050 2023-11-24T06:17:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.667+0000 7f194affd640 1 -- 172.21.15.37:0/1399634325 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f19500587c0 con 0x7f19540b2050 2023-11-24T06:17:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f193806af60 msgr2=0x7f193806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f193806af60 0x7f193806d420 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f195414be00 tx=0x7f1944009040 comp rx=0 tx=0).stop 2023-11-24T06:17:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 msgr2=0x7f195414b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f195414b630 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f195000cf60 tx=0x7f195000cf90 comp rx=0 tx=0).stop 2023-11-24T06:17:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 shutdown_connections 2023-11-24T06:17:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f193806af60 0x7f193806d420 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19541609f0 0x7f19540cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1954160dd0 0x7f19540cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 --2- 172.21.15.37:0/1399634325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19540b2050 0x7f195414b630 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.670+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 >> 172.21.15.37:0/1399634325 conn(0x7f195409c5b0 msgr2=0x7f195406bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.671+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 shutdown_connections 2023-11-24T06:17:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.671+0000 7f195b2df640 1 -- 172.21.15.37:0/1399634325 wait complete. 2023-11-24T06:17:57.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:17:57.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.911+0000 7fad7ee7c640 1 Processor -- start 2023-11-24T06:17:57.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.911+0000 7fad7ee7c640 1 -- start start 2023-11-24T06:17:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad7ee7c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad781461d0 0x7fad780b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad7ee7c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad780b3a60 0x7fad78167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad7ee7c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7806d180 con 0x7fad780b4fe0 2023-11-24T06:17:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad7ee7c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7806ba70 con 0x7fad780b3a60 2023-11-24T06:17:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad7ee7c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7806bd50 con 0x7fad781461d0 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad7d419640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad780b3a60 0x7fad78167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad77fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad780b4fe0 0x7fad780b3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52350/0 (socket says 172.21.15.37:52350) 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.913+0000 7fad77fff640 1 -- 172.21.15.37:0/154958764 learned_addr learned my addr 172.21.15.37:0/154958764 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.914+0000 7fad7cc18640 1 --2- 172.21.15.37:0/154958764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad781461d0 0x7fad780b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.914+0000 7fad777fe640 1 -- 172.21.15.37:0/154958764 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000519422 0 0) 0x7fad7806d180 con 0x7fad780b4fe0 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.914+0000 7fad777fe640 1 -- 172.21.15.37:0/154958764 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad68003520 con 0x7fad780b4fe0 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.914+0000 7fad7d419640 1 -- 172.21.15.37:0/154958764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad781461d0 msgr2=0x7fad780b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.914+0000 7fad7d419640 1 --2- 172.21.15.37:0/154958764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad781461d0 0x7fad780b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.914+0000 7fad7d419640 1 -- 172.21.15.37:0/154958764 >> v1:172.21.15.37:6789/0 conn(0x7fad780b4fe0 legacy=0x7fad780b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.914+0000 7fad7d419640 1 -- 172.21.15.37:0/154958764 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7806c030 con 0x7fad780b3a60 2023-11-24T06:17:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.915+0000 7fad7d419640 1 --2- 172.21.15.37:0/154958764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad780b3a60 0x7fad78167110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fad70009d90 tx=0x7fad7002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12199946d4d5f7be server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad777fe640 1 -- 172.21.15.37:0/154958764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7002cc50 con 0x7fad780b3a60 2023-11-24T06:17:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad777fe640 1 -- 172.21.15.37:0/154958764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7002cdb0 con 0x7fad780b3a60 2023-11-24T06:17:57.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad777fe640 1 -- 172.21.15.37:0/154958764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70034660 con 0x7fad780b3a60 2023-11-24T06:17:57.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad7ee7c640 1 -- 172.21.15.37:0/154958764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad780b3a60 msgr2=0x7fad78167110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:57.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/154958764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad780b3a60 0x7fad78167110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fad70009d90 tx=0x7fad7002bea0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad7ee7c640 1 -- 172.21.15.37:0/154958764 shutdown_connections 2023-11-24T06:17:57.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/154958764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad780b3a60 0x7fad78167110 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/154958764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad781461d0 0x7fad780b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad7ee7c640 1 -- 172.21.15.37:0/154958764 >> 172.21.15.37:0/154958764 conn(0x7fad78061340 msgr2=0x7fad78061750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:57.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.916+0000 7fad7ee7c640 1 -- 172.21.15.37:0/154958764 shutdown_connections 2023-11-24T06:17:57.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.917+0000 7fad7ee7c640 1 -- 172.21.15.37:0/154958764 wait complete. 2023-11-24T06:17:57.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.918+0000 7fad7ee7c640 1 Processor -- start 2023-11-24T06:17:57.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.919+0000 7fad7ee7c640 1 -- start start 2023-11-24T06:17:57.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.919+0000 7fad7ee7c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad780b3a60 0x7fad781f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:57.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.919+0000 7fad7ee7c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad780b4fe0 0x7fad780caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:57.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7ee7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad781461d0 0x7fad781404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:57.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7ee7c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad781f3ad0 con 0x7fad781461d0 2023-11-24T06:17:57.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7ee7c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7815ac20 con 0x7fad780b3a60 2023-11-24T06:17:57.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7ee7c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad781f2e50 con 0x7fad780b4fe0 2023-11-24T06:17:57.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad781461d0 0x7fad781404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:57.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad781461d0 0x7fad781404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38672/0 (socket says 172.21.15.37:38672) 2023-11-24T06:17:57.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 -- 172.21.15.37:0/1889170656 learned_addr learned my addr 172.21.15.37:0/1889170656 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad77fff640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad780b4fe0 0x7fad780caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 -- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad780b4fe0 msgr2=0x7fad780caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7cc18640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad780b3a60 0x7fad781f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad780b4fe0 0x7fad780caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 -- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad780b3a60 msgr2=0x7fad781f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad780b3a60 0x7fad781f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad7d419640 1 -- 172.21.15.37:0/1889170656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70009a70 con 0x7fad781461d0 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.920+0000 7fad77fff640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad780b4fe0 0x7fad780caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.921+0000 7fad7d419640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad781461d0 0x7fad781404a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fad70009eb0 tx=0x7fad70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.921+0000 7fad757fa640 1 -- 172.21.15.37:0/1889170656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70040650 con 0x7fad781461d0 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.921+0000 7fad757fa640 1 -- 172.21.15.37:0/1889170656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad700407b0 con 0x7fad781461d0 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.921+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad78146730 con 0x7fad781461d0 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.921+0000 7fad757fa640 1 -- 172.21.15.37:0/1889170656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70040b60 con 0x7fad781461d0 2023-11-24T06:17:57.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.921+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781f3410 con 0x7fad781461d0 2023-11-24T06:17:57.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.922+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad781f3c10 con 0x7fad781461d0 2023-11-24T06:17:57.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.923+0000 7fad757fa640 1 -- 172.21.15.37:0/1889170656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fad70040cc0 con 0x7fad781461d0 2023-11-24T06:17:57.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.924+0000 7fad757fa640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fad5c06af90 0x7fad5c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.924+0000 7fad757fa640 1 -- 172.21.15.37:0/1889170656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fad700ac2f0 con 0x7fad781461d0 2023-11-24T06:17:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.924+0000 7fad7cc18640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fad5c06af90 0x7fad5c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.925+0000 7fad7cc18640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fad5c06af90 0x7fad5c06d450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006fd0 tx=0x7fad6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:57.929+0000 7fad757fa640 1 -- 172.21.15.37:0/1889170656 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad781f3c10 con 0x7fad781461d0 2023-11-24T06:17:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.125+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad781f3c10 con 0x7fad781461d0 2023-11-24T06:17:58.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.887+0000 7fad757fa640 1 -- 172.21.15.37:0/1889170656 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 181+0+0 (secure 0 0 0) 0x7fad781f3c10 con 0x7fad781461d0 2023-11-24T06:17:58.890 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:17:58.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fad5c06af90 msgr2=0x7fad5c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:58.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fad5c06af90 0x7fad5c06d450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006fd0 tx=0x7fad6c008040 comp rx=0 tx=0).stop 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad781461d0 msgr2=0x7fad781404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad781461d0 0x7fad781404a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fad70009eb0 tx=0x7fad70004a40 comp rx=0 tx=0).stop 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 shutdown_connections 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fad5c06af90 0x7fad5c06d450 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad781461d0 0x7fad781404a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad780b4fe0 0x7fad780caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 --2- 172.21.15.37:0/1889170656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad780b3a60 0x7fad781f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 >> 172.21.15.37:0/1889170656 conn(0x7fad78061340 msgr2=0x7fad78145500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 shutdown_connections 2023-11-24T06:17:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:58.892+0000 7fad7ee7c640 1 -- 172.21.15.37:0/1889170656 wait complete. 2023-11-24T06:17:58.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:17:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.135+0000 7fd7a16ee640 1 Processor -- start 2023-11-24T06:17:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.135+0000 7fd7a16ee640 1 -- start start 2023-11-24T06:17:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.137+0000 7fd7a16ee640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c0ac840 0x7fd79c0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.137+0000 7fd7a16ee640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd79c0ae650 0x7fd79c0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.137+0000 7fd7a16ee640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0b4ef0 con 0x7fd79c15d4f0 2023-11-24T06:17:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.137+0000 7fd7a16ee640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0af000 con 0x7fd79c0ae650 2023-11-24T06:17:59.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.137+0000 7fd7a16ee640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0b4040 con 0x7fd79c0ac840 2023-11-24T06:17:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.138+0000 7fd79b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd79c0ae650 0x7fd79c0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.138+0000 7fd79b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd79c0ae650 0x7fd79c0aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.37:38524/0 (socket says 172.21.15.37:38524) 2023-11-24T06:17:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.138+0000 7fd79b7fe640 1 -- 172.21.15.37:0/2542291378 learned_addr learned my addr 172.21.15.37:0/2542291378 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.138+0000 7fd7927fc640 1 --2- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c0ac840 0x7fd79c0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.139+0000 7fd79b7fe640 1 -- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c0ac840 msgr2=0x7fd79c0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:17:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.139+0000 7fd79b7fe640 1 --2- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c0ac840 0x7fd79c0ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.139+0000 7fd79b7fe640 1 -- 172.21.15.37:0/2542291378 >> v1:172.21.15.188:6789/0 conn(0x7fd79c15d4f0 legacy=0x7fd79c0b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.139+0000 7fd79b7fe640 1 -- 172.21.15.37:0/2542291378 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c15d8d0 con 0x7fd79c0ae650 2023-11-24T06:17:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.140+0000 7fd79b7fe640 1 --2- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 0x7fd79c0aeac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd794009e50 tx=0x7fd79402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=793d047dc4f18b07 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.141+0000 7fd79a7fc640 1 -- 172.21.15.37:0/2542291378 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79402cb00 con 0x7fd79c0ae650 2023-11-24T06:17:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.141+0000 7fd79a7fc640 1 -- 172.21.15.37:0/2542291378 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79402cc60 con 0x7fd79c0ae650 2023-11-24T06:17:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.141+0000 7fd79a7fc640 1 -- 172.21.15.37:0/2542291378 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940343f0 con 0x7fd79c0ae650 2023-11-24T06:17:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.142+0000 7fd7a16ee640 1 -- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 msgr2=0x7fd79c0aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.142+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 0x7fd79c0aeac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd794009e50 tx=0x7fd79402bf60 comp rx=0 tx=0).stop 2023-11-24T06:17:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.142+0000 7fd7a16ee640 1 -- 172.21.15.37:0/2542291378 shutdown_connections 2023-11-24T06:17:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.142+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 0x7fd79c0aeac0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.142+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/2542291378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c0ac840 0x7fd79c0ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.142+0000 7fd7a16ee640 1 -- 172.21.15.37:0/2542291378 >> 172.21.15.37:0/2542291378 conn(0x7fd79c071d40 msgr2=0x7fd79c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.143+0000 7fd7a16ee640 1 -- 172.21.15.37:0/2542291378 shutdown_connections 2023-11-24T06:17:59.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.143+0000 7fd7a16ee640 1 -- 172.21.15.37:0/2542291378 wait complete. 2023-11-24T06:17:59.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.145+0000 7fd7a16ee640 1 Processor -- start 2023-11-24T06:17:59.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.145+0000 7fd7a16ee640 1 -- start start 2023-11-24T06:17:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd7a16ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd79c0ac840 0x7fd79c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd7a16ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 0x7fd79c152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd7a16ee640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c15d4f0 0x7fd79c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd7a16ee640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c14e9f0 con 0x7fd79c0ac840 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd7a16ee640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c1f2eb0 con 0x7fd79c0ae650 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd7a16ee640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c153560 con 0x7fd79c15d4f0 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd79affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd79c0ac840 0x7fd79c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd79affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd79c0ac840 0x7fd79c14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38678/0 (socket says 172.21.15.37:38678) 2023-11-24T06:17:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.146+0000 7fd79affd640 1 -- 172.21.15.37:0/1117827618 learned_addr learned my addr 172.21.15.37:0/1117827618 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:17:59.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd7927fc640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 0x7fd79c152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd79affd640 1 -- 172.21.15.37:0/1117827618 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c15d4f0 msgr2=0x7fd79c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd79affd640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c15d4f0 0x7fd79c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd79affd640 1 -- 172.21.15.37:0/1117827618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 msgr2=0x7fd79c152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd79affd640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 0x7fd79c152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd79affd640 1 -- 172.21.15.37:0/1117827618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794009b30 con 0x7fd79c0ac840 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd79affd640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd79c0ac840 0x7fd79c14e4b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c400 tx=0x7fd78c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd793fff640 1 -- 172.21.15.37:0/1117827618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0052d0 con 0x7fd79c0ac840 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd793fff640 1 -- 172.21.15.37:0/1117827618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c005450 con 0x7fd79c0ac840 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c1f30c0 con 0x7fd79c0ac840 2023-11-24T06:17:59.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd793fff640 1 -- 172.21.15.37:0/1117827618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c007260 con 0x7fd79c0ac840 2023-11-24T06:17:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.147+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c1f3680 con 0x7fd79c0ac840 2023-11-24T06:17:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.148+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c067470 con 0x7fd79c0ac840 2023-11-24T06:17:59.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.150+0000 7fd793fff640 1 -- 172.21.15.37:0/1117827618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fd78c0073c0 con 0x7fd79c0ac840 2023-11-24T06:17:59.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.151+0000 7fd793fff640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd78006af60 0x7fd78006d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:17:59.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.151+0000 7fd793fff640 1 -- 172.21.15.37:0/1117827618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fd78c088a10 con 0x7fd79c0ac840 2023-11-24T06:17:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.151+0000 7fd7927fc640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd78006af60 0x7fd78006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:17:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.152+0000 7fd7927fc640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd78006af60 0x7fd78006d420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0ceca0 tx=0x7fd784008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:17:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.156+0000 7fd793fff640 1 -- 172.21.15.37:0/1117827618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd78c053b00 con 0x7fd79c0ac840 2023-11-24T06:17:59.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.353+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd79c061100 con 0x7fd79c0ac840 2023-11-24T06:17:59.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.891+0000 7fd793fff640 1 -- 172.21.15.37:0/1117827618 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd78c057120 con 0x7fd79c0ac840 2023-11-24T06:17:59.894 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd78006af60 msgr2=0x7fd78006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd78006af60 0x7fd78006d420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0ceca0 tx=0x7fd784008040 comp rx=0 tx=0).stop 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd79c0ac840 msgr2=0x7fd79c14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd79c0ac840 0x7fd79c14e4b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00c400 tx=0x7fd78c00c8c0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 shutdown_connections 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd78006af60 0x7fd78006d420 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79c0ae650 0x7fd79c152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd79c15d4f0 0x7fd79c15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 --2- 172.21.15.37:0/1117827618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd79c0ac840 0x7fd79c14e4b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:17:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 >> 172.21.15.37:0/1117827618 conn(0x7fd79c071d40 msgr2=0x7fd79c0af140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:17:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.895+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 shutdown_connections 2023-11-24T06:17:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:17:59.896+0000 7fd7a16ee640 1 -- 172.21.15.37:0/1117827618 wait complete. 2023-11-24T06:17:59.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:18:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.137+0000 7f721c1a9640 1 Processor -- start 2023-11-24T06:18:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.138+0000 7f721c1a9640 1 -- start start 2023-11-24T06:18:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.140+0000 7f721c1a9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72140ccbd0 0x7f72141660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.140+0000 7f721c1a9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 0x7f72140c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.140+0000 7f721c1a9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72141655f0 con 0x7f72140ccfb0 2023-11-24T06:18:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.140+0000 7f721c1a9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140cc380 con 0x7f72140ccbd0 2023-11-24T06:18:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.141+0000 7f721c1a9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7214162b30 con 0x7f72140c9650 2023-11-24T06:18:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.141+0000 7f7219f45640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72140ccbd0 0x7f72141660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.141+0000 7f7219f45640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72140ccbd0 0x7f72141660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38680/0 (socket says 172.21.15.37:38680) 2023-11-24T06:18:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.141+0000 7f7219f45640 1 -- 172.21.15.37:0/3884906290 learned_addr learned my addr 172.21.15.37:0/3884906290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.141+0000 7f721a746640 1 --2- 172.21.15.37:0/3884906290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 0x7f72140c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.142+0000 7f7219f45640 1 -- 172.21.15.37:0/3884906290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 msgr2=0x7f72140c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.142+0000 7f7219f45640 1 --2- 172.21.15.37:0/3884906290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 0x7f72140c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.142+0000 7f7219f45640 1 -- 172.21.15.37:0/3884906290 >> v1:172.21.15.37:6789/0 conn(0x7f72140ccfb0 legacy=0x7f7214162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.142+0000 7f7218f43640 1 -- 172.21.15.37:0/3884906290 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314871651 0 0) 0x7f72141655f0 con 0x7f72140ccfb0 2023-11-24T06:18:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.142+0000 7f7219f45640 1 -- 172.21.15.37:0/3884906290 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214162e10 con 0x7f72140ccbd0 2023-11-24T06:18:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.144+0000 7f7219f45640 1 --2- 172.21.15.37:0/3884906290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141660b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7210009870 tx=0x7f721002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f28ec1412a4340c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.145+0000 7f7218f43640 1 -- 172.21.15.37:0/3884906290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210030840 con 0x7f72140ccbd0 2023-11-24T06:18:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.145+0000 7f7218f43640 1 -- 172.21.15.37:0/3884906290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72100309a0 con 0x7f72140ccbd0 2023-11-24T06:18:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.145+0000 7f7218f43640 1 -- 172.21.15.37:0/3884906290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210030d30 con 0x7f72140ccbd0 2023-11-24T06:18:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 -- 172.21.15.37:0/3884906290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 msgr2=0x7f72141660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3884906290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141660b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7210009870 tx=0x7f721002b980 comp rx=0 tx=0).stop 2023-11-24T06:18:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 -- 172.21.15.37:0/3884906290 shutdown_connections 2023-11-24T06:18:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3884906290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 0x7f72140c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3884906290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141660b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 -- 172.21.15.37:0/3884906290 >> 172.21.15.37:0/3884906290 conn(0x7f72140b0c50 msgr2=0x7f72140b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 -- 172.21.15.37:0/3884906290 shutdown_connections 2023-11-24T06:18:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.146+0000 7f721c1a9640 1 -- 172.21.15.37:0/3884906290 wait complete. 2023-11-24T06:18:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.148+0000 7f721c1a9640 1 Processor -- start 2023-11-24T06:18:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.149+0000 7f721c1a9640 1 -- start start 2023-11-24T06:18:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.149+0000 7f721c1a9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 0x7f7214163a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.149+0000 7f721c1a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f721c1a9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72140ccfb0 0x7f72140b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f721c1a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7214164b50 con 0x7f72140ccbd0 2023-11-24T06:18:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f721c1a9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140709b0 con 0x7f72140ccfb0 2023-11-24T06:18:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f721c1a9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72141642b0 con 0x7f72140c9650 2023-11-24T06:18:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141f6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38690/0 (socket says 172.21.15.37:38690) 2023-11-24T06:18:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 -- 172.21.15.37:0/3524670606 learned_addr learned my addr 172.21.15.37:0/3524670606 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 -- 172.21.15.37:0/3524670606 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 msgr2=0x7f7214163a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 0x7f7214163a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 -- 172.21.15.37:0/3524670606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72140ccfb0 msgr2=0x7f72140b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72140ccfb0 0x7f72140b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.150+0000 7f7219744640 1 -- 172.21.15.37:0/3524670606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100094d0 con 0x7f72140ccbd0 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.151+0000 7f7219744640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141f6b30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f720400c4b0 tx=0x7f720400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.151+0000 7f720a7fc640 1 -- 172.21.15.37:0/3524670606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204005480 con 0x7f72140ccbd0 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.151+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7214164590 con 0x7f72140ccbd0 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.151+0000 7f720a7fc640 1 -- 172.21.15.37:0/3524670606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72040035f0 con 0x7f72140ccbd0 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.152+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7214163fa0 con 0x7f72140ccbd0 2023-11-24T06:18:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.152+0000 7f720a7fc640 1 -- 172.21.15.37:0/3524670606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72040039a0 con 0x7f72140ccbd0 2023-11-24T06:18:00.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.153+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc005250 con 0x7f72140ccbd0 2023-11-24T06:18:00.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.155+0000 7f720a7fc640 1 -- 172.21.15.37:0/3524670606 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f7204003b00 con 0x7f72140ccbd0 2023-11-24T06:18:00.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.156+0000 7f720a7fc640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f806af90 0x7f71f806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.156+0000 7f720a7fc640 1 -- 172.21.15.37:0/3524670606 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7204088a70 con 0x7f72140ccbd0 2023-11-24T06:18:00.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.156+0000 7f7219f45640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f806af90 0x7f71f806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.157+0000 7f7219f45640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f806af90 0x7f71f806d450 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7210036000 tx=0x7f721003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:00.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.160+0000 7f720a7fc640 1 -- 172.21.15.37:0/3524670606 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7204053c90 con 0x7f72140ccbd0 2023-11-24T06:18:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.352+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f71fc005a80 con 0x7f72140ccbd0 2023-11-24T06:18:00.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.360+0000 7f720a7fc640 1 -- 172.21.15.37:0/3524670606 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72040572b0 con 0x7f72140ccbd0 2023-11-24T06:18:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f806af90 msgr2=0x7f71f806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f806af90 0x7f71f806d450 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7210036000 tx=0x7f721003b040 comp rx=0 tx=0).stop 2023-11-24T06:18:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 msgr2=0x7f72141f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141f6b30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f720400c4b0 tx=0x7f720400c970 comp rx=0 tx=0).stop 2023-11-24T06:18:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 shutdown_connections 2023-11-24T06:18:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f71f806af90 0x7f71f806d450 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72140ccfb0 0x7f72140b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72140ccbd0 0x7f72141f6b30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 --2- 172.21.15.37:0/3524670606 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72140c9650 0x7f7214163a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.362+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 >> 172.21.15.37:0/3524670606 conn(0x7f72140b0c50 msgr2=0x7f72140c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.363+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 shutdown_connections 2023-11-24T06:18:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.363+0000 7f721c1a9640 1 -- 172.21.15.37:0/3524670606 wait complete. 2023-11-24T06:18:00.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-11-24T06:18:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.605+0000 7f6afa573640 1 Processor -- start 2023-11-24T06:18:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.605+0000 7f6afa573640 1 -- start start 2023-11-24T06:18:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.606+0000 7f6afa573640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6af415d4e0 0x7f6af40d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.606+0000 7f6afa573640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af40d0240 0x7f6af40b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.606+0000 7f6afa573640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af40ce990 con 0x7f6af40d38e0 2023-11-24T06:18:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.606+0000 7f6afa573640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af40d4110 con 0x7f6af415d4e0 2023-11-24T06:18:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.606+0000 7f6afa573640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40cec70 con 0x7f6af40d0240 2023-11-24T06:18:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6af9571640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6af415d4e0 0x7f6af40d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6af8d70640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6af40d38e0 0x7f6af40cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52374/0 (socket says 172.21.15.37:52374) 2023-11-24T06:18:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6af8d70640 1 -- 172.21.15.37:0/1941124073 learned_addr learned my addr 172.21.15.37:0/1941124073 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6af9d72640 1 --2- 172.21.15.37:0/1941124073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af40d0240 0x7f6af40b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6af9571640 1 -- 172.21.15.37:0/1941124073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af40d0240 msgr2=0x7f6af40b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6af9571640 1 --2- 172.21.15.37:0/1941124073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af40d0240 0x7f6af40b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6af9571640 1 -- 172.21.15.37:0/1941124073 >> v1:172.21.15.37:6789/0 conn(0x7f6af40d38e0 legacy=0x7f6af40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.607+0000 7f6aebfff640 1 -- 172.21.15.37:0/1941124073 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203754843 0 0) 0x7f6af40ce990 con 0x7f6af40d38e0 2023-11-24T06:18:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.608+0000 7f6af9571640 1 -- 172.21.15.37:0/1941124073 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40cef50 con 0x7f6af415d4e0 2023-11-24T06:18:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.609+0000 7f6af9571640 1 --2- 172.21.15.37:0/1941124073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af415d4e0 0x7f6af40d1e20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6af00097a0 tx=0x7f6af002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32767873b5e2a2f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:00.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.609+0000 7f6aebfff640 1 -- 172.21.15.37:0/1941124073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0031830 con 0x7f6af415d4e0 2023-11-24T06:18:00.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.609+0000 7f6aebfff640 1 -- 172.21.15.37:0/1941124073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0031990 con 0x7f6af415d4e0 2023-11-24T06:18:00.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.609+0000 7f6aebfff640 1 -- 172.21.15.37:0/1941124073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0031d20 con 0x7f6af415d4e0 2023-11-24T06:18:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 -- 172.21.15.37:0/1941124073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af415d4e0 msgr2=0x7f6af40d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 --2- 172.21.15.37:0/1941124073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af415d4e0 0x7f6af40d1e20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6af00097a0 tx=0x7f6af002b8d0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 -- 172.21.15.37:0/1941124073 shutdown_connections 2023-11-24T06:18:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 --2- 172.21.15.37:0/1941124073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af40d0240 0x7f6af40b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 --2- 172.21.15.37:0/1941124073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af415d4e0 0x7f6af40d1e20 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 -- 172.21.15.37:0/1941124073 >> 172.21.15.37:0/1941124073 conn(0x7f6af409c510 msgr2=0x7f6af40d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 -- 172.21.15.37:0/1941124073 shutdown_connections 2023-11-24T06:18:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.610+0000 7f6afa573640 1 -- 172.21.15.37:0/1941124073 wait complete. 2023-11-24T06:18:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.612+0000 7f6afa573640 1 Processor -- start 2023-11-24T06:18:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.612+0000 7f6afa573640 1 -- start start 2023-11-24T06:18:00.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.613+0000 7f6afa573640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6af40d0240 0x7f6af40cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.613+0000 7f6afa573640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af40d38e0 0x7f6af415f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.613+0000 7f6afa573640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af415d4e0 0x7f6af40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.613+0000 7f6afa573640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c6ca0 con 0x7f6af40d38e0 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.613+0000 7f6afa573640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c6ef0 con 0x7f6af40d0240 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.613+0000 7f6afa573640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c71d0 con 0x7f6af415d4e0 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af40d38e0 0x7f6af415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af40d38e0 0x7f6af415f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38714/0 (socket says 172.21.15.37:38714) 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 -- 172.21.15.37:0/2193065466 learned_addr learned my addr 172.21.15.37:0/2193065466 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af9571640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6af40d0240 0x7f6af40cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af9d72640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af415d4e0 0x7f6af40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 -- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af415d4e0 msgr2=0x7f6af40ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af415d4e0 0x7f6af40ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 -- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6af40d0240 msgr2=0x7f6af40cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6af40d0240 0x7f6af40cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af8d70640 1 -- 172.21.15.37:0/2193065466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af0009400 con 0x7f6af40d38e0 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.614+0000 7f6af9d72640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af415d4e0 0x7f6af40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.615+0000 7f6af8d70640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af40d38e0 0x7f6af415f970 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c4a0 tx=0x7f6ae400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.615+0000 7f6ae9ffb640 1 -- 172.21.15.37:0/2193065466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4005ce0 con 0x7f6af40d38e0 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.615+0000 7f6ae9ffb640 1 -- 172.21.15.37:0/2193065466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4005e40 con 0x7f6af40d38e0 2023-11-24T06:18:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.615+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af40c74b0 con 0x7f6af40d38e0 2023-11-24T06:18:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.615+0000 7f6ae9ffb640 1 -- 172.21.15.37:0/2193065466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40072b0 con 0x7f6af40d38e0 2023-11-24T06:18:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.615+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af40c9a10 con 0x7f6af40d38e0 2023-11-24T06:18:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.616+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af40c79d0 con 0x7f6af40d38e0 2023-11-24T06:18:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.617+0000 7f6ae9ffb640 1 -- 172.21.15.37:0/2193065466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f6ae4007410 con 0x7f6af40d38e0 2023-11-24T06:18:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.618+0000 7f6ae9ffb640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ad806af60 0x7f6ad806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.618+0000 7f6ae9ffb640 1 -- 172.21.15.37:0/2193065466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ae4088a30 con 0x7f6af40d38e0 2023-11-24T06:18:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.619+0000 7f6af9571640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ad806af60 0x7f6ad806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.619+0000 7f6af9571640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ad806af60 0x7f6ad806d420 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6af0036000 tx=0x7f6af003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:00.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.623+0000 7f6ae9ffb640 1 -- 172.21.15.37:0/2193065466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6af40c79d0 con 0x7f6af40d38e0 2023-11-24T06:18:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.891+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f6af40c79d0 con 0x7f6af40d38e0 2023-11-24T06:18:00.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.908+0000 7f6ae9ffb640 1 -- 172.21.15.37:0/2193065466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v199) v1 ==== 158+0+0 (secure 0 0 0) 0x7f6af40c79d0 con 0x7f6af40d38e0 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ad806af60 msgr2=0x7f6ad806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ad806af60 0x7f6ad806d420 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6af0036000 tx=0x7f6af003c040 comp rx=0 tx=0).stop 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af40d38e0 msgr2=0x7f6af415f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af40d38e0 0x7f6af415f970 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c4a0 tx=0x7f6ae400c960 comp rx=0 tx=0).stop 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 shutdown_connections 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f6ad806af60 0x7f6ad806d420 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6af415d4e0 0x7f6af40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af40d38e0 0x7f6af415f970 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 --2- 172.21.15.37:0/2193065466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6af40d0240 0x7f6af40cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 >> 172.21.15.37:0/2193065466 conn(0x7f6af409c510 msgr2=0x7f6af406ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 shutdown_connections 2023-11-24T06:18:00.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:00.912+0000 7f6afa573640 1 -- 172.21.15.37:0/2193065466 wait complete. 2023-11-24T06:18:00.933 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ERROR 2023-11-24T06:18:00.933 INFO:tasks.cephfs_test_runner: 2023-11-24T06:18:00.933 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:18:00.933 INFO:tasks.cephfs_test_runner:ERROR: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-11-24T06:18:00.933 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 568, in test_volume_info_pending_subvol_deletions 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner: self._do_subvolume_io(subvolname, number_of_files=3000, file_size=0) 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 278, in _do_subvolume_io 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner: filename = "{0}.{1}".format(TestVolumes.TEST_FILE_NAME_PREFIX, i) 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner:AttributeError: type object 'TestVolumes' has no attribute 'TEST_FILE_NAME_PREFIX' 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner: 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner:Ran 3 tests in 151.462s 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner: 2023-11-24T06:18:00.934 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner: 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner:ERROR: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 568, in test_volume_info_pending_subvol_deletions 2023-11-24T06:18:00.937 INFO:tasks.cephfs_test_runner: self._do_subvolume_io(subvolname, number_of_files=3000, file_size=0) 2023-11-24T06:18:00.938 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 278, in _do_subvolume_io 2023-11-24T06:18:00.938 INFO:tasks.cephfs_test_runner: filename = "{0}.{1}".format(TestVolumes.TEST_FILE_NAME_PREFIX, i) 2023-11-24T06:18:00.938 INFO:tasks.cephfs_test_runner:AttributeError: type object 'TestVolumes' has no attribute 'TEST_FILE_NAME_PREFIX' 2023-11-24T06:18:00.938 INFO:tasks.cephfs_test_runner: 2023-11-24T06:18:00.938 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-11-24T06:18:01.003 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=47043a1c0bd240cca2f7998da2793d7a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-11-24T06:18:01.005 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T06:18:01.014 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-24T06:18:01.060 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T06:18:01.060 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:18:01.061 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:18:01.126 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:18:01.126 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-11-24T06:18:01.127 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:18:01.181 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T06:18:01.181 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:18:01.181 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:18:01.240 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:18:01.240 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-11-24T06:18:01.240 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:18:01.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T06:18:01.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.293 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:18:01.356 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:18:01.357 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:18:01.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:18:01.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:18:01.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-11-24T06:18:01.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.705 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-11-24T06:18:01.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-11-24T06:18:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-11-24T06:18:01.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:18:01.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.900 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:18:01.959 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:18:01.961 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:18:01.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:01.962 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:18:02.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:02.058 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:18:02.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:02.148 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2023-11-24T06:18:02.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:02.301 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-11-24T06:18:02.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:18:02.348 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2023-11-24T06:18:02.493 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2023-11-24T06:18:02.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:18:02.496 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T06:18:02.507 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:18:02.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:18:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.745+0000 7f557d678640 1 Processor -- start 2023-11-24T06:18:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.745+0000 7f557d678640 1 -- start start 2023-11-24T06:18:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.746+0000 7f557d678640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f55780b1180 0x7f55781683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.746+0000 7f557d678640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5578161510 con 0x7f5578161080 2023-11-24T06:18:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.747+0000 7f557d678640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55781617f0 con 0x7f5578143870 2023-11-24T06:18:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.747+0000 7f557d678640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5578070460 con 0x7f55780b1180 2023-11-24T06:18:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.747+0000 7f556f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5578161080 0x7f55780b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40696/0 (socket says 172.21.15.37:40696) 2023-11-24T06:18:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.747+0000 7f556f7fe640 1 -- 172.21.15.37:0/3542487877 learned_addr learned my addr 172.21.15.37:0/3542487877 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.747+0000 7f557ce77640 1 --2- 172.21.15.37:0/3542487877 >> v2:172.21.15.188:3300/0 conn(0x7f55780b1180 0x7f55781683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.747+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820170016 0 0) 0x7f5578161510 con 0x7f5578161080 2023-11-24T06:18:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.747+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5564003520 con 0x7f5578161080 2023-11-24T06:18:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682363677 0 0) 0x7f5564003520 con 0x7f5578161080 2023-11-24T06:18:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 >> v2:172.21.15.188:3300/0 conn(0x7f55780b1180 msgr2=0x7f55781683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 --2- 172.21.15.37:0/3542487877 >> v2:172.21.15.188:3300/0 conn(0x7f55780b1180 0x7f55781683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 >> v1:172.21.15.188:6789/0 conn(0x7f5578143870 legacy=0x7f5578146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578161ad0 con 0x7f5578161080 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f5560001670 con 0x7f5578161080 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 >> v1:172.21.15.37:6789/0 conn(0x7f5578161080 legacy=0x7f55780b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5564003970 0x7f5564003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f5564004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5564005180 0x7f556400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578070460 con 0x7f55640047c0 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556400c020 con 0x7f5564005180 2023-11-24T06:18:02.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556400c1e0 con 0x7f5564003970 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.748+0000 7f556f7fe640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f5564004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.749+0000 7f557ce77640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5564005180 0x7f556400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.749+0000 7f556f7fe640 1 -- 172.21.15.37:0/3542487877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5564003970 msgr2=0x7f5564003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.749+0000 7f556f7fe640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5564003970 0x7f5564003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.749+0000 7f556f7fe640 1 -- 172.21.15.37:0/3542487877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5564005180 msgr2=0x7f556400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.749+0000 7f556f7fe640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5564005180 0x7f556400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.749+0000 7f556f7fe640 1 -- 172.21.15.37:0/3542487877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5564003520 con 0x7f55640047c0 2023-11-24T06:18:02.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.749+0000 7f557ce77640 1 -- 172.21.15.37:0/3542487877 reap_dead start 2023-11-24T06:18:02.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.750+0000 7f556f7fe640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f5564004c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f556000c240 tx=0x7f55640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe590e3d1834f86 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:02.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.750+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560005ad0 con 0x7f55640047c0 2023-11-24T06:18:02.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.750+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5560005c30 con 0x7f55640047c0 2023-11-24T06:18:02.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.750+0000 7f55777fe640 1 -- 172.21.15.37:0/3542487877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556002cab0 con 0x7f55640047c0 2023-11-24T06:18:02.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.751+0000 7f557d678640 1 -- 172.21.15.37:0/3542487877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 msgr2=0x7f5564004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:02.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.751+0000 7f557d678640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f5564004c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f556000c240 tx=0x7f55640057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.751+0000 7f557d678640 1 -- 172.21.15.37:0/3542487877 shutdown_connections 2023-11-24T06:18:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.751+0000 7f557d678640 1 --2- 172.21.15.37:0/3542487877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f5564004c40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.751+0000 7f557d678640 1 -- 172.21.15.37:0/3542487877 >> 172.21.15.37:0/3542487877 conn(0x7f55780cb830 msgr2=0x7f55780cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.751+0000 7f557d678640 1 -- 172.21.15.37:0/3542487877 shutdown_connections 2023-11-24T06:18:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.751+0000 7f557d678640 1 -- 172.21.15.37:0/3542487877 wait complete. 2023-11-24T06:18:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.753+0000 7f557d678640 1 Processor -- start 2023-11-24T06:18:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.753+0000 7f557d678640 1 -- start start 2023-11-24T06:18:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f557d678640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f55781348a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f557d678640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f557813eb00 0x7f557813e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f557d678640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f557815db80 0x7f5578071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f557d678640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557815e080 con 0x7f55640047c0 2023-11-24T06:18:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f557d678640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557815e360 con 0x7f557813eb00 2023-11-24T06:18:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f557d678640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557815e640 con 0x7f557815db80 2023-11-24T06:18:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f5577fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f55781348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f5577fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f55781348a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49910/0 (socket says 172.21.15.37:49910) 2023-11-24T06:18:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f5577fff640 1 -- 172.21.15.37:0/2494030809 learned_addr learned my addr 172.21.15.37:0/2494030809 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f556f7fe640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f557813eb00 0x7f557813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f5577fff640 1 -- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f557815db80 msgr2=0x7f5578071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f5577fff640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f557815db80 0x7f5578071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f5577fff640 1 -- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f557813eb00 msgr2=0x7f557813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.754+0000 7f5577fff640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f557813eb00 0x7f557813e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f5577fff640 1 -- 172.21.15.37:0/2494030809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557815e920 con 0x7f55640047c0 2023-11-24T06:18:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f556f7fe640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f557813eb00 0x7f557813e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f5577fff640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f55781348a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f556800c690 tx=0x7f556800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f55757fa640 1 -- 172.21.15.37:0/2494030809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568006d50 con 0x7f55640047c0 2023-11-24T06:18:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f55757fa640 1 -- 172.21.15.37:0/2494030809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568003970 con 0x7f55640047c0 2023-11-24T06:18:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f55757fa640 1 -- 172.21.15.37:0/2494030809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568003d60 con 0x7f55640047c0 2023-11-24T06:18:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557815ec00 con 0x7f55640047c0 2023-11-24T06:18:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.755+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557815f300 con 0x7f55640047c0 2023-11-24T06:18:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.756+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557804e840 con 0x7f55640047c0 2023-11-24T06:18:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.757+0000 7f55757fa640 1 -- 172.21.15.37:0/2494030809 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f55680050d0 con 0x7f55640047c0 2023-11-24T06:18:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.758+0000 7f55757fa640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f555806af90 0x7f555806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.758+0000 7f55757fa640 1 -- 172.21.15.37:0/2494030809 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5568088ff0 con 0x7f55640047c0 2023-11-24T06:18:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.759+0000 7f556f7fe640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f555806af90 0x7f555806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.759+0000 7f556f7fe640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f555806af90 0x7f555806d450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5560034000 tx=0x7f5560009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.763+0000 7f55757fa640 1 -- 172.21.15.37:0/2494030809 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5568054280 con 0x7f55640047c0 2023-11-24T06:18:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.955+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f557815e4d0 con 0x7f555806af90 2023-11-24T06:18:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.958+0000 7f55757fa640 1 -- 172.21.15.37:0/2494030809 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49064 (secure 0 0 0) 0x7f557815e4d0 con 0x7f555806af90 2023-11-24T06:18:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:18:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:18:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.960+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f555806af90 msgr2=0x7f555806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.960+0000 7f557d678640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f555806af90 0x7f555806d450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5560034000 tx=0x7f5560009030 comp rx=0 tx=0).stop 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.960+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 msgr2=0x7f55781348a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.960+0000 7f557d678640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f55781348a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f556800c690 tx=0x7f556800cb50 comp rx=0 tx=0).stop 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 shutdown_connections 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f555806af90 0x7f555806d450 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f557813eb00 0x7f557813e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f557815db80 0x7f5578071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 --2- 172.21.15.37:0/2494030809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640047c0 0x7f55781348a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 >> 172.21.15.37:0/2494030809 conn(0x7f55780cb830 msgr2=0x7f5578146850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 shutdown_connections 2023-11-24T06:18:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:02.961+0000 7f557d678640 1 -- 172.21.15.37:0/2494030809 wait complete. 2023-11-24T06:18:02.982 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-24T06:18:02.874419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240368,"kb_used_data":7568,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734352,"statfs":{"total":773094113280,"available":772847976448,"internally_reserved":0,"allocated":7749632,"data_stored":4026736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33867,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-67,"num_write_kb":-57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.208539"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:34.043616+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:17:34.043616+0000","last_peered":"2023-11-24T06:17:34.043616+0000","last_clean":"2023-11-24T06:17:34.043616+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:17:34.043616+0000","last_undegraded":"2023-11-24T06:17:34.043616+0000","last_fullsized":"2023-11-24T06:17:34.043616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1409024,"data_stored":937329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.077,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6279999999999999,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.0389999999999999,"15min":0.997},"min":{"1min":0.64200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5529999999999999,"5min":1.681,"15min":1.681},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.633,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.232,"15min":1.238},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.492,"5min":2.004,"15min":2.004},"last":1.6220000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.175,"15min":1.194},"min":{"1min":0.752,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.048},{"interface":"front","average":{"1min":1.169,"5min":1.1619999999999999,"15min":1.1539999999999999},"min":{"1min":0.81599999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.645,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.256,"15min":1.238},"min":{"1min":0.95499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6060000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3440000000000001,"15min":1.3420000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.681,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3480000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6839999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.45,"5min":1.4570000000000001,"15min":1.4590000000000001},"min":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.7050000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4970000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4239999999999999,"15min":1.4319999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7230000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.556},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.464,"15min":1.48},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.677}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.516,"15min":1.5409999999999999},"min":{"1min":0.94199999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.8779999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.75},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.472,"15min":1.478},"min":{"1min":1.0469999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7949999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.72}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":346308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.427,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5009999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4850000000000001,"5min":1.615,"15min":1.615},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.075,"5min":1.1579999999999999,"15min":1.179},"min":{"1min":0.79500000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5049999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.264}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.3129999999999999},"min":{"1min":0.86899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6220000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.226,"5min":1.3240000000000001,"15min":1.3480000000000001},"min":{"1min":0.753,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.575,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.3,"15min":1.3580000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.375,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.121},{"interface":"front","average":{"1min":1.169,"5min":1.276,"15min":1.296},"min":{"1min":0.85299999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.542,"5min":2.056,"15min":2.056},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.3899999999999999,"15min":1.4370000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6899999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.4870000000000001,"15min":1.5269999999999999},"min":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6539999999999999,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.3819999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.409,"15min":1.4490000000000001},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.728,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.569,"15min":1.619},"min":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6379999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.5089999999999999,"15min":1.5249999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8560000000000001,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.482},{"interface":"front","average":{"1min":1.365,"5min":1.476,"15min":1.4770000000000001},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.712,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.3560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":346435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0509999999999999,"15min":1.0589999999999999},"min":{"1min":0.79700000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.133,"15min":1.131},"min":{"1min":0.72299999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5680000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.155,"15min":1.1699999999999999},"min":{"1min":0.86899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.288,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.85699999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.878}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.258,"15min":1.27},"min":{"1min":0.82599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7250000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4399999999999999,"15min":1.444},"min":{"1min":1.012,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.861,"5min":2.198,"15min":2.198},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.175},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4470000000000001},"min":{"1min":0.96699999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7290000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3220000000000001,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.9239999999999999,"5min":2.427,"15min":2.427},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.4419999999999999,"15min":1.474},"min":{"1min":1.085,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6890000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.339}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.54,"15min":1.5820000000000001},"min":{"1min":0.88,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.5509999999999999,"15min":1.6080000000000001},"min":{"1min":0.86599999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.98,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.222}]},{"osd":7,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.6419999999999999,"15min":1.6599999999999999},"min":{"1min":1.395,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.901,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.6930000000000001,"15min":1.7070000000000001},"min":{"1min":1.1359999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.95,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.4970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":346286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0289999999999999,"15min":1.002},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5109999999999999,"5min":1.643,"15min":1.643},"last":1.264},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.079,"15min":1.071},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.3129999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0900000000000001,"15min":1.0800000000000001},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.02},{"interface":"front","average":{"1min":1.244,"5min":1.2529999999999999,"15min":1.2569999999999999},"min":{"1min":0.88200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5429999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.224,"15min":1.212},"min":{"1min":0.82099999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.962,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2210000000000001,"15min":1.2430000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.413}]},{"osd":3,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3129999999999999,"15min":1.3340000000000001},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6200000000000001,"5min":2.089,"15min":2.089},"last":1.603},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.4710000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.298,"15min":1.3029999999999999},"min":{"1min":0.86699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.361,"5min":1.381,"15min":1.399},"min":{"1min":1.0669999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.8999999999999999,"5min":1.964,"15min":1.964},"last":1.5069999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.571,"15min":1.611},"min":{"1min":1.0700000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0169999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.569,"15min":1.5900000000000001},"min":{"1min":1.1479999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.9710000000000001,"5min":2.222,"15min":2.222},"last":1.6639999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4990000000000001,"15min":1.5209999999999999},"min":{"1min":1.107,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.135},{"interface":"front","average":{"1min":1.643,"5min":1.6850000000000001,"15min":1.7150000000000001},"min":{"1min":1.3160000000000001,"5min":1.157,"15min":1.157},"max":{"1min":2.246,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.552}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":346328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.353,"5min":1.71,"15min":1.71},"last":1.024},{"interface":"front","average":{"1min":1.018,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.413,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.92800000000000005,"15min":0.96999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2709999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97799999999999998,"15min":0.97499999999999998},"min":{"1min":0.50900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.556,"5min":1.998,"15min":1.998},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.103},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":1.802},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.155,"5min":1.1120000000000001,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.841,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.266}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":7.6399999999999997,"15min":10.481999999999999},"min":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6639999999999999,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3879999999999999,"15min":1.4399999999999999},"min":{"1min":0.877,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7350000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.423}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.419,"15min":1.4690000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7569999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.099},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9410000000000001,"5min":4.274,"15min":4.274},"last":1.3779999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.704,"15min":1.804},"min":{"1min":1.1259999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.0190000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.163},{"interface":"front","average":{"1min":1.399,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":0.76400000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7,"5min":3.157,"15min":3.157},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5269999999999999,"15min":1.5640000000000001},"min":{"1min":0.98799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9379999999999999,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.502,"15min":1.52},"min":{"1min":0.89500000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.9019999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":383425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.89800000000000002,"15min":0.91100000000000003},"min":{"1min":0.46200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.97699999999999998,"15min":0.97399999999999998},"min":{"1min":0.497,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.26,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.048},{"interface":"front","average":{"1min":0.996,"5min":1.1120000000000001,"15min":1.1539999999999999},"min":{"1min":0.55800000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6100000000000001,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.6579999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.121,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7170000000000001,"5min":2.355,"15min":2.355},"last":1.339},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.179,"15min":1.1930000000000001},"min":{"1min":0.65700000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.286}]},{"osd":4,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2829999999999999,"15min":1.288},"min":{"1min":0.79000000000000004,"5min":0.747,"15min":0.747},"max":{"1min":1.8240000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.405},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4330000000000001,"15min":1.4410000000000001},"min":{"1min":0.99199999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.907,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4910000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.46,"15min":1.4890000000000001},"min":{"1min":0.97499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7709999999999999,"5min":2.048,"15min":2.048},"last":1.536},{"interface":"front","average":{"1min":1.244,"5min":1.3660000000000001,"15min":1.389},"min":{"1min":0.79500000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.766,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.6020000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.5,"15min":1.528},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.74,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5609999999999999,"15min":1.579},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8380000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.899}]},{"osd":7,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5169999999999999,"15min":1.542},"min":{"1min":0.84999999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0019999999999998,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.546,"15min":1.5740000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.903,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.714}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":384041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90500000000000003,"15min":0.93300000000000005},"min":{"1min":0.42999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1759999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.375},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.64200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.466,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.0009999999999999},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4430000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.915,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.625}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.2090000000000001,"15min":1.2529999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6180000000000001,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.111,"15min":1.1279999999999999},"min":{"1min":0.63800000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.782,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3260000000000001,"15min":1.3799999999999999},"min":{"1min":0.66700000000000004,"5min":0.626,"15min":0.626},"max":{"1min":2.3170000000000002,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4690000000000001,"15min":1.5349999999999999},"min":{"1min":0.77100000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.1000000000000001,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.502}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.5409999999999999,"15min":1.6339999999999999},"min":{"1min":0.94099999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1970000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.351,"5min":1.597,"15min":1.7090000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.1499999999999999,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.151}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5329999999999999,"15min":1.581},"min":{"1min":0.81999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2639999999999998,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7250000000000001,"15min":1.853},"min":{"1min":0.83199999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0270000000000001,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":0.97299999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.5629999999999999,"15min":1.597},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.3650000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.5640000000000001,"15min":1.623},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9610000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.0960000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":936584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2110000000000001,"5min":2.452,"15min":2.452},"last":1.45},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6890000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.157,"15min":1.23},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5409999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.073},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.077,"15min":1.119},"min":{"1min":0.48599999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.74,"5min":3.411,"15min":3.411},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0980000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6890000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.216,"15min":1.25},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6519999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.5569999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3999999999999999,"15min":1.4359999999999999},"min":{"1min":0.746,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6359999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.496,"15min":1.579},"min":{"1min":0.81899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.756,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.524}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4670000000000001,"15min":1.5249999999999999},"min":{"1min":0.83799999999999997,"5min":0.747,"15min":0.747},"max":{"1min":1.647,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.5009999999999999,"15min":1.5529999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8939999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.216}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.7470000000000001,"15min":1.9350000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9390000000000001,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.6819999999999999,"15min":1.8080000000000001},"min":{"1min":0.83399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6080000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.6619999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5349999999999999,"15min":1.5649999999999999},"min":{"1min":0.90900000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.004,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7350000000000001,"15min":1.857},"min":{"1min":0.88100000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.044,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:18:02.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:18:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.201+0000 7f0a57415640 1 Processor -- start 2023-11-24T06:18:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.201+0000 7f0a57415640 1 -- start start 2023-11-24T06:18:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.203+0000 7f0a57415640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.203+0000 7f0a57415640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0a5015dc80 0x7f0a5015e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.203+0000 7f0a57415640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500ce0b0 con 0x7f0a50157c70 2023-11-24T06:18:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.203+0000 7f0a57415640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a50161960 con 0x7f0a5015dc80 2023-11-24T06:18:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.203+0000 7f0a57415640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5015e670 con 0x7f0a500cfb60 2023-11-24T06:18:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.203+0000 7f0a549b0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a549b0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:52166/0 (socket says 172.21.15.37:52166) 2023-11-24T06:18:03.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a549b0640 1 -- 172.21.15.37:0/2468826496 learned_addr learned my addr 172.21.15.37:0/2468826496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:03.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a559b2640 1 --2- 172.21.15.37:0/2468826496 >> v2:172.21.15.188:3300/0 conn(0x7f0a5015dc80 0x7f0a5015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a549b0640 1 -- 172.21.15.37:0/2468826496 >> v2:172.21.15.188:3300/0 conn(0x7f0a5015dc80 msgr2=0x7f0a5015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:03.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a549b0640 1 --2- 172.21.15.37:0/2468826496 >> v2:172.21.15.188:3300/0 conn(0x7f0a5015dc80 0x7f0a5015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a549b0640 1 -- 172.21.15.37:0/2468826496 >> v1:172.21.15.188:6789/0 conn(0x7f0a50157c70 legacy=0x7f0a500cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a549b0640 1 -- 172.21.15.37:0/2468826496 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5015e8d0 con 0x7f0a500cfb60 2023-11-24T06:18:03.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.204+0000 7f0a559b2640 1 --2- 172.21.15.37:0/2468826496 >> v2:172.21.15.188:3300/0 conn(0x7f0a5015dc80 0x7f0a5015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:18:03.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.206+0000 7f0a549b0640 1 --2- 172.21.15.37:0/2468826496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50161df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009870 tx=0x7f0a4002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c7e6e860f1c3c44 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:03.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.206+0000 7f0a47fff640 1 -- 172.21.15.37:0/2468826496 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40031640 con 0x7f0a500cfb60 2023-11-24T06:18:03.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.206+0000 7f0a47fff640 1 -- 172.21.15.37:0/2468826496 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a400317a0 con 0x7f0a500cfb60 2023-11-24T06:18:03.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.206+0000 7f0a47fff640 1 -- 172.21.15.37:0/2468826496 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40031b30 con 0x7f0a500cfb60 2023-11-24T06:18:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 -- 172.21.15.37:0/2468826496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 msgr2=0x7f0a50161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 --2- 172.21.15.37:0/2468826496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50161df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009870 tx=0x7f0a4002b8f0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 -- 172.21.15.37:0/2468826496 shutdown_connections 2023-11-24T06:18:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 --2- 172.21.15.37:0/2468826496 >> v2:172.21.15.188:3300/0 conn(0x7f0a5015dc80 0x7f0a5015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 --2- 172.21.15.37:0/2468826496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50161df0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 -- 172.21.15.37:0/2468826496 >> 172.21.15.37:0/2468826496 conn(0x7f0a5006a920 msgr2=0x7f0a5006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 -- 172.21.15.37:0/2468826496 shutdown_connections 2023-11-24T06:18:03.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.207+0000 7f0a57415640 1 -- 172.21.15.37:0/2468826496 wait complete. 2023-11-24T06:18:03.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.209+0000 7f0a57415640 1 Processor -- start 2023-11-24T06:18:03.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.209+0000 7f0a57415640 1 -- start start 2023-11-24T06:18:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a57415640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a57415640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a50157c70 0x7f0a500987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a57415640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a5015dc80 0x7f0a50071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a57415640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50150b40 con 0x7f0a50157c70 2023-11-24T06:18:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a57415640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50150d70 con 0x7f0a5015dc80 2023-11-24T06:18:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a57415640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50151050 con 0x7f0a500cfb60 2023-11-24T06:18:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a549b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a50157c70 0x7f0a500987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a549b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a50157c70 0x7f0a500987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49914/0 (socket says 172.21.15.37:49914) 2023-11-24T06:18:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.210+0000 7f0a549b0640 1 -- 172.21.15.37:0/902121328 learned_addr learned my addr 172.21.15.37:0/902121328 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a551b1640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a559b2640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a5015dc80 0x7f0a50071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a549b0640 1 -- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 msgr2=0x7f0a50150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a549b0640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a549b0640 1 -- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a5015dc80 msgr2=0x7f0a50071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a549b0640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a5015dc80 0x7f0a50071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a549b0640 1 -- 172.21.15.37:0/902121328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48009a70 con 0x7f0a50157c70 2023-11-24T06:18:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.211+0000 7f0a549b0640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a50157c70 0x7f0a500987f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0a400090b0 tx=0x7f0a400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.212+0000 7f0a45ffb640 1 -- 172.21.15.37:0/902121328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4003a9f0 con 0x7f0a50157c70 2023-11-24T06:18:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.212+0000 7f0a45ffb640 1 -- 172.21.15.37:0/902121328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4003ab90 con 0x7f0a50157c70 2023-11-24T06:18:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.212+0000 7f0a45ffb640 1 -- 172.21.15.37:0/902121328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400443f0 con 0x7f0a50157c70 2023-11-24T06:18:03.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.212+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a400094d0 con 0x7f0a50157c70 2023-11-24T06:18:03.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.212+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a50151610 con 0x7f0a50157c70 2023-11-24T06:18:03.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.213+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a50067470 con 0x7f0a50157c70 2023-11-24T06:18:03.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.214+0000 7f0a45ffb640 1 -- 172.21.15.37:0/902121328 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f0a4002f050 con 0x7f0a50157c70 2023-11-24T06:18:03.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.215+0000 7f0a45ffb640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0a3406af60 0x7f0a3406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.215+0000 7f0a45ffb640 1 -- 172.21.15.37:0/902121328 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a400ab4c0 con 0x7f0a50157c70 2023-11-24T06:18:03.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.215+0000 7f0a551b1640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0a3406af60 0x7f0a3406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.216+0000 7f0a551b1640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0a3406af60 0x7f0a3406d420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c001640 tx=0x7f0a4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:03.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.219+0000 7f0a45ffb640 1 -- 172.21.15.37:0/902121328 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a40076760 con 0x7f0a50157c70 2023-11-24T06:18:03.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.408+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a501615f0 con 0x7f0a3406af60 2023-11-24T06:18:03.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.415+0000 7f0a45ffb640 1 -- 172.21.15.37:0/902121328 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49064 (secure 0 0 0) 0x7f0a4c0050d0 con 0x7f0a3406af60 2023-11-24T06:18:03.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:18:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:18:03.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.417+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0a3406af60 msgr2=0x7f0a3406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.417+0000 7f0a57415640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0a3406af60 0x7f0a3406d420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c001640 tx=0x7f0a4c009040 comp rx=0 tx=0).stop 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.417+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a50157c70 msgr2=0x7f0a500987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.417+0000 7f0a57415640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a50157c70 0x7f0a500987f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0a400090b0 tx=0x7f0a400046c0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 shutdown_connections 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f0a3406af60 0x7f0a3406d420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a5015dc80 0x7f0a50071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a50157c70 0x7f0a500987f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 --2- 172.21.15.37:0/902121328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a500cfb60 0x7f0a50150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 >> 172.21.15.37:0/902121328 conn(0x7f0a5006a920 msgr2=0x7f0a5006c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:03.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 shutdown_connections 2023-11-24T06:18:03.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.418+0000 7f0a57415640 1 -- 172.21.15.37:0/902121328 wait complete. 2023-11-24T06:18:03.439 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-24T06:18:02.874419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240368,"kb_used_data":7568,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734352,"statfs":{"total":773094113280,"available":772847976448,"internally_reserved":0,"allocated":7749632,"data_stored":4026736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33867,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-67,"num_write_kb":-57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.208539"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:34.043616+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:17:34.043616+0000","last_peered":"2023-11-24T06:17:34.043616+0000","last_clean":"2023-11-24T06:17:34.043616+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:17:34.043616+0000","last_undegraded":"2023-11-24T06:17:34.043616+0000","last_fullsized":"2023-11-24T06:17:34.043616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1409024,"data_stored":937329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.077,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6279999999999999,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.0389999999999999,"15min":0.997},"min":{"1min":0.64200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5529999999999999,"5min":1.681,"15min":1.681},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.633,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.232,"15min":1.238},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.492,"5min":2.004,"15min":2.004},"last":1.6220000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.175,"15min":1.194},"min":{"1min":0.752,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.048},{"interface":"front","average":{"1min":1.169,"5min":1.1619999999999999,"15min":1.1539999999999999},"min":{"1min":0.81599999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.645,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.256,"15min":1.238},"min":{"1min":0.95499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6060000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3440000000000001,"15min":1.3420000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.681,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3480000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6839999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.45,"5min":1.4570000000000001,"15min":1.4590000000000001},"min":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.7050000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4970000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4239999999999999,"15min":1.4319999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7230000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.556},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.464,"15min":1.48},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.677}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.516,"15min":1.5409999999999999},"min":{"1min":0.94199999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.8779999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.75},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.472,"15min":1.478},"min":{"1min":1.0469999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7949999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.72}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":346308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.427,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5009999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4850000000000001,"5min":1.615,"15min":1.615},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.075,"5min":1.1579999999999999,"15min":1.179},"min":{"1min":0.79500000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5049999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.264}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.3129999999999999},"min":{"1min":0.86899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6220000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.226,"5min":1.3240000000000001,"15min":1.3480000000000001},"min":{"1min":0.753,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.575,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.3,"15min":1.3580000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.375,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.121},{"interface":"front","average":{"1min":1.169,"5min":1.276,"15min":1.296},"min":{"1min":0.85299999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.542,"5min":2.056,"15min":2.056},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.3899999999999999,"15min":1.4370000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6899999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.4870000000000001,"15min":1.5269999999999999},"min":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6539999999999999,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.3819999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.409,"15min":1.4490000000000001},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.728,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.569,"15min":1.619},"min":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6379999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.5089999999999999,"15min":1.5249999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8560000000000001,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.482},{"interface":"front","average":{"1min":1.365,"5min":1.476,"15min":1.4770000000000001},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.712,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.3560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":346435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0509999999999999,"15min":1.0589999999999999},"min":{"1min":0.79700000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.133,"15min":1.131},"min":{"1min":0.72299999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5680000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.155,"15min":1.1699999999999999},"min":{"1min":0.86899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.288,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.85699999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.878}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.258,"15min":1.27},"min":{"1min":0.82599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7250000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4399999999999999,"15min":1.444},"min":{"1min":1.012,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.861,"5min":2.198,"15min":2.198},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.175},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4470000000000001},"min":{"1min":0.96699999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7290000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3220000000000001,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.9239999999999999,"5min":2.427,"15min":2.427},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.4419999999999999,"15min":1.474},"min":{"1min":1.085,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6890000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.339}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.54,"15min":1.5820000000000001},"min":{"1min":0.88,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.5509999999999999,"15min":1.6080000000000001},"min":{"1min":0.86599999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.98,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.222}]},{"osd":7,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.6419999999999999,"15min":1.6599999999999999},"min":{"1min":1.395,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.901,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.6930000000000001,"15min":1.7070000000000001},"min":{"1min":1.1359999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.95,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.4970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":346286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0289999999999999,"15min":1.002},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5109999999999999,"5min":1.643,"15min":1.643},"last":1.264},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.079,"15min":1.071},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.3129999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0900000000000001,"15min":1.0800000000000001},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.02},{"interface":"front","average":{"1min":1.244,"5min":1.2529999999999999,"15min":1.2569999999999999},"min":{"1min":0.88200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5429999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.224,"15min":1.212},"min":{"1min":0.82099999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.962,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2210000000000001,"15min":1.2430000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.413}]},{"osd":3,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3129999999999999,"15min":1.3340000000000001},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6200000000000001,"5min":2.089,"15min":2.089},"last":1.603},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.4710000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.298,"15min":1.3029999999999999},"min":{"1min":0.86699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.361,"5min":1.381,"15min":1.399},"min":{"1min":1.0669999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.8999999999999999,"5min":1.964,"15min":1.964},"last":1.5069999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.571,"15min":1.611},"min":{"1min":1.0700000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0169999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.569,"15min":1.5900000000000001},"min":{"1min":1.1479999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.9710000000000001,"5min":2.222,"15min":2.222},"last":1.6639999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4990000000000001,"15min":1.5209999999999999},"min":{"1min":1.107,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.135},{"interface":"front","average":{"1min":1.643,"5min":1.6850000000000001,"15min":1.7150000000000001},"min":{"1min":1.3160000000000001,"5min":1.157,"15min":1.157},"max":{"1min":2.246,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.552}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":346328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.353,"5min":1.71,"15min":1.71},"last":1.024},{"interface":"front","average":{"1min":1.018,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.413,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.92800000000000005,"15min":0.96999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2709999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97799999999999998,"15min":0.97499999999999998},"min":{"1min":0.50900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.556,"5min":1.998,"15min":1.998},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.103},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":1.802},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.155,"5min":1.1120000000000001,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.841,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.266}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":7.6399999999999997,"15min":10.481999999999999},"min":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6639999999999999,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3879999999999999,"15min":1.4399999999999999},"min":{"1min":0.877,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7350000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.423}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.419,"15min":1.4690000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7569999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.099},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9410000000000001,"5min":4.274,"15min":4.274},"last":1.3779999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.704,"15min":1.804},"min":{"1min":1.1259999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.0190000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.163},{"interface":"front","average":{"1min":1.399,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":0.76400000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7,"5min":3.157,"15min":3.157},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5269999999999999,"15min":1.5640000000000001},"min":{"1min":0.98799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9379999999999999,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.502,"15min":1.52},"min":{"1min":0.89500000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.9019999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":383425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.89800000000000002,"15min":0.91100000000000003},"min":{"1min":0.46200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.97699999999999998,"15min":0.97399999999999998},"min":{"1min":0.497,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.26,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.048},{"interface":"front","average":{"1min":0.996,"5min":1.1120000000000001,"15min":1.1539999999999999},"min":{"1min":0.55800000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6100000000000001,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.6579999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.121,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7170000000000001,"5min":2.355,"15min":2.355},"last":1.339},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.179,"15min":1.1930000000000001},"min":{"1min":0.65700000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.286}]},{"osd":4,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2829999999999999,"15min":1.288},"min":{"1min":0.79000000000000004,"5min":0.747,"15min":0.747},"max":{"1min":1.8240000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.405},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4330000000000001,"15min":1.4410000000000001},"min":{"1min":0.99199999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.907,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4910000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.46,"15min":1.4890000000000001},"min":{"1min":0.97499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7709999999999999,"5min":2.048,"15min":2.048},"last":1.536},{"interface":"front","average":{"1min":1.244,"5min":1.3660000000000001,"15min":1.389},"min":{"1min":0.79500000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.766,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.6020000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.5,"15min":1.528},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.74,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5609999999999999,"15min":1.579},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8380000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.899}]},{"osd":7,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5169999999999999,"15min":1.542},"min":{"1min":0.84999999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0019999999999998,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.546,"15min":1.5740000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.903,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.714}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":384041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90500000000000003,"15min":0.93300000000000005},"min":{"1min":0.42999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1759999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.375},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.64200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.466,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.0009999999999999},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4430000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.915,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.625}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.2090000000000001,"15min":1.2529999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6180000000000001,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.111,"15min":1.1279999999999999},"min":{"1min":0.63800000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.782,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3260000000000001,"15min":1.3799999999999999},"min":{"1min":0.66700000000000004,"5min":0.626,"15min":0.626},"max":{"1min":2.3170000000000002,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4690000000000001,"15min":1.5349999999999999},"min":{"1min":0.77100000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.1000000000000001,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.502}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.5409999999999999,"15min":1.6339999999999999},"min":{"1min":0.94099999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1970000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.351,"5min":1.597,"15min":1.7090000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.1499999999999999,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.151}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5329999999999999,"15min":1.581},"min":{"1min":0.81999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2639999999999998,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7250000000000001,"15min":1.853},"min":{"1min":0.83199999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0270000000000001,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":0.97299999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.5629999999999999,"15min":1.597},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.3650000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.5640000000000001,"15min":1.623},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9610000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.0960000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":936584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2110000000000001,"5min":2.452,"15min":2.452},"last":1.45},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6890000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.157,"15min":1.23},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5409999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.073},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.077,"15min":1.119},"min":{"1min":0.48599999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.74,"5min":3.411,"15min":3.411},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0980000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6890000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.216,"15min":1.25},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6519999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.5569999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3999999999999999,"15min":1.4359999999999999},"min":{"1min":0.746,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6359999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.496,"15min":1.579},"min":{"1min":0.81899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.756,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.524}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4670000000000001,"15min":1.5249999999999999},"min":{"1min":0.83799999999999997,"5min":0.747,"15min":0.747},"max":{"1min":1.647,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.5009999999999999,"15min":1.5529999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8939999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.216}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.7470000000000001,"15min":1.9350000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9390000000000001,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.6819999999999999,"15min":1.8080000000000001},"min":{"1min":0.83399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6080000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.6619999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5349999999999999,"15min":1.5649999999999999},"min":{"1min":0.90900000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.004,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7350000000000001,"15min":1.857},"min":{"1min":0.88100000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.044,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:18:03.440 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:18:03.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:18:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.661+0000 7f7c4759e640 1 Processor -- start 2023-11-24T06:18:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.661+0000 7f7c4759e640 1 -- start start 2023-11-24T06:18:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.663+0000 7f7c4759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7c4814b100 0x7f7c48162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.663+0000 7f7c4759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 0x7f7c48165c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.663+0000 7f7c4759e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c48162eb0 con 0x7f7c48166150 2023-11-24T06:18:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.663+0000 7f7c4759e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c481654a0 con 0x7f7c4814b100 2023-11-24T06:18:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.663+0000 7f7c4759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480ccf00 con 0x7f7c480703f0 2023-11-24T06:18:03.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.663+0000 7f7c46d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7c48166150 0x7f7c480cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40704/0 (socket says 172.21.15.37:40704) 2023-11-24T06:18:03.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.663+0000 7f7c46d9d640 1 -- 172.21.15.37:0/3135166149 learned_addr learned my addr 172.21.15.37:0/3135166149 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c3dd9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 0x7f7c48165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c4659c640 1 --2- 172.21.15.37:0/3135166149 >> v2:172.21.15.188:3300/0 conn(0x7f7c4814b100 0x7f7c48162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312510067 0 0) 0x7f7c40001110 con 0x7f7c48166150 2023-11-24T06:18:03.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c34003520 con 0x7f7c48166150 2023-11-24T06:18:03.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 399766197 0 0) 0x7f7c34003520 con 0x7f7c48166150 2023-11-24T06:18:03.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 msgr2=0x7f7c48165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:03.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 0x7f7c48165c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 >> v2:172.21.15.188:3300/0 conn(0x7f7c4814b100 msgr2=0x7f7c48162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:03.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 --2- 172.21.15.37:0/3135166149 >> v2:172.21.15.188:3300/0 conn(0x7f7c4814b100 0x7f7c48162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480708f0 con 0x7f7c48166150 2023-11-24T06:18:03.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f7c40001800 con 0x7f7c48166150 2023-11-24T06:18:03.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 >> v1:172.21.15.37:6789/0 conn(0x7f7c48166150 legacy=0x7f7c480cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 0x7f7c34003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c34003ef0 0x7f7c340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34004d00 0x7f7c34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c481654a0 con 0x7f7c34003ef0 2023-11-24T06:18:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480ccf00 con 0x7f7c34004d00 2023-11-24T06:18:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.664+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3400b9d0 con 0x7f7c480703f0 2023-11-24T06:18:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c3dd9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c34003ef0 0x7f7c340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c4659c640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 0x7f7c34003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c46d9d640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34004d00 0x7f7c34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c3dd9b640 1 -- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 msgr2=0x7f7c34003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c3dd9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480703f0 0x7f7c34003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c3dd9b640 1 -- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34004d00 msgr2=0x7f7c34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c3dd9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34004d00 0x7f7c34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.665+0000 7f7c3dd9b640 1 -- 172.21.15.37:0/3135166149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c34003520 con 0x7f7c34003ef0 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.666+0000 7f7c3dd9b640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c34003ef0 0x7f7c340047c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009af0 tx=0x7f7c340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa24723874ffc08d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3002c6b0 con 0x7f7c34003ef0 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3002c810 con 0x7f7c34003ef0 2023-11-24T06:18:03.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c45d9b640 1 -- 172.21.15.37:0/3135166149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3002cba0 con 0x7f7c34003ef0 2023-11-24T06:18:03.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c4759e640 1 -- 172.21.15.37:0/3135166149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c34003ef0 msgr2=0x7f7c340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c4759e640 1 --2- 172.21.15.37:0/3135166149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c34003ef0 0x7f7c340047c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009af0 tx=0x7f7c340057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c46d9d640 1 -- 172.21.15.37:0/3135166149 reap_dead start 2023-11-24T06:18:03.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c4759e640 1 -- 172.21.15.37:0/3135166149 shutdown_connections 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.667+0000 7f7c4759e640 1 -- 172.21.15.37:0/3135166149 >> 172.21.15.37:0/3135166149 conn(0x7f7c480cb830 msgr2=0x7f7c480cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.668+0000 7f7c4759e640 1 -- 172.21.15.37:0/3135166149 shutdown_connections 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.668+0000 7f7c4759e640 1 -- 172.21.15.37:0/3135166149 wait complete. 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.669+0000 7f7c4759e640 1 Processor -- start 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.669+0000 7f7c4759e640 1 -- start start 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.670+0000 7f7c4759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34003ef0 0x7f7c480a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.670+0000 7f7c4759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480adc30 0x7f7c481ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.670+0000 7f7c4759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c480ae0b0 0x7f7c48148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.670+0000 7f7c4759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480aa0f0 con 0x7f7c480ae0b0 2023-11-24T06:18:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.670+0000 7f7c4759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480aa340 con 0x7f7c34003ef0 2023-11-24T06:18:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.670+0000 7f7c4759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480aa620 con 0x7f7c480adc30 2023-11-24T06:18:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c480ae0b0 0x7f7c48148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c480ae0b0 0x7f7c48148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49924/0 (socket says 172.21.15.37:49924) 2023-11-24T06:18:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 -- 172.21.15.37:0/3948037044 learned_addr learned my addr 172.21.15.37:0/3948037044 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c3dd9b640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480adc30 0x7f7c481ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c4659c640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34003ef0 0x7f7c480a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 -- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480adc30 msgr2=0x7f7c481ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480adc30 0x7f7c481ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 -- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34003ef0 msgr2=0x7f7c480a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34003ef0 0x7f7c480a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 -- 172.21.15.37:0/3948037044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480aa900 con 0x7f7c480ae0b0 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c4659c640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34003ef0 0x7f7c480a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.671+0000 7f7c46d9d640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c480ae0b0 0x7f7c48148990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7c40001eb0 tx=0x7f7c40007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.672+0000 7f7c3f7fe640 1 -- 172.21.15.37:0/3948037044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40007760 con 0x7f7c480ae0b0 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.672+0000 7f7c3f7fe640 1 -- 172.21.15.37:0/3948037044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000e6b0 con 0x7f7c480ae0b0 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.672+0000 7f7c3f7fe640 1 -- 172.21.15.37:0/3948037044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000ea60 con 0x7f7c480ae0b0 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.672+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c480ac2d0 con 0x7f7c480ae0b0 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.672+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c480aabe0 con 0x7f7c480ae0b0 2023-11-24T06:18:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.673+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c480ac130 con 0x7f7c480ae0b0 2023-11-24T06:18:03.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.674+0000 7f7c3f7fe640 1 -- 172.21.15.37:0/3948037044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f7c4000ebc0 con 0x7f7c480ae0b0 2023-11-24T06:18:03.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.676+0000 7f7c3f7fe640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c2806af60 0x7f7c2806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:03.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.676+0000 7f7c3f7fe640 1 -- 172.21.15.37:0/3948037044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c400890d0 con 0x7f7c480ae0b0 2023-11-24T06:18:03.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.676+0000 7f7c4659c640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c2806af60 0x7f7c2806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:03.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.677+0000 7f7c4659c640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c2806af60 0x7f7c2806d420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7c480b42b0 tx=0x7f7c3800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:03.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.680+0000 7f7c3f7fe640 1 -- 172.21.15.37:0/3948037044 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c480ac130 con 0x7f7c480ae0b0 2023-11-24T06:18:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.871+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c481656f0 con 0x7f7c2806af60 2023-11-24T06:18:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.878+0000 7f7c3f7fe640 1 -- 172.21.15.37:0/3948037044 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49064 (secure 0 0 0) 0x7f7c38016420 con 0x7f7c2806af60 2023-11-24T06:18:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:18:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:18:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.880+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c2806af60 msgr2=0x7f7c2806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.880+0000 7f7c4759e640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c2806af60 0x7f7c2806d420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7c480b42b0 tx=0x7f7c3800b040 comp rx=0 tx=0).stop 2023-11-24T06:18:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.880+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c480ae0b0 msgr2=0x7f7c48148990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.880+0000 7f7c4759e640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c480ae0b0 0x7f7c48148990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7c40001eb0 tx=0x7f7c40007420 comp rx=0 tx=0).stop 2023-11-24T06:18:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 shutdown_connections 2023-11-24T06:18:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7c2806af60 0x7f7c2806d420 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c480ae0b0 0x7f7c48148990 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c480adc30 0x7f7c481ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 --2- 172.21.15.37:0/3948037044 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c34003ef0 0x7f7c480a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 >> 172.21.15.37:0/3948037044 conn(0x7f7c480cb830 msgr2=0x7f7c480cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 shutdown_connections 2023-11-24T06:18:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:03.881+0000 7f7c4759e640 1 -- 172.21.15.37:0/3948037044 wait complete. 2023-11-24T06:18:03.903 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-24T06:18:02.874419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240368,"kb_used_data":7568,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734352,"statfs":{"total":773094113280,"available":772847976448,"internally_reserved":0,"allocated":7749632,"data_stored":4026736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33867,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-67,"num_write_kb":-57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.208539"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-24T06:17:34.043616+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:17:34.043616+0000","last_peered":"2023-11-24T06:17:34.043616+0000","last_clean":"2023-11-24T06:17:34.043616+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:17:34.043616+0000","last_undegraded":"2023-11-24T06:17:34.043616+0000","last_fullsized":"2023-11-24T06:17:34.043616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1409024,"data_stored":937329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.077,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6279999999999999,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.0389999999999999,"15min":0.997},"min":{"1min":0.64200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5529999999999999,"5min":1.681,"15min":1.681},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.633,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.232,"15min":1.238},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.492,"5min":2.004,"15min":2.004},"last":1.6220000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.175,"15min":1.194},"min":{"1min":0.752,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.048},{"interface":"front","average":{"1min":1.169,"5min":1.1619999999999999,"15min":1.1539999999999999},"min":{"1min":0.81599999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.645,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.256,"15min":1.238},"min":{"1min":0.95499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6060000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3440000000000001,"15min":1.3420000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.681,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3480000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6839999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.45,"5min":1.4570000000000001,"15min":1.4590000000000001},"min":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.7050000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4970000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4239999999999999,"15min":1.4319999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7230000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.556},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.464,"15min":1.48},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.677}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.516,"15min":1.5409999999999999},"min":{"1min":0.94199999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.8779999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.75},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.472,"15min":1.478},"min":{"1min":1.0469999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7949999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.72}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":346308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.427,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5009999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4850000000000001,"5min":1.615,"15min":1.615},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.075,"5min":1.1579999999999999,"15min":1.179},"min":{"1min":0.79500000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5049999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.264}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.3129999999999999},"min":{"1min":0.86899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6220000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.226,"5min":1.3240000000000001,"15min":1.3480000000000001},"min":{"1min":0.753,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.575,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.3,"15min":1.3580000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.375,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.121},{"interface":"front","average":{"1min":1.169,"5min":1.276,"15min":1.296},"min":{"1min":0.85299999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.542,"5min":2.056,"15min":2.056},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.3899999999999999,"15min":1.4370000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6899999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.4870000000000001,"15min":1.5269999999999999},"min":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6539999999999999,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.3819999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.409,"15min":1.4490000000000001},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.728,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.569,"15min":1.619},"min":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6379999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.5089999999999999,"15min":1.5249999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8560000000000001,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.482},{"interface":"front","average":{"1min":1.365,"5min":1.476,"15min":1.4770000000000001},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.712,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.3560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":346435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0509999999999999,"15min":1.0589999999999999},"min":{"1min":0.79700000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.133,"15min":1.131},"min":{"1min":0.72299999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5680000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.155,"15min":1.1699999999999999},"min":{"1min":0.86899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.288,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.85699999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.878}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.258,"15min":1.27},"min":{"1min":0.82599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7250000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4399999999999999,"15min":1.444},"min":{"1min":1.012,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.861,"5min":2.198,"15min":2.198},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.175},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4470000000000001},"min":{"1min":0.96699999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7290000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3220000000000001,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.9239999999999999,"5min":2.427,"15min":2.427},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.4419999999999999,"15min":1.474},"min":{"1min":1.085,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6890000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.339}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.54,"15min":1.5820000000000001},"min":{"1min":0.88,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.5509999999999999,"15min":1.6080000000000001},"min":{"1min":0.86599999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.98,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.222}]},{"osd":7,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.6419999999999999,"15min":1.6599999999999999},"min":{"1min":1.395,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.901,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.6930000000000001,"15min":1.7070000000000001},"min":{"1min":1.1359999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.95,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.4970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":346286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0289999999999999,"15min":1.002},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5109999999999999,"5min":1.643,"15min":1.643},"last":1.264},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.079,"15min":1.071},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.3129999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0900000000000001,"15min":1.0800000000000001},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.02},{"interface":"front","average":{"1min":1.244,"5min":1.2529999999999999,"15min":1.2569999999999999},"min":{"1min":0.88200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5429999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.224,"15min":1.212},"min":{"1min":0.82099999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.962,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2210000000000001,"15min":1.2430000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.413}]},{"osd":3,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3129999999999999,"15min":1.3340000000000001},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6200000000000001,"5min":2.089,"15min":2.089},"last":1.603},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.4710000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.298,"15min":1.3029999999999999},"min":{"1min":0.86699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.361,"5min":1.381,"15min":1.399},"min":{"1min":1.0669999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.8999999999999999,"5min":1.964,"15min":1.964},"last":1.5069999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.571,"15min":1.611},"min":{"1min":1.0700000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0169999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.569,"15min":1.5900000000000001},"min":{"1min":1.1479999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.9710000000000001,"5min":2.222,"15min":2.222},"last":1.6639999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4990000000000001,"15min":1.5209999999999999},"min":{"1min":1.107,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.135},{"interface":"front","average":{"1min":1.643,"5min":1.6850000000000001,"15min":1.7150000000000001},"min":{"1min":1.3160000000000001,"5min":1.157,"15min":1.157},"max":{"1min":2.246,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.552}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":346328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.353,"5min":1.71,"15min":1.71},"last":1.024},{"interface":"front","average":{"1min":1.018,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.413,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.92800000000000005,"15min":0.96999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2709999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97799999999999998,"15min":0.97499999999999998},"min":{"1min":0.50900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.556,"5min":1.998,"15min":1.998},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.103},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":1.802},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.155,"5min":1.1120000000000001,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.841,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.266}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":7.6399999999999997,"15min":10.481999999999999},"min":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6639999999999999,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3879999999999999,"15min":1.4399999999999999},"min":{"1min":0.877,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7350000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.423}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.419,"15min":1.4690000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7569999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.099},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9410000000000001,"5min":4.274,"15min":4.274},"last":1.3779999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.704,"15min":1.804},"min":{"1min":1.1259999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.0190000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.163},{"interface":"front","average":{"1min":1.399,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":0.76400000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7,"5min":3.157,"15min":3.157},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5269999999999999,"15min":1.5640000000000001},"min":{"1min":0.98799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9379999999999999,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.502,"15min":1.52},"min":{"1min":0.89500000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.9019999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":383425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.89800000000000002,"15min":0.91100000000000003},"min":{"1min":0.46200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.97699999999999998,"15min":0.97399999999999998},"min":{"1min":0.497,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.26,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.048},{"interface":"front","average":{"1min":0.996,"5min":1.1120000000000001,"15min":1.1539999999999999},"min":{"1min":0.55800000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6100000000000001,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.6579999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.121,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7170000000000001,"5min":2.355,"15min":2.355},"last":1.339},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.179,"15min":1.1930000000000001},"min":{"1min":0.65700000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.286}]},{"osd":4,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2829999999999999,"15min":1.288},"min":{"1min":0.79000000000000004,"5min":0.747,"15min":0.747},"max":{"1min":1.8240000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.405},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4330000000000001,"15min":1.4410000000000001},"min":{"1min":0.99199999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.907,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4910000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.46,"15min":1.4890000000000001},"min":{"1min":0.97499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7709999999999999,"5min":2.048,"15min":2.048},"last":1.536},{"interface":"front","average":{"1min":1.244,"5min":1.3660000000000001,"15min":1.389},"min":{"1min":0.79500000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.766,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.6020000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.5,"15min":1.528},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.74,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5609999999999999,"15min":1.579},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8380000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.899}]},{"osd":7,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5169999999999999,"15min":1.542},"min":{"1min":0.84999999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0019999999999998,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.546,"15min":1.5740000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.903,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.714}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":384041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90500000000000003,"15min":0.93300000000000005},"min":{"1min":0.42999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1759999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.375},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.64200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.466,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.0009999999999999},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4430000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.915,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":0.625}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.2090000000000001,"15min":1.2529999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6180000000000001,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.111,"15min":1.1279999999999999},"min":{"1min":0.63800000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.782,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3260000000000001,"15min":1.3799999999999999},"min":{"1min":0.66700000000000004,"5min":0.626,"15min":0.626},"max":{"1min":2.3170000000000002,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4690000000000001,"15min":1.5349999999999999},"min":{"1min":0.77100000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.1000000000000001,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.502}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.5409999999999999,"15min":1.6339999999999999},"min":{"1min":0.94099999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1970000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.351,"5min":1.597,"15min":1.7090000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.1499999999999999,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.151}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5329999999999999,"15min":1.581},"min":{"1min":0.81999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2639999999999998,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7250000000000001,"15min":1.853},"min":{"1min":0.83199999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0270000000000001,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":0.97299999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.5629999999999999,"15min":1.597},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.3650000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.5640000000000001,"15min":1.623},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9610000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.0960000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":936584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2110000000000001,"5min":2.452,"15min":2.452},"last":1.45},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6890000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.157,"15min":1.23},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5409999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.073},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.077,"15min":1.119},"min":{"1min":0.48599999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.74,"5min":3.411,"15min":3.411},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0980000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6890000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.216,"15min":1.25},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6519999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.5569999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3999999999999999,"15min":1.4359999999999999},"min":{"1min":0.746,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6359999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.496,"15min":1.579},"min":{"1min":0.81899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.756,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.524}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4670000000000001,"15min":1.5249999999999999},"min":{"1min":0.83799999999999997,"5min":0.747,"15min":0.747},"max":{"1min":1.647,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.5009999999999999,"15min":1.5529999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8939999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.216}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.7470000000000001,"15min":1.9350000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9390000000000001,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.6819999999999999,"15min":1.8080000000000001},"min":{"1min":0.83399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6080000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.6619999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5349999999999999,"15min":1.5649999999999999},"min":{"1min":0.90900000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.004,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7350000000000001,"15min":1.857},"min":{"1min":0.88100000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.044,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:18:03.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:18:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.133+0000 7f68f571a640 1 Processor -- start 2023-11-24T06:18:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.133+0000 7f68f571a640 1 -- start start 2023-11-24T06:18:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68f571a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 0x7f68f006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68f571a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f68f00cdbf0 0x7f68f00ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68f571a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f006e060 con 0x7f68f013d120 2023-11-24T06:18:04.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68f571a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f013f9e0 con 0x7f68f00cdbf0 2023-11-24T06:18:04.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68f571a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f013fcc0 con 0x7f68f006d6c0 2023-11-24T06:18:04.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68effff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f68f013d120 0x7f68f015af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40714/0 (socket says 172.21.15.37:40714) 2023-11-24T06:18:04.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68effff640 1 -- 172.21.15.37:0/918939261 learned_addr learned my addr 172.21.15.37:0/918939261 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:04.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68ef7fe640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 0x7f68f006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.135+0000 7f68f4f19640 1 --2- 172.21.15.37:0/918939261 >> v2:172.21.15.188:3300/0 conn(0x7f68f00cdbf0 0x7f68f00ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208251601 0 0) 0x7f68f006e060 con 0x7f68f013d120 2023-11-24T06:18:04.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68dc005730 con 0x7f68f013d120 2023-11-24T06:18:04.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1025033290 0 0) 0x7f68dc005730 con 0x7f68f013d120 2023-11-24T06:18:04.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 msgr2=0x7f68f006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:04.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 0x7f68f006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 >> v2:172.21.15.188:3300/0 conn(0x7f68f00cdbf0 msgr2=0x7f68f00ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:04.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 --2- 172.21.15.37:0/918939261 >> v2:172.21.15.188:3300/0 conn(0x7f68f00cdbf0 0x7f68f00ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f013ffa0 con 0x7f68f013d120 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f68e0001670 con 0x7f68f013d120 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 >> v1:172.21.15.37:6789/0 conn(0x7f68f013d120 legacy=0x7f68f015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc005b80 0x7f68dc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 0x7f68dc0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68dc006f10 0x7f68dc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f013f9e0 con 0x7f68dc006f10 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f013fcc0 con 0x7f68dc005b80 2023-11-24T06:18:04.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.136+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc00dbc0 con 0x7f68f006d6c0 2023-11-24T06:18:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68f4f19640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68dc006f10 0x7f68dc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68effff640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc005b80 0x7f68dc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68f4f19640 1 -- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 msgr2=0x7f68dc0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68ef7fe640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 0x7f68dc0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68f4f19640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 0x7f68dc0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68f4f19640 1 -- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc005b80 msgr2=0x7f68dc005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68f4f19640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc005b80 0x7f68dc005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68f4f19640 1 -- 172.21.15.37:0/918939261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc005730 con 0x7f68dc006f10 2023-11-24T06:18:04.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.137+0000 7f68ef7fe640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f006d6c0 0x7f68dc0069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:04.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.138+0000 7f68f4f19640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68dc006f10 0x7f68dc007390 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009fc0 tx=0x7f68dc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690bb37bda3bc831 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:04.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.139+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e802cc60 con 0x7f68dc006f10 2023-11-24T06:18:04.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.139+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e800f040 con 0x7f68dc006f10 2023-11-24T06:18:04.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.139+0000 7f68eeffd640 1 -- 172.21.15.37:0/918939261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8034440 con 0x7f68dc006f10 2023-11-24T06:18:04.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.139+0000 7f68f571a640 1 -- 172.21.15.37:0/918939261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68dc006f10 msgr2=0x7f68dc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:04.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.139+0000 7f68f571a640 1 --2- 172.21.15.37:0/918939261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68dc006f10 0x7f68dc007390 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009fc0 tx=0x7f68dc007a00 comp rx=0 tx=0).stop 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.139+0000 7f68f4f19640 1 -- 172.21.15.37:0/918939261 reap_dead start 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.140+0000 7f68f571a640 1 -- 172.21.15.37:0/918939261 shutdown_connections 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.140+0000 7f68f571a640 1 -- 172.21.15.37:0/918939261 >> 172.21.15.37:0/918939261 conn(0x7f68f00cb830 msgr2=0x7f68f00cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.140+0000 7f68f571a640 1 -- 172.21.15.37:0/918939261 shutdown_connections 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.140+0000 7f68f571a640 1 -- 172.21.15.37:0/918939261 wait complete. 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.141+0000 7f68f571a640 1 Processor -- start 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.142+0000 7f68f571a640 1 -- start start 2023-11-24T06:18:04.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f571a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc006f10 0x7f68f015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f571a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b0220 0x7f68f013c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f571a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f015cce0 0x7f68f0140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f571a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00b06a0 con 0x7f68f015cce0 2023-11-24T06:18:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f571a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00afd90 con 0x7f68dc006f10 2023-11-24T06:18:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f571a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f015d160 con 0x7f68f00b0220 2023-11-24T06:18:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f4f19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f015cce0 0x7f68f0140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f4f19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f015cce0 0x7f68f0140980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49932/0 (socket says 172.21.15.37:49932) 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f4f19640 1 -- 172.21.15.37:0/3355876024 learned_addr learned my addr 172.21.15.37:0/3355876024 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68ef7fe640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b0220 0x7f68f013c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68effff640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc006f10 0x7f68f015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f4f19640 1 -- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b0220 msgr2=0x7f68f013c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f4f19640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b0220 0x7f68f013c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f4f19640 1 -- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc006f10 msgr2=0x7f68f015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.143+0000 7f68f4f19640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc006f10 0x7f68f015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68f4f19640 1 -- 172.21.15.37:0/3355876024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f015a9d0 con 0x7f68f015cce0 2023-11-24T06:18:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68effff640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc006f10 0x7f68f015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68f4f19640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f015cce0 0x7f68f0140980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f68e8037040 tx=0x7f68e8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68ecff9640 1 -- 172.21.15.37:0/3355876024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8034d50 con 0x7f68f015cce0 2023-11-24T06:18:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68ecff9640 1 -- 172.21.15.37:0/3355876024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e8003990 con 0x7f68f015cce0 2023-11-24T06:18:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68ecff9640 1 -- 172.21.15.37:0/3355876024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8003d40 con 0x7f68f015cce0 2023-11-24T06:18:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f015c270 con 0x7f68f015cce0 2023-11-24T06:18:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.144+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f00af740 con 0x7f68f015cce0 2023-11-24T06:18:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.146+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f004e840 con 0x7f68f015cce0 2023-11-24T06:18:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.146+0000 7f68ecff9640 1 -- 172.21.15.37:0/3355876024 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f68e8004030 con 0x7f68f015cce0 2023-11-24T06:18:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.148+0000 7f68ecff9640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f68d006af90 0x7f68d006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.148+0000 7f68ecff9640 1 -- 172.21.15.37:0/3355876024 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f68e80aabe0 con 0x7f68f015cce0 2023-11-24T06:18:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.148+0000 7f68effff640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f68d006af90 0x7f68d006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.149+0000 7f68effff640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f68d006af90 0x7f68d006d450 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f68e0001050 tx=0x7f68e0000f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:04.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.152+0000 7f68ecff9640 1 -- 172.21.15.37:0/3355876024 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68e8075f20 con 0x7f68f015cce0 2023-11-24T06:18:04.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.348+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68f013cc90 con 0x7f68f015cce0 2023-11-24T06:18:04.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.349+0000 7f68ecff9640 1 -- 172.21.15.37:0/3355876024 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12951 (secure 0 0 0) 0x7f68e8045090 con 0x7f68f015cce0 2023-11-24T06:18:04.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:18:04.353 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":68,"fsid":"f9941f81-ea4f-4d1c-af48-22a4f4ec7cd3","created":"2023-11-24T06:14:25.622989+0000","modified":"2023-11-24T06:17:59.888322+0000","last_up_change":"2023-11-24T06:14:38.055014+0000","last_in_change":"2023-11-24T06:14:29.130794+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:14:38.894675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7ff11bf-51c8-47f0-8426-8d4005839088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6816","nonce":1821926241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6824","nonce":1821926241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6831","nonce":1821926241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1821926241},{"type":"v1","addr":"172.21.15.37:6829","nonce":1821926241}]},"public_addr":"172.21.15.37:6816/1821926241","cluster_addr":"172.21.15.37:6824/1821926241","heartbeat_back_addr":"172.21.15.37:6831/1821926241","heartbeat_front_addr":"172.21.15.37:6829/1821926241","state":["exists","up"]},{"osd":1,"uuid":"39d80199-292c-4234-b348-c46b381ef1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6809","nonce":2348647226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6811","nonce":2348647226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6823","nonce":2348647226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":2348647226},{"type":"v1","addr":"172.21.15.37:6817","nonce":2348647226}]},"public_addr":"172.21.15.37:6809/2348647226","cluster_addr":"172.21.15.37:6811/2348647226","heartbeat_back_addr":"172.21.15.37:6823/2348647226","heartbeat_front_addr":"172.21.15.37:6817/2348647226","state":["exists","up"]},{"osd":2,"uuid":"70aa1a34-99ad-43fc-9514-63c77331e1a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6801","nonce":276316987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6803","nonce":276316987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6807","nonce":276316987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":276316987},{"type":"v1","addr":"172.21.15.37:6805","nonce":276316987}]},"public_addr":"172.21.15.37:6801/276316987","cluster_addr":"172.21.15.37:6803/276316987","heartbeat_back_addr":"172.21.15.37:6807/276316987","heartbeat_front_addr":"172.21.15.37:6805/276316987","state":["exists","up"]},{"osd":3,"uuid":"7ae887cd-3392-49d5-8a73-6a31c2fba916","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6815","nonce":1198045157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6821","nonce":1198045157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6828","nonce":1198045157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1198045157},{"type":"v1","addr":"172.21.15.37:6825","nonce":1198045157}]},"public_addr":"172.21.15.37:6815/1198045157","cluster_addr":"172.21.15.37:6821/1198045157","heartbeat_back_addr":"172.21.15.37:6828/1198045157","heartbeat_front_addr":"172.21.15.37:6825/1198045157","state":["exists","up"]},{"osd":4,"uuid":"057d1b9e-738e-403a-b13b-ae15009ff6c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6825","nonce":146983005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6827","nonce":146983005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6831","nonce":146983005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":146983005},{"type":"v1","addr":"172.21.15.188:6829","nonce":146983005}]},"public_addr":"172.21.15.188:6825/146983005","cluster_addr":"172.21.15.188:6827/146983005","heartbeat_back_addr":"172.21.15.188:6831/146983005","heartbeat_front_addr":"172.21.15.188:6829/146983005","state":["exists","up"]},{"osd":5,"uuid":"228d3443-fb4c-41e2-b10e-810193979c46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6801","nonce":3786933785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6803","nonce":3786933785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6807","nonce":3786933785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3786933785},{"type":"v1","addr":"172.21.15.188:6805","nonce":3786933785}]},"public_addr":"172.21.15.188:6801/3786933785","cluster_addr":"172.21.15.188:6803/3786933785","heartbeat_back_addr":"172.21.15.188:6807/3786933785","heartbeat_front_addr":"172.21.15.188:6805/3786933785","state":["exists","up"]},{"osd":6,"uuid":"b4fb09aa-d3f6-4133-9539-450e36215cdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6811","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6813","nonce":2333602039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6815","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6817","nonce":2333602039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6823","nonce":2333602039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6819","nonce":2333602039},{"type":"v1","addr":"172.21.15.188:6820","nonce":2333602039}]},"public_addr":"172.21.15.188:6813/2333602039","cluster_addr":"172.21.15.188:6817/2333602039","heartbeat_back_addr":"172.21.15.188:6823/2333602039","heartbeat_front_addr":"172.21.15.188:6820/2333602039","state":["exists","up"]},{"osd":7,"uuid":"c5647f29-1d8c-4f36-8acb-5a91d0063625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6809","nonce":89402988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6812","nonce":89402988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6821","nonce":89402988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":89402988},{"type":"v1","addr":"172.21.15.188:6816","nonce":89402988}]},"public_addr":"172.21.15.188:6809/89402988","cluster_addr":"172.21.15.188:6812/89402988","heartbeat_back_addr":"172.21.15.188:6821/89402988","heartbeat_front_addr":"172.21.15.188:6816/89402988","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.515464+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.674616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.715156+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.508694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.445221+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.604918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.519975+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:14:34.464728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6836/2581426871":"2023-11-25T06:17:56.660934+0000","172.21.15.37:6834/2581426871":"2023-11-25T06:17:56.660934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:18:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f68d006af90 msgr2=0x7f68d006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f68d006af90 0x7f68d006d450 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f68e0001050 tx=0x7f68e0000f50 comp rx=0 tx=0).stop 2023-11-24T06:18:04.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f015cce0 msgr2=0x7f68f0140980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:04.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f015cce0 0x7f68f0140980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f68e8037040 tx=0x7f68e8009750 comp rx=0 tx=0).stop 2023-11-24T06:18:04.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 shutdown_connections 2023-11-24T06:18:04.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f68d006af90 0x7f68d006d450 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f015cce0 0x7f68f0140980 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b0220 0x7f68f013c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 --2- 172.21.15.37:0/3355876024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68dc006f10 0x7f68f015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:04.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 >> 172.21.15.37:0/3355876024 conn(0x7f68f00cb830 msgr2=0x7f68f01581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:04.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 shutdown_connections 2023-11-24T06:18:04.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:04.352+0000 7f68f571a640 1 -- 172.21.15.37:0/3355876024 wait complete. 2023-11-24T06:18:05.375 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T06:18:05.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.613+0000 7fd85ca15640 1 Processor -- start 2023-11-24T06:18:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.614+0000 7fd85ca15640 1 -- start start 2023-11-24T06:18:05.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.615+0000 7fd85ca15640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd8580b2250 0x7fd85815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.615+0000 7fd85ca15640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85815ab80 con 0x7fd8580b2aa0 2023-11-24T06:18:05.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.615+0000 7fd85ca15640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85815e680 con 0x7fd8580b2630 2023-11-24T06:18:05.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.615+0000 7fd85ca15640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85815a990 con 0x7fd8580b2250 2023-11-24T06:18:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd856d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd8580b2aa0 0x7fd85815b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40718/0 (socket says 172.21.15.37:40718) 2023-11-24T06:18:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd856d9d640 1 -- 172.21.15.37:0/148333969 learned_addr learned my addr 172.21.15.37:0/148333969 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182504835 0 0) 0x7fd85815ab80 con 0x7fd8580b2aa0 2023-11-24T06:18:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd844003520 con 0x7fd8580b2aa0 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd85659c640 1 --2- 172.21.15.37:0/148333969 >> v2:172.21.15.188:3300/0 conn(0x7fd8580b2250 0x7fd85815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4187212365 0 0) 0x7fd844003520 con 0x7fd8580b2aa0 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 >> v2:172.21.15.188:3300/0 conn(0x7fd8580b2250 msgr2=0x7fd85815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.616+0000 7fd855d9b640 1 --2- 172.21.15.37:0/148333969 >> v2:172.21.15.188:3300/0 conn(0x7fd8580b2250 0x7fd85815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 >> v1:172.21.15.188:6789/0 conn(0x7fd8580b2630 legacy=0x7fd8580ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85815e960 con 0x7fd8580b2aa0 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd8500019f0 con 0x7fd8580b2aa0 2023-11-24T06:18:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 >> v1:172.21.15.37:6789/0 conn(0x7fd8580b2aa0 legacy=0x7fd85815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd844003970 0x7fd844003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440047c0 0x7fd844004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440051d0 0x7fd84400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400c0d0 con 0x7fd8440051d0 2023-11-24T06:18:05.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400c240 con 0x7fd8440047c0 2023-11-24T06:18:05.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400c400 con 0x7fd844003970 2023-11-24T06:18:05.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd856d9d640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440051d0 0x7fd84400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd856d9d640 1 -- 172.21.15.37:0/148333969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd844003970 msgr2=0x7fd844003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd856d9d640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd844003970 0x7fd844003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd856d9d640 1 -- 172.21.15.37:0/148333969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440047c0 msgr2=0x7fd844004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd856d9d640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440047c0 0x7fd844004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.617+0000 7fd856d9d640 1 -- 172.21.15.37:0/148333969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844003520 con 0x7fd8440051d0 2023-11-24T06:18:05.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.618+0000 7fd856d9d640 1 -- 172.21.15.37:0/148333969 reap_dead start 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.619+0000 7fd856d9d640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440051d0 0x7fd84400b980 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd85000a830 tx=0x7fd8440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af1ac90f52b78cc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.619+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8500072d0 con 0x7fd8440051d0 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.619+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85002f070 con 0x7fd8440051d0 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.619+0000 7fd855d9b640 1 -- 172.21.15.37:0/148333969 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8500076b0 con 0x7fd8440051d0 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.619+0000 7fd85ca15640 1 -- 172.21.15.37:0/148333969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440051d0 msgr2=0x7fd84400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.619+0000 7fd85ca15640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440051d0 0x7fd84400b980 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd85000a830 tx=0x7fd8440057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.620+0000 7fd85ca15640 1 -- 172.21.15.37:0/148333969 shutdown_connections 2023-11-24T06:18:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.620+0000 7fd85ca15640 1 --2- 172.21.15.37:0/148333969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440051d0 0x7fd84400b980 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.620+0000 7fd85ca15640 1 -- 172.21.15.37:0/148333969 >> 172.21.15.37:0/148333969 conn(0x7fd85806a920 msgr2=0x7fd85806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.620+0000 7fd85ca15640 1 -- 172.21.15.37:0/148333969 shutdown_connections 2023-11-24T06:18:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.620+0000 7fd85ca15640 1 -- 172.21.15.37:0/148333969 wait complete. 2023-11-24T06:18:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.622+0000 7fd85ca15640 1 Processor -- start 2023-11-24T06:18:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.622+0000 7fd85ca15640 1 -- start start 2023-11-24T06:18:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd85ca15640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440051d0 0x7fd85814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd85ca15640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858150290 0x7fd858150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd85ca15640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd858152770 0x7fd858152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd85ca15640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858153130 con 0x7fd858150290 2023-11-24T06:18:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd85ca15640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85814cea0 con 0x7fd8440051d0 2023-11-24T06:18:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd85ca15640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd858150e00 con 0x7fd858152770 2023-11-24T06:18:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd84ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858150290 0x7fd858150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd84ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858150290 0x7fd858150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49940/0 (socket says 172.21.15.37:49940) 2023-11-24T06:18:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.623+0000 7fd84ffff640 1 -- 172.21.15.37:0/3518147674 learned_addr learned my addr 172.21.15.37:0/3518147674 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd85659c640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440051d0 0x7fd85814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84ffff640 1 -- 172.21.15.37:0/3518147674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd858152770 msgr2=0x7fd858152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84ffff640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd858152770 0x7fd858152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84ffff640 1 -- 172.21.15.37:0/3518147674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440051d0 msgr2=0x7fd85814d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84ffff640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440051d0 0x7fd85814d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84ffff640 1 -- 172.21.15.37:0/3518147674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8581510e0 con 0x7fd858150290 2023-11-24T06:18:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd85659c640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd8440051d0 0x7fd85814d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84ffff640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858150290 0x7fd858150710 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c480 tx=0x7fd84000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:05.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400052d0 con 0x7fd858150290 2023-11-24T06:18:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840005470 con 0x7fd858150290 2023-11-24T06:18:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840007260 con 0x7fd858150290 2023-11-24T06:18:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.624+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8581513c0 con 0x7fd858150290 2023-11-24T06:18:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.625+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85815b190 con 0x7fd858150290 2023-11-24T06:18:05.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.625+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8581518e0 con 0x7fd858150290 2023-11-24T06:18:05.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.627+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fd8400073c0 con 0x7fd858150290 2023-11-24T06:18:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.628+0000 7fd84effd640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd83806af90 0x7fd83806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.628+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd840088e20 con 0x7fd858150290 2023-11-24T06:18:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.628+0000 7fd84effd640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7fd838070df0 0x7fd838073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.628+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 --> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8380738c0 con 0x7fd838070df0 2023-11-24T06:18:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.628+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd84008b3a0 con 0x7fd858150290 2023-11-24T06:18:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.628+0000 7fd85659c640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd83806af90 0x7fd83806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.628+0000 7fd856d9d640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7fd838070df0 0x7fd838073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.629+0000 7fd85659c640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd83806af90 0x7fd83806d450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd848006a90 tx=0x7fd848008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:05.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.629+0000 7fd856d9d640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7fd838070df0 0x7fd838073210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:05.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.630+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== osd.0 v2:172.21.15.37:6814/1821926241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd8380738c0 con 0x7fd838070df0 2023-11-24T06:18:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.644+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 --> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd858067470 con 0x7fd838070df0 2023-11-24T06:18:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.645+0000 7fd84effd640 1 -- 172.21.15.37:0/3518147674 <== osd.0 v2:172.21.15.37:6814/1821926241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd858067470 con 0x7fd838070df0 2023-11-24T06:18:05.648 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:05.648 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:05.648 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.645+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7fd838070df0 msgr2=0x7fd838073210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.645+0000 7fd85ca15640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6814/1821926241,v1:172.21.15.37:6816/1821926241] conn(0x7fd838070df0 0x7fd838073210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd83806af90 msgr2=0x7fd83806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd83806af90 0x7fd83806d450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd848006a90 tx=0x7fd848008040 comp rx=0 tx=0).stop 2023-11-24T06:18:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858150290 msgr2=0x7fd858150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 --2- 172.21.15.37:0/3518147674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858150290 0x7fd858150710 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c480 tx=0x7fd84000c940 comp rx=0 tx=0).stop 2023-11-24T06:18:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd856d9d640 1 -- 172.21.15.37:0/3518147674 reap_dead start 2023-11-24T06:18:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 shutdown_connections 2023-11-24T06:18:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 >> 172.21.15.37:0/3518147674 conn(0x7fd85806a920 msgr2=0x7fd858159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 shutdown_connections 2023-11-24T06:18:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.646+0000 7fd85ca15640 1 -- 172.21.15.37:0/3518147674 wait complete. 2023-11-24T06:18:05.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T06:18:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.874+0000 7fb086cda640 1 Processor -- start 2023-11-24T06:18:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.874+0000 7fb086cda640 1 -- start start 2023-11-24T06:18:05.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.876+0000 7fb086cda640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 0x7fb0800b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.876+0000 7fb086cda640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb0800b1090 0x7fb0800718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.876+0000 7fb086cda640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800b14f0 con 0x7fb080071e10 2023-11-24T06:18:05.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.876+0000 7fb086cda640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0801450d0 con 0x7fb0800b1090 2023-11-24T06:18:05.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.876+0000 7fb086cda640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801422b0 con 0x7fb080141b90 2023-11-24T06:18:05.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.876+0000 7fb0864d9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb080071e10 0x7fb08015f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40724/0 (socket says 172.21.15.37:40724) 2023-11-24T06:18:05.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.876+0000 7fb0864d9640 1 -- 172.21.15.37:0/578215363 learned_addr learned my addr 172.21.15.37:0/578215363 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb085cd8640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 0x7fb0800b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb0854d7640 1 --2- 172.21.15.37:0/578215363 >> v2:172.21.15.188:3300/0 conn(0x7fb0800b1090 0x7fb0800718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575385603 0 0) 0x7fb0800b14f0 con 0x7fb080071e10 2023-11-24T06:18:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb06c003520 con 0x7fb080071e10 2023-11-24T06:18:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4272949842 0 0) 0x7fb06c003520 con 0x7fb080071e10 2023-11-24T06:18:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 msgr2=0x7fb0800b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 0x7fb0800b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 >> v2:172.21.15.188:3300/0 conn(0x7fb0800b1090 msgr2=0x7fb0800718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 --2- 172.21.15.37:0/578215363 >> v2:172.21.15.188:3300/0 conn(0x7fb0800b1090 0x7fb0800718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800725e0 con 0x7fb080071e10 2023-11-24T06:18:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fb0780019f0 con 0x7fb080071e10 2023-11-24T06:18:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 >> v1:172.21.15.37:6789/0 conn(0x7fb080071e10 legacy=0x7fb08015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb06c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 0x7fb06c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c004d00 0x7fb06c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801450d0 con 0x7fb06c003970 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801422b0 con 0x7fb06c004d00 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.877+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c00fd90 con 0x7fb080141b90 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb085cd8640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb06c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb0854d7640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 0x7fb06c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb0864d9640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c004d00 0x7fb06c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb085cd8640 1 -- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 msgr2=0x7fb06c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb085cd8640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb080141b90 0x7fb06c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb085cd8640 1 -- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c004d00 msgr2=0x7fb06c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb085cd8640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb06c004d00 0x7fb06c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.878+0000 7fb085cd8640 1 -- 172.21.15.37:0/578215363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c003520 con 0x7fb06c003970 2023-11-24T06:18:05.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.879+0000 7fb085cd8640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb06c003d90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009ac0 tx=0x7fb06c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127443e7545b6c00 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c02c6b0 con 0x7fb06c003970 2023-11-24T06:18:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c02c810 con 0x7fb06c003970 2023-11-24T06:18:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb084cd6640 1 -- 172.21.15.37:0/578215363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c02cba0 con 0x7fb06c003970 2023-11-24T06:18:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb086cda640 1 -- 172.21.15.37:0/578215363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 msgr2=0x7fb06c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb086cda640 1 --2- 172.21.15.37:0/578215363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb06c003d90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009ac0 tx=0x7fb06c0057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb0864d9640 1 -- 172.21.15.37:0/578215363 reap_dead start 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb086cda640 1 -- 172.21.15.37:0/578215363 shutdown_connections 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.880+0000 7fb086cda640 1 -- 172.21.15.37:0/578215363 >> 172.21.15.37:0/578215363 conn(0x7fb08006a500 msgr2=0x7fb08006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.881+0000 7fb086cda640 1 -- 172.21.15.37:0/578215363 shutdown_connections 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.881+0000 7fb086cda640 1 -- 172.21.15.37:0/578215363 wait complete. 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.882+0000 7fb086cda640 1 Processor -- start 2023-11-24T06:18:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.883+0000 7fb086cda640 1 -- start start 2023-11-24T06:18:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.883+0000 7fb086cda640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb08015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.883+0000 7fb086cda640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb08015bec0 0x7fb0801560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb086cda640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0801565e0 0x7fb0800cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb086cda640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080156a60 con 0x7fb06c003970 2023-11-24T06:18:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb086cda640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800cda40 con 0x7fb0801565e0 2023-11-24T06:18:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb086cda640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800cce30 con 0x7fb08015bec0 2023-11-24T06:18:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb08015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb08015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49952/0 (socket says 172.21.15.37:49952) 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 -- 172.21.15.37:0/2365839516 learned_addr learned my addr 172.21.15.37:0/2365839516 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 -- 172.21.15.37:0/2365839516 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb08015bec0 msgr2=0x7fb0801560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb08015bec0 0x7fb0801560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 -- 172.21.15.37:0/2365839516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0801565e0 msgr2=0x7fb0800cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0801565e0 0x7fb0800cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 -- 172.21.15.37:0/2365839516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800cd110 con 0x7fb06c003970 2023-11-24T06:18:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.884+0000 7fb085cd8640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb08015b980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb07c037040 tx=0x7fb07c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.885+0000 7fb0767fc640 1 -- 172.21.15.37:0/2365839516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c003810 con 0x7fb06c003970 2023-11-24T06:18:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.885+0000 7fb0767fc640 1 -- 172.21.15.37:0/2365839516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c003970 con 0x7fb06c003970 2023-11-24T06:18:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.885+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800cd3f0 con 0x7fb06c003970 2023-11-24T06:18:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.885+0000 7fb0767fc640 1 -- 172.21.15.37:0/2365839516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c003ce0 con 0x7fb06c003970 2023-11-24T06:18:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.885+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0800ce410 con 0x7fb06c003970 2023-11-24T06:18:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.886+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb080156a00 con 0x7fb06c003970 2023-11-24T06:18:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.887+0000 7fb0767fc640 1 -- 172.21.15.37:0/2365839516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fb07c034440 con 0x7fb06c003970 2023-11-24T06:18:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.888+0000 7fb0767fc640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb06406af90 0x7fb06406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.888+0000 7fb0767fc640 1 -- 172.21.15.37:0/2365839516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb07c0ab440 con 0x7fb06c003970 2023-11-24T06:18:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.888+0000 7fb0854d7640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb06406af90 0x7fb06406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.889+0000 7fb0854d7640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb06406af90 0x7fb06406d450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb080156f10 tx=0x7fb070008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:05.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:05.893+0000 7fb0767fc640 1 -- 172.21.15.37:0/2365839516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb080156a00 con 0x7fb06c003970 2023-11-24T06:18:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.087+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0800722a0 con 0x7fb06406af90 2023-11-24T06:18:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.087+0000 7fb0767fc640 1 -- 172.21.15.37:0/2365839516 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb070009e60 con 0x7fb06406af90 2023-11-24T06:18:06.090 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T06:18:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb06406af90 msgr2=0x7fb06406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb06406af90 0x7fb06406d450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb080156f10 tx=0x7fb070008040 comp rx=0 tx=0).stop 2023-11-24T06:18:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 msgr2=0x7fb08015b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb08015b980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb07c037040 tx=0x7fb07c004730 comp rx=0 tx=0).stop 2023-11-24T06:18:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 shutdown_connections 2023-11-24T06:18:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fb06406af90 0x7fb06406d450 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0801565e0 0x7fb0800cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb08015bec0 0x7fb0801560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 --2- 172.21.15.37:0/2365839516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c003970 0x7fb08015b980 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.090+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 >> 172.21.15.37:0/2365839516 conn(0x7fb08006a500 msgr2=0x7fb08006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.091+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 shutdown_connections 2023-11-24T06:18:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.091+0000 7fb086cda640 1 -- 172.21.15.37:0/2365839516 wait complete. 2023-11-24T06:18:06.112 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T06:18:06.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:06.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.340+0000 7f7b9bd1d640 1 Processor -- start 2023-11-24T06:18:06.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.341+0000 7f7b9bd1d640 1 -- start start 2023-11-24T06:18:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.342+0000 7f7b9bd1d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 0x7f7b9415b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.342+0000 7f7b9bd1d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9415e3f0 con 0x7f7b940b2250 2023-11-24T06:18:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.342+0000 7f7b9bd1d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9415ab80 con 0x7f7b9415df80 2023-11-24T06:18:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.342+0000 7f7b9bd1d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9415a990 con 0x7f7b9415b080 2023-11-24T06:18:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.343+0000 7f7b99ab9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7b940b2250 0x7f7b940b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40738/0 (socket says 172.21.15.37:40738) 2023-11-24T06:18:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.343+0000 7f7b99ab9640 1 -- 172.21.15.37:0/1628911813 learned_addr learned my addr 172.21.15.37:0/1628911813 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.343+0000 7f7b9a2ba640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 0x7f7b9415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.343+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882763780 0 0) 0x7f7b9415e3f0 con 0x7f7b940b2250 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.343+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b80005730 con 0x7f7b940b2250 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1761730649 0 0) 0x7f7b80005730 con 0x7f7b940b2250 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 msgr2=0x7f7b9415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 0x7f7b9415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 >> v1:172.21.15.188:6789/0 conn(0x7f7b9415df80 legacy=0x7f7b940ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940b2d40 con 0x7f7b940b2250 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f7b90001670 con 0x7f7b940b2250 2023-11-24T06:18:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 >> v1:172.21.15.37:6789/0 conn(0x7f7b940b2250 legacy=0x7f7b940b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b80005bb0 0x7f7b80005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b800069d0 0x7f7b80006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 0x7f7b80007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8000dc40 con 0x7f7b80005bb0 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8000dd80 con 0x7f7b800069d0 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8000df40 con 0x7f7b9415b080 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.344+0000 7f7b99ab9640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b80005bb0 0x7f7b80005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b992b8640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b800069d0 0x7f7b80006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b99ab9640 1 -- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 msgr2=0x7f7b80007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b9a2ba640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 0x7f7b80007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b99ab9640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b9415b080 0x7f7b80007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b99ab9640 1 -- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b800069d0 msgr2=0x7f7b80006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b99ab9640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b800069d0 0x7f7b80006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b99ab9640 1 -- 172.21.15.37:0/1628911813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b80005730 con 0x7f7b80005bb0 2023-11-24T06:18:06.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.345+0000 7f7b992b8640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b800069d0 0x7f7b80006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.346+0000 7f7b99ab9640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b80005bb0 0x7f7b80005fd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7b90007fd0 tx=0x7f7b80007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f475bc24ecfc68 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.346+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90005ad0 con 0x7f7b80005bb0 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.346+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b90005c30 con 0x7f7b80005bb0 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.346+0000 7f7b98ab7640 1 -- 172.21.15.37:0/1628911813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9002c850 con 0x7f7b80005bb0 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.347+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/1628911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b80005bb0 msgr2=0x7f7b80005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.347+0000 7f7b9bd1d640 1 --2- 172.21.15.37:0/1628911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b80005bb0 0x7f7b80005fd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7b90007fd0 tx=0x7f7b80007a00 comp rx=0 tx=0).stop 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.347+0000 7f7b9a2ba640 1 -- 172.21.15.37:0/1628911813 reap_dead start 2023-11-24T06:18:06.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.347+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/1628911813 shutdown_connections 2023-11-24T06:18:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.347+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/1628911813 >> 172.21.15.37:0/1628911813 conn(0x7f7b9406a920 msgr2=0x7f7b9406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.347+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/1628911813 shutdown_connections 2023-11-24T06:18:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.347+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/1628911813 wait complete. 2023-11-24T06:18:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.349+0000 7f7b9bd1d640 1 Processor -- start 2023-11-24T06:18:06.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.349+0000 7f7b9bd1d640 1 -- start start 2023-11-24T06:18:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b9bd1d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b80005bb0 0x7f7b94099de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b9bd1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9409cee0 0x7f7b94154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b9bd1d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b94154ed0 0x7f7b940b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b9bd1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94070910 con 0x7f7b9409cee0 2023-11-24T06:18:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b9bd1d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94070bf0 con 0x7f7b94154ed0 2023-11-24T06:18:06.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b9bd1d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94070ed0 con 0x7f7b80005bb0 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b992b8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9409cee0 0x7f7b94154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b992b8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9409cee0 0x7f7b94154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49964/0 (socket says 172.21.15.37:49964) 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.350+0000 7f7b992b8640 1 -- 172.21.15.37:0/3148837075 learned_addr learned my addr 172.21.15.37:0/3148837075 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b992b8640 1 -- 172.21.15.37:0/3148837075 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b80005bb0 msgr2=0x7f7b94099de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b99ab9640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b80005bb0 0x7f7b94099de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b9a2ba640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b94154ed0 0x7f7b940b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b992b8640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b80005bb0 0x7f7b94099de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b992b8640 1 -- 172.21.15.37:0/3148837075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b94154ed0 msgr2=0x7f7b940b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b992b8640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b94154ed0 0x7f7b940b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b992b8640 1 -- 172.21.15.37:0/3148837075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940711b0 con 0x7f7b9409cee0 2023-11-24T06:18:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b992b8640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9409cee0 0x7f7b94154690 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400d770 tx=0x7f7b8400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.351+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84005270 con 0x7f7b9409cee0 2023-11-24T06:18:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.352+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b840053d0 con 0x7f7b9409cee0 2023-11-24T06:18:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.352+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b94071490 con 0x7f7b9409cee0 2023-11-24T06:18:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.352+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8400b8f0 con 0x7f7b9409cee0 2023-11-24T06:18:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.352+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b94154bd0 con 0x7f7b9409cee0 2023-11-24T06:18:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.353+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b94070d60 con 0x7f7b9409cee0 2023-11-24T06:18:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.354+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f7b8400ba50 con 0x7f7b9409cee0 2023-11-24T06:18:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.355+0000 7f7b8a7fc640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b7806af90 0x7f7b7806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.355+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7b840895a0 con 0x7f7b9409cee0 2023-11-24T06:18:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.355+0000 7f7b8a7fc640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f7b78070df0 0x7f7b78073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.355+0000 7f7b99ab9640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b7806af90 0x7f7b7806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.356+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 --> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b780738c0 con 0x7f7b78070df0 2023-11-24T06:18:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.356+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b8408bb80 con 0x7f7b9409cee0 2023-11-24T06:18:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.356+0000 7f7b9a2ba640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f7b78070df0 0x7f7b78073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.356+0000 7f7b99ab9640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b7806af90 0x7f7b7806d450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7b90034000 tx=0x7f7b90009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.356+0000 7f7b9a2ba640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f7b78070df0 0x7f7b78073210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.357+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== osd.1 v2:172.21.15.37:6808/2348647226 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7b780738c0 con 0x7f7b78070df0 2023-11-24T06:18:06.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.372+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 --> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b94071040 con 0x7f7b78070df0 2023-11-24T06:18:06.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.372+0000 7f7b8a7fc640 1 -- 172.21.15.37:0/3148837075 <== osd.1 v2:172.21.15.37:6808/2348647226 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7b94071040 con 0x7f7b78070df0 2023-11-24T06:18:06.375 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:06.375 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:06.376 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f7b78070df0 msgr2=0x7f7b78073210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6808/2348647226,v1:172.21.15.37:6809/2348647226] conn(0x7f7b78070df0 0x7f7b78073210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b7806af90 msgr2=0x7f7b7806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b7806af90 0x7f7b7806d450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7b90034000 tx=0x7f7b90009030 comp rx=0 tx=0).stop 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9409cee0 msgr2=0x7f7b94154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 --2- 172.21.15.37:0/3148837075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9409cee0 0x7f7b94154690 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400d770 tx=0x7f7b8400dc30 comp rx=0 tx=0).stop 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9a2ba640 1 -- 172.21.15.37:0/3148837075 reap_dead start 2023-11-24T06:18:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 shutdown_connections 2023-11-24T06:18:06.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 >> 172.21.15.37:0/3148837075 conn(0x7f7b9406a920 msgr2=0x7f7b94159520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:06.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 shutdown_connections 2023-11-24T06:18:06.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.373+0000 7f7b9bd1d640 1 -- 172.21.15.37:0/3148837075 wait complete. 2023-11-24T06:18:06.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T06:18:06.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.617+0000 7f50b7fff640 1 Processor -- start 2023-11-24T06:18:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.617+0000 7f50b7fff640 1 -- start start 2023-11-24T06:18:06.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.619+0000 7f50b7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50b80b1260 0x7f50b80718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.619+0000 7f50b7fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b81450d0 con 0x7f50b8141b90 2023-11-24T06:18:06.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.619+0000 7f50b7fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b81422b0 con 0x7f50b8071e10 2023-11-24T06:18:06.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.619+0000 7f50b7fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b80725e0 con 0x7f50b80b1260 2023-11-24T06:18:06.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.619+0000 7f50b6ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50b8141b90 0x7f50b80b0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40744/0 (socket says 172.21.15.37:40744) 2023-11-24T06:18:06.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.619+0000 7f50b6ffd640 1 -- 172.21.15.37:0/310902247 learned_addr learned my addr 172.21.15.37:0/310902247 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:06.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.619+0000 7f50b67fc640 1 --2- 172.21.15.37:0/310902247 >> v2:172.21.15.37:3300/0 conn(0x7f50b80b1260 0x7f50b80718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.620+0000 7f50b5ffb640 1 -- 172.21.15.37:0/310902247 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363978370 0 0) 0x7f50b81450d0 con 0x7f50b8141b90 2023-11-24T06:18:06.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.620+0000 7f50b5ffb640 1 -- 172.21.15.37:0/310902247 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a4003520 con 0x7f50b8141b90 2023-11-24T06:18:06.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.620+0000 7f50b67fc640 1 -- 172.21.15.37:0/310902247 >> v1:172.21.15.188:6789/0 conn(0x7f50b8071e10 legacy=0x7f50b8142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.620+0000 7f50b67fc640 1 -- 172.21.15.37:0/310902247 >> v1:172.21.15.37:6789/0 conn(0x7f50b8141b90 legacy=0x7f50b80b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.620+0000 7f50b67fc640 1 -- 172.21.15.37:0/310902247 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8142520 con 0x7f50b80b1260 2023-11-24T06:18:06.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.621+0000 7f50b67fc640 1 --2- 172.21.15.37:0/310902247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80718d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009d90 tx=0x7f50a002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2a41c34de1e2d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:06.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.621+0000 7f50b5ffb640 1 -- 172.21.15.37:0/310902247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a002cc60 con 0x7f50b80b1260 2023-11-24T06:18:06.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.621+0000 7f50b5ffb640 1 -- 172.21.15.37:0/310902247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a002cdc0 con 0x7f50b80b1260 2023-11-24T06:18:06.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.621+0000 7f50b5ffb640 1 -- 172.21.15.37:0/310902247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0034660 con 0x7f50b80b1260 2023-11-24T06:18:06.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.622+0000 7f50b7fff640 1 -- 172.21.15.37:0/310902247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 msgr2=0x7f50b80718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.622+0000 7f50b7fff640 1 --2- 172.21.15.37:0/310902247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80718d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009d90 tx=0x7f50a002beb0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.622+0000 7f50b7fff640 1 -- 172.21.15.37:0/310902247 shutdown_connections 2023-11-24T06:18:06.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.622+0000 7f50b7fff640 1 --2- 172.21.15.37:0/310902247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80718d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.622+0000 7f50b7fff640 1 -- 172.21.15.37:0/310902247 >> 172.21.15.37:0/310902247 conn(0x7f50b806a500 msgr2=0x7f50b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:06.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.622+0000 7f50b7fff640 1 -- 172.21.15.37:0/310902247 shutdown_connections 2023-11-24T06:18:06.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.622+0000 7f50b7fff640 1 -- 172.21.15.37:0/310902247 wait complete. 2023-11-24T06:18:06.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.624+0000 7f50b7fff640 1 Processor -- start 2023-11-24T06:18:06.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.624+0000 7f50b7fff640 1 -- start start 2023-11-24T06:18:06.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b7fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b8071e10 0x7f50b81f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b8141b90 0x7f50b8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b7fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80ac970 con 0x7f50b80b1260 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b7fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80acc10 con 0x7f50b8141b90 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b7fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80acef0 con 0x7f50b8071e10 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80ad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49986/0 (socket says 172.21.15.37:49986) 2023-11-24T06:18:06.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.625+0000 7f50b67fc640 1 -- 172.21.15.37:0/3857411359 learned_addr learned my addr 172.21.15.37:0/3857411359 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b67fc640 1 -- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b8071e10 msgr2=0x7f50b81f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b67fc640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b8071e10 0x7f50b81f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b67fc640 1 -- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b8141b90 msgr2=0x7f50b8158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b77fe640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b8141b90 0x7f50b8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b67fc640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b8141b90 0x7f50b8158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b67fc640 1 -- 172.21.15.37:0/3857411359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a0009a70 con 0x7f50b80b1260 2023-11-24T06:18:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b77fe640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b8141b90 0x7f50b8158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:06.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.626+0000 7f50b67fc640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80ad9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009d90 tx=0x7f50a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:06.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.627+0000 7f50af7fe640 1 -- 172.21.15.37:0/3857411359 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a003e610 con 0x7f50b80b1260 2023-11-24T06:18:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.627+0000 7f50af7fe640 1 -- 172.21.15.37:0/3857411359 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a003e770 con 0x7f50b80b1260 2023-11-24T06:18:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.627+0000 7f50af7fe640 1 -- 172.21.15.37:0/3857411359 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a003eb60 con 0x7f50b80b1260 2023-11-24T06:18:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.627+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b80ad1d0 con 0x7f50b80b1260 2023-11-24T06:18:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.627+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b81f6d30 con 0x7f50b80b1260 2023-11-24T06:18:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.628+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b81f6ec0 con 0x7f50b80b1260 2023-11-24T06:18:06.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.629+0000 7f50af7fe640 1 -- 172.21.15.37:0/3857411359 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f50a003b050 con 0x7f50b80b1260 2023-11-24T06:18:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.630+0000 7f50af7fe640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509806af90 0x7f509806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.630+0000 7f50af7fe640 1 -- 172.21.15.37:0/3857411359 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50a00abb40 con 0x7f50b80b1260 2023-11-24T06:18:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.630+0000 7f50b6ffd640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509806af90 0x7f509806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.631+0000 7f50b6ffd640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509806af90 0x7f509806d450 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f50a8001570 tx=0x7f50a8007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.635+0000 7f50af7fe640 1 -- 172.21.15.37:0/3857411359 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50a0076dd0 con 0x7f50b80b1260 2023-11-24T06:18:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.829+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f50b80728c0 con 0x7f509806af90 2023-11-24T06:18:06.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.830+0000 7f50af7fe640 1 -- 172.21.15.37:0/3857411359 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f50a80058b0 con 0x7f509806af90 2023-11-24T06:18:06.832 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T06:18:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509806af90 msgr2=0x7f509806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509806af90 0x7f509806d450 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f50a8001570 tx=0x7f50a8007930 comp rx=0 tx=0).stop 2023-11-24T06:18:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 msgr2=0x7f50b80ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80ad9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009d90 tx=0x7f50a0004a40 comp rx=0 tx=0).stop 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 shutdown_connections 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f509806af90 0x7f509806d450 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b8141b90 0x7f50b8158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50b80b1260 0x7f50b80ad9d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 --2- 172.21.15.37:0/3857411359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b8071e10 0x7f50b81f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.832+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 >> 172.21.15.37:0/3857411359 conn(0x7f50b806a500 msgr2=0x7f50b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.833+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 shutdown_connections 2023-11-24T06:18:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:06.833+0000 7f50b7fff640 1 -- 172.21.15.37:0/3857411359 wait complete. 2023-11-24T06:18:06.856 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T06:18:06.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.088+0000 7f31ad0ca640 1 Processor -- start 2023-11-24T06:18:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.088+0000 7f31ad0ca640 1 -- start start 2023-11-24T06:18:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.090+0000 7f31ad0ca640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 0x7f31a806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.090+0000 7f31ad0ca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a81448f0 con 0x7f31a815edd0 2023-11-24T06:18:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.090+0000 7f31ad0ca640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a8144d80 con 0x7f31a8144510 2023-11-24T06:18:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.090+0000 7f31ad0ca640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a815f2d0 con 0x7f31a80b11f0 2023-11-24T06:18:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.090+0000 7f31ac8c9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31a815edd0 0x7f31a80b4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40748/0 (socket says 172.21.15.37:40748) 2023-11-24T06:18:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.090+0000 7f31ac8c9640 1 -- 172.21.15.37:0/1315108260 learned_addr learned my addr 172.21.15.37:0/1315108260 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a77fe640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 0x7f31a806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462220624 0 0) 0x7f31a81448f0 con 0x7f31a815edd0 2023-11-24T06:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3190003520 con 0x7f31a815edd0 2023-11-24T06:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 132721105 0 0) 0x7f3190003520 con 0x7f31a815edd0 2023-11-24T06:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 msgr2=0x7f31a806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 0x7f31a806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 >> v1:172.21.15.188:6789/0 conn(0x7f31a8144510 legacy=0x7f31a80b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a815f5b0 con 0x7f31a815edd0 2023-11-24T06:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f31a00019f0 con 0x7f31a815edd0 2023-11-24T06:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 >> v1:172.21.15.37:6789/0 conn(0x7f31a815edd0 legacy=0x7f31a80b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.091+0000 7f31a6ffd640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 0x7f31900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a6ffd640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3190003f20 0x7f31900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a6ffd640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f3190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a815f2d0 con 0x7f3190004d00 2023-11-24T06:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319000bb10 con 0x7f3190003f20 2023-11-24T06:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319000bcd0 con 0x7f31a80b11f0 2023-11-24T06:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31ac8c9640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f3190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a77fe640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3190003f20 0x7f31900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a7fff640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 0x7f31900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31ac8c9640 1 -- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 msgr2=0x7f31900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31ac8c9640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a80b11f0 0x7f31900039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31ac8c9640 1 -- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3190003f20 msgr2=0x7f31900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31ac8c9640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3190003f20 0x7f31900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31ac8c9640 1 -- 172.21.15.37:0/1315108260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190003520 con 0x7f3190004d00 2023-11-24T06:18:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.092+0000 7f31a77fe640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3190003f20 0x7f31900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31ac8c9640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f3190005180 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f31a815f200 tx=0x7f31900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbe19a84016bf7f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00072d0 con 0x7f3190004d00 2023-11-24T06:18:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a002f070 con 0x7f3190004d00 2023-11-24T06:18:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31a6ffd640 1 -- 172.21.15.37:0/1315108260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00076f0 con 0x7f3190004d00 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31ad0ca640 1 -- 172.21.15.37:0/1315108260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 msgr2=0x7f3190005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31ad0ca640 1 --2- 172.21.15.37:0/1315108260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f3190005180 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f31a815f200 tx=0x7f31900057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31ac8c9640 1 -- 172.21.15.37:0/1315108260 reap_dead start 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31ad0ca640 1 -- 172.21.15.37:0/1315108260 shutdown_connections 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.094+0000 7f31ad0ca640 1 -- 172.21.15.37:0/1315108260 >> 172.21.15.37:0/1315108260 conn(0x7f31a80cb8a0 msgr2=0x7f31a80cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.095+0000 7f31ad0ca640 1 -- 172.21.15.37:0/1315108260 shutdown_connections 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.095+0000 7f31ad0ca640 1 -- 172.21.15.37:0/1315108260 wait complete. 2023-11-24T06:18:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.096+0000 7f31ad0ca640 1 Processor -- start 2023-11-24T06:18:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.097+0000 7f31ad0ca640 1 -- start start 2023-11-24T06:18:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31ad0ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f31a80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31ad0ca640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31a813fc50 0x7f31a8143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31ad0ca640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a8071460 0x7f31a80b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31ad0ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8070830 con 0x7f3190004d00 2023-11-24T06:18:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31ad0ca640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8140150 con 0x7f31a813fc50 2023-11-24T06:18:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31ad0ca640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8142840 con 0x7f31a8071460 2023-11-24T06:18:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f31a80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f31a80702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50012/0 (socket says 172.21.15.37:50012) 2023-11-24T06:18:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 -- 172.21.15.37:0/2543844063 learned_addr learned my addr 172.21.15.37:0/2543844063 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 -- 172.21.15.37:0/2543844063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a8071460 msgr2=0x7f31a80b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f31a8071460 0x7f31a80b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 -- 172.21.15.37:0/2543844063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31a813fc50 msgr2=0x7f31a8143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f31a813fc50 0x7f31a8143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.098+0000 7f31a7fff640 1 -- 172.21.15.37:0/2543844063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8142b20 con 0x7f3190004d00 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.099+0000 7f31a7fff640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f31a80702f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f319800d570 tx=0x7f319800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.099+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198005480 con 0x7f3190004d00 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.099+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198003610 con 0x7f3190004d00 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.099+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a8142e00 con 0x7f3190004d00 2023-11-24T06:18:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.099+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198003980 con 0x7f3190004d00 2023-11-24T06:18:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.099+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a8151050 con 0x7f3190004d00 2023-11-24T06:18:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.100+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31a80b3c30 con 0x7f3190004d00 2023-11-24T06:18:07.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.101+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f3198003ae0 con 0x7f3190004d00 2023-11-24T06:18:07.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.102+0000 7f31a4ff9640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f319406af90 0x7f319406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.102+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31980894b0 con 0x7f3190004d00 2023-11-24T06:18:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.102+0000 7f31a4ff9640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f3194070df0 0x7f3194073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.102+0000 7f31a77fe640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f319406af90 0x7f319406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.102+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 --> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31940738c0 con 0x7f3194070df0 2023-11-24T06:18:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.102+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f319808ba90 con 0x7f3190004d00 2023-11-24T06:18:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.103+0000 7f31ac8c9640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f3194070df0 0x7f3194073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.103+0000 7f31a77fe640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f319406af90 0x7f319406d450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31a815a670 tx=0x7f319c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.103+0000 7f31ac8c9640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f3194070df0 0x7f3194073210 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.104+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== osd.2 v2:172.21.15.37:6800/276316987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f31940738c0 con 0x7f3194070df0 2023-11-24T06:18:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.119+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 --> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31a815fb70 con 0x7f3194070df0 2023-11-24T06:18:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31a4ff9640 1 -- 172.21.15.37:0/2543844063 <== osd.2 v2:172.21.15.37:6800/276316987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f31a00017f0 con 0x7f3194070df0 2023-11-24T06:18:07.122 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:07.123 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:07.123 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:07.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f3194070df0 msgr2=0x7f3194073210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6800/276316987,v1:172.21.15.37:6801/276316987] conn(0x7f3194070df0 0x7f3194073210 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f319406af90 msgr2=0x7f319406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f319406af90 0x7f319406d450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31a815a670 tx=0x7f319c008040 comp rx=0 tx=0).stop 2023-11-24T06:18:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 msgr2=0x7f31a80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 --2- 172.21.15.37:0/2543844063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3190004d00 0x7f31a80702f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f319800d570 tx=0x7f319800da30 comp rx=0 tx=0).stop 2023-11-24T06:18:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ac8c9640 1 -- 172.21.15.37:0/2543844063 reap_dead start 2023-11-24T06:18:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 shutdown_connections 2023-11-24T06:18:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.120+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 >> 172.21.15.37:0/2543844063 conn(0x7f31a80cb8a0 msgr2=0x7f31a80cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.121+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 shutdown_connections 2023-11-24T06:18:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.121+0000 7f31ad0ca640 1 -- 172.21.15.37:0/2543844063 wait complete. 2023-11-24T06:18:07.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T06:18:07.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.352+0000 7f5823b78640 1 Processor -- start 2023-11-24T06:18:07.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.352+0000 7f5823b78640 1 -- start start 2023-11-24T06:18:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.353+0000 7f5823b78640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f581c15c7f0 0x7f581c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.354+0000 7f5823b78640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c0cece0 con 0x7f581c0ce6c0 2023-11-24T06:18:07.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.354+0000 7f5823b78640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c06d040 con 0x7f581c0cf450 2023-11-24T06:18:07.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.354+0000 7f5823b78640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c0ceaf0 con 0x7f581c15c7f0 2023-11-24T06:18:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.354+0000 7f5822115640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f581c0ce6c0 0x7f581c0714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40764/0 (socket says 172.21.15.37:40764) 2023-11-24T06:18:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.354+0000 7f5822115640 1 -- 172.21.15.37:0/4184445462 learned_addr learned my addr 172.21.15.37:0/4184445462 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.354+0000 7f5821914640 1 --2- 172.21.15.37:0/4184445462 >> v2:172.21.15.188:3300/0 conn(0x7f581c15c7f0 0x7f581c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455281733 0 0) 0x7f581c0cece0 con 0x7f581c0ce6c0 2023-11-24T06:18:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5808003520 con 0x7f581c0ce6c0 2023-11-24T06:18:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1528072205 0 0) 0x7f5808003520 con 0x7f581c0ce6c0 2023-11-24T06:18:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 >> v2:172.21.15.188:3300/0 conn(0x7f581c15c7f0 msgr2=0x7f581c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 --2- 172.21.15.37:0/4184445462 >> v2:172.21.15.188:3300/0 conn(0x7f581c15c7f0 0x7f581c06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 >> v1:172.21.15.188:6789/0 conn(0x7f581c0cf450 legacy=0x7f581c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c06d320 con 0x7f581c0ce6c0 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f58140019f0 con 0x7f581c0ce6c0 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 >> v1:172.21.15.37:6789/0 conn(0x7f581c0ce6c0 legacy=0x7f581c0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58080039c0 0x7f5808003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58080047c0 0x7f5808004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f580800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580800c050 con 0x7f5808005180 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580800c1c0 con 0x7f58080047c0 2023-11-24T06:18:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.355+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580800c380 con 0x7f58080039c0 2023-11-24T06:18:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5822115640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f580800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5821914640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58080039c0 0x7f5808003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5822115640 1 -- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58080039c0 msgr2=0x7f5808003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5822115640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58080039c0 0x7f5808003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5821113640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58080047c0 0x7f5808004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5822115640 1 -- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58080047c0 msgr2=0x7f5808004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5822115640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58080047c0 0x7f5808004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.356+0000 7f5822115640 1 -- 172.21.15.37:0/4184445462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808003520 con 0x7f5808005180 2023-11-24T06:18:07.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.357+0000 7f5822115640 1 -- 172.21.15.37:0/4184445462 reap_dead start 2023-11-24T06:18:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.357+0000 7f5822115640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f580800b980 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f581400a760 tx=0x7f58080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620958051ebfad40 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814034630 con 0x7f5808005180 2023-11-24T06:18:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581402f070 con 0x7f5808005180 2023-11-24T06:18:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5820912640 1 -- 172.21.15.37:0/4184445462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814034a10 con 0x7f5808005180 2023-11-24T06:18:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5823b78640 1 -- 172.21.15.37:0/4184445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 msgr2=0x7f580800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5823b78640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f580800b980 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f581400a760 tx=0x7f58080057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5823b78640 1 -- 172.21.15.37:0/4184445462 shutdown_connections 2023-11-24T06:18:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5823b78640 1 --2- 172.21.15.37:0/4184445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f580800b980 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5823b78640 1 -- 172.21.15.37:0/4184445462 >> 172.21.15.37:0/4184445462 conn(0x7f581c06a920 msgr2=0x7f581c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.358+0000 7f5823b78640 1 -- 172.21.15.37:0/4184445462 shutdown_connections 2023-11-24T06:18:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.359+0000 7f5823b78640 1 -- 172.21.15.37:0/4184445462 wait complete. 2023-11-24T06:18:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.360+0000 7f5823b78640 1 Processor -- start 2023-11-24T06:18:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.360+0000 7f5823b78640 1 -- start start 2023-11-24T06:18:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.361+0000 7f5823b78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f581c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.361+0000 7f5823b78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f581c0b3550 0x7f581c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.361+0000 7f5823b78640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f581c151be0 0x7f581c14fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.361+0000 7f5823b78640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0b30c0 con 0x7f5808005180 2023-11-24T06:18:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.361+0000 7f5823b78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0b24b0 con 0x7f581c0b3550 2023-11-24T06:18:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.361+0000 7f5823b78640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0b2790 con 0x7f581c151be0 2023-11-24T06:18:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f581c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f581c0b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50030/0 (socket says 172.21.15.37:50030) 2023-11-24T06:18:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 -- 172.21.15.37:0/3220438166 learned_addr learned my addr 172.21.15.37:0/3220438166 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 -- 172.21.15.37:0/3220438166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f581c151be0 msgr2=0x7f581c14fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f581c151be0 0x7f581c14fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 -- 172.21.15.37:0/3220438166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f581c0b3550 msgr2=0x7f581c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f581c0b3550 0x7f581c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 -- 172.21.15.37:0/3220438166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0b2a70 con 0x7f5808005180 2023-11-24T06:18:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.362+0000 7f5821914640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f581c0b1db0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5818010860 tx=0x7f5818010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.363+0000 7f58127fc640 1 -- 172.21.15.37:0/3220438166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818009610 con 0x7f5808005180 2023-11-24T06:18:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.363+0000 7f58127fc640 1 -- 172.21.15.37:0/3220438166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581800eb60 con 0x7f5808005180 2023-11-24T06:18:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.363+0000 7f58127fc640 1 -- 172.21.15.37:0/3220438166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581801c400 con 0x7f5808005180 2023-11-24T06:18:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.363+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c0b2d50 con 0x7f5808005180 2023-11-24T06:18:07.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.363+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c152230 con 0x7f5808005180 2023-11-24T06:18:07.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.364+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c067470 con 0x7f5808005180 2023-11-24T06:18:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.365+0000 7f58127fc640 1 -- 172.21.15.37:0/3220438166 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f581801c560 con 0x7f5808005180 2023-11-24T06:18:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.366+0000 7f58127fc640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f580006af60 0x7f580006d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.366+0000 7f58127fc640 1 -- 172.21.15.37:0/3220438166 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5818089a20 con 0x7f5808005180 2023-11-24T06:18:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.366+0000 7f5821113640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f580006af60 0x7f580006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.367+0000 7f5821113640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f580006af60 0x7f580006d420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f580c000f60 tx=0x7f580c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.370+0000 7f58127fc640 1 -- 172.21.15.37:0/3220438166 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5818054d60 con 0x7f5808005180 2023-11-24T06:18:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.569+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f581c0b3200 con 0x7f580006af60 2023-11-24T06:18:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.570+0000 7f58127fc640 1 -- 172.21.15.37:0/3220438166 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f580c001290 con 0x7f580006af60 2023-11-24T06:18:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T06:18:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f580006af60 msgr2=0x7f580006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f580006af60 0x7f580006d420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f580c000f60 tx=0x7f580c009040 comp rx=0 tx=0).stop 2023-11-24T06:18:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 msgr2=0x7f581c0b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f581c0b1db0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5818010860 tx=0x7f5818010d20 comp rx=0 tx=0).stop 2023-11-24T06:18:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 shutdown_connections 2023-11-24T06:18:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f580006af60 0x7f580006d420 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f581c0b3550 0x7f581c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f581c151be0 0x7f581c14fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 --2- 172.21.15.37:0/3220438166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5808005180 0x7f581c0b1db0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 >> 172.21.15.37:0/3220438166 conn(0x7f581c06a920 msgr2=0x7f581c06d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 shutdown_connections 2023-11-24T06:18:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.573+0000 7f5823b78640 1 -- 172.21.15.37:0/3220438166 wait complete. 2023-11-24T06:18:07.596 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T06:18:07.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:07.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.827+0000 7faa3262e640 1 Processor -- start 2023-11-24T06:18:07.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.827+0000 7faa3262e640 1 -- start start 2023-11-24T06:18:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.829+0000 7faa3262e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa2c070ab0 0x7faa2c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.829+0000 7faa3262e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c0b22a0 con 0x7faa2c0b1e50 2023-11-24T06:18:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.829+0000 7faa3262e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c165ba0 con 0x7faa2c14acb0 2023-11-24T06:18:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.829+0000 7faa3262e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c165e80 con 0x7faa2c070ab0 2023-11-24T06:18:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.830+0000 7faa30e2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa2c070ab0 0x7faa2c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.830+0000 7faa31e2d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faa2c0b1e50 0x7faa2c0cd5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40766/0 (socket says 172.21.15.37:40766) 2023-11-24T06:18:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.830+0000 7faa31e2d640 1 -- 172.21.15.37:0/896332737 learned_addr learned my addr 172.21.15.37:0/896332737 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.830+0000 7faa30e2b640 1 -- 172.21.15.37:0/896332737 >> v1:172.21.15.188:6789/0 conn(0x7faa2c14acb0 legacy=0x7faa2c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.830+0000 7faa30e2b640 1 -- 172.21.15.37:0/896332737 >> v1:172.21.15.37:6789/0 conn(0x7faa2c0b1e50 legacy=0x7faa2c0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.830+0000 7faa23fff640 1 -- 172.21.15.37:0/896332737 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162210216 0 0) 0x7faa24001490 con 0x7faa2c0b1e50 2023-11-24T06:18:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.830+0000 7faa30e2b640 1 -- 172.21.15.37:0/896332737 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c166160 con 0x7faa2c070ab0 2023-11-24T06:18:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.831+0000 7faa30e2b640 1 --2- 172.21.15.37:0/896332737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c0b14f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009790 tx=0x7faa1c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137b147e9d10fdb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.832+0000 7faa23fff640 1 -- 172.21.15.37:0/896332737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c030610 con 0x7faa2c070ab0 2023-11-24T06:18:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.832+0000 7faa23fff640 1 -- 172.21.15.37:0/896332737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c030770 con 0x7faa2c070ab0 2023-11-24T06:18:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.832+0000 7faa23fff640 1 -- 172.21.15.37:0/896332737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c030b00 con 0x7faa2c070ab0 2023-11-24T06:18:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.832+0000 7faa3262e640 1 -- 172.21.15.37:0/896332737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 msgr2=0x7faa2c0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.832+0000 7faa3262e640 1 --2- 172.21.15.37:0/896332737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c0b14f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009790 tx=0x7faa1c02b960 comp rx=0 tx=0).stop 2023-11-24T06:18:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.833+0000 7faa3262e640 1 -- 172.21.15.37:0/896332737 shutdown_connections 2023-11-24T06:18:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.833+0000 7faa3262e640 1 --2- 172.21.15.37:0/896332737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c0b14f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.833+0000 7faa3262e640 1 -- 172.21.15.37:0/896332737 >> 172.21.15.37:0/896332737 conn(0x7faa2c0cb8a0 msgr2=0x7faa2c0cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.833+0000 7faa3262e640 1 -- 172.21.15.37:0/896332737 shutdown_connections 2023-11-24T06:18:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.833+0000 7faa3262e640 1 -- 172.21.15.37:0/896332737 wait complete. 2023-11-24T06:18:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.834+0000 7faa3262e640 1 Processor -- start 2023-11-24T06:18:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.835+0000 7faa3262e640 1 -- start start 2023-11-24T06:18:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3262e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3262e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa2c0b1e50 0x7faa2c142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3262e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa2c14acb0 0x7faa2c0b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3262e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c144680 con 0x7faa2c070ab0 2023-11-24T06:18:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3262e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c143090 con 0x7faa2c14acb0 2023-11-24T06:18:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3262e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c0b01d0 con 0x7faa2c0b1e50 2023-11-24T06:18:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50050/0 (socket says 172.21.15.37:50050) 2023-11-24T06:18:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 -- 172.21.15.37:0/219193385 learned_addr learned my addr 172.21.15.37:0/219193385 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 -- 172.21.15.37:0/219193385 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa2c0b1e50 msgr2=0x7faa2c142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa2c0b1e50 0x7faa2c142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 -- 172.21.15.37:0/219193385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa2c14acb0 msgr2=0x7faa2c0b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa2c14acb0 0x7faa2c0b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.836+0000 7faa3162c640 1 -- 172.21.15.37:0/219193385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c0093a0 con 0x7faa2c070ab0 2023-11-24T06:18:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.837+0000 7faa3162c640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c142b50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7faa2800c400 tx=0x7faa2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.837+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280052d0 con 0x7faa2c070ab0 2023-11-24T06:18:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.837+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28005430 con 0x7faa2c070ab0 2023-11-24T06:18:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.837+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28003830 con 0x7faa2c070ab0 2023-11-24T06:18:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.837+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c0b04b0 con 0x7faa2c070ab0 2023-11-24T06:18:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.837+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c0b0a70 con 0x7faa2c070ab0 2023-11-24T06:18:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.838+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa2c0cb730 con 0x7faa2c070ab0 2023-11-24T06:18:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.839+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7faa28003990 con 0x7faa2c070ab0 2023-11-24T06:18:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.840+0000 7faa21ffb640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faa1006af60 0x7faa1006d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.841+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faa28089250 con 0x7faa2c070ab0 2023-11-24T06:18:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.841+0000 7faa30e2b640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faa1006af60 0x7faa1006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.841+0000 7faa21ffb640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7faa10070dc0 0x7faa100731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.841+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 --> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa10073890 con 0x7faa10070dc0 2023-11-24T06:18:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.841+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa280895c0 con 0x7faa2c070ab0 2023-11-24T06:18:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.841+0000 7faa31e2d640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7faa10070dc0 0x7faa100731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.842+0000 7faa30e2b640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faa1006af60 0x7faa1006d420 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faa1c036000 tx=0x7faa1c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.842+0000 7faa31e2d640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7faa10070dc0 0x7faa100731e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.842+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== osd.3 v2:172.21.15.37:6812/1198045157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faa10073890 con 0x7faa10070dc0 2023-11-24T06:18:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.857+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 --> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa2c04e840 con 0x7faa10070dc0 2023-11-24T06:18:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa21ffb640 1 -- 172.21.15.37:0/219193385 <== osd.3 v2:172.21.15.37:6812/1198045157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faa2c04e840 con 0x7faa10070dc0 2023-11-24T06:18:07.861 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:07.861 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:07.861 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7faa10070dc0 msgr2=0x7faa100731e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6812/1198045157,v1:172.21.15.37:6815/1198045157] conn(0x7faa10070dc0 0x7faa100731e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faa1006af60 msgr2=0x7faa1006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7faa1006af60 0x7faa1006d420 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faa1c036000 tx=0x7faa1c03b040 comp rx=0 tx=0).stop 2023-11-24T06:18:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 msgr2=0x7faa2c142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 --2- 172.21.15.37:0/219193385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c070ab0 0x7faa2c142b50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7faa2800c400 tx=0x7faa2800c8c0 comp rx=0 tx=0).stop 2023-11-24T06:18:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa31e2d640 1 -- 172.21.15.37:0/219193385 reap_dead start 2023-11-24T06:18:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 shutdown_connections 2023-11-24T06:18:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.858+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 >> 172.21.15.37:0/219193385 conn(0x7faa2c0cb8a0 msgr2=0x7faa2c0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.859+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 shutdown_connections 2023-11-24T06:18:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:07.859+0000 7faa3262e640 1 -- 172.21.15.37:0/219193385 wait complete. 2023-11-24T06:18:07.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T06:18:08.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.103+0000 7efc67fff640 1 Processor -- start 2023-11-24T06:18:08.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.104+0000 7efc67fff640 1 -- start start 2023-11-24T06:18:08.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.106+0000 7efc67fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efc6815e620 0x7efc680ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.106+0000 7efc67fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 0x7efc680b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.106+0000 7efc67fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc68072960 con 0x7efc680b0b50 2023-11-24T06:18:08.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.106+0000 7efc67fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6815dc10 con 0x7efc6815e620 2023-11-24T06:18:08.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.106+0000 7efc67fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc680cb0b0 con 0x7efc680ae670 2023-11-24T06:18:08.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.106+0000 7efc66ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc680b0b50 0x7efc680b0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40772/0 (socket says 172.21.15.37:40772) 2023-11-24T06:18:08.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.106+0000 7efc66ffd640 1 -- 172.21.15.37:0/2963757961 learned_addr learned my addr 172.21.15.37:0/2963757961 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:08.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc677fe640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 0x7efc680b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc5ffff640 1 --2- 172.21.15.37:0/2963757961 >> v2:172.21.15.188:3300/0 conn(0x7efc6815e620 0x7efc680ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517805179 0 0) 0x7efc68072960 con 0x7efc680b0b50 2023-11-24T06:18:08.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc54003520 con 0x7efc680b0b50 2023-11-24T06:18:08.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531937231 0 0) 0x7efc54003520 con 0x7efc680b0b50 2023-11-24T06:18:08.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 msgr2=0x7efc680b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 0x7efc680b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 >> v2:172.21.15.188:3300/0 conn(0x7efc6815e620 msgr2=0x7efc680ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 --2- 172.21.15.37:0/2963757961 >> v2:172.21.15.188:3300/0 conn(0x7efc6815e620 0x7efc680ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc680cb390 con 0x7efc680b0b50 2023-11-24T06:18:08.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7efc58001670 con 0x7efc680b0b50 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc677fe640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 0x7efc680b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 >> v1:172.21.15.37:6789/0 conn(0x7efc680b0b50 legacy=0x7efc680b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 0x7efc54003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54003f00 0x7efc540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc54004d00 0x7efc54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815dc10 con 0x7efc54004d00 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc680cb0b0 con 0x7efc54003f00 2023-11-24T06:18:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.107+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5400ba00 con 0x7efc680ae670 2023-11-24T06:18:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc677fe640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc54004d00 0x7efc54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc66ffd640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 0x7efc54003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc5ffff640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54003f00 0x7efc540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc677fe640 1 -- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 msgr2=0x7efc54003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc677fe640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc680ae670 0x7efc54003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc677fe640 1 -- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54003f00 msgr2=0x7efc540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc677fe640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc54003f00 0x7efc540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.108+0000 7efc677fe640 1 -- 172.21.15.37:0/2963757961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54003520 con 0x7efc54004d00 2023-11-24T06:18:08.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.109+0000 7efc677fe640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc54004d00 0x7efc54005180 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efc600073b0 tx=0x7efc540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f379a0839faab5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6002cd30 con 0x7efc54004d00 2023-11-24T06:18:08.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6002ce90 con 0x7efc54004d00 2023-11-24T06:18:08.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc667fc640 1 -- 172.21.15.37:0/2963757961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60003b90 con 0x7efc54004d00 2023-11-24T06:18:08.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc67fff640 1 -- 172.21.15.37:0/2963757961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc54004d00 msgr2=0x7efc54005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc67fff640 1 --2- 172.21.15.37:0/2963757961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc54004d00 0x7efc54005180 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efc600073b0 tx=0x7efc540057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc677fe640 1 -- 172.21.15.37:0/2963757961 reap_dead start 2023-11-24T06:18:08.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc67fff640 1 -- 172.21.15.37:0/2963757961 shutdown_connections 2023-11-24T06:18:08.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc67fff640 1 -- 172.21.15.37:0/2963757961 >> 172.21.15.37:0/2963757961 conn(0x7efc6806a500 msgr2=0x7efc6806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:08.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc67fff640 1 -- 172.21.15.37:0/2963757961 shutdown_connections 2023-11-24T06:18:08.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.110+0000 7efc67fff640 1 -- 172.21.15.37:0/2963757961 wait complete. 2023-11-24T06:18:08.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.112+0000 7efc67fff640 1 Processor -- start 2023-11-24T06:18:08.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.112+0000 7efc67fff640 1 -- start start 2023-11-24T06:18:08.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.113+0000 7efc67fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc54004d00 0x7efc68155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.113+0000 7efc67fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc6815d570 0x7efc680cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.113+0000 7efc67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc6813e640 0x7efc6813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.113+0000 7efc67fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815d9f0 con 0x7efc6813e640 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.113+0000 7efc67fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6813efe0 con 0x7efc6815d570 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.113+0000 7efc67fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc68156160 con 0x7efc54004d00 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc6813e640 0x7efc6813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc6813e640 0x7efc6813eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50054/0 (socket says 172.21.15.37:50054) 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 -- 172.21.15.37:0/3737185203 learned_addr learned my addr 172.21.15.37:0/3737185203 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc66ffd640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc54004d00 0x7efc68155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc5ffff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc6815d570 0x7efc680cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 -- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc54004d00 msgr2=0x7efc68155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc54004d00 0x7efc68155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 -- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc6815d570 msgr2=0x7efc680cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc6815d570 0x7efc680cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc677fe640 1 -- 172.21.15.37:0/3737185203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68156440 con 0x7efc6813e640 2023-11-24T06:18:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.114+0000 7efc5ffff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc6815d570 0x7efc680cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:08.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.115+0000 7efc677fe640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc6813e640 0x7efc6813eaa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efc600073b0 tx=0x7efc60004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.115+0000 7efc64ff9640 1 -- 172.21.15.37:0/3737185203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60004440 con 0x7efc6813e640 2023-11-24T06:18:08.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.115+0000 7efc64ff9640 1 -- 172.21.15.37:0/3737185203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600045a0 con 0x7efc6813e640 2023-11-24T06:18:08.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.115+0000 7efc64ff9640 1 -- 172.21.15.37:0/3737185203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6003e430 con 0x7efc6813e640 2023-11-24T06:18:08.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.115+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68156720 con 0x7efc6813e640 2023-11-24T06:18:08.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.115+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc68156ce0 con 0x7efc6813e640 2023-11-24T06:18:08.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.117+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6813f300 con 0x7efc6813e640 2023-11-24T06:18:08.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.117+0000 7efc64ff9640 1 -- 172.21.15.37:0/3737185203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7efc6003e590 con 0x7efc6813e640 2023-11-24T06:18:08.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.118+0000 7efc64ff9640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc4806af60 0x7efc4806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.118+0000 7efc64ff9640 1 -- 172.21.15.37:0/3737185203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efc600ab730 con 0x7efc6813e640 2023-11-24T06:18:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.119+0000 7efc66ffd640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc4806af60 0x7efc4806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.119+0000 7efc66ffd640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc4806af60 0x7efc4806d420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.123+0000 7efc64ff9640 1 -- 172.21.15.37:0/3737185203 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc6813f300 con 0x7efc6813e640 2023-11-24T06:18:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.316+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7efc6815e100 con 0x7efc4806af60 2023-11-24T06:18:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.317+0000 7efc64ff9640 1 -- 172.21.15.37:0/3737185203 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efc58010980 con 0x7efc4806af60 2023-11-24T06:18:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T06:18:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc4806af60 msgr2=0x7efc4806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc4806af60 0x7efc4806d420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58009040 comp rx=0 tx=0).stop 2023-11-24T06:18:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc6813e640 msgr2=0x7efc6813eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc6813e640 0x7efc6813eaa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efc600073b0 tx=0x7efc60004ab0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 shutdown_connections 2023-11-24T06:18:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7efc4806af60 0x7efc4806d420 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc6815d570 0x7efc680cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc6813e640 0x7efc6813eaa0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 --2- 172.21.15.37:0/3737185203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc54004d00 0x7efc68155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.319+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 >> 172.21.15.37:0/3737185203 conn(0x7efc6806a500 msgr2=0x7efc680b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.320+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 shutdown_connections 2023-11-24T06:18:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.320+0000 7efc67fff640 1 -- 172.21.15.37:0/3737185203 wait complete. 2023-11-24T06:18:08.341 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T06:18:08.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:08.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.559+0000 7f7b5759e640 1 Processor -- start 2023-11-24T06:18:08.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.560+0000 7f7b5759e640 1 -- start start 2023-11-24T06:18:08.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.561+0000 7f7b5759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b58160b00 0x7f7b580d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.561+0000 7f7b5759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7b580d12e0 0x7f7b580cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.561+0000 7f7b5759e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5815ea30 con 0x7f7b580d0120 2023-11-24T06:18:08.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.561+0000 7f7b5759e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b580d05b0 con 0x7f7b580d12e0 2023-11-24T06:18:08.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.561+0000 7f7b5759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5815de20 con 0x7f7b58160b00 2023-11-24T06:18:08.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.562+0000 7f7b5659c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b58160b00 0x7f7b580d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.562+0000 7f7b5659c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b58160b00 0x7f7b580d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:52392/0 (socket says 172.21.15.37:52392) 2023-11-24T06:18:08.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.562+0000 7f7b5659c640 1 -- 172.21.15.37:0/2399332100 learned_addr learned my addr 172.21.15.37:0/2399332100 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:08.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.562+0000 7f7b4ffff640 1 --2- 172.21.15.37:0/2399332100 >> v2:172.21.15.188:3300/0 conn(0x7f7b580d12e0 0x7f7b580cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.563+0000 7f7b5659c640 1 -- 172.21.15.37:0/2399332100 >> v2:172.21.15.188:3300/0 conn(0x7f7b580d12e0 msgr2=0x7f7b580cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.563+0000 7f7b5659c640 1 --2- 172.21.15.37:0/2399332100 >> v2:172.21.15.188:3300/0 conn(0x7f7b580d12e0 0x7f7b580cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.563+0000 7f7b5659c640 1 -- 172.21.15.37:0/2399332100 >> v1:172.21.15.188:6789/0 conn(0x7f7b580d0120 legacy=0x7f7b5815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.563+0000 7f7b5659c640 1 -- 172.21.15.37:0/2399332100 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5815e100 con 0x7f7b58160b00 2023-11-24T06:18:08.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.564+0000 7f7b5659c640 1 --2- 172.21.15.37:0/2399332100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b58160b00 0x7f7b580d0da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009870 tx=0x7f7b4802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b193167e1909bdc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.565+0000 7f7b55d9b640 1 -- 172.21.15.37:0/2399332100 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48030840 con 0x7f7b58160b00 2023-11-24T06:18:08.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.565+0000 7f7b55d9b640 1 -- 172.21.15.37:0/2399332100 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b480309a0 con 0x7f7b58160b00 2023-11-24T06:18:08.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.565+0000 7f7b55d9b640 1 -- 172.21.15.37:0/2399332100 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48030d30 con 0x7f7b58160b00 2023-11-24T06:18:08.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 -- 172.21.15.37:0/2399332100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b58160b00 msgr2=0x7f7b580d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 --2- 172.21.15.37:0/2399332100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b58160b00 0x7f7b580d0da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009870 tx=0x7f7b4802b980 comp rx=0 tx=0).stop 2023-11-24T06:18:08.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 -- 172.21.15.37:0/2399332100 shutdown_connections 2023-11-24T06:18:08.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 --2- 172.21.15.37:0/2399332100 >> v2:172.21.15.188:3300/0 conn(0x7f7b580d12e0 0x7f7b580cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 --2- 172.21.15.37:0/2399332100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b58160b00 0x7f7b580d0da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 -- 172.21.15.37:0/2399332100 >> 172.21.15.37:0/2399332100 conn(0x7f7b5809c510 msgr2=0x7f7b580d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:08.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 -- 172.21.15.37:0/2399332100 shutdown_connections 2023-11-24T06:18:08.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.566+0000 7f7b5759e640 1 -- 172.21.15.37:0/2399332100 wait complete. 2023-11-24T06:18:08.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.568+0000 7f7b5759e640 1 Processor -- start 2023-11-24T06:18:08.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.568+0000 7f7b5759e640 1 -- start start 2023-11-24T06:18:08.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b5759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b580d0120 0x7f7b580b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b5759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b580d12e0 0x7f7b58152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b5759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b58160b00 0x7f7b580b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b5759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580b5df0 con 0x7f7b58160b00 2023-11-24T06:18:08.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b5759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580b7ee0 con 0x7f7b580d12e0 2023-11-24T06:18:08.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b5759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580b6040 con 0x7f7b580d0120 2023-11-24T06:18:08.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b58160b00 0x7f7b580b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b58160b00 0x7f7b580b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50060/0 (socket says 172.21.15.37:50060) 2023-11-24T06:18:08.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.569+0000 7f7b56d9d640 1 -- 172.21.15.37:0/2591088749 learned_addr learned my addr 172.21.15.37:0/2591088749 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:08.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b5659c640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b580d0120 0x7f7b580b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b4ffff640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b580d12e0 0x7f7b58152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b56d9d640 1 -- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b580d0120 msgr2=0x7f7b580b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b56d9d640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b580d0120 0x7f7b580b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b56d9d640 1 -- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b580d12e0 msgr2=0x7f7b58152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b56d9d640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b580d12e0 0x7f7b58152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b56d9d640 1 -- 172.21.15.37:0/2591088749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480094d0 con 0x7f7b58160b00 2023-11-24T06:18:08.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b5659c640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b580d0120 0x7f7b580b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:18:08.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.570+0000 7f7b56d9d640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b58160b00 0x7f7b580b7520 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c7a0 tx=0x7f7b5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.571+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50003b70 con 0x7f7b58160b00 2023-11-24T06:18:08.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.571+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b50003cf0 con 0x7f7b58160b00 2023-11-24T06:18:08.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.571+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50003ea0 con 0x7f7b58160b00 2023-11-24T06:18:08.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.571+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b580b6320 con 0x7f7b58160b00 2023-11-24T06:18:08.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.571+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b580b7060 con 0x7f7b58160b00 2023-11-24T06:18:08.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.572+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b5815ee40 con 0x7f7b58160b00 2023-11-24T06:18:08.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.573+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f7b5000aa90 con 0x7f7b58160b00 2023-11-24T06:18:08.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.574+0000 7f7b4effd640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b3806af60 0x7f7b3806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.574+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7b50089d30 con 0x7f7b58160b00 2023-11-24T06:18:08.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.574+0000 7f7b4effd640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f7b38070dc0 0x7f7b380731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.574+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 --> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b38073890 con 0x7f7b38070dc0 2023-11-24T06:18:08.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.574+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b5008a0a0 con 0x7f7b58160b00 2023-11-24T06:18:08.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.575+0000 7f7b5659c640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b3806af60 0x7f7b3806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.575+0000 7f7b4ffff640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f7b38070dc0 0x7f7b380731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.575+0000 7f7b5659c640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b3806af60 0x7f7b3806d420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b48036000 tx=0x7f7b4803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.576+0000 7f7b4ffff640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f7b38070dc0 0x7f7b380731e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.578+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== osd.4 v2:172.21.15.188:6824/146983005 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7b38073890 con 0x7f7b38070dc0 2023-11-24T06:18:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.593+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 --> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b5815e6c0 con 0x7f7b38070dc0 2023-11-24T06:18:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b4effd640 1 -- 172.21.15.37:0/2591088749 <== osd.4 v2:172.21.15.188:6824/146983005 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7b40009b40 con 0x7f7b38070dc0 2023-11-24T06:18:08.598 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:08.598 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:08.598 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f7b38070dc0 msgr2=0x7f7b380731e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b5759e640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.188:6824/146983005,v1:172.21.15.188:6825/146983005] conn(0x7f7b38070dc0 0x7f7b380731e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b3806af60 msgr2=0x7f7b3806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b5759e640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f7b3806af60 0x7f7b3806d420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b48036000 tx=0x7f7b4803b040 comp rx=0 tx=0).stop 2023-11-24T06:18:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b58160b00 msgr2=0x7f7b580b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b5759e640 1 --2- 172.21.15.37:0/2591088749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b58160b00 0x7f7b580b7520 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c7a0 tx=0x7f7b5000cc60 comp rx=0 tx=0).stop 2023-11-24T06:18:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.595+0000 7f7b56d9d640 1 -- 172.21.15.37:0/2591088749 reap_dead start 2023-11-24T06:18:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.596+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 shutdown_connections 2023-11-24T06:18:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.596+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 >> 172.21.15.37:0/2591088749 conn(0x7f7b5809c510 msgr2=0x7f7b5815c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.596+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 shutdown_connections 2023-11-24T06:18:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.596+0000 7f7b5759e640 1 -- 172.21.15.37:0/2591088749 wait complete. 2023-11-24T06:18:08.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T06:18:08.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.832+0000 7f9edd639640 1 Processor -- start 2023-11-24T06:18:08.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.833+0000 7f9edd639640 1 -- start start 2023-11-24T06:18:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.834+0000 7f9edd639640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 0x7f9ed80b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.834+0000 7f9edd639640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9ed80d1610 0x7f9ed80b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.834+0000 7f9edd639640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed80d1d80 con 0x7f9ed815d5c0 2023-11-24T06:18:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.834+0000 7f9edd639640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed80d2060 con 0x7f9ed80d1610 2023-11-24T06:18:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.834+0000 7f9edd639640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80d2340 con 0x7f9ed80d08b0 2023-11-24T06:18:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.834+0000 7f9ed7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ed815d5c0 0x7f9ed80d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40776/0 (socket says 172.21.15.37:40776) 2023-11-24T06:18:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.834+0000 7f9ed7fff640 1 -- 172.21.15.37:0/3290411534 learned_addr learned my addr 172.21.15.37:0/3290411534 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ecffff640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 0x7f9ed80b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9edce38640 1 --2- 172.21.15.37:0/3290411534 >> v2:172.21.15.188:3300/0 conn(0x7f9ed80d1610 0x7f9ed80b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798892553 0 0) 0x7f9ed80d1d80 con 0x7f9ed815d5c0 2023-11-24T06:18:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec4003520 con 0x7f9ed815d5c0 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 123235570 0 0) 0x7f9ec4003520 con 0x7f9ed815d5c0 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 msgr2=0x7f9ed80b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 0x7f9ed80b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 >> v2:172.21.15.188:3300/0 conn(0x7f9ed80d1610 msgr2=0x7f9ed80b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 --2- 172.21.15.37:0/3290411534 >> v2:172.21.15.188:3300/0 conn(0x7f9ed80d1610 0x7f9ed80b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80d2620 con 0x7f9ed815d5c0 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7f9ec8001670 con 0x7f9ed815d5c0 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 >> v1:172.21.15.37:6789/0 conn(0x7f9ed815d5c0 legacy=0x7f9ed80d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ec4003970 0x7f9ec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ec4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 0x7f9ec4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80d2060 con 0x7f9ec40047c0 2023-11-24T06:18:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80d2340 con 0x7f9ec4003970 2023-11-24T06:18:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.835+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400b9b0 con 0x7f9ed80d08b0 2023-11-24T06:18:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9ecffff640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ec4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9edce38640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 0x7f9ec4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9ecffff640 1 -- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 msgr2=0x7f9ec4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9ecffff640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 0x7f9ec4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9ecffff640 1 -- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ec4003970 msgr2=0x7f9ec4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9ecffff640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ec4003970 0x7f9ec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9ecffff640 1 -- 172.21.15.37:0/3290411534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4003520 con 0x7f9ec40047c0 2023-11-24T06:18:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.836+0000 7f9edce38640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed80d08b0 0x7f9ec4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.837+0000 7f9ecffff640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ec4004c40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009ac0 tx=0x7f9ec40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c655eee8ce1b64a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec002c6b0 con 0x7f9ec40047c0 2023-11-24T06:18:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec002c810 con 0x7f9ec40047c0 2023-11-24T06:18:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9ed77fe640 1 -- 172.21.15.37:0/3290411534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec002cba0 con 0x7f9ec40047c0 2023-11-24T06:18:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9edd639640 1 -- 172.21.15.37:0/3290411534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 msgr2=0x7f9ec4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9edd639640 1 --2- 172.21.15.37:0/3290411534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ec4004c40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009ac0 tx=0x7f9ec40057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9edce38640 1 -- 172.21.15.37:0/3290411534 reap_dead start 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9edd639640 1 -- 172.21.15.37:0/3290411534 shutdown_connections 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9edd639640 1 -- 172.21.15.37:0/3290411534 >> 172.21.15.37:0/3290411534 conn(0x7f9ed8061310 msgr2=0x7f9ed8061720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9edd639640 1 -- 172.21.15.37:0/3290411534 shutdown_connections 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.838+0000 7f9edd639640 1 -- 172.21.15.37:0/3290411534 wait complete. 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.840+0000 7f9edd639640 1 Processor -- start 2023-11-24T06:18:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.840+0000 7f9edd639640 1 -- start start 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.841+0000 7f9edd639640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ed80cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.841+0000 7f9edd639640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed814f500 0x7f9ed80cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.841+0000 7f9edd639640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed80cbf30 0x7f9ed80c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.841+0000 7f9edd639640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80cd0c0 con 0x7f9ec40047c0 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.841+0000 7f9edd639640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80cc4b0 con 0x7f9ed80cbf30 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.841+0000 7f9edd639640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80cc790 con 0x7f9ed814f500 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ed80cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ed80cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50074/0 (socket says 172.21.15.37:50074) 2023-11-24T06:18:08.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 -- 172.21.15.37:0/2127436867 learned_addr learned my addr 172.21.15.37:0/2127436867 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ecffff640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed814f500 0x7f9ed80cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 -- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed814f500 msgr2=0x7f9ed80cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed814f500 0x7f9ed80cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 -- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed80cbf30 msgr2=0x7f9ed80c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9edce38640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed80cbf30 0x7f9ed80c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed80cbf30 0x7f9ed80c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 -- 172.21.15.37:0/2127436867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80cca70 con 0x7f9ec40047c0 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ecffff640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed814f500 0x7f9ed80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.842+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ed80cd550 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c730 tx=0x7f9ec800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.843+0000 7f9ed57fa640 1 -- 172.21.15.37:0/2127436867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80074e0 con 0x7f9ec40047c0 2023-11-24T06:18:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.843+0000 7f9ed57fa640 1 -- 172.21.15.37:0/2127436867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec8007640 con 0x7f9ec40047c0 2023-11-24T06:18:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.843+0000 7f9ed57fa640 1 -- 172.21.15.37:0/2127436867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8004a00 con 0x7f9ec40047c0 2023-11-24T06:18:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.843+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed80ccd50 con 0x7f9ec40047c0 2023-11-24T06:18:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.843+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed814f980 con 0x7f9ec40047c0 2023-11-24T06:18:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.844+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed804e840 con 0x7f9ec40047c0 2023-11-24T06:18:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.845+0000 7f9ed57fa640 1 -- 172.21.15.37:0/2127436867 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f9ec8004b60 con 0x7f9ec40047c0 2023-11-24T06:18:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.846+0000 7f9ed57fa640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb806afb0 0x7f9eb806d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.846+0000 7f9ed57fa640 1 -- 172.21.15.37:0/2127436867 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9ec8088dc0 con 0x7f9ec40047c0 2023-11-24T06:18:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.846+0000 7f9ecffff640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb806afb0 0x7f9eb806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.847+0000 7f9ecffff640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb806afb0 0x7f9eb806d470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:08.850+0000 7f9ed57fa640 1 -- 172.21.15.37:0/2127436867 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ec8054040 con 0x7f9ec40047c0 2023-11-24T06:18:09.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.045+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ed80d1a60 con 0x7f9eb806afb0 2023-11-24T06:18:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.046+0000 7f9ed57fa640 1 -- 172.21.15.37:0/2127436867 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9ec0004140 con 0x7f9eb806afb0 2023-11-24T06:18:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T06:18:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.048+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb806afb0 msgr2=0x7f9eb806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.048+0000 7f9edd639640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb806afb0 0x7f9eb806d470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec0030000 comp rx=0 tx=0).stop 2023-11-24T06:18:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 msgr2=0x7f9ed80cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ed80cd550 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c730 tx=0x7f9ec800cbf0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 shutdown_connections 2023-11-24T06:18:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f9eb806afb0 0x7f9eb806d470 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed80cbf30 0x7f9ed80c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed814f500 0x7f9ed80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 --2- 172.21.15.37:0/2127436867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec40047c0 0x7f9ed80cd550 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 >> 172.21.15.37:0/2127436867 conn(0x7f9ed8061310 msgr2=0x7f9ed80b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:09.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 shutdown_connections 2023-11-24T06:18:09.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.049+0000 7f9edd639640 1 -- 172.21.15.37:0/2127436867 wait complete. 2023-11-24T06:18:09.068 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T06:18:09.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:09.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.296+0000 7f08ee883640 1 Processor -- start 2023-11-24T06:18:09.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.296+0000 7f08ee883640 1 -- start start 2023-11-24T06:18:09.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08ee883640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08e815c7f0 0x7f08e806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08ee883640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cf450 0x7f08e80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08ee883640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80cece0 con 0x7f08e80cdfb0 2023-11-24T06:18:09.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08ee883640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e8156010 con 0x7f08e815c7f0 2023-11-24T06:18:09.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08ee883640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e806ce30 con 0x7f08e80cf450 2023-11-24T06:18:09.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08e7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08e815c7f0 0x7f08e806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08ece20640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08e80cdfb0 0x7f08e80ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40792/0 (socket says 172.21.15.37:40792) 2023-11-24T06:18:09.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.298+0000 7f08ece20640 1 -- 172.21.15.37:0/4033844601 learned_addr learned my addr 172.21.15.37:0/4033844601 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:09.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.299+0000 7f08e7fff640 1 -- 172.21.15.37:0/4033844601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cf450 msgr2=0x7f08e80cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:09.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.299+0000 7f08dffff640 1 --2- 172.21.15.37:0/4033844601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cf450 0x7f08e80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.299+0000 7f08e77fe640 1 -- 172.21.15.37:0/4033844601 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158489752 0 0) 0x7f08e80cece0 con 0x7f08e80cdfb0 2023-11-24T06:18:09.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.299+0000 7f08e7fff640 1 --2- 172.21.15.37:0/4033844601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cf450 0x7f08e80cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.299+0000 7f08e7fff640 1 -- 172.21.15.37:0/4033844601 >> v1:172.21.15.37:6789/0 conn(0x7f08e80cdfb0 legacy=0x7f08e80ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.299+0000 7f08e7fff640 1 -- 172.21.15.37:0/4033844601 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e806d040 con 0x7f08e815c7f0 2023-11-24T06:18:09.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.299+0000 7f08dffff640 1 --2- 172.21.15.37:0/4033844601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cf450 0x7f08e80cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:09.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.300+0000 7f08e7fff640 1 --2- 172.21.15.37:0/4033844601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e806db20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f08d80097a0 tx=0x7f08d802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1839c5ef90fd203b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:09.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.300+0000 7f08e77fe640 1 -- 172.21.15.37:0/4033844601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d802d040 con 0x7f08e815c7f0 2023-11-24T06:18:09.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.300+0000 7f08e77fe640 1 -- 172.21.15.37:0/4033844601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8031810 con 0x7f08e815c7f0 2023-11-24T06:18:09.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.300+0000 7f08e77fe640 1 -- 172.21.15.37:0/4033844601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8031ba0 con 0x7f08e815c7f0 2023-11-24T06:18:09.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 -- 172.21.15.37:0/4033844601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 msgr2=0x7f08e806db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 --2- 172.21.15.37:0/4033844601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e806db20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f08d80097a0 tx=0x7f08d802b8b0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 -- 172.21.15.37:0/4033844601 shutdown_connections 2023-11-24T06:18:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 --2- 172.21.15.37:0/4033844601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cf450 0x7f08e80cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 --2- 172.21.15.37:0/4033844601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e806db20 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 -- 172.21.15.37:0/4033844601 >> 172.21.15.37:0/4033844601 conn(0x7f08e806a920 msgr2=0x7f08e806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 -- 172.21.15.37:0/4033844601 shutdown_connections 2023-11-24T06:18:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.301+0000 7f08ee883640 1 -- 172.21.15.37:0/4033844601 wait complete. 2023-11-24T06:18:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.303+0000 7f08ee883640 1 Processor -- start 2023-11-24T06:18:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.303+0000 7f08ee883640 1 -- start start 2023-11-24T06:18:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ee883640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cdfb0 0x7f08e814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ee883640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08e80cf450 0x7f08e8154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ee883640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e81545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ee883640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e81f4dd0 con 0x7f08e815c7f0 2023-11-24T06:18:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ee883640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e81f4150 con 0x7f08e80cf450 2023-11-24T06:18:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ee883640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e81f4430 con 0x7f08e80cdfb0 2023-11-24T06:18:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ece20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e81545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ece20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e81545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50096/0 (socket says 172.21.15.37:50096) 2023-11-24T06:18:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.304+0000 7f08ece20640 1 -- 172.21.15.37:0/191599397 learned_addr learned my addr 172.21.15.37:0/191599397 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08dffff640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08e80cf450 0x7f08e8154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08e7fff640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cdfb0 0x7f08e814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08ece20640 1 -- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cdfb0 msgr2=0x7f08e814caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08ece20640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cdfb0 0x7f08e814caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08ece20640 1 -- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08e80cf450 msgr2=0x7f08e8154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08ece20640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08e80cf450 0x7f08e8154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08ece20640 1 -- 172.21.15.37:0/191599397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009400 con 0x7f08e815c7f0 2023-11-24T06:18:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08e7fff640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08e80cdfb0 0x7f08e814caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08ece20640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e81545a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f08e0002230 tx=0x7f08e000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000ce30 con 0x7f08e815c7f0 2023-11-24T06:18:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e000a640 con 0x7f08e815c7f0 2023-11-24T06:18:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e81f4710 con 0x7f08e815c7f0 2023-11-24T06:18:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.305+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000a9f0 con 0x7f08e815c7f0 2023-11-24T06:18:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.306+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e80afdd0 con 0x7f08e815c7f0 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.306+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08e806e060 con 0x7f08e815c7f0 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.308+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f08e000ab50 con 0x7f08e815c7f0 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.308+0000 7f08e57fa640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08c806af60 0x7f08c806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.309+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08e0088c20 con 0x7f08e815c7f0 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.309+0000 7f08e57fa640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f08c8070dc0 0x7f08c80731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.309+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 --> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08c8073890 con 0x7f08c8070dc0 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.309+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e008d220 con 0x7f08e815c7f0 2023-11-24T06:18:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.309+0000 7f08e7fff640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08c806af60 0x7f08c806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.310+0000 7f08dffff640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f08c8070dc0 0x7f08c80731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.310+0000 7f08e7fff640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08c806af60 0x7f08c806d420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f08d8036000 tx=0x7f08d803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:09.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.310+0000 7f08dffff640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f08c8070dc0 0x7f08c80731e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:09.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.312+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== osd.5 v2:172.21.15.188:6800/3786933785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f08c8073890 con 0x7f08c8070dc0 2023-11-24T06:18:09.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.327+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 --> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f08e806d600 con 0x7f08c8070dc0 2023-11-24T06:18:09.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.328+0000 7f08e57fa640 1 -- 172.21.15.37:0/191599397 <== osd.5 v2:172.21.15.188:6800/3786933785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f08d000a660 con 0x7f08c8070dc0 2023-11-24T06:18:09.331 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:09.331 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:09.331 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.328+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f08c8070dc0 msgr2=0x7f08c80731e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.328+0000 7f08ee883640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.188:6800/3786933785,v1:172.21.15.188:6801/3786933785] conn(0x7f08c8070dc0 0x7f08c80731e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08c806af60 msgr2=0x7f08c806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f08c806af60 0x7f08c806d420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f08d8036000 tx=0x7f08d803c040 comp rx=0 tx=0).stop 2023-11-24T06:18:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 msgr2=0x7f08e81545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 --2- 172.21.15.37:0/191599397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e815c7f0 0x7f08e81545a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f08e0002230 tx=0x7f08e000cbe0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ece20640 1 -- 172.21.15.37:0/191599397 reap_dead start 2023-11-24T06:18:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 shutdown_connections 2023-11-24T06:18:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 >> 172.21.15.37:0/191599397 conn(0x7f08e806a920 msgr2=0x7f08e80ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 shutdown_connections 2023-11-24T06:18:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.329+0000 7f08ee883640 1 -- 172.21.15.37:0/191599397 wait complete. 2023-11-24T06:18:09.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T06:18:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.571+0000 7f44bb44b640 1 Processor -- start 2023-11-24T06:18:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.572+0000 7f44bb44b640 1 -- start start 2023-11-24T06:18:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.573+0000 7f44bb44b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44b40cf480 0x7f44b415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.573+0000 7f44bb44b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f44b415d7b0 0x7f44b40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.573+0000 7f44bb44b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b40b2850 con 0x7f44b40b2400 2023-11-24T06:18:09.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.573+0000 7f44bb44b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b415a700 con 0x7f44b40cf480 2023-11-24T06:18:09.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.573+0000 7f44bb44b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b413d140 con 0x7f44b415d7b0 2023-11-24T06:18:09.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44ba449640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44b40cf480 0x7f44b415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44ba449640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44b40cf480 0x7f44b415a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50108/0 (socket says 172.21.15.37:50108) 2023-11-24T06:18:09.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44ba449640 1 -- 172.21.15.37:0/3244898577 learned_addr learned my addr 172.21.15.37:0/3244898577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:09.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44b9c48640 1 --2- 172.21.15.37:0/3244898577 >> v2:172.21.15.188:3300/0 conn(0x7f44b415d7b0 0x7f44b40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44ba449640 1 -- 172.21.15.37:0/3244898577 >> v2:172.21.15.188:3300/0 conn(0x7f44b415d7b0 msgr2=0x7f44b40b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:09.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44ba449640 1 --2- 172.21.15.37:0/3244898577 >> v2:172.21.15.188:3300/0 conn(0x7f44b415d7b0 0x7f44b40b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44ba449640 1 -- 172.21.15.37:0/3244898577 >> v1:172.21.15.188:6789/0 conn(0x7f44b40b2400 legacy=0x7f44b413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:09.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.574+0000 7f44ba449640 1 -- 172.21.15.37:0/3244898577 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b415b190 con 0x7f44b40cf480 2023-11-24T06:18:09.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.575+0000 7f44ba449640 1 --2- 172.21.15.37:0/3244898577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40cf480 0x7f44b415a1c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f44b406b2a0 tx=0x7f44b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363633dfe83759a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:09.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.576+0000 7f44b9447640 1 -- 172.21.15.37:0/3244898577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0031870 con 0x7f44b40cf480 2023-11-24T06:18:09.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.576+0000 7f44b9447640 1 -- 172.21.15.37:0/3244898577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b00319d0 con 0x7f44b40cf480 2023-11-24T06:18:09.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.576+0000 7f44b9447640 1 -- 172.21.15.37:0/3244898577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0031d60 con 0x7f44b40cf480 2023-11-24T06:18:09.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.576+0000 7f44bb44b640 1 -- 172.21.15.37:0/3244898577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40cf480 msgr2=0x7f44b415a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.576+0000 7f44bb44b640 1 --2- 172.21.15.37:0/3244898577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40cf480 0x7f44b415a1c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f44b406b2a0 tx=0x7f44b002b910 comp rx=0 tx=0).stop 2023-11-24T06:18:09.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.577+0000 7f44bb44b640 1 -- 172.21.15.37:0/3244898577 shutdown_connections 2023-11-24T06:18:09.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.577+0000 7f44bb44b640 1 --2- 172.21.15.37:0/3244898577 >> v2:172.21.15.188:3300/0 conn(0x7f44b415d7b0 0x7f44b40b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.577+0000 7f44bb44b640 1 --2- 172.21.15.37:0/3244898577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40cf480 0x7f44b415a1c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.577+0000 7f44bb44b640 1 -- 172.21.15.37:0/3244898577 >> 172.21.15.37:0/3244898577 conn(0x7f44b406a500 msgr2=0x7f44b406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:09.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.577+0000 7f44bb44b640 1 -- 172.21.15.37:0/3244898577 shutdown_connections 2023-11-24T06:18:09.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.577+0000 7f44bb44b640 1 -- 172.21.15.37:0/3244898577 wait complete. 2023-11-24T06:18:09.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.578+0000 7f44bb44b640 1 Processor -- start 2023-11-24T06:18:09.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.579+0000 7f44bb44b640 1 -- start start 2023-11-24T06:18:09.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bb44b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44b40b2400 0x7f44b40ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bb44b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44b40cf480 0x7f44b41e35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bb44b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b415d7b0 0x7f44b4144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bb44b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41e4c50 con 0x7f44b415d7b0 2023-11-24T06:18:09.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bb44b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41e5070 con 0x7f44b40b2400 2023-11-24T06:18:09.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bb44b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41e3fd0 con 0x7f44b40cf480 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bac4a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b415d7b0 0x7f44b4144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bac4a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b415d7b0 0x7f44b4144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50124/0 (socket says 172.21.15.37:50124) 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44bac4a640 1 -- 172.21.15.37:0/1385903844 learned_addr learned my addr 172.21.15.37:0/1385903844 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44ba449640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44b40b2400 0x7f44b40ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.580+0000 7f44b9c48640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44b40cf480 0x7f44b41e35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bac4a640 1 -- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44b40cf480 msgr2=0x7f44b41e35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bac4a640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44b40cf480 0x7f44b41e35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bac4a640 1 -- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44b40b2400 msgr2=0x7f44b40ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bac4a640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44b40b2400 0x7f44b40ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bac4a640 1 -- 172.21.15.37:0/1385903844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00094d0 con 0x7f44b415d7b0 2023-11-24T06:18:09.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bac4a640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b415d7b0 0x7f44b4144480 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c780 tx=0x7f44ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:09.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44aaffd640 1 -- 172.21.15.37:0/1385903844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac004b60 con 0x7f44b415d7b0 2023-11-24T06:18:09.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44aaffd640 1 -- 172.21.15.37:0/1385903844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac00ce90 con 0x7f44b415d7b0 2023-11-24T06:18:09.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44aaffd640 1 -- 172.21.15.37:0/1385903844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00a850 con 0x7f44b415d7b0 2023-11-24T06:18:09.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b41e42b0 con 0x7f44b415d7b0 2023-11-24T06:18:09.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.581+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b41e4870 con 0x7f44b415d7b0 2023-11-24T06:18:09.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.583+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b415abb0 con 0x7f44b415d7b0 2023-11-24T06:18:09.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.583+0000 7f44aaffd640 1 -- 172.21.15.37:0/1385903844 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f44ac00a9b0 con 0x7f44b415d7b0 2023-11-24T06:18:09.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.585+0000 7f44aaffd640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f449806af90 0x7f449806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:09.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.585+0000 7f44aaffd640 1 -- 172.21.15.37:0/1385903844 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f44ac0895e0 con 0x7f44b415d7b0 2023-11-24T06:18:09.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.585+0000 7f44ba449640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f449806af90 0x7f449806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:09.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.586+0000 7f44ba449640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f449806af90 0x7f449806d450 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f44b0036000 tx=0x7f44b003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:09.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.589+0000 7f44aaffd640 1 -- 172.21.15.37:0/1385903844 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44b415abb0 con 0x7f44b415d7b0 2023-11-24T06:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.789+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f44b415aeb0 con 0x7f449806af90 2023-11-24T06:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.790+0000 7f44aaffd640 1 -- 172.21.15.37:0/1385903844 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f44b0031bc0 con 0x7f449806af90 2023-11-24T06:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T06:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f449806af90 msgr2=0x7f449806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f449806af90 0x7f449806d450 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f44b0036000 tx=0x7f44b003c040 comp rx=0 tx=0).stop 2023-11-24T06:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b415d7b0 msgr2=0x7f44b4144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b415d7b0 0x7f44b4144480 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c780 tx=0x7f44ac00cc40 comp rx=0 tx=0).stop 2023-11-24T06:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 shutdown_connections 2023-11-24T06:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f449806af90 0x7f449806d450 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b415d7b0 0x7f44b4144480 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44b40cf480 0x7f44b41e35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 --2- 172.21.15.37:0/1385903844 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44b40b2400 0x7f44b40ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 >> 172.21.15.37:0/1385903844 conn(0x7f44b406a500 msgr2=0x7f44b40b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 shutdown_connections 2023-11-24T06:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:09.793+0000 7f44bb44b640 1 -- 172.21.15.37:0/1385903844 wait complete. 2023-11-24T06:18:09.813 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T06:18:09.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.047+0000 7f362f4d3640 1 Processor -- start 2023-11-24T06:18:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.047+0000 7f362f4d3640 1 -- start start 2023-11-24T06:18:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.049+0000 7f362f4d3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f36280ac840 0x7f36280ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.049+0000 7f362f4d3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36280ae650 0x7f36280aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.049+0000 7f362f4d3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280aefe0 con 0x7f362815d4f0 2023-11-24T06:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.049+0000 7f362f4d3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280b4ef0 con 0x7f36280ae650 2023-11-24T06:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.049+0000 7f362f4d3640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280b4040 con 0x7f36280ac840 2023-11-24T06:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.050+0000 7f362da70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36280ae650 0x7f36280aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.050+0000 7f362da70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36280ae650 0x7f36280aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50134/0 (socket says 172.21.15.37:50134) 2023-11-24T06:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.050+0000 7f362da70640 1 -- 172.21.15.37:0/1025604690 learned_addr learned my addr 172.21.15.37:0/1025604690 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.050+0000 7f362da70640 1 -- 172.21.15.37:0/1025604690 >> v2:172.21.15.188:3300/0 conn(0x7f36280ac840 msgr2=0x7f36280ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.050+0000 7f362da70640 1 --2- 172.21.15.37:0/1025604690 >> v2:172.21.15.188:3300/0 conn(0x7f36280ac840 0x7f36280ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.050+0000 7f362da70640 1 -- 172.21.15.37:0/1025604690 >> v1:172.21.15.188:6789/0 conn(0x7f362815d4f0 legacy=0x7f36280b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.050+0000 7f362da70640 1 -- 172.21.15.37:0/1025604690 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362815d8d0 con 0x7f36280ae650 2023-11-24T06:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.051+0000 7f362da70640 1 --2- 172.21.15.37:0/1025604690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36280ae650 0x7f36280aeaa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3628074290 tx=0x7f362002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4fa62a650f1eb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.052+0000 7f361ffff640 1 -- 172.21.15.37:0/1025604690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362002ca80 con 0x7f36280ae650 2023-11-24T06:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.052+0000 7f361ffff640 1 -- 172.21.15.37:0/1025604690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362002cbe0 con 0x7f36280ae650 2023-11-24T06:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.052+0000 7f361ffff640 1 -- 172.21.15.37:0/1025604690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200343f0 con 0x7f36280ae650 2023-11-24T06:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.052+0000 7f362f4d3640 1 -- 172.21.15.37:0/1025604690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36280ae650 msgr2=0x7f36280aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.052+0000 7f362f4d3640 1 --2- 172.21.15.37:0/1025604690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36280ae650 0x7f36280aeaa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3628074290 tx=0x7f362002bee0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.053+0000 7f362f4d3640 1 -- 172.21.15.37:0/1025604690 shutdown_connections 2023-11-24T06:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.053+0000 7f362f4d3640 1 --2- 172.21.15.37:0/1025604690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36280ae650 0x7f36280aeaa0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.053+0000 7f362f4d3640 1 --2- 172.21.15.37:0/1025604690 >> v2:172.21.15.188:3300/0 conn(0x7f36280ac840 0x7f36280ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.053+0000 7f362f4d3640 1 -- 172.21.15.37:0/1025604690 >> 172.21.15.37:0/1025604690 conn(0x7f3628071d40 msgr2=0x7f362806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.053+0000 7f362f4d3640 1 -- 172.21.15.37:0/1025604690 shutdown_connections 2023-11-24T06:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.053+0000 7f362f4d3640 1 -- 172.21.15.37:0/1025604690 wait complete. 2023-11-24T06:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.055+0000 7f362f4d3640 1 Processor -- start 2023-11-24T06:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.055+0000 7f362f4d3640 1 -- start start 2023-11-24T06:18:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362f4d3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36280ac840 0x7f362813d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362f4d3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36280ae650 0x7f3628140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362f4d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362815d4f0 0x7f362815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362f4d3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362813de70 con 0x7f362815d4f0 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362f4d3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362813e140 con 0x7f36280ac840 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362f4d3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3628140a20 con 0x7f36280ae650 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362da70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362815d4f0 0x7f362815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362da70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362815d4f0 0x7f362815eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50136/0 (socket says 172.21.15.37:50136) 2023-11-24T06:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362da70640 1 -- 172.21.15.37:0/3647619616 learned_addr learned my addr 172.21.15.37:0/3647619616 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.056+0000 7f362d26f640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36280ac840 0x7f362813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362ca6e640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36280ae650 0x7f3628140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362da70640 1 -- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36280ae650 msgr2=0x7f3628140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362da70640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36280ae650 0x7f3628140190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362da70640 1 -- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36280ac840 msgr2=0x7f362813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362da70640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36280ac840 0x7f362813d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362da70640 1 -- 172.21.15.37:0/3647619616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009b30 con 0x7f362815d4f0 2023-11-24T06:18:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362da70640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362815d4f0 0x7f362815eb10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3620036040 tx=0x7f3620004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362003e450 con 0x7f362815d4f0 2023-11-24T06:18:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362003e5d0 con 0x7f362815d4f0 2023-11-24T06:18:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362003e980 con 0x7f362815d4f0 2023-11-24T06:18:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.057+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3628140d00 con 0x7f362815d4f0 2023-11-24T06:18:10.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.058+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362813e3e0 con 0x7f362815d4f0 2023-11-24T06:18:10.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.058+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36280aec80 con 0x7f362815d4f0 2023-11-24T06:18:10.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.060+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f362002cd50 con 0x7f362815d4f0 2023-11-24T06:18:10.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.061+0000 7f361dffb640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f360c06af60 0x7f360c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.061+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f36200abfe0 con 0x7f362815d4f0 2023-11-24T06:18:10.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.061+0000 7f362d26f640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f360c06af60 0x7f360c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.061+0000 7f361dffb640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7f360c070dc0 0x7f360c0731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.061+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 --> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f360c073890 con 0x7f360c070dc0 2023-11-24T06:18:10.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.061+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36200b1590 con 0x7f362815d4f0 2023-11-24T06:18:10.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.062+0000 7f362d26f640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f360c06af60 0x7f360c06d420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3624007fd0 tx=0x7f3624009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.062+0000 7f362ca6e640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7f360c070dc0 0x7f360c0731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.063+0000 7f362ca6e640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7f360c070dc0 0x7f360c0731e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.065+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== osd.6 v2:172.21.15.188:6811/2333602039 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f360c073890 con 0x7f360c070dc0 2023-11-24T06:18:10.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.080+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 --> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f36280b48a0 con 0x7f360c070dc0 2023-11-24T06:18:10.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.081+0000 7f361dffb640 1 -- 172.21.15.37:0/3647619616 <== osd.6 v2:172.21.15.188:6811/2333602039 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f361800b940 con 0x7f360c070dc0 2023-11-24T06:18:10.084 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:10.084 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:10.084 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.081+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7f360c070dc0 msgr2=0x7f360c0731e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.081+0000 7f362f4d3640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.188:6811/2333602039,v1:172.21.15.188:6813/2333602039] conn(0x7f360c070dc0 0x7f360c0731e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f360c06af60 msgr2=0x7f360c06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f360c06af60 0x7f360c06d420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3624007fd0 tx=0x7f3624009040 comp rx=0 tx=0).stop 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362815d4f0 msgr2=0x7f362815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 --2- 172.21.15.37:0/3647619616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362815d4f0 0x7f362815eb10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3620036040 tx=0x7f3620004a40 comp rx=0 tx=0).stop 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362da70640 1 -- 172.21.15.37:0/3647619616 reap_dead start 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 shutdown_connections 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 >> 172.21.15.37:0/3647619616 conn(0x7f3628071d40 msgr2=0x7f3628157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 shutdown_connections 2023-11-24T06:18:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.082+0000 7f362f4d3640 1 -- 172.21.15.37:0/3647619616 wait complete. 2023-11-24T06:18:10.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T06:18:10.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:18:10.157 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:18:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.310+0000 7fdf97153640 1 Processor -- start 2023-11-24T06:18:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.310+0000 7fdf97153640 1 -- start start 2023-11-24T06:18:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.312+0000 7fdf97153640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf900ac840 0x7fdf900b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.312+0000 7fdf97153640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf901610f0 0x7fdf900b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.312+0000 7fdf97153640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900b4170 con 0x7fdf9015d3f0 2023-11-24T06:18:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.312+0000 7fdf97153640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900b4450 con 0x7fdf900ac840 2023-11-24T06:18:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.312+0000 7fdf97153640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900b4730 con 0x7fdf901610f0 2023-11-24T06:18:10.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.312+0000 7fdf94eef640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdf9015d3f0 0x7fdf9006d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40796/0 (socket says 172.21.15.37:40796) 2023-11-24T06:18:10.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf94eef640 1 -- 172.21.15.37:0/2382864057 learned_addr learned my addr 172.21.15.37:0/2382864057 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:10.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf87fff640 1 --2- 172.21.15.37:0/2382864057 >> v2:172.21.15.37:3300/0 conn(0x7fdf900ac840 0x7fdf900b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf956f0640 1 --2- 172.21.15.37:0/2382864057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf901610f0 0x7fdf900b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf877fe640 1 -- 172.21.15.37:0/2382864057 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635285933 0 0) 0x7fdf900b4170 con 0x7fdf9015d3f0 2023-11-24T06:18:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf877fe640 1 -- 172.21.15.37:0/2382864057 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf78003520 con 0x7fdf9015d3f0 2023-11-24T06:18:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf87fff640 1 -- 172.21.15.37:0/2382864057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf901610f0 msgr2=0x7fdf900b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf87fff640 1 --2- 172.21.15.37:0/2382864057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf901610f0 0x7fdf900b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf87fff640 1 -- 172.21.15.37:0/2382864057 >> v1:172.21.15.37:6789/0 conn(0x7fdf9015d3f0 legacy=0x7fdf9006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.313+0000 7fdf87fff640 1 -- 172.21.15.37:0/2382864057 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900b4a10 con 0x7fdf900ac840 2023-11-24T06:18:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.314+0000 7fdf87fff640 1 --2- 172.21.15.37:0/2382864057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf900ac840 0x7fdf900b5210 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097a0 tx=0x7fdf8002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cdd6a00a55af6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf877fe640 1 -- 172.21.15.37:0/2382864057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8002d040 con 0x7fdf900ac840 2023-11-24T06:18:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf877fe640 1 -- 172.21.15.37:0/2382864057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80031810 con 0x7fdf900ac840 2023-11-24T06:18:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf877fe640 1 -- 172.21.15.37:0/2382864057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80031ba0 con 0x7fdf900ac840 2023-11-24T06:18:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf97153640 1 -- 172.21.15.37:0/2382864057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf900ac840 msgr2=0x7fdf900b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf97153640 1 --2- 172.21.15.37:0/2382864057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf900ac840 0x7fdf900b5210 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097a0 tx=0x7fdf8002b8b0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf97153640 1 -- 172.21.15.37:0/2382864057 shutdown_connections 2023-11-24T06:18:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf97153640 1 --2- 172.21.15.37:0/2382864057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf901610f0 0x7fdf900b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf97153640 1 --2- 172.21.15.37:0/2382864057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf900ac840 0x7fdf900b5210 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.315+0000 7fdf97153640 1 -- 172.21.15.37:0/2382864057 >> 172.21.15.37:0/2382864057 conn(0x7fdf90071d40 msgr2=0x7fdf9006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.316+0000 7fdf97153640 1 -- 172.21.15.37:0/2382864057 shutdown_connections 2023-11-24T06:18:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.316+0000 7fdf97153640 1 -- 172.21.15.37:0/2382864057 wait complete. 2023-11-24T06:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.317+0000 7fdf97153640 1 Processor -- start 2023-11-24T06:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.317+0000 7fdf97153640 1 -- start start 2023-11-24T06:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.318+0000 7fdf97153640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf900ac840 0x7fdf9014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.318+0000 7fdf97153640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9015d3f0 0x7fdf9015e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.318+0000 7fdf97153640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf901610f0 0x7fdf9015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.318+0000 7fdf97153640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900ceac0 con 0x7fdf9015d3f0 2023-11-24T06:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.318+0000 7fdf97153640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900ceda0 con 0x7fdf901610f0 2023-11-24T06:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.318+0000 7fdf97153640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf90155060 con 0x7fdf900ac840 2023-11-24T06:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9015d3f0 0x7fdf9015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9015d3f0 0x7fdf9015e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50160/0 (socket says 172.21.15.37:50160) 2023-11-24T06:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 -- 172.21.15.37:0/4204718246 learned_addr learned my addr 172.21.15.37:0/4204718246 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf956f0640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf901610f0 0x7fdf9015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf94eef640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf900ac840 0x7fdf9014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 -- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf900ac840 msgr2=0x7fdf9014f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf900ac840 0x7fdf9014f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 -- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf901610f0 msgr2=0x7fdf9015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf901610f0 0x7fdf9015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf87fff640 1 -- 172.21.15.37:0/4204718246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009400 con 0x7fdf9015d3f0 2023-11-24T06:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.319+0000 7fdf956f0640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf901610f0 0x7fdf9015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.320+0000 7fdf87fff640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9015d3f0 0x7fdf9015e190 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098c0 tx=0x7fdf800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.320+0000 7fdf857fa640 1 -- 172.21.15.37:0/4204718246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80006e10 con 0x7fdf9015d3f0 2023-11-24T06:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.320+0000 7fdf857fa640 1 -- 172.21.15.37:0/4204718246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8003ad60 con 0x7fdf9015d3f0 2023-11-24T06:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.320+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9006d8d0 con 0x7fdf9015d3f0 2023-11-24T06:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.320+0000 7fdf857fa640 1 -- 172.21.15.37:0/4204718246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80044620 con 0x7fdf9015d3f0 2023-11-24T06:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.320+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf90155620 con 0x7fdf9015d3f0 2023-11-24T06:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.321+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf90067470 con 0x7fdf9015d3f0 2023-11-24T06:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.322+0000 7fdf857fa640 1 -- 172.21.15.37:0/4204718246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fdf8004d440 con 0x7fdf9015d3f0 2023-11-24T06:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.323+0000 7fdf857fa640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf7c06af60 0x7fdf7c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.323+0000 7fdf857fa640 1 -- 172.21.15.37:0/4204718246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdf800ab9e0 con 0x7fdf9015d3f0 2023-11-24T06:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.324+0000 7fdf94eef640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf7c06af60 0x7fdf7c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.324+0000 7fdf94eef640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf7c06af60 0x7fdf7c06d420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c001560 tx=0x7fdf8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.328+0000 7fdf857fa640 1 -- 172.21.15.37:0/4204718246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf80076ad0 con 0x7fdf9015d3f0 2023-11-24T06:18:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.522+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf900b5d30 con 0x7fdf7c06af60 2023-11-24T06:18:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.523+0000 7fdf857fa640 1 -- 172.21.15.37:0/4204718246 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdf900b5d30 con 0x7fdf7c06af60 2023-11-24T06:18:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T06:18:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf7c06af60 msgr2=0x7fdf7c06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf7c06af60 0x7fdf7c06d420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c001560 tx=0x7fdf8c009040 comp rx=0 tx=0).stop 2023-11-24T06:18:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9015d3f0 msgr2=0x7fdf9015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9015d3f0 0x7fdf9015e190 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098c0 tx=0x7fdf800046c0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 shutdown_connections 2023-11-24T06:18:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fdf7c06af60 0x7fdf7c06d420 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf901610f0 0x7fdf9015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf9015d3f0 0x7fdf9015e190 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 --2- 172.21.15.37:0/4204718246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf900ac840 0x7fdf9014f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 >> 172.21.15.37:0/4204718246 conn(0x7fdf90071d40 msgr2=0x7fdf900ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.525+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 shutdown_connections 2023-11-24T06:18:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.526+0000 7fdf97153640 1 -- 172.21.15.37:0/4204718246 wait complete. 2023-11-24T06:18:10.547 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T06:18:10.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:18:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.826+0000 7f0875a50640 1 Processor -- start 2023-11-24T06:18:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.826+0000 7f0875a50640 1 -- start start 2023-11-24T06:18:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.828+0000 7f0875a50640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f08700b11f0 0x7f087006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.828+0000 7f0875a50640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f087015edd0 0x7f08700b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.828+0000 7f0875a50640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08701448f0 con 0x7f0870144510 2023-11-24T06:18:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.828+0000 7f0875a50640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0870144d80 con 0x7f08700b11f0 2023-11-24T06:18:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.828+0000 7f0875a50640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087015f2d0 con 0x7f087015edd0 2023-11-24T06:18:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.829+0000 7f087524f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f087015edd0 0x7f08700b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.829+0000 7f087524f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f087015edd0 0x7f08700b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.37:55394/0 (socket says 172.21.15.37:55394) 2023-11-24T06:18:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.829+0000 7f087524f640 1 -- 172.21.15.37:0/4258231631 learned_addr learned my addr 172.21.15.37:0/4258231631 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.829+0000 7f086ffff640 1 --2- 172.21.15.37:0/4258231631 >> v2:172.21.15.188:3300/0 conn(0x7f08700b11f0 0x7f087006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.830+0000 7f087524f640 1 -- 172.21.15.37:0/4258231631 >> v2:172.21.15.188:3300/0 conn(0x7f08700b11f0 msgr2=0x7f087006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.830+0000 7f087524f640 1 --2- 172.21.15.37:0/4258231631 >> v2:172.21.15.188:3300/0 conn(0x7f08700b11f0 0x7f087006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.830+0000 7f087524f640 1 -- 172.21.15.37:0/4258231631 >> v1:172.21.15.188:6789/0 conn(0x7f0870144510 legacy=0x7f08700b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.830+0000 7f087524f640 1 -- 172.21.15.37:0/4258231631 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087015f5b0 con 0x7f087015edd0 2023-11-24T06:18:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.830+0000 7f086ffff640 1 --2- 172.21.15.37:0/4258231631 >> v2:172.21.15.188:3300/0 conn(0x7f08700b11f0 0x7f087006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:18:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.831+0000 7f087524f640 1 --2- 172.21.15.37:0/4258231631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f087015edd0 0x7f08700b4180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0868009e50 tx=0x7f086802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba2c29e1ea358d7c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.832+0000 7f086f7fe640 1 -- 172.21.15.37:0/4258231631 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086802ca80 con 0x7f087015edd0 2023-11-24T06:18:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.832+0000 7f086f7fe640 1 -- 172.21.15.37:0/4258231631 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086802cbe0 con 0x7f087015edd0 2023-11-24T06:18:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.832+0000 7f086f7fe640 1 -- 172.21.15.37:0/4258231631 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08680343f0 con 0x7f087015edd0 2023-11-24T06:18:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.832+0000 7f0875a50640 1 -- 172.21.15.37:0/4258231631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f087015edd0 msgr2=0x7f08700b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.832+0000 7f0875a50640 1 --2- 172.21.15.37:0/4258231631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f087015edd0 0x7f08700b4180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0868009e50 tx=0x7f086802bee0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.833+0000 7f0875a50640 1 -- 172.21.15.37:0/4258231631 shutdown_connections 2023-11-24T06:18:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.833+0000 7f0875a50640 1 --2- 172.21.15.37:0/4258231631 >> v2:172.21.15.188:3300/0 conn(0x7f08700b11f0 0x7f087006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.833+0000 7f0875a50640 1 --2- 172.21.15.37:0/4258231631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f087015edd0 0x7f08700b4180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.833+0000 7f0875a50640 1 -- 172.21.15.37:0/4258231631 >> 172.21.15.37:0/4258231631 conn(0x7f08700cb8a0 msgr2=0x7f08700cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.833+0000 7f0875a50640 1 -- 172.21.15.37:0/4258231631 shutdown_connections 2023-11-24T06:18:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.833+0000 7f0875a50640 1 -- 172.21.15.37:0/4258231631 wait complete. 2023-11-24T06:18:10.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.835+0000 7f0875a50640 1 Processor -- start 2023-11-24T06:18:10.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.835+0000 7f0875a50640 1 -- start start 2023-11-24T06:18:10.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f0875a50640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08700b11f0 0x7f087013a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f0875a50640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0870144510 0x7f087015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f0875a50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087015edd0 0x7f08701f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f0875a50640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087013e580 con 0x7f087015edd0 2023-11-24T06:18:10.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f0875a50640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087013bc70 con 0x7f08700b11f0 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f0875a50640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087013b0a0 con 0x7f0870144510 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f087524f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087015edd0 0x7f08701f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f087524f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087015edd0 0x7f08701f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48706/0 (socket says 172.21.15.37:48706) 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f087524f640 1 -- 172.21.15.37:0/1685151381 learned_addr learned my addr 172.21.15.37:0/1685151381 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f0874a4e640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08700b11f0 0x7f087013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.836+0000 7f086ffff640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0870144510 0x7f087015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f087524f640 1 -- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0870144510 msgr2=0x7f087015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f087524f640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0870144510 0x7f087015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f087524f640 1 -- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08700b11f0 msgr2=0x7f087013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f087524f640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08700b11f0 0x7f087013a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f087524f640 1 -- 172.21.15.37:0/1685151381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0093a0 con 0x7f087015edd0 2023-11-24T06:18:10.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f087524f640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087015edd0 0x7f08701f6320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0868009e50 tx=0x7f0868004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868009510 con 0x7f087015edd0 2023-11-24T06:18:10.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086803e450 con 0x7f087015edd0 2023-11-24T06:18:10.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.837+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086803e800 con 0x7f087015edd0 2023-11-24T06:18:10.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.838+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0868009b30 con 0x7f087015edd0 2023-11-24T06:18:10.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.838+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087013b900 con 0x7f087015edd0 2023-11-24T06:18:10.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.839+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08700b3c30 con 0x7f087015edd0 2023-11-24T06:18:10.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.840+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f086802cd50 con 0x7f087015edd0 2023-11-24T06:18:10.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.841+0000 7f086d7fa640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f085406af60 0x7f085406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.841+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08680abf40 con 0x7f087015edd0 2023-11-24T06:18:10.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.841+0000 7f086d7fa640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f0854070dc0 0x7f08540731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:10.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.841+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 --> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0854073890 con 0x7f0854070dc0 2023-11-24T06:18:10.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.841+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08680ae600 con 0x7f087015edd0 2023-11-24T06:18:10.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.841+0000 7f0874a4e640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f085406af60 0x7f085406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.842+0000 7f0874a4e640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f085406af60 0x7f085406d420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0864000f60 tx=0x7f0864009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.842+0000 7f086ffff640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f0854070dc0 0x7f08540731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:10.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.843+0000 7f086ffff640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f0854070dc0 0x7f08540731e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:10.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.845+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== osd.7 v2:172.21.15.188:6808/89402988 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0854073890 con 0x7f0854070dc0 2023-11-24T06:18:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.861+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 --> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f087015fb70 con 0x7f0854070dc0 2023-11-24T06:18:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f086d7fa640 1 -- 172.21.15.37:0/1685151381 <== osd.7 v2:172.21.15.188:6808/89402988 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f085c0098a0 con 0x7f0854070dc0 2023-11-24T06:18:10.865 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-11-24T06:18:10.866 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:18:10.866 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-11-24T06:18:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f0854070dc0 msgr2=0x7f08540731e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.188:6808/89402988,v1:172.21.15.188:6809/89402988] conn(0x7f0854070dc0 0x7f08540731e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f085406af60 msgr2=0x7f085406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f085406af60 0x7f085406d420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0864000f60 tx=0x7f0864009040 comp rx=0 tx=0).stop 2023-11-24T06:18:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087015edd0 msgr2=0x7f08701f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 --2- 172.21.15.37:0/1685151381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087015edd0 0x7f08701f6320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0868009e50 tx=0x7f0868004a40 comp rx=0 tx=0).stop 2023-11-24T06:18:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f087524f640 1 -- 172.21.15.37:0/1685151381 reap_dead start 2023-11-24T06:18:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 shutdown_connections 2023-11-24T06:18:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.863+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 >> 172.21.15.37:0/1685151381 conn(0x7f08700cb8a0 msgr2=0x7f08700ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.864+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 shutdown_connections 2023-11-24T06:18:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:10.864+0000 7f0875a50640 1 -- 172.21.15.37:0/1685151381 wait complete. 2023-11-24T06:18:10.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T06:18:11.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.101+0000 7fbde9528640 1 Processor -- start 2023-11-24T06:18:11.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.102+0000 7fbde9528640 1 -- start start 2023-11-24T06:18:11.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.103+0000 7fbde9528640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbde415d5c0 0x7fbde40b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.103+0000 7fbde9528640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbde40d08b0 0x7fbde40b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.103+0000 7fbde9528640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde40d1d80 con 0x7fbde40d1610 2023-11-24T06:18:11.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.103+0000 7fbde9528640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde40d2060 con 0x7fbde415d5c0 2023-11-24T06:18:11.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.103+0000 7fbde9528640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde40d2340 con 0x7fbde40d08b0 2023-11-24T06:18:11.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.104+0000 7fbde3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbde415d5c0 0x7fbde40b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.104+0000 7fbde3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbde415d5c0 0x7fbde40b8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48720/0 (socket says 172.21.15.37:48720) 2023-11-24T06:18:11.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.104+0000 7fbde3fff640 1 -- 172.21.15.37:0/160728271 learned_addr learned my addr 172.21.15.37:0/160728271 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:11.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.104+0000 7fbde3fff640 1 -- 172.21.15.37:0/160728271 >> v2:172.21.15.188:3300/0 conn(0x7fbde40d08b0 msgr2=0x7fbde40b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:11.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.104+0000 7fbde3fff640 1 --2- 172.21.15.37:0/160728271 >> v2:172.21.15.188:3300/0 conn(0x7fbde40d08b0 0x7fbde40b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.104+0000 7fbde3fff640 1 -- 172.21.15.37:0/160728271 >> v1:172.21.15.188:6789/0 conn(0x7fbde40d1610 legacy=0x7fbde40d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:11.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.104+0000 7fbde3fff640 1 -- 172.21.15.37:0/160728271 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde40d2620 con 0x7fbde415d5c0 2023-11-24T06:18:11.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.105+0000 7fbde3fff640 1 --2- 172.21.15.37:0/160728271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40b8dd0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbde40cfba0 tx=0x7fbdd402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4de98217071d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:11.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde37fe640 1 -- 172.21.15.37:0/160728271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40317e0 con 0x7fbde415d5c0 2023-11-24T06:18:11.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde37fe640 1 -- 172.21.15.37:0/160728271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd4031940 con 0x7fbde415d5c0 2023-11-24T06:18:11.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde37fe640 1 -- 172.21.15.37:0/160728271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4031cd0 con 0x7fbde415d5c0 2023-11-24T06:18:11.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 -- 172.21.15.37:0/160728271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 msgr2=0x7fbde40b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 --2- 172.21.15.37:0/160728271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40b8dd0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbde40cfba0 tx=0x7fbdd402b880 comp rx=0 tx=0).stop 2023-11-24T06:18:11.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 -- 172.21.15.37:0/160728271 shutdown_connections 2023-11-24T06:18:11.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 --2- 172.21.15.37:0/160728271 >> v2:172.21.15.188:3300/0 conn(0x7fbde40d08b0 0x7fbde40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 --2- 172.21.15.37:0/160728271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40b8dd0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 -- 172.21.15.37:0/160728271 >> 172.21.15.37:0/160728271 conn(0x7fbde4061310 msgr2=0x7fbde4061720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:11.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 -- 172.21.15.37:0/160728271 shutdown_connections 2023-11-24T06:18:11.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.106+0000 7fbde9528640 1 -- 172.21.15.37:0/160728271 wait complete. 2023-11-24T06:18:11.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.108+0000 7fbde9528640 1 Processor -- start 2023-11-24T06:18:11.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.108+0000 7fbde9528640 1 -- start start 2023-11-24T06:18:11.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.109+0000 7fbde9528640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbde40d08b0 0x7fbde41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.109+0000 7fbde9528640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbde40d1610 0x7fbde40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.109+0000 7fbde9528640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.109+0000 7fbde9528640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde41595e0 con 0x7fbde415d5c0 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.109+0000 7fbde9528640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40b59d0 con 0x7fbde40d08b0 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.109+0000 7fbde9528640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40ca850 con 0x7fbde40d1610 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48722/0 (socket says 172.21.15.37:48722) 2023-11-24T06:18:11.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 -- 172.21.15.37:0/2661162372 learned_addr learned my addr 172.21.15.37:0/2661162372 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde3fff640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbde40d08b0 0x7fbde41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbddbfff640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbde40d1610 0x7fbde40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 -- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbde40d1610 msgr2=0x7fbde40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbde40d1610 0x7fbde40ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 -- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbde40d08b0 msgr2=0x7fbde41590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbde40d08b0 0x7fbde41590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbde8d27640 1 -- 172.21.15.37:0/2661162372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40094d0 con 0x7fbde415d5c0 2023-11-24T06:18:11.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.110+0000 7fbddbfff640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbde40d1610 0x7fbde40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:11.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.111+0000 7fbde8d27640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40cca00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00b970 tx=0x7fbddc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.111+0000 7fbde17fa640 1 -- 172.21.15.37:0/2661162372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00cb40 con 0x7fbde415d5c0 2023-11-24T06:18:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.111+0000 7fbde17fa640 1 -- 172.21.15.37:0/2661162372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc00ccc0 con 0x7fbde415d5c0 2023-11-24T06:18:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.111+0000 7fbde17fa640 1 -- 172.21.15.37:0/2661162372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc014680 con 0x7fbde415d5c0 2023-11-24T06:18:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.111+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde40b5130 con 0x7fbde415d5c0 2023-11-24T06:18:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.111+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde40b56f0 con 0x7fbde415d5c0 2023-11-24T06:18:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.112+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde40c8090 con 0x7fbde415d5c0 2023-11-24T06:18:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.113+0000 7fbde17fa640 1 -- 172.21.15.37:0/2661162372 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fbddc01d3b0 con 0x7fbde415d5c0 2023-11-24T06:18:11.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.114+0000 7fbde17fa640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbdc406af60 0x7fbdc406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.114+0000 7fbde17fa640 1 -- 172.21.15.37:0/2661162372 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbddc089420 con 0x7fbde415d5c0 2023-11-24T06:18:11.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.114+0000 7fbde3fff640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbdc406af60 0x7fbdc406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.115+0000 7fbde3fff640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbdc406af60 0x7fbdc406d420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4036000 tx=0x7fbdd403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.119+0000 7fbde17fa640 1 -- 172.21.15.37:0/2661162372 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbddc0546b0 con 0x7fbde415d5c0 2023-11-24T06:18:11.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.314+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fbde40b5ed0 con 0x7fbdc406af60 2023-11-24T06:18:11.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.315+0000 7fbde17fa640 1 -- 172.21.15.37:0/2661162372 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbde40b5ed0 con 0x7fbdc406af60 2023-11-24T06:18:11.317 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T06:18:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbdc406af60 msgr2=0x7fbdc406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbdc406af60 0x7fbdc406d420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4036000 tx=0x7fbdd403d040 comp rx=0 tx=0).stop 2023-11-24T06:18:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 msgr2=0x7fbde40cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40cca00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00b970 tx=0x7fbddc00be30 comp rx=0 tx=0).stop 2023-11-24T06:18:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 shutdown_connections 2023-11-24T06:18:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fbdc406af60 0x7fbdc406d420 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde415d5c0 0x7fbde40cca00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbde40d1610 0x7fbde40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 --2- 172.21.15.37:0/2661162372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbde40d08b0 0x7fbde41590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 >> 172.21.15.37:0/2661162372 conn(0x7fbde4061310 msgr2=0x7fbde40d3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 shutdown_connections 2023-11-24T06:18:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.317+0000 7fbde9528640 1 -- 172.21.15.37:0/2661162372 wait complete. 2023-11-24T06:18:11.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:18:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.563+0000 7fc68359e640 1 Processor -- start 2023-11-24T06:18:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.563+0000 7fc68359e640 1 -- start start 2023-11-24T06:18:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.565+0000 7fc68359e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc684143870 0x7fc684146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.565+0000 7fc68359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6840b1180 0x7fc6840cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.565+0000 7fc68359e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc684161510 con 0x7fc684161080 2023-11-24T06:18:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.565+0000 7fc68359e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc684070460 con 0x7fc684143870 2023-11-24T06:18:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.565+0000 7fc68359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6841617f0 con 0x7fc6840b1180 2023-11-24T06:18:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.566+0000 7fc682d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6840b1180 0x7fc6840cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.566+0000 7fc681d9b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc684161080 0x7fc6840b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.37:49824/0 (socket says 172.21.15.37:49824) 2023-11-24T06:18:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.566+0000 7fc681d9b640 1 -- 172.21.15.37:0/1016274662 learned_addr learned my addr 172.21.15.37:0/1016274662 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.566+0000 7fc68259c640 1 --2- 172.21.15.37:0/1016274662 >> v2:172.21.15.188:3300/0 conn(0x7fc684143870 0x7fc684146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.567+0000 7fc682d9d640 1 -- 172.21.15.37:0/1016274662 >> v2:172.21.15.188:3300/0 conn(0x7fc684143870 msgr2=0x7fc684146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.567+0000 7fc682d9d640 1 --2- 172.21.15.37:0/1016274662 >> v2:172.21.15.188:3300/0 conn(0x7fc684143870 0x7fc684146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.567+0000 7fc682d9d640 1 -- 172.21.15.37:0/1016274662 >> v1:172.21.15.188:6789/0 conn(0x7fc684161080 legacy=0x7fc6840b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.567+0000 7fc682d9d640 1 -- 172.21.15.37:0/1016274662 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684161ad0 con 0x7fc6840b1180 2023-11-24T06:18:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.567+0000 7fc68259c640 1 --2- 172.21.15.37:0/1016274662 >> v2:172.21.15.188:3300/0 conn(0x7fc684143870 0x7fc684146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:18:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.568+0000 7fc682d9d640 1 --2- 172.21.15.37:0/1016274662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6840b1180 0x7fc6840cd520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6840705a0 tx=0x7fc67c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57419579c874035e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.569+0000 7fc68159a640 1 -- 172.21.15.37:0/1016274662 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c02cc40 con 0x7fc6840b1180 2023-11-24T06:18:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.569+0000 7fc68159a640 1 -- 172.21.15.37:0/1016274662 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c02cda0 con 0x7fc6840b1180 2023-11-24T06:18:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.569+0000 7fc68159a640 1 -- 172.21.15.37:0/1016274662 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c034660 con 0x7fc6840b1180 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 -- 172.21.15.37:0/1016274662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6840b1180 msgr2=0x7fc6840cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 --2- 172.21.15.37:0/1016274662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6840b1180 0x7fc6840cd520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6840705a0 tx=0x7fc67c02be90 comp rx=0 tx=0).stop 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 -- 172.21.15.37:0/1016274662 shutdown_connections 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 --2- 172.21.15.37:0/1016274662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6840b1180 0x7fc6840cd520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 --2- 172.21.15.37:0/1016274662 >> v2:172.21.15.188:3300/0 conn(0x7fc684143870 0x7fc684146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 -- 172.21.15.37:0/1016274662 >> 172.21.15.37:0/1016274662 conn(0x7fc6840cb830 msgr2=0x7fc6840cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 -- 172.21.15.37:0/1016274662 shutdown_connections 2023-11-24T06:18:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.570+0000 7fc68359e640 1 -- 172.21.15.37:0/1016274662 wait complete. 2023-11-24T06:18:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.572+0000 7fc68359e640 1 Processor -- start 2023-11-24T06:18:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.572+0000 7fc68359e640 1 -- start start 2023-11-24T06:18:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.573+0000 7fc68359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6840b1180 0x7fc684141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.573+0000 7fc68359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc684143870 0x7fc68415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.573+0000 7fc68359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6840b1b60 0x7fc6840b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.573+0000 7fc68359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840b1ff0 con 0x7fc6840b1b60 2023-11-24T06:18:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.573+0000 7fc68359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840b22d0 con 0x7fc6840b1180 2023-11-24T06:18:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.573+0000 7fc68359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840b25b0 con 0x7fc684143870 2023-11-24T06:18:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6840b1b60 0x7fc6840b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6840b1b60 0x7fc6840b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48734/0 (socket says 172.21.15.37:48734) 2023-11-24T06:18:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 -- 172.21.15.37:0/1805355110 learned_addr learned my addr 172.21.15.37:0/1805355110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc68259c640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6840b1180 0x7fc684141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc681d9b640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc684143870 0x7fc68415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 -- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc684143870 msgr2=0x7fc68415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc684143870 0x7fc68415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 -- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6840b1180 msgr2=0x7fc684141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6840b1180 0x7fc684141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc682d9d640 1 -- 172.21.15.37:0/1805355110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674009400 con 0x7fc6840b1b60 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.574+0000 7fc68259c640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6840b1180 0x7fc684141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:18:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.575+0000 7fc682d9d640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6840b1b60 0x7fc6840b3090 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc67c02c4a0 tx=0x7fc67c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:11.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.575+0000 7fc672ffd640 1 -- 172.21.15.37:0/1805355110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c03e610 con 0x7fc6840b1b60 2023-11-24T06:18:11.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.575+0000 7fc672ffd640 1 -- 172.21.15.37:0/1805355110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c03e770 con 0x7fc6840b1b60 2023-11-24T06:18:11.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.575+0000 7fc672ffd640 1 -- 172.21.15.37:0/1805355110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c03eb20 con 0x7fc6840b1b60 2023-11-24T06:18:11.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.575+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c009a70 con 0x7fc6840b1b60 2023-11-24T06:18:11.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.575+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6840b2b70 con 0x7fc6840b1b60 2023-11-24T06:18:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.577+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68406e260 con 0x7fc6840b1b60 2023-11-24T06:18:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.578+0000 7fc672ffd640 1 -- 172.21.15.37:0/1805355110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fc67c03b050 con 0x7fc6840b1b60 2023-11-24T06:18:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.578+0000 7fc672ffd640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc66406af60 0x7fc66406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.579+0000 7fc672ffd640 1 -- 172.21.15.37:0/1805355110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc67c0abdb0 con 0x7fc6840b1b60 2023-11-24T06:18:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.579+0000 7fc68259c640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc66406af60 0x7fc66406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:11.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.580+0000 7fc68259c640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc66406af60 0x7fc66406d420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc674009d20 tx=0x7fc674008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:11.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.583+0000 7fc672ffd640 1 -- 172.21.15.37:0/1805355110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc68406e260 con 0x7fc6840b1b60 2023-11-24T06:18:11.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.778+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc68406e260 con 0x7fc66406af60 2023-11-24T06:18:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.783+0000 7fc672ffd640 1 -- 172.21.15.37:0/1805355110 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48969 (secure 0 0 0) 0x7fc68406e260 con 0x7fc66406af60 2023-11-24T06:18:11.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:18:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:18:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc66406af60 msgr2=0x7fc66406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc66406af60 0x7fc66406d420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc674009d20 tx=0x7fc674008040 comp rx=0 tx=0).stop 2023-11-24T06:18:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6840b1b60 msgr2=0x7fc6840b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6840b1b60 0x7fc6840b3090 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc67c02c4a0 tx=0x7fc67c004a40 comp rx=0 tx=0).stop 2023-11-24T06:18:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 shutdown_connections 2023-11-24T06:18:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fc66406af60 0x7fc66406d420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6840b1b60 0x7fc6840b3090 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc684143870 0x7fc68415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 --2- 172.21.15.37:0/1805355110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6840b1180 0x7fc684141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 >> 172.21.15.37:0/1805355110 conn(0x7fc6840cb830 msgr2=0x7fc6840cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 shutdown_connections 2023-11-24T06:18:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:11.786+0000 7fc68359e640 1 -- 172.21.15.37:0/1805355110 wait complete. 2023-11-24T06:18:11.808 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-11-24T06:18:10.876162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":244664,"kb_used_data":7688,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730056,"statfs":{"total":773094113280,"available":772843577344,"internally_reserved":0,"allocated":7872512,"data_stored":4043008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.982791"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-24T06:17:58.981188+0000","last_change":"2023-11-24T06:14:40.443416+0000","last_active":"2023-11-24T06:17:58.981188+0000","last_peered":"2023-11-24T06:17:58.981188+0000","last_clean":"2023-11-24T06:17:58.981188+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:17:58.981188+0000","last_undegraded":"2023-11-24T06:17:58.981188+0000","last_fullsized":"2023-11-24T06:17:58.981188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:39.083607+0000","last_clean_scrub_stamp":"2023-11-24T06:14:39.083607+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:23:14.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":948152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.077,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6279999999999999,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.0389999999999999,"15min":0.997},"min":{"1min":0.64200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5529999999999999,"5min":1.681,"15min":1.681},"last":1.218}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.633,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.232,"15min":1.238},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.492,"5min":2.004,"15min":2.004},"last":1.399}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.175,"15min":1.194},"min":{"1min":0.752,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1619999999999999,"15min":1.1539999999999999},"min":{"1min":0.81599999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.645,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.097}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.256,"15min":1.238},"min":{"1min":0.95499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6060000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.286},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3440000000000001,"15min":1.3420000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.681,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.369}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3480000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6839999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.45,"5min":1.4570000000000001,"15min":1.4590000000000001},"min":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.7050000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4690000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4239999999999999,"15min":1.4319999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7230000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.464,"15min":1.48},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.4470000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.516,"15min":1.5409999999999999},"min":{"1min":0.94199999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.8779999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.472,"15min":1.478},"min":{"1min":1.0469999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7949999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.256}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.427,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.022},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5009999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4850000000000001,"5min":1.615,"15min":1.615},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.1579999999999999,"15min":1.179},"min":{"1min":0.79500000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5049999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.3129999999999999},"min":{"1min":0.86899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6220000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.177},{"interface":"front","average":{"1min":1.226,"5min":1.3240000000000001,"15min":1.3480000000000001},"min":{"1min":0.753,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.575,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.121}]},{"osd":3,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.3,"15min":1.3580000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.375,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.359},{"interface":"front","average":{"1min":1.169,"5min":1.276,"15min":1.296},"min":{"1min":0.85299999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.542,"5min":2.056,"15min":2.056},"last":1.0860000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.3899999999999999,"15min":1.4370000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6899999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.248},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.4870000000000001,"15min":1.5269999999999999},"min":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6539999999999999,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.494}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.409,"15min":1.4490000000000001},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.728,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.601},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.569,"15min":1.619},"min":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6379999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.6970000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.5089999999999999,"15min":1.5249999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8560000000000001,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.476,"15min":1.4770000000000001},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.712,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.5580000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0509999999999999,"15min":1.0589999999999999},"min":{"1min":0.79700000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.133,"15min":1.131},"min":{"1min":0.72299999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5680000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.155,"15min":1.1699999999999999},"min":{"1min":0.86899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.85699999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.5029999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.258,"15min":1.27},"min":{"1min":0.82599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7250000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4399999999999999,"15min":1.444},"min":{"1min":1.012,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.861,"5min":2.198,"15min":2.198},"last":1.097}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4470000000000001},"min":{"1min":0.96699999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7290000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3220000000000001,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.9239999999999999,"5min":2.427,"15min":2.427},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.4419999999999999,"15min":1.474},"min":{"1min":1.085,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6890000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.2270000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.54,"15min":1.5820000000000001},"min":{"1min":0.88,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.5509999999999999,"15min":1.6080000000000001},"min":{"1min":0.86599999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.98,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.446}]},{"osd":7,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.6419999999999999,"15min":1.6599999999999999},"min":{"1min":1.395,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.901,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.6930000000000001,"15min":1.7070000000000001},"min":{"1min":1.1359999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.95,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.2829999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0289999999999999,"15min":1.002},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5109999999999999,"5min":1.643,"15min":1.643},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.079,"15min":1.071},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0900000000000001,"15min":1.0800000000000001},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.244,"5min":1.2529999999999999,"15min":1.2569999999999999},"min":{"1min":0.88200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5429999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.1910000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.224,"15min":1.212},"min":{"1min":0.82099999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.962,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2210000000000001,"15min":1.2430000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.659}]},{"osd":3,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3129999999999999,"15min":1.3340000000000001},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6200000000000001,"5min":2.089,"15min":2.089},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.266}]},{"osd":5,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.298,"15min":1.3029999999999999},"min":{"1min":0.86699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.381,"15min":1.399},"min":{"1min":1.0669999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.8999999999999999,"5min":1.964,"15min":1.964},"last":1.825}]},{"osd":6,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.571,"15min":1.611},"min":{"1min":1.0700000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0169999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.569,"15min":1.5900000000000001},"min":{"1min":1.1479999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.9710000000000001,"5min":2.222,"15min":2.222},"last":1.744}]},{"osd":7,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4990000000000001,"15min":1.5209999999999999},"min":{"1min":1.107,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.512},{"interface":"front","average":{"1min":1.643,"5min":1.6850000000000001,"15min":1.7150000000000001},"min":{"1min":1.3160000000000001,"5min":1.157,"15min":1.157},"max":{"1min":2.246,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.323}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.353,"5min":1.71,"15min":1.71},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.018,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.413,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.2809999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.92800000000000005,"15min":0.96999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2709999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.746},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97799999999999998,"15min":0.97499999999999998},"min":{"1min":0.50900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.556,"5min":1.998,"15min":1.998},"last":0.95999999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.103},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":1.802},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.155,"5min":1.1120000000000001,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.841,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.0960000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":7.6399999999999997,"15min":10.481999999999999},"min":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6639999999999999,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3879999999999999,"15min":1.4399999999999999},"min":{"1min":0.877,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7350000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.857}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.419,"15min":1.4690000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7569999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.9530000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9410000000000001,"5min":4.274,"15min":4.274},"last":1.3280000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.704,"15min":1.804},"min":{"1min":1.1259999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.0190000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":2.3620000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":0.76400000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7,"5min":3.157,"15min":3.157},"last":1.2070000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5269999999999999,"15min":1.5640000000000001},"min":{"1min":0.98799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9379999999999999,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.9990000000000001},{"interface":"front","average":{"1min":1.526,"5min":1.502,"15min":1.52},"min":{"1min":0.89500000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.9019999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.52}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.89800000000000002,"15min":0.91100000000000003},"min":{"1min":0.46200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.625},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.97699999999999998,"15min":0.97399999999999998},"min":{"1min":0.497,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.26,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1120000000000001,"15min":1.1539999999999999},"min":{"1min":0.55800000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6100000000000001,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.121,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7170000000000001,"5min":2.355,"15min":2.355},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.179,"15min":1.1930000000000001},"min":{"1min":0.65700000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2829999999999999,"15min":1.288},"min":{"1min":0.79000000000000004,"5min":0.747,"15min":0.747},"max":{"1min":1.8240000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4330000000000001,"15min":1.4410000000000001},"min":{"1min":0.99199999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.907,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.1679999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.46,"15min":1.4890000000000001},"min":{"1min":0.97499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7709999999999999,"5min":2.048,"15min":2.048},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.3660000000000001,"15min":1.389},"min":{"1min":0.79500000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.766,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.3720000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.5,"15min":1.528},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.74,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5609999999999999,"15min":1.579},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8380000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5169999999999999,"15min":1.542},"min":{"1min":0.84999999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0019999999999998,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.546,"15min":1.5740000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.903,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.329}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90500000000000003,"15min":0.93300000000000005},"min":{"1min":0.42999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1759999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.64200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.466,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.0009999999999999},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4430000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.915,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.7030000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.2090000000000001,"15min":1.2529999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6180000000000001,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.8080000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.111,"15min":1.1279999999999999},"min":{"1min":0.63800000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.782,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.429}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3260000000000001,"15min":1.3799999999999999},"min":{"1min":0.66700000000000004,"5min":0.626,"15min":0.626},"max":{"1min":2.3170000000000002,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.038},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4690000000000001,"15min":1.5349999999999999},"min":{"1min":0.77100000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.1000000000000001,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.9139999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.5409999999999999,"15min":1.6339999999999999},"min":{"1min":0.94099999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1970000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.601},{"interface":"front","average":{"1min":1.351,"5min":1.597,"15min":1.7090000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.1499999999999999,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5329999999999999,"15min":1.581},"min":{"1min":0.81999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2639999999999998,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.9910000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7250000000000001,"15min":1.853},"min":{"1min":0.83199999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0270000000000001,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.758}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.5629999999999999,"15min":1.597},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.3650000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.5640000000000001,"15min":1.623},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9610000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.383}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":948152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2110000000000001,"5min":2.452,"15min":2.452},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6890000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.157,"15min":1.23},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5409999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.077,"15min":1.119},"min":{"1min":0.48599999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.74,"5min":3.411,"15min":3.411},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0980000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6890000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.216,"15min":1.25},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6519999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":0.97799999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3999999999999999,"15min":1.4359999999999999},"min":{"1min":0.746,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6359999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.496,"15min":1.579},"min":{"1min":0.81899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.756,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.208}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4670000000000001,"15min":1.5249999999999999},"min":{"1min":0.83799999999999997,"5min":0.747,"15min":0.747},"max":{"1min":1.647,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.252},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.5009999999999999,"15min":1.5529999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8939999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.165}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.7470000000000001,"15min":1.9350000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9390000000000001,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.069},{"interface":"front","average":{"1min":1.284,"5min":1.6819999999999999,"15min":1.8080000000000001},"min":{"1min":0.83399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6080000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.101}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5349999999999999,"15min":1.5649999999999999},"min":{"1min":0.90900000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.004,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.298},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7350000000000001,"15min":1.857},"min":{"1min":0.88100000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.044,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.0269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:18:11.815 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T06:14:39.083607+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=14, tm_sec=39, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=18, tm_sec=4, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T06:18:11.815 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T06:18:31.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.047+0000 7f2a819a5640 1 Processor -- start 2023-11-24T06:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.047+0000 7f2a819a5640 1 -- start start 2023-11-24T06:18:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.049+0000 7f2a819a5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a7c15c7f0 0x7f2a7c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.049+0000 7f2a819a5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0cece0 con 0x7f2a7c0cf450 2023-11-24T06:18:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.049+0000 7f2a819a5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c06d040 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.049+0000 7f2a819a5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c0ceaf0 con 0x7f2a7c15c7f0 2023-11-24T06:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.050+0000 7f2a7affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a7c15c7f0 0x7f2a7c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.050+0000 7f2a73fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a7c0cf450 0x7f2a7c0cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51014/0 (socket says 172.21.15.37:51014) 2023-11-24T06:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.050+0000 7f2a73fff640 1 -- 172.21.15.37:0/3256471120 learned_addr learned my addr 172.21.15.37:0/3256471120 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.050+0000 7f2a7affd640 1 -- 172.21.15.37:0/3256471120 >> v1:172.21.15.188:6789/0 conn(0x7f2a7c0ce6c0 legacy=0x7f2a7c0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.050+0000 7f2a7affd640 1 -- 172.21.15.37:0/3256471120 >> v1:172.21.15.37:6789/0 conn(0x7f2a7c0cf450 legacy=0x7f2a7c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.050+0000 7f2a7a7fc640 1 -- 172.21.15.37:0/3256471120 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319022411 0 0) 0x7f2a7c0cece0 con 0x7f2a7c0cf450 2023-11-24T06:18:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.050+0000 7f2a7affd640 1 -- 172.21.15.37:0/3256471120 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c06d320 con 0x7f2a7c15c7f0 2023-11-24T06:18:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.051+0000 7f2a7affd640 1 --2- 172.21.15.37:0/3256471120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c15c7f0 0x7f2a7c06db20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0097a0 tx=0x7f2a6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d58eebe3de140cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a7a7fc640 1 -- 172.21.15.37:0/3256471120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c031830 con 0x7f2a7c15c7f0 2023-11-24T06:18:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a7a7fc640 1 -- 172.21.15.37:0/3256471120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c031990 con 0x7f2a7c15c7f0 2023-11-24T06:18:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a7a7fc640 1 -- 172.21.15.37:0/3256471120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c031d20 con 0x7f2a7c15c7f0 2023-11-24T06:18:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a819a5640 1 -- 172.21.15.37:0/3256471120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c15c7f0 msgr2=0x7f2a7c06db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a819a5640 1 --2- 172.21.15.37:0/3256471120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c15c7f0 0x7f2a7c06db20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0097a0 tx=0x7f2a6c02b8d0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a819a5640 1 -- 172.21.15.37:0/3256471120 shutdown_connections 2023-11-24T06:18:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a819a5640 1 --2- 172.21.15.37:0/3256471120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c15c7f0 0x7f2a7c06db20 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a819a5640 1 -- 172.21.15.37:0/3256471120 >> 172.21.15.37:0/3256471120 conn(0x7f2a7c06a920 msgr2=0x7f2a7c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a819a5640 1 -- 172.21.15.37:0/3256471120 shutdown_connections 2023-11-24T06:18:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.052+0000 7f2a819a5640 1 -- 172.21.15.37:0/3256471120 wait complete. 2023-11-24T06:18:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.054+0000 7f2a819a5640 1 Processor -- start 2023-11-24T06:18:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.054+0000 7f2a819a5640 1 -- start start 2023-11-24T06:18:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.055+0000 7f2a819a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c0ce6c0 0x7f2a7c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.055+0000 7f2a819a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a7c0cf450 0x7f2a7c0ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.055+0000 7f2a819a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a7c15c7f0 0x7f2a7c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.055+0000 7f2a819a5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c156f40 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.055+0000 7f2a819a5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c150420 con 0x7f2a7c0cf450 2023-11-24T06:18:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.055+0000 7f2a819a5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1563c0 con 0x7f2a7c15c7f0 2023-11-24T06:18:32.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c0ce6c0 0x7f2a7c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c0ce6c0 0x7f2a7c155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58676/0 (socket says 172.21.15.37:58676) 2023-11-24T06:18:32.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 -- 172.21.15.37:0/254067040 learned_addr learned my addr 172.21.15.37:0/254067040 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:32.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 -- 172.21.15.37:0/254067040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a7c15c7f0 msgr2=0x7f2a7c1549d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:18:32.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a7c15c7f0 0x7f2a7c1549d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 -- 172.21.15.37:0/254067040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a7c0cf450 msgr2=0x7f2a7c0ae250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:18:32.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a7c0cf450 0x7f2a7c0ae250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 -- 172.21.15.37:0/254067040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c009400 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.056+0000 7f2a7affd640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c0ce6c0 0x7f2a7c155de0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0097a0 tx=0x7f2a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.057+0000 7f2a78ff9640 1 -- 172.21.15.37:0/254067040 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c03aa60 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.057+0000 7f2a78ff9640 1 -- 172.21.15.37:0/254067040 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c03abc0 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.057+0000 7f2a78ff9640 1 -- 172.21.15.37:0/254067040 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0443f0 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.057+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c1566a0 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.057+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c156c60 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.058+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c061a50 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.059+0000 7f2a78ff9640 1 -- 172.21.15.37:0/254067040 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f2a6c04d450 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.061+0000 7f2a78ff9640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2a5c06af90 0x7f2a5c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.061+0000 7f2a78ff9640 1 -- 172.21.15.37:0/254067040 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2a6c0ab830 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.061+0000 7f2a73fff640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2a5c06af90 0x7f2a5c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.062+0000 7f2a73fff640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2a5c06af90 0x7f2a5c06d450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a640011e0 tx=0x7f2a640078b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.066+0000 7f2a78ff9640 1 -- 172.21.15.37:0/254067040 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a6c076920 con 0x7f2a7c0ce6c0 2023-11-24T06:18:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.256+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 --> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a7c06e060 con 0x7f2a5c06af90 2023-11-24T06:18:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.259+0000 7f2a78ff9640 1 -- 172.21.15.37:0/254067040 <== mgr.4110 v2:172.21.15.37:6832/3129158683 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48794 (secure 0 0 0) 0x7f2a640070d0 con 0x7f2a5c06af90 2023-11-24T06:18:32.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:18:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-11-24T06:18:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2a5c06af90 msgr2=0x7f2a5c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2a5c06af90 0x7f2a5c06d450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a640011e0 tx=0x7f2a640078b0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c0ce6c0 msgr2=0x7f2a7c155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c0ce6c0 0x7f2a7c155de0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0097a0 tx=0x7f2a6c0046c0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 shutdown_connections 2023-11-24T06:18:32.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f2a5c06af90 0x7f2a5c06d450 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a7c0cf450 0x7f2a7c0ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a7c15c7f0 0x7f2a7c1549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 --2- 172.21.15.37:0/254067040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a7c0ce6c0 0x7f2a7c155de0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 >> 172.21.15.37:0/254067040 conn(0x7f2a7c06a920 msgr2=0x7f2a7c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 shutdown_connections 2023-11-24T06:18:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.262+0000 7f2a819a5640 1 -- 172.21.15.37:0/254067040 wait complete. 2023-11-24T06:18:32.286 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-11-24T06:18:30.881638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":244652,"kb_used_data":7688,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730068,"statfs":{"total":773094113280,"available":772843589632,"internally_reserved":0,"allocated":7872512,"data_stored":4043008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003340"},"pg_stats":[{"pgid":"1.0","version":"68'119","reported_seq":218,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-24T06:18:11.498013+0000","last_change":"2023-11-24T06:18:11.498082+0000","last_active":"2023-11-24T06:18:11.498013+0000","last_peered":"2023-11-24T06:18:11.498013+0000","last_clean":"2023-11-24T06:18:11.498013+0000","last_became_active":"2023-11-24T06:14:40.441192+0000","last_became_peered":"2023-11-24T06:14:40.441192+0000","last_unstale":"2023-11-24T06:18:11.498013+0000","last_undegraded":"2023-11-24T06:18:11.498013+0000","last_fullsized":"2023-11-24T06:18:11.498013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'119","last_scrub_stamp":"2023-11-24T06:18:11.497832+0000","last_deep_scrub":"68'119","last_deep_scrub_stamp":"2023-11-24T06:18:11.497832+0000","last_clean_scrub_stamp":"2023-11-24T06:18:11.497832+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:40:55.400535+0000","scrub_duration":0.011341176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1429504,"data_stored":948152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.077,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6279999999999999,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.0389999999999999,"15min":0.997},"min":{"1min":0.64200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5529999999999999,"5min":1.681,"15min":1.681},"last":0.999}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1240000000000001,"15min":1.1180000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.633,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.232,"15min":1.238},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.492,"5min":2.004,"15min":2.004},"last":1.2430000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.175,"15min":1.194},"min":{"1min":0.752,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.1619999999999999,"15min":1.1539999999999999},"min":{"1min":0.81599999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.645,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.3}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.256,"15min":1.238},"min":{"1min":0.95499999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6060000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.655},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3440000000000001,"15min":1.3420000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.681,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.754}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3480000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6839999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.353},{"interface":"front","average":{"1min":1.45,"5min":1.4570000000000001,"15min":1.4590000000000001},"min":{"1min":0.97199999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.7050000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.4139999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.4239999999999999,"15min":1.4319999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7230000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.464,"15min":1.48},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.5649999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.516,"15min":1.5409999999999999},"min":{"1min":0.94199999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.8779999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.472,"15min":1.478},"min":{"1min":1.0469999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7949999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.6020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.427,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.874},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.018,"15min":1.0129999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5009999999999999,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.175}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4850000000000001,"5min":1.615,"15min":1.615},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1579999999999999,"15min":1.179},"min":{"1min":0.79500000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5049999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.569}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2889999999999999,"15min":1.3129999999999999},"min":{"1min":0.86899999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6220000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.226,"5min":1.3240000000000001,"15min":1.3480000000000001},"min":{"1min":0.753,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.575,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.4530000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.3,"15min":1.3580000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.375,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.276,"15min":1.296},"min":{"1min":0.85299999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.542,"5min":2.056,"15min":2.056},"last":1.3819999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.3899999999999999,"15min":1.4370000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6899999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.272},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.4870000000000001,"15min":1.5269999999999999},"min":{"1min":0.77200000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6539999999999999,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":1.119}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.409,"15min":1.4490000000000001},"min":{"1min":0.63400000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.728,"5min":4.1760000000000002,"15min":4.1760000000000002},"last":1.246},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.569,"15min":1.619},"min":{"1min":0.70799999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6379999999999999,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":1.333}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.5089999999999999,"15min":1.5249999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8560000000000001,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.706},{"interface":"front","average":{"1min":1.365,"5min":1.476,"15min":1.4770000000000001},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.712,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.514}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0509999999999999,"15min":1.0589999999999999},"min":{"1min":0.79700000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.133,"15min":1.131},"min":{"1min":0.72299999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.5680000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3879999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.155,"15min":1.1699999999999999},"min":{"1min":0.86899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.288,"5min":1.286,"15min":1.3049999999999999},"min":{"1min":0.85699999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.2050000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.258,"15min":1.27},"min":{"1min":0.82599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.7250000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.5},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4399999999999999,"15min":1.444},"min":{"1min":1.012,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.861,"5min":2.198,"15min":2.198},"last":1.361}]},{"osd":3,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2929999999999999,"15min":1.3089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4319999999999999,"15min":1.4470000000000001},"min":{"1min":0.96699999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.7290000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.083}]},{"osd":4,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3220000000000001,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.9239999999999999,"5min":2.427,"15min":2.427},"last":1.319},{"interface":"front","average":{"1min":1.363,"5min":1.4419999999999999,"15min":1.474},"min":{"1min":1.085,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6890000000000001,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.6579999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.54,"15min":1.5820000000000001},"min":{"1min":0.88,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":1.29},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.5509999999999999,"15min":1.6080000000000001},"min":{"1min":0.86599999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.98,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.591}]},{"osd":7,"last update":"Fri Nov 24 06:17:40 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.6419999999999999,"15min":1.6599999999999999},"min":{"1min":1.395,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.901,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.716},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.6930000000000001,"15min":1.7070000000000001},"min":{"1min":1.1359999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.95,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.534}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0289999999999999,"15min":1.002},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5109999999999999,"5min":1.643,"15min":1.643},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.079,"15min":1.071},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.843}]},{"osd":1,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0900000000000001,"15min":1.0800000000000001},"min":{"1min":0.67400000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.244,"5min":1.2529999999999999,"15min":1.2569999999999999},"min":{"1min":0.88200000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5429999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.7929999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.224,"15min":1.212},"min":{"1min":0.82099999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.962,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2210000000000001,"15min":1.2430000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6359999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3129999999999999,"15min":1.3340000000000001},"min":{"1min":0.88300000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6200000000000001,"5min":2.089,"15min":2.089},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.085}]},{"osd":5,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.298,"15min":1.3029999999999999},"min":{"1min":0.86699999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.448},{"interface":"front","average":{"1min":1.361,"5min":1.381,"15min":1.399},"min":{"1min":1.0669999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.8999999999999999,"5min":1.964,"15min":1.964},"last":1.1379999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.571,"15min":1.611},"min":{"1min":1.0700000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0169999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.661},{"interface":"front","average":{"1min":1.524,"5min":1.569,"15min":1.5900000000000001},"min":{"1min":1.1479999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.9710000000000001,"5min":2.222,"15min":2.222},"last":1.3480000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:17:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4990000000000001,"15min":1.5209999999999999},"min":{"1min":1.107,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.643,"5min":1.6850000000000001,"15min":1.7150000000000001},"min":{"1min":1.3160000000000001,"5min":1.157,"15min":1.157},"max":{"1min":2.246,"5min":3.7360000000000002,"15min":3.7360000000000002},"last":1.7370000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"min":{"1min":0.42199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.353,"5min":1.71,"15min":1.71},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.018,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.413,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.92800000000000005,"15min":0.96999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2709999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97799999999999998,"15min":0.97499999999999998},"min":{"1min":0.50900000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.556,"5min":1.998,"15min":1.998},"last":1.0529999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.103},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":1.802},"last":1.458},{"interface":"front","average":{"1min":1.155,"5min":1.1120000000000001,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.841,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.401}]},{"osd":4,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":7.6399999999999997,"15min":10.481999999999999},"min":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6639999999999999,"5min":204.87899999999999,"15min":204.87899999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3879999999999999,"15min":1.4399999999999999},"min":{"1min":0.877,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.7350000000000001,"5min":2.9569999999999999,"15min":2.9569999999999999},"last":1.6359999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.419,"15min":1.4690000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7569999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4099999999999999,"15min":1.4199999999999999},"min":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.9410000000000001,"5min":4.274,"15min":4.274},"last":1.3049999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.704,"15min":1.804},"min":{"1min":1.1259999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.0190000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":0.76400000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7,"5min":3.157,"15min":3.157},"last":1.421}]},{"osd":7,"last update":"Fri Nov 24 06:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5269999999999999,"15min":1.5640000000000001},"min":{"1min":0.98799999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9379999999999999,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.502,"15min":1.52},"min":{"1min":0.89500000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.9019999999999999,"5min":3.6589999999999998,"15min":3.6589999999999998},"last":1.593}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31996,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.89800000000000002,"15min":0.91100000000000003},"min":{"1min":0.46200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.97699999999999998,"15min":0.97399999999999998},"min":{"1min":0.497,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.0840000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0189999999999999,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.26,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.996,"5min":1.1120000000000001,"15min":1.1539999999999999},"min":{"1min":0.55800000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6100000000000001,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.415}]},{"osd":3,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.121,"15min":1.1339999999999999},"min":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.7170000000000001,"5min":2.355,"15min":2.355},"last":1.556},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.179,"15min":1.1930000000000001},"min":{"1min":0.65700000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.149}]},{"osd":4,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2829999999999999,"15min":1.288},"min":{"1min":0.79000000000000004,"5min":0.747,"15min":0.747},"max":{"1min":1.8240000000000001,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.266},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4330000000000001,"15min":1.4410000000000001},"min":{"1min":0.99199999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.907,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.659}]},{"osd":5,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.46,"15min":1.4890000000000001},"min":{"1min":0.97499999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7709999999999999,"5min":2.048,"15min":2.048},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.3660000000000001,"15min":1.389},"min":{"1min":0.79500000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.766,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":2.012}]},{"osd":6,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.5,"15min":1.528},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.74,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.738},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5609999999999999,"15min":1.579},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8380000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.325}]},{"osd":7,"last update":"Fri Nov 24 06:17:41 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.5169999999999999,"15min":1.542},"min":{"1min":0.84999999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0019999999999998,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":2.1219999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.546,"15min":1.5740000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.903,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.956}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":357784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.90500000000000003,"15min":0.93300000000000005},"min":{"1min":0.42999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1759999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":0.999},"min":{"1min":0.64200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.466,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.3979999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.0009999999999999},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4430000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1919999999999999,"15min":1.2330000000000001},"min":{"1min":0.61699999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.915,"5min":3.5339999999999998,"15min":3.5339999999999998},"last":1.702}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.2090000000000001,"15min":1.2529999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6180000000000001,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.111,"15min":1.1279999999999999},"min":{"1min":0.63800000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.782,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.6459999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.3260000000000001,"15min":1.3799999999999999},"min":{"1min":0.66700000000000004,"5min":0.626,"15min":0.626},"max":{"1min":2.3170000000000002,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":1.109},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.4690000000000001,"15min":1.5349999999999999},"min":{"1min":0.77100000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.1000000000000001,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":1.881}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.5409999999999999,"15min":1.6339999999999999},"min":{"1min":0.94099999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.1970000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":1.7829999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.597,"15min":1.7090000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.1499999999999999,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":1.4890000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5329999999999999,"15min":1.581},"min":{"1min":0.81999999999999995,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2639999999999998,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":5.54},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7250000000000001,"15min":1.853},"min":{"1min":0.83199999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0270000000000001,"5min":7.0990000000000002,"15min":7.0990000000000002},"last":1.952}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.5629999999999999,"15min":1.597},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.3650000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":2.0379999999999998},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.5640000000000001,"15min":1.623},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9610000000000001,"5min":5.2519999999999998,"15min":5.2519999999999998},"last":1.8360000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1429504,"data_stored":948152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.92500000000000004,"15min":0.95399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2110000000000001,"5min":2.452,"15min":2.452},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.03,"15min":1.0660000000000001},"min":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6890000000000001,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":1.526}]},{"osd":2,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.157,"15min":1.23},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5409999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.077,"15min":1.119},"min":{"1min":0.48599999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.74,"5min":3.411,"15min":3.411},"last":1.1739999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0980000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6890000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.216,"15min":1.25},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6519999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":1.349}]},{"osd":4,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3999999999999999,"15min":1.4359999999999999},"min":{"1min":0.746,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6359999999999999,"5min":4.4379999999999997,"15min":4.4379999999999997},"last":1.321},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.496,"15min":1.579},"min":{"1min":0.81899999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.756,"5min":5.5439999999999996,"15min":5.5439999999999996},"last":1.468}]},{"osd":5,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4670000000000001,"15min":1.5249999999999999},"min":{"1min":0.83799999999999997,"5min":0.747,"15min":0.747},"max":{"1min":1.647,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.5009999999999999,"15min":1.5529999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8939999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.4099999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.7470000000000001,"15min":1.9350000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9390000000000001,"5min":8.3689999999999998,"15min":8.3689999999999998},"last":1.601},{"interface":"front","average":{"1min":1.284,"5min":1.6819999999999999,"15min":1.8080000000000001},"min":{"1min":0.83399999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6080000000000001,"5min":8.7620000000000005,"15min":8.7620000000000005},"last":1.673}]},{"osd":7,"last update":"Fri Nov 24 06:17:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5349999999999999,"15min":1.5649999999999999},"min":{"1min":0.90900000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.004,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.7350000000000001,"15min":1.857},"min":{"1min":0.88100000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.044,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.7270000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:18:32.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T06:18:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.503+0000 7fd1d9c8a640 1 Processor -- start 2023-11-24T06:18:32.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.503+0000 7fd1d9c8a640 1 -- start start 2023-11-24T06:18:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.504+0000 7fd1d9c8a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 0x7fd1d406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.504+0000 7fd1d9c8a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd1d40b1250 0x7fd1d406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.504+0000 7fd1d9c8a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d415ed20 con 0x7fd1d406e580 2023-11-24T06:18:32.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.504+0000 7fd1d9c8a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d415b640 con 0x7fd1d40b1250 2023-11-24T06:18:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.504+0000 7fd1d9c8a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d415f8a0 con 0x7fd1d415b260 2023-11-24T06:18:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.505+0000 7fd1d3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd1d406e580 0x7fd1d40b0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51024/0 (socket says 172.21.15.37:51024) 2023-11-24T06:18:32.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.505+0000 7fd1d3fff640 1 -- 172.21.15.37:0/58518996 learned_addr learned my addr 172.21.15.37:0/58518996 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-11-24T06:18:32.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.505+0000 7fd1d8c88640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 0x7fd1d406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.505+0000 7fd1d9489640 1 --2- 172.21.15.37:0/58518996 >> v2:172.21.15.188:3300/0 conn(0x7fd1d40b1250 0x7fd1d406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.505+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558481994 0 0) 0x7fd1d415ed20 con 0x7fd1d406e580 2023-11-24T06:18:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.505+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c4003520 con 0x7fd1d406e580 2023-11-24T06:18:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1153373711 0 0) 0x7fd1c4003520 con 0x7fd1d406e580 2023-11-24T06:18:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 msgr2=0x7fd1d406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 0x7fd1d406e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 >> v2:172.21.15.188:3300/0 conn(0x7fd1d40b1250 msgr2=0x7fd1d406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 --2- 172.21.15.37:0/58518996 >> v2:172.21.15.188:3300/0 conn(0x7fd1d40b1250 0x7fd1d406c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40abe50 con 0x7fd1d406e580 2023-11-24T06:18:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3835567329 0 0) 0x7fd1c0001670 con 0x7fd1d406e580 2023-11-24T06:18:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 >> v1:172.21.15.37:6789/0 conn(0x7fd1d406e580 legacy=0x7fd1d40b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 0x7fd1c4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c4003f40 0x7fd1c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1c4004d00 0x7fd1c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d415b640 con 0x7fd1c4003f40 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d415f8a0 con 0x7fd1c4004d00 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c400bb60 con 0x7fd1d415b260 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d9489640 1 --2- 172.21.15.37:0/58518996 >> v2:172.21.15.188:3300/0 conn(0x7fd1d40b1250 0x7fd1d406c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.506+0000 7fd1d3fff640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c4003f40 0x7fd1c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.507+0000 7fd1d8c88640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 0x7fd1c4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.507+0000 7fd1d3fff640 1 -- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 msgr2=0x7fd1c4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:32.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.507+0000 7fd1d3fff640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1d415b260 0x7fd1c4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.507+0000 7fd1d3fff640 1 -- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1c4004d00 msgr2=0x7fd1c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.507+0000 7fd1d3fff640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1c4004d00 0x7fd1c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.507+0000 7fd1d3fff640 1 -- 172.21.15.37:0/58518996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4003520 con 0x7fd1c4003f40 2023-11-24T06:18:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.508+0000 7fd1d3fff640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c4003f40 0x7fd1c40047c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000c110 tx=0x7fd1c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147253e269f97d99 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.508+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0005ad0 con 0x7fd1c4003f40 2023-11-24T06:18:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.508+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0005c30 con 0x7fd1c4003f40 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.508+0000 7fd1d37fe640 1 -- 172.21.15.37:0/58518996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c002ca70 con 0x7fd1c4003f40 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.509+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/58518996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c4003f40 msgr2=0x7fd1c40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.509+0000 7fd1d9c8a640 1 --2- 172.21.15.37:0/58518996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c4003f40 0x7fd1c40047c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000c110 tx=0x7fd1c40057f0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.509+0000 7fd1d9489640 1 -- 172.21.15.37:0/58518996 reap_dead start 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.509+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/58518996 shutdown_connections 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.509+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/58518996 >> 172.21.15.37:0/58518996 conn(0x7fd1d40cbb40 msgr2=0x7fd1d40cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.509+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/58518996 shutdown_connections 2023-11-24T06:18:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.509+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/58518996 wait complete. 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.511+0000 7fd1d9c8a640 1 Processor -- start 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.511+0000 7fd1d9c8a640 1 -- start start 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d9c8a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1c4003f40 0x7fd1d4157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d9c8a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d409a4b0 0x7fd1d40c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d9c8a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1d40c8ef0 0x7fd1d40b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d9c8a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4157fe0 con 0x7fd1d409a4b0 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d9c8a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40c9370 con 0x7fd1d40c8ef0 2023-11-24T06:18:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d9c8a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d415d130 con 0x7fd1c4003f40 2023-11-24T06:18:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d409a4b0 0x7fd1d40c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d409a4b0 0x7fd1d40c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58700/0 (socket says 172.21.15.37:58700) 2023-11-24T06:18:32.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.512+0000 7fd1d3fff640 1 -- 172.21.15.37:0/2825872058 learned_addr learned my addr 172.21.15.37:0/2825872058 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:32.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d3fff640 1 -- 172.21.15.37:0/2825872058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1c4003f40 msgr2=0x7fd1d4157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d3fff640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1c4003f40 0x7fd1d4157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d3fff640 1 -- 172.21.15.37:0/2825872058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1d40c8ef0 msgr2=0x7fd1d40b1ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d3fff640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1d40c8ef0 0x7fd1d40b1ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d3fff640 1 -- 172.21.15.37:0/2825872058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40b4d30 con 0x7fd1d409a4b0 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d3fff640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d409a4b0 0x7fd1d40c89b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd1c002c3d0 tx=0x7fd1c0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c002cc40 con 0x7fd1d409a4b0 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c002cdc0 con 0x7fd1d409a4b0 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.513+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00072b0 con 0x7fd1d409a4b0 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.514+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d415c870 con 0x7fd1d409a4b0 2023-11-24T06:18:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.514+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d415cdc0 con 0x7fd1d409a4b0 2023-11-24T06:18:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.515+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d404e840 con 0x7fd1d409a4b0 2023-11-24T06:18:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.516+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7fd1c0032070 con 0x7fd1d409a4b0 2023-11-24T06:18:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.517+0000 7fd1d17fa640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd1b806afb0 0x7fd1b806d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.518+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1c003c040 con 0x7fd1d409a4b0 2023-11-24T06:18:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.518+0000 7fd1d8c88640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd1b806afb0 0x7fd1b806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.518+0000 7fd1d8c88640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd1b806afb0 0x7fd1b806d470 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009870 tx=0x7fd1c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.522+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1c0075c00 con 0x7fd1d409a4b0 2023-11-24T06:18:32.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.717+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd1d40ce640 con 0x7fd1d409a4b0 2023-11-24T06:18:32.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.724+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd1c0079220 con 0x7fd1d409a4b0 2023-11-24T06:18:32.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.726+0000 7fd1d17fa640 1 -- 172.21.15.37:0/2825872058 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd1c0075c00 con 0x7fd1d409a4b0 2023-11-24T06:18:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd1b806afb0 msgr2=0x7fd1b806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd1b806afb0 0x7fd1b806d470 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009870 tx=0x7fd1c8008040 comp rx=0 tx=0).stop 2023-11-24T06:18:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d409a4b0 msgr2=0x7fd1d40c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d409a4b0 0x7fd1d40c89b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd1c002c3d0 tx=0x7fd1c0001930 comp rx=0 tx=0).stop 2023-11-24T06:18:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 shutdown_connections 2023-11-24T06:18:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7fd1b806afb0 0x7fd1b806d470 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1d40c8ef0 0x7fd1d40b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d409a4b0 0x7fd1d40c89b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 --2- 172.21.15.37:0/2825872058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1c4003f40 0x7fd1d4157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 >> 172.21.15.37:0/2825872058 conn(0x7fd1d40cbb40 msgr2=0x7fd1d40aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 shutdown_connections 2023-11-24T06:18:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.728+0000 7fd1d9c8a640 1 -- 172.21.15.37:0/2825872058 wait complete. 2023-11-24T06:18:32.751 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:18:32.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:18:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.963+0000 7f87fe671640 1 Processor -- start 2023-11-24T06:18:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.963+0000 7f87fe671640 1 -- start start 2023-11-24T06:18:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fe671640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f87f815d4e0 0x7f87f80d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fe671640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d38e0 0x7f87f80cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fe671640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87f80d0070 0x7f87f80d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fe671640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f80d4110 con 0x7f87f80d0070 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fe671640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f80d04e0 con 0x7f87f815d4e0 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fe671640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80ce990 con 0x7f87f80d38e0 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fde70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87f80d0070 0x7f87f80d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fde70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87f80d0070 0x7f87f80d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58706/0 (socket says 172.21.15.37:58706) 2023-11-24T06:18:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.965+0000 7f87fde70640 1 -- 172.21.15.37:0/2765886668 learned_addr learned my addr 172.21.15.37:0/2765886668 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:32.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.966+0000 7f87fde70640 1 -- 172.21.15.37:0/2765886668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d38e0 msgr2=0x7f87f80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.966+0000 7f87fde70640 1 --2- 172.21.15.37:0/2765886668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d38e0 0x7f87f80cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.966+0000 7f87fde70640 1 -- 172.21.15.37:0/2765886668 >> v2:172.21.15.188:3300/0 conn(0x7f87f815d4e0 msgr2=0x7f87f80d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.966+0000 7f87fd66f640 1 --2- 172.21.15.37:0/2765886668 >> v2:172.21.15.188:3300/0 conn(0x7f87f815d4e0 0x7f87f80d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.966+0000 7f87fde70640 1 --2- 172.21.15.37:0/2765886668 >> v2:172.21.15.188:3300/0 conn(0x7f87f815d4e0 0x7f87f80d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.966+0000 7f87fde70640 1 -- 172.21.15.37:0/2765886668 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f80cec70 con 0x7f87f80d0070 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.967+0000 7f87fde70640 1 --2- 172.21.15.37:0/2765886668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f80d0070 0x7f87f80d0da0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f87f808b800 tx=0x7f87f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5744c3c06a0d7742 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.967+0000 7f87f7fff640 1 -- 172.21.15.37:0/2765886668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0031870 con 0x7f87f80d0070 2023-11-24T06:18:32.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.967+0000 7f87f7fff640 1 -- 172.21.15.37:0/2765886668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f87f00319d0 con 0x7f87f80d0070 2023-11-24T06:18:32.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.967+0000 7f87f7fff640 1 -- 172.21.15.37:0/2765886668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0031d80 con 0x7f87f80d0070 2023-11-24T06:18:32.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 -- 172.21.15.37:0/2765886668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f80d0070 msgr2=0x7f87f80d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 --2- 172.21.15.37:0/2765886668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f80d0070 0x7f87f80d0da0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f87f808b800 tx=0x7f87f002b910 comp rx=0 tx=0).stop 2023-11-24T06:18:32.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 -- 172.21.15.37:0/2765886668 shutdown_connections 2023-11-24T06:18:32.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 --2- 172.21.15.37:0/2765886668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f80d0070 0x7f87f80d0da0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 --2- 172.21.15.37:0/2765886668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d38e0 0x7f87f80cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 --2- 172.21.15.37:0/2765886668 >> v2:172.21.15.188:3300/0 conn(0x7f87f815d4e0 0x7f87f80d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 -- 172.21.15.37:0/2765886668 >> 172.21.15.37:0/2765886668 conn(0x7f87f809c510 msgr2=0x7f87f80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:32.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 -- 172.21.15.37:0/2765886668 shutdown_connections 2023-11-24T06:18:32.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.968+0000 7f87fe671640 1 -- 172.21.15.37:0/2765886668 wait complete. 2023-11-24T06:18:32.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.969+0000 7f87fe671640 1 Processor -- start 2023-11-24T06:18:32.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.970+0000 7f87fe671640 1 -- start start 2023-11-24T06:18:32.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.970+0000 7f87fe671640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d0070 0x7f87f81f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fe671640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87f80d38e0 0x7f87f80c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fe671640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f815d4e0 0x7f87f815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fe671640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80cb490 con 0x7f87f815d4e0 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fe671640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80cb770 con 0x7f87f80d38e0 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fe671640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80cba50 con 0x7f87f80d0070 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f815d4e0 0x7f87f815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f815d4e0 0x7f87f815b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58710/0 (socket says 172.21.15.37:58710) 2023-11-24T06:18:32.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 -- 172.21.15.37:0/849233075 learned_addr learned my addr 172.21.15.37:0/849233075 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-11-24T06:18:32.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fce6e640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87f80d38e0 0x7f87f80c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 -- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d0070 msgr2=0x7f87f81f3980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:18:32.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d0070 0x7f87f81f3980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 -- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87f80d38e0 msgr2=0x7f87f80c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:32.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87f80d38e0 0x7f87f80c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:32.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fde70640 1 -- 172.21.15.37:0/849233075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00094d0 con 0x7f87f815d4e0 2023-11-24T06:18:32.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.971+0000 7f87fce6e640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87f80d38e0 0x7f87f80c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:18:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.972+0000 7f87fde70640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f815d4e0 0x7f87f815b3f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f87f002b950 tx=0x7f87f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.972+0000 7f87f5ffb640 1 -- 172.21.15.37:0/849233075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f00443f0 con 0x7f87f815d4e0 2023-11-24T06:18:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.972+0000 7f87f5ffb640 1 -- 172.21.15.37:0/849233075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f87f0044570 con 0x7f87f815d4e0 2023-11-24T06:18:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.972+0000 7f87f5ffb640 1 -- 172.21.15.37:0/849233075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0044940 con 0x7f87f815d4e0 2023-11-24T06:18:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.972+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f80cbd30 con 0x7f87f815d4e0 2023-11-24T06:18:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.972+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f81f3ec0 con 0x7f87f815d4e0 2023-11-24T06:18:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.973+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f80cc250 con 0x7f87f815d4e0 2023-11-24T06:18:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.974+0000 7f87f5ffb640 1 -- 172.21.15.37:0/849233075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89333+0+0 (secure 0 0 0) 0x7f87f0044aa0 con 0x7f87f815d4e0 2023-11-24T06:18:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.975+0000 7f87f5ffb640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f87e406af60 0x7f87e406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:18:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.975+0000 7f87f5ffb640 1 -- 172.21.15.37:0/849233075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f87f002d040 con 0x7f87f815d4e0 2023-11-24T06:18:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.975+0000 7f87fd66f640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f87e406af60 0x7f87e406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:18:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.976+0000 7f87fd66f640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f87e406af60 0x7f87e406d420 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f87e8007d40 tx=0x7f87e8007270 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:18:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:32.979+0000 7f87f5ffb640 1 -- 172.21.15.37:0/849233075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87f80cc250 con 0x7f87f815d4e0 2023-11-24T06:18:33.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.208+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87f80cc250 con 0x7f87f815d4e0 2023-11-24T06:18:33.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.208+0000 7f87f5ffb640 1 -- 172.21.15.37:0/849233075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f87f80cc250 con 0x7f87f815d4e0 2023-11-24T06:18:33.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-11-24T06:18:33.211 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2892400858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6833","nonce":2892400858},{"type":"v1","addr":"172.21.15.188:6835","nonce":2892400858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":4961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/4008465884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":4008465884},{"type":"v1","addr":"172.21.15.37:6837","nonce":4008465884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6834/2245601301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":2245601301},{"type":"v1","addr":"172.21.15.188:6834","nonce":2245601301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/807486675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":807486675},{"type":"v1","addr":"172.21.15.37:6836","nonce":807486675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[]} 2023-11-24T06:18:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 43 2023-11-24T06:18:33.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.211+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f87e406af60 msgr2=0x7f87e406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:33.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.211+0000 7f87fe671640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f87e406af60 0x7f87e406d420 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f87e8007d40 tx=0x7f87e8007270 comp rx=0 tx=0).stop 2023-11-24T06:18:33.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.211+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f815d4e0 msgr2=0x7f87f815b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:18:33.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.211+0000 7f87fe671640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f815d4e0 0x7f87f815b3f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f87f002b950 tx=0x7f87f00046c0 comp rx=0 tx=0).stop 2023-11-24T06:18:33.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 shutdown_connections 2023-11-24T06:18:33.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:6832/3129158683,v1:172.21.15.37:6833/3129158683] conn(0x7f87e406af60 0x7f87e406d420 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:33.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87f80d38e0 0x7f87f80c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:33.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f815d4e0 0x7f87f815b3f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:33.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 --2- 172.21.15.37:0/849233075 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87f80d0070 0x7f87f81f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:18:33.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 >> 172.21.15.37:0/849233075 conn(0x7f87f809c510 msgr2=0x7f87f80d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:18:33.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 shutdown_connections 2023-11-24T06:18:33.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-11-24T06:18:33.212+0000 7f87fe671640 1 -- 172.21.15.37:0/849233075 wait complete. 2023-11-24T06:18:33.234 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T06:18:33.234 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T06:18:33.234 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:18:33.234 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.249 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:18:33.250 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:18:33.250 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.320 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:18:33.320 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:18:33.320 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.350 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:18:33.351 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:18:33.351 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.414 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:18:33.415 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T06:18:33.415 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T06:18:33.415 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.475 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T06:18:33.475 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T06:18:33.476 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.546 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T06:18:33.546 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T06:18:33.546 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.621 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T06:18:33.621 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T06:18:33.621 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.693 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T06:18:33.694 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T06:18:33.694 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.744 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T06:18:33.744 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T06:18:33.744 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.798 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T06:18:33.799 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T06:18:33.799 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.863 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T06:18:33.864 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T06:18:33.864 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.918 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T06:18:33.918 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T06:18:33.919 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T06:18:33.919 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:33.989 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T06:18:33.990 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T06:18:33.990 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:34.071 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T06:18:34.071 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T06:18:34.072 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T06:18:34.072 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:34.122 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T06:18:34.122 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T06:18:34.123 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:34.157 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T06:18:34.157 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T06:18:34.157 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:18:34.232 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T06:18:34.232 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T06:18:34.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T06:18:34.356 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:18:34.357 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T06:18:34.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:18:34.592 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T06:18:34.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:18:34.751 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T06:18:34.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:18:34.910 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T06:18:35.078 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:18:35.078 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T06:18:35.327 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:18:35.327 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T06:18:35.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:18:35.467 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T06:18:35.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:18:35.625 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T06:18:35.791 INFO:tasks.ceph:Archiving mon data... 2023-11-24T06:18:35.794 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/data/mon.a.tgz 2023-11-24T06:18:35.794 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-11-24T06:18:35.857 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.yrJ4b59Jjn 2023-11-24T06:18:35.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yrJ4b59Jjn 2023-11-24T06:18:36.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.yrJ4b59Jjn 2023-11-24T06:18:36.252 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.yrJ4b59Jjn is 460KB 2023-11-24T06:18:36.365 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.yrJ4b59Jjn 2023-11-24T06:18:36.428 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/data/mon.b.tgz 2023-11-24T06:18:36.428 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2023-11-24T06:18:36.487 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.Cm2gvoyip7 2023-11-24T06:18:36.488 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Cm2gvoyip7 2023-11-24T06:18:36.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.Cm2gvoyip7 2023-11-24T06:18:36.887 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.Cm2gvoyip7 is 607KB 2023-11-24T06:18:36.995 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.Cm2gvoyip7 2023-11-24T06:18:37.053 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/data/mon.c.tgz 2023-11-24T06:18:37.053 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2023-11-24T06:18:37.108 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.qmOp5mS1Rl 2023-11-24T06:18:37.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qmOp5mS1Rl 2023-11-24T06:18:37.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.qmOp5mS1Rl 2023-11-24T06:18:37.483 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.qmOp5mS1Rl is 607KB 2023-11-24T06:18:37.596 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.qmOp5mS1Rl 2023-11-24T06:18:37.655 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T06:18:37.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:18:37.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:18:37.766 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T06:18:37.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:18:37.775 DEBUG:teuthology.orchestra.run.smithi188:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:18:37.879 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:18:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:18:37.893 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T06:18:37.895 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/remote/smithi037/crash 2023-11-24T06:18:37.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:18:37.977 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/remote/smithi188/crash 2023-11-24T06:18:37.978 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:18:38.080 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T06:18:38.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:18:38.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:18:38.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:18:38.344 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:18:38.453 INFO:tasks.ceph:Compressing logs... 2023-11-24T06:18:38.454 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:18:38.462 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:18:38.549 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T06:18:38.550 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94749.log 2023-11-24T06:18:38.551 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T06:18:38.552 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.3.94749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.94749.log.gz 2023-11-24T06:18:38.552 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T06:18:38.554 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88852.log 2023-11-24T06:18:38.555 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T06:18:38.556 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88852.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88852.log.gz 2023-11-24T06:18:38.557 INFO:teuthology.orchestra.run.smithi188.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:18:38.557 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95878.log 2023-11-24T06:18:38.558 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96373.log 2023-11-24T06:18:38.559 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.1.95878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95878.log.gz 2023-11-24T06:18:38.559 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94356.log 2023-11-24T06:18:38.561 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98914.log 2023-11-24T06:18:38.561 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.1.96373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96373.log.gz 2023-11-24T06:18:38.561 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T06:18:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.1.94356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94356.log.gz 2023-11-24T06:18:38.562 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T06:18:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101543.log 2023-11-24T06:18:38.563 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88732.log 2023-11-24T06:18:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93902.log 2023-11-24T06:18:38.564 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98914.log.gz 2023-11-24T06:18:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109201.log 2023-11-24T06:18:38.565 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101543.log.gz 2023-11-24T06:18:38.566 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88652.log 2023-11-24T06:18:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95374.log 2023-11-24T06:18:38.567 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93902.log.gz 2023-11-24T06:18:38.568 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88812.log 2023-11-24T06:18:38.568 INFO:teuthology.orchestra.run.smithi188.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88732.log.gz 2023-11-24T06:18:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108404.log 2023-11-24T06:18:38.569 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109201.log.gz 2023-11-24T06:18:38.569 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88692.log 2023-11-24T06:18:38.569 INFO:teuthology.orchestra.run.smithi188.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88652.log.gz 2023-11-24T06:18:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106578.log 2023-11-24T06:18:38.570 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95374.log.gz 2023-11-24T06:18:38.571 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88812.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88812.log.gz 2023-11-24T06:18:38.571 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95370.log 2023-11-24T06:18:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108404.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T06:18:38.572 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108404.log.gz 2023-11-24T06:18:38.572 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88692.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T06:18:38.572 INFO:teuthology.orchestra.run.smithi188.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88692.log.gz 2023-11-24T06:18:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103510.log 2023-11-24T06:18:38.573 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106578.log.gz 2023-11-24T06:18:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98674.log 2023-11-24T06:18:38.574 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.1.95370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95370.log.gz 2023-11-24T06:18:38.574 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:18:38.575 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107739.log 2023-11-24T06:18:38.575 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103510.log.gz 2023-11-24T06:18:38.576 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T06:18:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98674.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.98674.log.gz 2023-11-24T06:18:38.576 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.103596.log 2023-11-24T06:18:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106750.log 2023-11-24T06:18:38.577 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107739.log.gz 2023-11-24T06:18:38.578 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:18:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107180.log 2023-11-24T06:18:38.579 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103596.log.gz 2023-11-24T06:18:38.580 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88892.log 2023-11-24T06:18:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99588.log 2023-11-24T06:18:38.581 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106750.log.gz 2023-11-24T06:18:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107180.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107180.log.gz 2023-11-24T06:18:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100804.log 2023-11-24T06:18:38.582 INFO:teuthology.orchestra.run.smithi188.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T06:18:38.582 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T06:18:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99588.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99588.log.gz 2023-11-24T06:18:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99714.log 2023-11-24T06:18:38.584 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88932.log 2023-11-24T06:18:38.584 INFO:teuthology.orchestra.run.smithi188.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88892.log.gz 2023-11-24T06:18:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100804.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100804.log.gz 2023-11-24T06:18:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104346.log 2023-11-24T06:18:38.585 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88772.log 2023-11-24T06:18:38.586 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88932.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88932.log.gz 2023-11-24T06:18:38.587 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98428.log 2023-11-24T06:18:38.587 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99714.log.gz 2023-11-24T06:18:38.588 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104346.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104346.log.gz 2023-11-24T06:18:38.588 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103067.log 2023-11-24T06:18:38.588 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.88772.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88772.log.gz 2023-11-24T06:18:38.588 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T06:18:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98428.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98428.log.gz 2023-11-24T06:18:38.589 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106027.log 2023-11-24T06:18:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103067.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103067.log.gz 2023-11-24T06:18:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109243.log 2023-11-24T06:18:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108178.log 2023-11-24T06:18:38.592 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106027.log.gz 2023-11-24T06:18:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109243.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109243.log.gz 2023-11-24T06:18:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109931.log 2023-11-24T06:18:38.595 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105504.log 2023-11-24T06:18:38.595 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108178.log.gz 2023-11-24T06:18:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109931.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109931.log.gz 2023-11-24T06:18:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102983.log 2023-11-24T06:18:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105504.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105504.log.gz 2023-11-24T06:18:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95045.log 2023-11-24T06:18:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102983.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102983.log.gz 2023-11-24T06:18:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94326.log 2023-11-24T06:18:38.601 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102521.log 2023-11-24T06:18:38.601 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95045.log.gz 2023-11-24T06:18:38.602 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94326.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94326.log.gz 2023-11-24T06:18:38.602 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94284.log 2023-11-24T06:18:38.604 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102521.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102521.log.gz 2023-11-24T06:18:38.604 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108220.log 2023-11-24T06:18:38.605 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94284.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94284.log.gz 2023-11-24T06:18:38.605 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94410.log 2023-11-24T06:18:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98065.log 2023-11-24T06:18:38.607 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108220.log.gz 2023-11-24T06:18:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94410.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94410.log.gz 2023-11-24T06:18:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104533.log 2023-11-24T06:18:38.609 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mon.c.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T06:18:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98344.log 2023-11-24T06:18:38.610 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98065.log.gz 2023-11-24T06:18:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.104533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104533.log.gz 2023-11-24T06:18:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97393.log 2023-11-24T06:18:38.611 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T06:18:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102211.log 2023-11-24T06:18:38.613 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.98344.log.gz 2023-11-24T06:18:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97393.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97393.log.gz 2023-11-24T06:18:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100254.log 2023-11-24T06:18:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102211.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102211.log.gz 2023-11-24T06:18:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94158.log 2023-11-24T06:18:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100254.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100254.log.gz 2023-11-24T06:18:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107571.log 2023-11-24T06:18:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94158.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94158.log.gz 2023-11-24T06:18:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102353.log 2023-11-24T06:18:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99210.log 2023-11-24T06:18:38.620 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107571.log.gz 2023-11-24T06:18:38.621 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93944.log 2023-11-24T06:18:38.621 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102353.log.gz 2023-11-24T06:18:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99210.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99210.log.gz 2023-11-24T06:18:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105362.log 2023-11-24T06:18:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102007.log 2023-11-24T06:18:38.624 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93944.log.gz 2023-11-24T06:18:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105362.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105362.log.gz 2023-11-24T06:18:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97603.log 2023-11-24T06:18:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100128.log 2023-11-24T06:18:38.628 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102007.log.gz 2023-11-24T06:18:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95353.log 2023-11-24T06:18:38.629 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97603.log.gz 2023-11-24T06:18:38.630 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94713.log 2023-11-24T06:18:38.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100128.log.gz 2023-11-24T06:18:38.632 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95353.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95353.log.gz 2023-11-24T06:18:38.632 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95042.log 2023-11-24T06:18:38.633 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94713.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94713.log.gz 2023-11-24T06:18:38.633 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102815.log 2023-11-24T06:18:38.634 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107012.log 2023-11-24T06:18:38.635 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95042.log.gz 2023-11-24T06:18:38.636 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102815.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102815.log.gz 2023-11-24T06:18:38.636 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103986.log 2023-11-24T06:18:38.637 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102689.log 2023-11-24T06:18:38.637 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107012.log.gz 2023-11-24T06:18:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103986.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103986.log.gz 2023-11-24T06:18:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105236.log 2023-11-24T06:18:38.639 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102689.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.102689.log.gz -- 2023-11-24T06:18:38.640 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.99378.log 2023-11-24T06:18:38.640 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99630.log 2023-11-24T06:18:38.641 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105236.log.gz 2023-11-24T06:18:38.642 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94536.log 2023-11-24T06:18:38.642 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99378.log.gz 2023-11-24T06:18:38.643 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101417.log 2023-11-24T06:18:38.644 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99630.log.gz 2023-11-24T06:18:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94536.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94536.log.gz 2023-11-24T06:18:38.645 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108058.log 2023-11-24T06:18:38.646 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105056.log 2023-11-24T06:18:38.646 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101417.log.gz 2023-11-24T06:18:38.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97897.log 2023-11-24T06:18:38.647 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108058.log.gz 2023-11-24T06:18:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95838.log 2023-11-24T06:18:38.648 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105056.log.gz 2023-11-24T06:18:38.650 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96702.log 2023-11-24T06:18:38.650 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97897.log.gz 2023-11-24T06:18:38.651 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109369.log 2023-11-24T06:18:38.651 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95838.log.gz 2023-11-24T06:18:38.652 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.96702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96702.log.gz 2023-11-24T06:18:38.652 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98590.log 2023-11-24T06:18:38.653 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109705.log 2023-11-24T06:18:38.654 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109369.log.gz 2023-11-24T06:18:38.655 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100043.log 2023-11-24T06:18:38.655 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98590.log.gz 2023-11-24T06:18:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109705.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109705.log.gz -5 2023-11-24T06:18:38.656 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.106069.log 2023-11-24T06:18:38.657 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100043.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100043.log.gz 2023-11-24T06:18:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107613.log 2023-11-24T06:18:38.659 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103109.log 88.1% 2023-11-24T06:18:38.659 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106069.log.gz 2023-11-24T06:18:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108842.log 2023-11-24T06:18:38.661 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107613.log.gz 2023-11-24T06:18:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99882.log 2023-11-24T06:18:38.662 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103109.log.gz 2023-11-24T06:18:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106842.log 2023-11-24T06:18:38.663 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108842.log.gz 2023-11-24T06:18:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99882.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99882.log.gz 2023-11-24T06:18:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101597.log 2023-11-24T06:18:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106842.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106842.log.gz 2023-11-24T06:18:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105714.log 2023-11-24T06:18:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104238.log 2023-11-24T06:18:38.666 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101597.log.gz 2023-11-24T06:18:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105714.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.97687.log 2023-11-24T06:18:38.668 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105714.log.gz 2023-11-24T06:18:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94718.log 2023-11-24T06:18:38.669 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104238.log.gz 2023-11-24T06:18:38.670 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97813.log 2023-11-24T06:18:38.670 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97687.log.gz 2023-11-24T06:18:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96174.log 2023-11-24T06:18:38.672 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94718.log.gz 2023-11-24T06:18:38.673 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97813.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97813.log.gz 2023-11-24T06:18:38.673 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97267.log 2023-11-24T06:18:38.674 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96174.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96174.log.gz 2023-11-24T06:18:38.674 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95796.log 2023-11-24T06:18:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104653.log 2023-11-24T06:18:38.675 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97267.log.gz 2023-11-24T06:18:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95796.log: gzip -5 --verbose 88.5% -- /var/log/ceph/ceph-client.admin.105672.log -- replaced with /var/log/ceph/ceph-client.admin.95796.log.gz 2023-11-24T06:18:38.676 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-11-24T06:18:38.678 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96006.log 2023-11-24T06:18:38.678 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104653.log.gz 2023-11-24T06:18:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105672.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.95964.log 2023-11-24T06:18:38.679 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105672.log.gz 2023-11-24T06:18:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105900.log 2023-11-24T06:18:38.680 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96006.log.gz 2023-11-24T06:18:38.681 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95754.log 88.5% 2023-11-24T06:18:38.681 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95964.log.gz 2023-11-24T06:18:38.683 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105840.log 2023-11-24T06:18:38.683 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105900.log.gz 2023-11-24T06:18:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93860.log 2023-11-24T06:18:38.684 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95754.log.gz 2023-11-24T06:18:38.685 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106332.log 88.6% 2023-11-24T06:18:38.685 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105840.log.gz 2023-11-24T06:18:38.686 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98470.log 2023-11-24T06:18:38.687 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93860.log.gz 2023-11-24T06:18:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107493.log 2023-11-24T06:18:38.688 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106332.log.gz 2023-11-24T06:18:38.689 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99756.log 2023-11-24T06:18:38.689 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98470.log.gz 2023-11-24T06:18:38.690 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.107493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107493.log.gz 2023-11-24T06:18:38.690 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98233.log 2023-11-24T06:18:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100594.log 2023-11-24T06:18:38.692 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99756.log.gz 2023-11-24T06:18:38.693 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100338.log 2023-11-24T06:18:38.693 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98233.log.gz 2023-11-24T06:18:38.694 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101374.log 2023-11-24T06:18:38.694 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100594.log.gz 2023-11-24T06:18:38.695 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100338.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.100338.log.gz --verbose 2023-11-24T06:18:38.696 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.101683.log 2023-11-24T06:18:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101374.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101374.log.gz 2023-11-24T06:18:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106970.log 2023-11-24T06:18:38.698 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98961.log 2023-11-24T06:18:38.698 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101683.log.gz 2023-11-24T06:18:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96090.log 2023-11-24T06:18:38.699 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106970.log.gz 2023-11-24T06:18:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105546.log 2023-11-24T06:18:38.701 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98961.log.gz 2023-11-24T06:18:38.702 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103818.log 2023-11-24T06:18:38.702 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96090.log.gz 2023-11-24T06:18:38.703 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105546.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105546.log.gz 2023-11-24T06:18:38.703 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101881.log 2023-11-24T06:18:38.704 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93817.log 2023-11-24T06:18:38.704 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103818.log.gz 2023-11-24T06:18:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101881.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.101881.log.gz /var/log/ceph/ceph.audit.log 2023-11-24T06:18:38.705 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-11-24T06:18:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95880.log 2023-11-24T06:18:38.707 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93817.log.gz 2023-11-24T06:18:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102085.log 2023-11-24T06:18:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100380.log 2023-11-24T06:18:38.709 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95880.log.gz 2023-11-24T06:18:38.709 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:18:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95047.log 2023-11-24T06:18:38.711 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102085.log.gz 2023-11-24T06:18:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95922.log 2023-11-24T06:18:38.712 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100380.log.gz 2023-11-24T06:18:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106662.log 2023-11-24T06:18:38.713 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95047.log.gz 2023-11-24T06:18:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102311.log 2023-11-24T06:18:38.714 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95922.log.gz 2023-11-24T06:18:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106662.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106662.log.gz 2023-11-24T06:18:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103690.log 2023-11-24T06:18:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102311.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102311.log.gz 2023-11-24T06:18:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103552.log 2023-11-24T06:18:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95628.log 2023-11-24T06:18:38.718 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103690.log.gz 2023-11-24T06:18:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94074.log 2023-11-24T06:18:38.720 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103552.log.gz 2023-11-24T06:18:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98760.log 2023-11-24T06:18:38.721 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95628.log.gz 2023-11-24T06:18:38.722 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99336.log 2023-11-24T06:18:38.722 INFO:teuthology.orchestra.run.smithi037.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94074.log.gz 2023-11-24T06:18:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98191.log 2023-11-24T06:18:38.723 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98760.log.gz 2023-11-24T06:18:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100212.log 2023-11-24T06:18:38.724 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99336.log.gz 2023-11-24T06:18:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88625.log 2023-11-24T06:18:38.726 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98191.log.gz 2023-11-24T06:18:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97729.log 2023-11-24T06:18:38.727 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100212.log.gz 2023-11-24T06:18:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.88625.log: gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.108016.log -- replaced with /var/log/ceph/ceph-client.admin.88625.log.gz 2023-11-24T06:18:38.728 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-11-24T06:18:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109831.log 2023-11-24T06:18:38.730 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97729.log.gz 2023-11-24T06:18:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104835.log 2023-11-24T06:18:38.731 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108016.log.gz 2023-11-24T06:18:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109831.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109831.log.gz 2023-11-24T06:18:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96216.log 2023-11-24T06:18:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107890.log 2023-11-24T06:18:38.734 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104835.log.gz 2023-11-24T06:18:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97519.log 2023-11-24T06:18:38.735 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.96216.log.gz 2023-11-24T06:18:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107890.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107890.log.gz 2023-11-24T06:18:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104196.log 2023-11-24T06:18:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95052.log 2023-11-24T06:18:38.738 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97519.log.gz 2023-11-24T06:18:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104196.log: gzip -5 --verbose 88.0% -- -- replaced with /var/log/ceph/ceph-client.admin.104196.log.gz 2023-11-24T06:18:38.739 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.100464.log 2023-11-24T06:18:38.740 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94200.log 2023-11-24T06:18:38.741 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95052.log.gz 2023-11-24T06:18:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110183.log 2023-11-24T06:18:38.742 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100464.log.gz 2023-11-24T06:18:38.743 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94200.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.94200.log.gz -5 2023-11-24T06:18:38.743 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93488.log 2023-11-24T06:18:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.110183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108740.log 2023-11-24T06:18:38.744 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110183.log.gz 2023-11-24T06:18:38.745 INFO:teuthology.orchestra.run.smithi188.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T06:18:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93488.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93488.log.gz 2023-11-24T06:18:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T06:18:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105278.log 2023-11-24T06:18:38.747 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108740.log.gz 2023-11-24T06:18:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95378.log 2023-11-24T06:18:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110141.log 2023-11-24T06:18:38.749 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105278.log.gz 2023-11-24T06:18:38.751 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95378.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95378.log.gz 2023-11-24T06:18:38.751 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102479.log 2023-11-24T06:18:38.752 INFO:teuthology.orchestra.run.smithi188.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T06:18:38.753 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.110141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95043.log 2023-11-24T06:18:38.753 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110141.log.gz 2023-11-24T06:18:38.754 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102479.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.102479.log.gz 2023-11-24T06:18:38.754 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107054.log 2023-11-24T06:18:38.756 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99294.log 2023-11-24T06:18:38.756 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95043.log.gz 2023-11-24T06:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107054.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107054.log.gz 2023-11-24T06:18:38.757 INFO:teuthology.orchestra.run.smithi188.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T06:18:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105098.log 2023-11-24T06:18:38.759 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100972.log 2023-11-24T06:18:38.760 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99294.log.gz 2023-11-24T06:18:38.760 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105098.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105098.log.gz 2023-11-24T06:18:38.761 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94716.log 2023-11-24T06:18:38.762 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104737.log 2023-11-24T06:18:38.763 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94716.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100972.log.gz 2023-11-24T06:18:38.763 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94716.log.gz 2023-11-24T06:18:38.764 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102253.log 2023-11-24T06:18:38.766 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108488.log 2023-11-24T06:18:38.766 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104737.log.gz 2023-11-24T06:18:38.767 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102253.log.gz 2023-11-24T06:18:38.767 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95392.log 2023-11-24T06:18:38.768 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106494.log 2023-11-24T06:18:38.769 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108488.log.gz 2023-11-24T06:18:38.770 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95392.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95392.log.gz 2023-11-24T06:18:38.770 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109011.log 2023-11-24T06:18:38.771 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106928.log 2023-11-24T06:18:38.771 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106494.log.gz 2023-11-24T06:18:38.772 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109011.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109011.log.gz 2023-11-24T06:18:38.772 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102899.log 2023-11-24T06:18:38.773 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104972.log 2023-11-24T06:18:38.774 INFO:teuthology.orchestra.run.smithi188.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T06:18:38.774 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106928.log.gz 2023-11-24T06:18:38.775 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102899.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102899.log.gz 2023-11-24T06:18:38.775 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98386.log 2023-11-24T06:18:38.776 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108262.log 2023-11-24T06:18:38.776 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104972.log.gz 2023-11-24T06:18:38.777 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98386.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98386.log.gz 2023-11-24T06:18:38.777 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99672.log 2023-11-24T06:18:38.778 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109663.log 2023-11-24T06:18:38.779 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108262.log.gz 2023-11-24T06:18:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99672.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99672.log.gz 2023-11-24T06:18:38.780 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99420.log 2023-11-24T06:18:38.781 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103776.log 2023-11-24T06:18:38.781 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109663.log.gz 2023-11-24T06:18:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99420.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99420.log.gz 2023-11-24T06:18:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108572.log 2023-11-24T06:18:38.783 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101080.log 2023-11-24T06:18:38.784 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103776.log.gz 2023-11-24T06:18:38.784 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108572.log.gz 2023-11-24T06:18:38.785 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97939.log 2023-11-24T06:18:38.786 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109975.log 2023-11-24T06:18:38.786 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101080.log.gz 2023-11-24T06:18:38.787 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97939.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97939.log.gz 2023-11-24T06:18:38.787 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106412.log 2023-11-24T06:18:38.788 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107655.log 2023-11-24T06:18:38.789 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109975.log.gz 2023-11-24T06:18:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106412.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106412.log.gz 2023-11-24T06:18:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104779.log 2023-11-24T06:18:38.791 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100085.log 2023-11-24T06:18:38.791 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107655.log.gz 2023-11-24T06:18:38.792 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104779.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104779.log.gz 2023-11-24T06:18:38.792 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94709.log 2023-11-24T06:18:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95311.log 2023-11-24T06:18:38.794 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100085.log.gz 2023-11-24T06:18:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94709.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94709.log.gz 2023-11-24T06:18:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102773.log 2023-11-24T06:18:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103902.log 2023-11-24T06:18:38.796 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95311.log.gz 2023-11-24T06:18:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102773.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102773.log.gz 2023-11-24T06:18:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109747.log 2023-11-24T06:18:38.798 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99462.log 2023-11-24T06:18:38.798 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103902.log.gz 2023-11-24T06:18:38.800 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109747.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109747.log.gz 2023-11-24T06:18:38.800 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106800.log 2023-11-24T06:18:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95712.log 2023-11-24T06:18:38.801 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99462.log.gz 2023-11-24T06:18:38.802 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106800.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.106800.log.gz 2023-11-24T06:18:38.802 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102605.log 2023-11-24T06:18:38.803 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95035.log 2023-11-24T06:18:38.803 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95712.log.gz 2023-11-24T06:18:38.804 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102605.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102605.log.gz 2023-11-24T06:18:38.805 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100720.log 2023-11-24T06:18:38.806 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109873.log 2023-11-24T06:18:38.806 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95035.log.gz 2023-11-24T06:18:38.807 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100720.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100720.log.gz 2023-11-24T06:18:38.807 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103944.log 2023-11-24T06:18:38.808 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109873.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T06:18:38.809 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109873.log.gz 2023-11-24T06:18:38.809 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103944.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103944.log.gz 2023-11-24T06:18:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88368.log 2023-11-24T06:18:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102169.log 2023-11-24T06:18:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.88368.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88368.log.gz 2023-11-24T06:18:38.812 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97435.log 2023-11-24T06:18:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95053.log 2023-11-24T06:18:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102169.log: /var/log/ceph/ceph-client.admin.97435.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102169.log.gz 2023-11-24T06:18:38.815 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97435.log.gz 2023-11-24T06:18:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102563.log 2023-11-24T06:18:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105588.log 2023-11-24T06:18:38.817 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95053.log.gz 2023-11-24T06:18:38.817 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102563.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102563.log.gz 2023-11-24T06:18:38.818 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105194.log 2023-11-24T06:18:38.819 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99962.log 2023-11-24T06:18:38.820 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105588.log: /var/log/ceph/ceph-client.admin.105194.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105588.log.gz 2023-11-24T06:18:38.820 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105194.log.gz 2023-11-24T06:18:38.820 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103732.log 2023-11-24T06:18:38.822 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100636.log 2023-11-24T06:18:38.822 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99962.log.gz 2023-11-24T06:18:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103732.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103732.log.gz 2023-11-24T06:18:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108969.log 2023-11-24T06:18:38.825 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102127.log 2023-11-24T06:18:38.826 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100636.log: /var/log/ceph/ceph-client.admin.108969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100636.log.gz 2023-11-24T06:18:38.826 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108969.log.gz 2023-11-24T06:18:38.826 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98717.log 2023-11-24T06:18:38.827 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110059.log 2023-11-24T06:18:38.828 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102127.log.gz 2023-11-24T06:18:38.828 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98717.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98717.log.gz 2023-11-24T06:18:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108530.log 2023-11-24T06:18:38.829 INFO:teuthology.orchestra.run.smithi188.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T06:18:38.830 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96837.log 2023-11-24T06:18:38.830 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.110059.log: /var/log/ceph/ceph-client.admin.108530.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110059.log.gz 2023-11-24T06:18:38.831 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108530.log.gz 2023-11-24T06:18:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100296.log 2023-11-24T06:18:38.832 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95393.log 2023-11-24T06:18:38.833 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96837.log.gz 2023-11-24T06:18:38.833 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100296.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100296.log.gz 2023-11-24T06:18:38.834 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98512.log 2023-11-24T06:18:38.835 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106536.log 2023-11-24T06:18:38.836 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95393.log: /var/log/ceph/ceph-client.admin.98512.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95393.log.gz 2023-11-24T06:18:38.836 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98512.log.gz 2023-11-24T06:18:38.836 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93986.log 2023-11-24T06:18:38.838 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109495.log 2023-11-24T06:18:38.838 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106536.log.gz 2023-11-24T06:18:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93986.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93986.log.gz 2023-11-24T06:18:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93775.log 2023-11-24T06:18:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88752.log 2023-11-24T06:18:38.841 INFO:teuthology.orchestra.run.smithi037.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.109495.log.gz 2023-11-24T06:18:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93775.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93775.log.gz 2023-11-24T06:18:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94717.log 2023-11-24T06:18:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94703.log 2023-11-24T06:18:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.88752.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88752.log.gz 2023-11-24T06:18:38.844 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94717.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94717.log.gz 2023-11-24T06:18:38.844 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101294.log 2023-11-24T06:18:38.845 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100552.log 2023-11-24T06:18:38.846 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94703.log.gz 2023-11-24T06:18:38.846 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.101294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101294.log.gz 2023-11-24T06:18:38.846 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101501.log 2023-11-24T06:18:38.848 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104611.log 2023-11-24T06:18:38.849 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100552.log.gz 2023-11-24T06:18:38.850 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101501.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101501.log.gz 2023-11-24T06:18:38.850 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109285.log 2023-11-24T06:18:38.850 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108698.log 2023-11-24T06:18:38.851 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104611.log.gz 2023-11-24T06:18:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109285.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109285.log.gz 2023-11-24T06:18:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108927.log 2023-11-24T06:18:38.853 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99168.log 2023-11-24T06:18:38.853 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108698.log: /var/log/ceph/ceph-client.admin.108927.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108698.log.gz 2023-11-24T06:18:38.854 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108927.log.gz 2023-11-24T06:18:38.854 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94030.log 2023-11-24T06:18:38.855 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108656.log 2023-11-24T06:18:38.856 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99168.log.gz 2023-11-24T06:18:38.856 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94030.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94030.log.gz 2023-11-24T06:18:38.857 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99798.log 2023-11-24T06:18:38.858 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95670.log 2023-11-24T06:18:38.858 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108656.log.gz 2023-11-24T06:18:38.859 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99798.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99798.log.gz 2023-11-24T06:18:38.859 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103860.log 2023-11-24T06:18:38.860 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.95670.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94116.log 2023-11-24T06:18:38.861 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95670.log.gz 2023-11-24T06:18:38.861 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103860.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103860.log.gz 2023-11-24T06:18:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97477.log 2023-11-24T06:18:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109789.log 2023-11-24T06:18:38.863 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94116.log.gz 2023-11-24T06:18:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97477.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97477.log.gz 2023-11-24T06:18:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T06:18:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94705.log 2023-11-24T06:18:38.866 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T06:18:38.866 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109789.log.gz 2023-11-24T06:18:38.867 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97309.log 2023-11-24T06:18:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101965.log 2023-11-24T06:18:38.868 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94705.log.gz 2023-11-24T06:18:38.869 INFO:teuthology.orchestra.run.smithi188.stderr: 2023-11-24T06:18:38.869 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m0.358s 2023-11-24T06:18:38.870 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m1.304s 2023-11-24T06:18:38.870 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m0.253s 2023-11-24T06:18:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101459.log 2023-11-24T06:18:38.871 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97309.log.gz 2023-11-24T06:18:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99048.log 2023-11-24T06:18:38.872 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101965.log.gz 2023-11-24T06:18:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97855.log 2023-11-24T06:18:38.873 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101459.log.gz 2023-11-24T06:18:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96048.log 2023-11-24T06:18:38.875 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99048.log.gz 2023-11-24T06:18:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101014.log 2023-11-24T06:18:38.876 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97855.log.gz 2023-11-24T06:18:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105630.log 2023-11-24T06:18:38.878 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96048.log.gz 2023-11-24T06:18:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97981.log 2023-11-24T06:18:38.879 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.101014.log.gz 2023-11-24T06:18:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107932.log 2023-11-24T06:18:38.881 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105630.log.gz 2023-11-24T06:18:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107222.log 2023-11-24T06:18:38.882 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97981.log.gz 2023-11-24T06:18:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97771.log 2023-11-24T06:18:38.884 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107932.log.gz 2023-11-24T06:18:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101725.log 2023-11-24T06:18:38.886 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.107222.log.gz 2023-11-24T06:18:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97645.log 2023-11-24T06:18:38.887 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97771.log.gz 2023-11-24T06:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101923.log 2023-11-24T06:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101725.log.gz 2023-11-24T06:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100678.log 2023-11-24T06:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97645.log.gz 2023-11-24T06:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110101.log 2023-11-24T06:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101923.log.gz 2023-11-24T06:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96354.log 2023-11-24T06:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100678.log.gz 2023-11-24T06:18:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.110101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108885.log 2023-11-24T06:18:38.895 INFO:teuthology.orchestra.run.smithi037.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.110101.log.gz 2023-11-24T06:18:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109579.log 2023-11-24T06:18:38.896 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96354.log.gz 2023-11-24T06:18:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108885.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108885.log.gzgzip 2023-11-24T06:18:38.897 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94714.log 2023-11-24T06:18:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100508.log 2023-11-24T06:18:38.899 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109579.log.gz 2023-11-24T06:18:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109453.log 2023-11-24T06:18:38.901 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94714.log.gz 2023-11-24T06:18:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104154.log 2023-11-24T06:18:38.902 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100508.log.gz 2023-11-24T06:18:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99252.log 2023-11-24T06:18:38.907 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109453.log.gz 2023-11-24T06:18:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104154.log: gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.106620.log -- replaced with /var/log/ceph/ceph-client.admin.104154.log.gz 2023-11-24T06:18:38.907 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-11-24T06:18:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99252.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99252.log.gz 2023-11-24T06:18:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102731.log 2023-11-24T06:18:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93694.log 2023-11-24T06:18:38.908 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106620.log.gz 2023-11-24T06:18:38.910 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94494.log 2023-11-24T06:18:38.910 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102731.log.gz 2023-11-24T06:18:38.911 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93694.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T06:18:38.911 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93694.log.gz 2023-11-24T06:18:38.913 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97351.log 2023-11-24T06:18:38.913 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94494.log.gz 2023-11-24T06:18:38.914 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104112.log 2023-11-24T06:18:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107096.log 2023-11-24T06:18:38.917 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97351.log.gz 2023-11-24T06:18:38.918 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101639.log 2023-11-24T06:18:38.918 INFO:teuthology.orchestra.run.smithi037.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104112.log.gz 2023-11-24T06:18:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110017.log 2023-11-24T06:18:38.920 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107096.log.gz 2023-11-24T06:18:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98632.log 2023-11-24T06:18:38.921 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101639.log.gz 2023-11-24T06:18:38.922 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.110017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102941.log 2023-11-24T06:18:38.922 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110017.log.gz 2023-11-24T06:18:38.924 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109537.log 2023-11-24T06:18:38.924 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98632.log.gz 2023-11-24T06:18:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100422.log 2023-11-24T06:18:38.925 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102941.log.gz 2023-11-24T06:18:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98149.log 2023-11-24T06:18:38.927 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109537.log.gz 2023-11-24T06:18:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103640.log 2023-11-24T06:18:38.929 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100422.log.gz 2023-11-24T06:18:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94368.log 2023-11-24T06:18:38.930 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98149.log.gz 2023-11-24T06:18:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103640.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:18:38.932 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103640.log.gz 2023-11-24T06:18:38.933 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102395.log 2023-11-24T06:18:38.933 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94368.log.gz 2023-11-24T06:18:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107795.log 2023-11-24T06:18:38.936 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102395.log: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:18:38.937 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102395.log.gz 90.6% 2023-11-24T06:18:38.937 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T06:18:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108446.log 2023-11-24T06:18:38.938 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95054.log 2023-11-24T06:18:38.938 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107795.log.gz 2023-11-24T06:18:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108446.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T06:18:38.939 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108446.log.gz 2023-11-24T06:18:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T06:18:38.940 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106237.log 2023-11-24T06:18:38.940 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95054.log.gz 2023-11-24T06:18:38.942 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106886.log 2023-11-24T06:18:38.943 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106237.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106237.log.gz 2023-11-24T06:18:38.944 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100762.log 2023-11-24T06:18:38.944 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106886.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106886.log.gz 2023-11-24T06:18:38.944 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T06:18:38.946 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105985.log 2023-11-24T06:18:38.946 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100762.log.gz 2023-11-24T06:18:38.947 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100170.log 2023-11-24T06:18:38.949 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106706.log 2023-11-24T06:18:38.949 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105985.log.gz 2023-11-24T06:18:38.950 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100170.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.100170.log.gz -5 2023-11-24T06:18:38.951 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104695.log 2023-11-24T06:18:38.952 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99005.log 2023-11-24T06:18:38.952 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106706.log.gz 2023-11-24T06:18:38.953 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104695.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104695.log.gz 2023-11-24T06:18:38.954 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95586.log 2023-11-24T06:18:38.955 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99005.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99005.log.gz 2023-11-24T06:18:38.955 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95390.log 2023-11-24T06:18:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108136.log 2023-11-24T06:18:38.957 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95586.log.gz 2023-11-24T06:18:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95390.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95390.log.gz 2023-11-24T06:18:38.959 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103384.log 2023-11-24T06:18:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108136.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108136.log.gz 2023-11-24T06:18:38.961 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.109411.log 2023-11-24T06:18:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103384.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103384.log.gz 2023-11-24T06:18:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98107.log 2023-11-24T06:18:38.964 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109411.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82309.log 2023-11-24T06:18:38.964 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109411.log.gz 2023-11-24T06:18:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107697.log 2023-11-24T06:18:38.965 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98107.log.gz 2023-11-24T06:18:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.82309.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82309.log.gz 2023-11-24T06:18:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107138.log 2023-11-24T06:18:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.97137.log 2023-11-24T06:18:38.968 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107697.log.gz 2023-11-24T06:18:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98023.log 2023-11-24T06:18:38.970 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107138.log.gz 2023-11-24T06:18:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.2.97137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.97137.log.gz 2023-11-24T06:18:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94242.log 2023-11-24T06:18:38.973 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104028.log 2023-11-24T06:18:38.973 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98023.log.gz 2023-11-24T06:18:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102647.log 2023-11-24T06:18:38.975 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94242.log.gz 2023-11-24T06:18:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99504.log 2023-11-24T06:18:38.976 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104028.log.gz 2023-11-24T06:18:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102647.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105462.log 2023-11-24T06:18:38.977 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102647.log.gz 2023-11-24T06:18:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108304.log 2023-11-24T06:18:38.979 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99504.log.gz 2023-11-24T06:18:38.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103025.log 2023-11-24T06:18:38.981 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105462.log.gz 2023-11-24T06:18:38.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105420.log 2023-11-24T06:18:38.982 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108304.log.gz 2023-11-24T06:18:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103025.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103025.log.gz -5 2023-11-24T06:18:38.984 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108614.log 2023-11-24T06:18:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102437.log 2023-11-24T06:18:38.985 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105420.log.gz 2023-11-24T06:18:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108614.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106195.log 2023-11-24T06:18:38.987 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108614.log.gz 2023-11-24T06:18:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102437.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102437.log.gz 2023-11-24T06:18:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105756.log 2023-11-24T06:18:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108782.log 2023-11-24T06:18:38.990 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106195.log.gz 2023-11-24T06:18:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99840.log 2023-11-24T06:18:38.994 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105756.log.gz 2023-11-24T06:18:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104930.log 2023-11-24T06:18:38.994 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108782.log.gz 2023-11-24T06:18:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105798.log 2023-11-24T06:18:38.995 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99840.log.gz 2023-11-24T06:18:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96132.log 2023-11-24T06:18:38.996 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104930.log.gz 2023-11-24T06:18:38.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94452.log 2023-11-24T06:18:38.998 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105798.log.gz 2023-11-24T06:18:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100846.log 2023-11-24T06:18:38.999 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96132.log.gz 2023-11-24T06:18:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94452.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T06:18:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98851.log 2023-11-24T06:18:39.002 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.94452.log.gz 2023-11-24T06:18:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106153.log 2023-11-24T06:18:39.002 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100846.log.gz 2023-11-24T06:18:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-11-24T06:18:39.004 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98851.log.gz 2023-11-24T06:18:39.004 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106153.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106153.log.gz 2023-11-24T06:18:39.005 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93598.log 2023-11-24T06:18:39.006 INFO:teuthology.orchestra.run.smithi037.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T06:18:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.95305.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99126.log 2023-11-24T06:18:39.007 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-11-24T06:18:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105320.log 2023-11-24T06:18:39.007 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93598.log.gz 2023-11-24T06:18:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99126.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99126.log.gz 2023-11-24T06:18:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100930.log 2023-11-24T06:18:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105014.log 2023-11-24T06:18:39.010 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105320.log.gz 2023-11-24T06:18:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100930.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100930.log.gz 2023-11-24T06:18:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104280.log 2023-11-24T06:18:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97561.log 2023-11-24T06:18:39.012 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105014.log.gz 2023-11-24T06:18:39.013 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103468.log 2023-11-24T06:18:39.013 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.104280.log.gz 2023-11-24T06:18:39.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108362.log 2023-11-24T06:18:39.015 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97561.log.gz 2023-11-24T06:18:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103468.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103468.log.gz 2023-11-24T06:18:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99546.log 2023-11-24T06:18:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108362.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108362.log.gz 2023-11-24T06:18:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106111.log 2023-11-24T06:18:39.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99546.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99546.log.gz 2023-11-24T06:18:39.018 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104070.log 2023-11-24T06:18:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101839.log 2023-11-24T06:18:39.020 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106111.log.gz 2023-11-24T06:18:39.021 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104070.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104070.log.gz 2023-11-24T06:18:39.021 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T06:18:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103222.log 2023-11-24T06:18:39.022 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101839.log.gz 2023-11-24T06:18:39.023 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100888.log 2023-11-24T06:18:39.024 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103222.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103222.log.gz 2023-11-24T06:18:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105943.log 2023-11-24T06:18:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103302.log 2023-11-24T06:18:39.026 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100888.log.gz 2023-11-24T06:18:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105943.log.gz 2023-11-24T06:18:39.027 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109327.log 2023-11-24T06:18:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107974.log 2023-11-24T06:18:39.029 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103302.log.gz 2023-11-24T06:18:39.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109327.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109327.log.gz 2023-11-24T06:18:39.031 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103426.log 2023-11-24T06:18:39.031 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107974.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107974.log.gz 2023-11-24T06:18:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102857.log 2023-11-24T06:18:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103426.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103426.log.gz 2023-11-24T06:18:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107288.log 2023-11-24T06:18:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102857.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102857.log.gz 2023-11-24T06:18:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109621.log 2023-11-24T06:18:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107288.log: /var/log/ceph/ceph-client.admin.109621.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107288.log.gz 2023-11-24T06:18:39.037 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.109621.log.gz 2023-11-24T06:18:39.049 INFO:teuthology.orchestra.run.smithi037.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T06:18:39.117 INFO:teuthology.orchestra.run.smithi037.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T06:18:39.130 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T06:18:39.172 INFO:teuthology.orchestra.run.smithi037.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T06:18:39.178 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-11-24T06:18:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m0.664s 2023-11-24T06:18:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m1.561s 2023-11-24T06:18:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m1.149s 2023-11-24T06:18:39.179 INFO:tasks.ceph:Archiving logs... 2023-11-24T06:18:39.179 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/remote/smithi037/log 2023-11-24T06:18:39.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:18:39.724 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/remote/smithi188/log 2023-11-24T06:18:39.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:18:39.986 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T06:18:39.996 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T06:18:39.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:18:40.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:18:40.169 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T06:18:40.178 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T06:18:40.178 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:18:40.188 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:18:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:18:40.247 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2023-11-24T06:18:40.250 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:18:40.250 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-11-24T06:18:40.250 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 24 +2127us[+2131us] +/- 74ms 2023-11-24T06:18:40.250 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 6 377 22 -1692us[-1689us] +/- 63ms 2023-11-24T06:18:40.251 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -93us[ -90us] +/- 95ms 2023-11-24T06:18:40.251 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:18:40.258 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:18:40.258 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2023-11-24T06:18:40.259 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 23 +2128us[+2128us] +/- 74ms 2023-11-24T06:18:40.259 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 -1687us[-1685us] +/- 63ms 2023-11-24T06:18:40.259 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 -84us[ -84us] +/- 95ms 2023-11-24T06:18:40.259 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:18:40.260 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T06:18:40.269 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T06:18:40.270 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T06:18:40.278 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T06:18:40.575 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T06:18:40.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:18:40.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:18:40.963 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:18:41.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:18:41.072 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T06:18:41.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T06:18:41.090 INFO:teuthology.task.internal:Duration was 1050.042431 seconds 2023-11-24T06:18:41.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T06:18:41.099 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T06:18:41.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:18:41.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:18:41.278 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:18:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:18:41.703 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T06:18:41.703 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-11-24T06:18:41.703 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:18:41.779 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2023-11-24T06:18:41.780 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:18:41.858 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T06:18:41.858 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:18:41.867 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:18:41.967 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T06:18:41.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:18:41.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:18:42.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T06:18:42.176 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T06:18:42.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:18:42.280 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:18:42.380 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T06:18:42.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:18:42.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:18:42.513 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2023-11-24T06:18:42.514 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-11-24T06:18:42.568 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:18:42.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:18:42.620 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:18:42.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:18:42.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T06:18:42.687 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T06:18:42.688 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/remote/smithi037 2023-11-24T06:18:42.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:18:42.803 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551/remote/smithi188 2023-11-24T06:18:42.804 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:18:42.913 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T06:18:42.913 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:18:42.923 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:18:42.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T06:18:42.993 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T06:18:42.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T06:18:43.003 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T06:18:43.004 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:18:43.013 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:18:43.067 INFO:teuthology.orchestra.run.smithi037.stdout: 393622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:18 /home/ubuntu/cephtest 2023-11-24T06:18:43.072 INFO:teuthology.orchestra.run.smithi188.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:18 /home/ubuntu/cephtest 2023-11-24T06:18:43.076 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T06:18:43.086 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T06:18:43.107 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T06:18:43.134 DEBUG:teuthology.nuke:shortname: smithi037 2023-11-24T06:18:43.134 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:18:43.157 DEBUG:teuthology.nuke:shortname: smithi188 2023-11-24T06:18:43.157 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:18:43.163 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:51:47.664274', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5qF7p74YaACFye6SUxwuT6WvUyn9torgEIVYQMzkIKIAJUTWTSVfwaDzWjwxnyAKl9aBcgz4B3OilkZeHPWNU='} 2023-11-24T06:18:43.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:51:47.662304', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJweiEB58igV9ycutzsmY/QeiFksdxoOFacgsEqE6Rv1U8yi5jIsbOJE8kzhcIsnnqsblklgn6xyUB98S9h/MMw='} 2023-11-24T06:18:43.219 INFO:teuthology.orchestra.console.smithi037:Power off 2023-11-24T06:18:43.219 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:18:43.233 INFO:teuthology.orchestra.console.smithi188:Power off 2023-11-24T06:18:43.233 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:18:43.242 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-11-24T06:18:43.243 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:43.255 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-11-24T06:18:43.255 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:43.270 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-11-24T06:18:43.276 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-24T06:18:47.272 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:47.282 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:47.385 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-11-24T06:18:47.392 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-24T06:18:51.386 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:51.394 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:18:51.496 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-11-24T06:18:51.503 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-24T06:18:51.598 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-11-24T06:18:51.605 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-11-24T06:18:51.710 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} duration: 1050.0424308776855 failure_reason: 'Test failure: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=47043a1c0bd240cca2f7998da2793d7a status: fail success: false 2023-11-24T06:18:51.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T06:18:51.779 INFO:teuthology.run:FAIL